Computer-supported collaborative learning in the medical workplace: Students' experiences on formative peer feedback of a critical appraisal of a topic paper

B-learning in human anatomy: Comparative analysis of academic achievement between face-to-face and e-learning modalities

INTRODUCTION

In recent years, modern technologies have become established in most educational fields. Thus, e-learning tends to be an integral part of the learner-centered learning process, with the teacher acting as a facilitator. However, the methodologies used to study the impact of e-learning have been varied and imprecise, making comparison and meta-analysis difficult. This study attempts to overcome these obstacles with a large and homogeneous sample to compare (1) the academic outcomes obtained with face-to-face and e-learning in a blended module of human anatomy and (2) the response attempts (response index) of each student in answering questions specific to each learning modality.

MATERIAL AND METHODS

The results of the multiple-choice exams under study were collected. All students (n=1160) were from four consecutive academic years following the same teaching program with a b-learning method: 13 topics were presented face to face by the same lecturers, and six via e-learning with the same online resources. Two variables were compared: (1) the academic grade, based on the score for correct answers and the penalty for incorrect ones, and (2) the response index, based on the number of correct and incorrect answers.

RESULTS

(1) 73.45 % of the examinees passed the test. In the sample as a whole, results were better in face-to-face than in e-learning. In the quartiles ordered by overall academic performance, this superiority was limited to the top half of the higher-performing students. In contrast, lower-scoring students performed better in e-learning. However, these differences were modest (≤ 0.54 points). (2) In proportion, the questions on topics learned face-to-face were the most frequently answered. A strong correlation was observed between the variables in the whole sample and the students with the highest academic scores (first quartile) on the global exam and the questions on topics learned in each modality. In the remaining quartiles, the correlation was also strong in the e-learning content.

CONCLUSIONS

(1) Both modalities included in b-learning are academically effective. (2) Proportionally, students take more risks when answering content questions learned in face-to-face classes, and there is a strong correlation between response attempts and academic grades, especially, on the brightest exams and e-learning content.

A Web Platform (MOSAICO) to Design, Perform, and Assess Collaborative Clinical Scenarios for Medical Students: Viewpoint

BACKGROUND

The collaborative clinical simulation (CCS) model is a structured method for the development and assessment of clinical competencies through small groups working collaboratively in simulated environments. From 2016 onward, the CCS model has been applied successfully among undergraduate and graduate medical students from the Universidad de Talca, Chile; the Universität de Barcelona, Spain; and the Universidad de Vic-Manresa, Spain. All the templates for building the clinical cases and the assessment instruments with CCS were printed on paper. Considering the large number of CCS sessions and the number of participating students that are required throughout the medical degree curriculum, it is impossible to keep an organized record when the instruments are printed on paper. Moreover, with the COVID-19 pandemic, web platforms have become important as safe training environments for students and medical faculties; this new educational environment should include the consolidation and adaptation of didactic sessions that create and use available virtual cases and use different web platforms.

OBJECTIVE

The goal of this study is to describe the design and development of a web platform that was created to strengthen the CCS model.

METHODS

The design of the web platform aimed to support each phase of the CCS by incorporating functional requirements (ie, features that the web platform will be able to perform) and nonfunctional requirements (ie, how the web platform should behave) that are needed to run collaborative sessions. The software was developed under the Model-View-Controller architecture to separate the views from the data model and the business logic.

RESULTS

MOSAICO is a web platform used to design, perform, and assess collaborative clinical scenarios for medical students. MOSAICO has four modules: educational design, students' collaborative design, collaborative simulation, and collaborative debriefing. The web platform has three different user profiles: academic simulation unit, teacher, and student. These users interact under different roles in collaborative simulations. MOSAICO enables a collaborative environment, which is connected via the internet, to design clinical scenarios guided by the teacher and enables the use of all data generated to be discussed in the debriefing session with the teacher as a guide. The web platform is running at the Universidad de Talca in Chile and is supporting collaborative simulation activities via the internet for two medical courses: (1) Semiology for third-year students (70 students in total) and (2) Medical Genetics for fifth-year students (30 students in total).

CONCLUSIONS

MOSAICO is applicable within the CCS model and is used frequently in different simulation sessions at the Universidad de Talca, where medical students can work collaboratively via the internet. MOSAICO simplifies the application and reuse of clinical simulation scenarios, allowing its use in multiple simulation centers. Moreover, its applications in different courses (ie, a large part of the medical curriculum) support the automatic tracking of simulation activities and their assessment.

A collaborative clinical simulation model for the development of competencies by medical students

Herein, we present a new collaborative clinical simulation (CCS) model for the development of medical competencies by medical students. The model is a comprehensive compendium of published considerations and recommendations on clinical simulation (CS) and computer-supported collaborative learning (CSCL). Currently, there are no educational models combining CS and CSCL. The CCS model was designed for the acquisition and assessment of clinical competencies; working collaboratively and supported by technology, small groups of medical students independently design and perform simulated cases. The model includes four phases in which the learning objectives, short case scenarios, materials, indices, and the clinical simulation are designed, monitored, rated and debriefed.

What Are We Looking for in Computer-Based Learning Interventions in Medical Education? A Systematic Review

Background

Computer-based learning (CBL) has been widely used in medical education, and reports regarding its usage and effectiveness have ranged broadly. Most work has been done on the effectiveness of CBL approaches versus traditional methods, and little has been done on the comparative effects of CBL versus CBL methodologies. These findings urged other authors to recommend such studies in hopes of improving knowledge about which CBL methods work best in which settings.

Objective

In this systematic review, we aimed to characterize recent studies of the development of software platforms and interventions in medical education, search for common points among studies, and assess whether recommendations for CBL research are being taken into consideration.

Methods

We conducted a systematic review of the literature published from 2003 through 2013. We included studies written in English, specifically in medical education, regarding either the development of instructional software or interventions using instructional software, during training or practice, that reported learner attitudes, satisfaction, knowledge, skills, or software usage. We conducted 2 latent class analyses to group articles according to platform features and intervention characteristics. In addition, we analyzed references and citations for abstracted articles.

Results

We analyzed 251 articles. The number of publications rose over time, and they encompassed most medical disciplines, learning settings, and training levels, totaling 25 different platforms specifically for medical education. We uncovered 4 latent classes for educational software, characteristically making use of multimedia (115/251, 45.8%), text (64/251, 25.5%), Web conferencing (54/251, 21.5%), and instructional design principles (18/251, 7.2%). We found 3 classes for intervention outcomes: knowledge and attitudes (175/212, 82.6%), knowledge, attitudes, and skills (11.8%), and online activity (12/212, 5.7%). About a quarter of the articles (58/227, 25.6%) did not hold references or citations in common with other articles. The number of common references and citations increased in articles reporting instructional design principles (P=.03), articles measuring online activities (P=.01), and articles citing a review by Cook and colleagues on CBL (P=.04). There was an association between number of citations and studies comparing CBL versus CBL, independent of publication date (P=.02).

Conclusions

Studies in this field vary highly, and a high number of software systems are being developed. It seems that past recommendations regarding CBL interventions are being taken into consideration. A move into a more student-centered model, a focus on implementing reusable software platforms for specific learning contexts, and the analysis of online activity to track and predict outcomes are relevant areas for future research in this field.

Characterization of medical students recall of factual knowledge using learning objects and repeated testing in a novel e-learning system

BACKGROUND

Spaced-repetition and test-enhanced learning are two methodologies that boost knowledge retention. ALERT STUDENT is a platform that allows creation and distribution of Learning Objects named flashcards, and provides insight into student judgments-of-learning through a metric called 'recall accuracy'. This study aims to understand how the spaced-repetition and test-enhanced learning features provided by the platform affect recall accuracy, and to characterize the effect that students, flashcards and repetitions exert on this measurement.

METHODS

Three spaced laboratory sessions (s0, s1 and s2), were conducted with n=96 medical students. The intervention employed a study task, and a quiz task that consisted in mentally answering open-ended questions about each flashcard and grading recall accuracy. Students were randomized into study-quiz and quiz groups. On s0 both groups performed the quiz task. On s1 and s2, the study-quiz group performed the study task followed by the quiz task, whereas the quiz group only performed the quiz task. We measured differences in recall accuracy between groups/sessions, its variance components, and the G-coefficients for the flashcard component.

RESULTS

At s0 there were no differences in recall accuracy between groups. The experiment group achieved a significant increase in recall accuracy that was superior to the quiz group in s1 and s2. In the study-quiz group, increases in recall accuracy were mainly due to the session, followed by flashcard factors and student factors. In the quiz group, increases in recall accuracy were mainly accounted by flashcard factors, followed by student and session factors. The flashcard G-coefficient indicated an agreement on recall accuracy of 91% in the quiz group, and of 47% in the study-quiz group.

CONCLUSIONS

Recall accuracy is an easily collectible measurement that increases the educational value of Learning Objects and open-ended questions. This metric seems to vary in a way consistent with knowledge retention, but further investigation is necessary to ascertain the nature of such relationship. Recall accuracy has educational implications to students and educators, and may contribute to deliver tailored learning experiences, assess the effectiveness of instruction, and facilitate research comparing blended-learning interventions.

A novel collaborative e-learning platform for medical students - ALERT STUDENT

BACKGROUND

The increasing complexity of medical curricula would benefit from adaptive computer supported collaborative learning systems that support study management using instructional design and learning object principles. However, to our knowledge, there are scarce reports regarding applications developed to meet this goal and encompass the complete medical curriculum. The aim of ths study was to develop and assess the usability of an adaptive computer supported collaborative learning system for medical students to manage study sessions.

RESULTS

A study platform named ALERT STUDENT was built as a free web application. Content chunks are represented as Flashcards that hold knowledge and open ended questions. These can be created in a collaborative fashion. Multiple Flashcards can be combined into custom stacks called Notebooks that can be accessed in study Groups that belong to the user institution. The system provides a Study Mode that features text markers, text notes, timers and color-coded content prioritization based on self-assessment of open ended questions presented in a Quiz Mode. Time spent studying and Perception of knowledge are displayed for each student and peers using charts. Computer supported collaborative learning is achieved by allowing for simultaneous creation of Notebooks and self-assessment questions by many users in a pre-defined Group. Past personal performance data is retrieved when studying new Notebooks containing previously studied Flashcards. Self-report surveys showed that students highly agreed that the system was useful and were willing to use it as a reference tool.

CONCLUSIONS

The platform employs various instructional design and learning object principles in a computer supported collaborative learning platform for medical students that allows for study management. The application broadens student insight over learning results and supports informed decisions based on past learning performance. It serves as a potential educational model for the medical education setting that has gathered strong positive feedback from students at our school.This platform provides a case study on how effective blending of instructional design and learning object principles can be brought together to manage study, and takes an important step towards bringing information management tools to support study decisions and improving learning outcomes.

Computer supported collaborative learning in a clerkship: an exploratory study on the relation of discussion activity and revision of critical appraisal papers

BACKGROUND

Medical students in clerkship are continuously confronted with real and relevant patient problems. To support clinical problem solving skills, students perform a Critical Appraisal of a Topic (CAT) task, often resulting in a paper. Because such a paper may contain errors, students could profit from discussion with peers, leading to paper revision. Active peer discussion by a Computer Supported Collaborative Learning (CSCL) environment show positive medical students perceptions on subjective knowledge improvement. High students' activity during discussions in a CSCL environment demonstrated higher task-focussed discussion reflecting higher levels of knowledge construction. However, it remains unclear whether high discussion activity influences students' decisions revise their CAT paper. The aim of this research is to examine whether students who revise their critical appraisal papers after discussion in a CSCL environment show more task-focussed activity and discuss more intensively on critical appraisal topics than students who do not revise their papers.

METHODS

Forty-seven medical students, stratified in subgroups, participated in a structured asynchronous online discussion of individual written CAT papers on self-selected clinical problems. The discussion was structured by three critical appraisal topics. After the discussion, the students could revise their paper. For analysis purposes, all students' postings were blinded and analysed by the investigator, unaware of students characteristics and whether or not the paper was revised. Postings were counted and analysed by an independent rater, Postings were assigned into outside activity, non-task-focussed activity or task-focussed activity. Additionally, postings were assigned to one of the three critical appraisal topics. Analysis results were compared by revised and unrevised papers.

RESULTS

Twenty-four papers (51.6%) were revised after the online discussion. The discussions of the revised papers showed significantly higher numbers of postings, more task-focussed activities, and more postings about the two critical appraisal topics: "appraisal of the selected article(s)", and "relevant conclusion regarding the clinical problem".

CONCLUSION

A CSCL environment can support medical students in the execution and critical appraisal of authentic tasks in the clinical workplace. Revision of CAT papers appears to be related to discussions activity, more specifically reflecting high task-focussed activity of critical appraisal topics.

Developing research skills in medical students: AMEE Guide No. 69

This Guide has been written to provide guidance for individuals involved in curriculum design who wish to develop research skills and foster the attributes in medical undergraduates that help develop research. The Guide will provoke debate on an important subject, and although written specifically with undergraduate medical education in mind, we hope that it will be of interest to all those involved with other health professionals' education. Initially, the Guide describes why research skills and its related attributes are important to those pursuing a medical career. It also explores the reasons why research skills and an ethos of research should be instilled into professionals of the future. The Guide also tries to define what these skills and attributes should be for medical students and lays out the case for providing opportunities to develop research expertise in the undergraduate curriculum. Potential methods to encourage the development of research-related attributes are explored as are some suggestions as to how research skills could be taught and assessed within already busy curricula. This publication also discusses the real and potential barriers to developing research skills in undergraduate students, and suggests strategies to overcome or circumvent these. Whilst we anticipate that this Guide will appeal to all levels of expertise in terms of student research, we hope that, through the use of case studies, we will provide practical advice to those currently developing this area within their curriculum.