Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis

Teaching differential diagnosis to nurse practitioner students in a distance program

An interactive case study (ICS) is a novel way to enhance the teaching of differential diagnosis to distance learning nurse practitioner students. Distance education renders the use of many teaching strategies commonly used with face-to-face students difficult, if not impossible. To meet this new pedagogical dilemma and to provide excellence in education, the ICS was developed. Kolb's theory of experiential learning supported efforts to follow the utilization of the ICS. This study sought to determine whether learning outcomes for the distance learning students were equivalent to those of on-campus students who engaged in a live-patient encounter. Accuracy of differential diagnosis lists generated by onsite and online students was compared. Equivalency testing assessed clinical, rather than only statistical, significance in data from 291 students. The ICS responses from the distance learning and onsite students differed by 4.9%, which was within the a priori equivalence estimate of 10%. Narrative data supported the findings.

A novel collaborative e-learning platform for medical students - ALERT STUDENT

BACKGROUND

The increasing complexity of medical curricula would benefit from adaptive computer supported collaborative learning systems that support study management using instructional design and learning object principles. However, to our knowledge, there are scarce reports regarding applications developed to meet this goal and encompass the complete medical curriculum. The aim of ths study was to develop and assess the usability of an adaptive computer supported collaborative learning system for medical students to manage study sessions.

RESULTS

A study platform named ALERT STUDENT was built as a free web application. Content chunks are represented as Flashcards that hold knowledge and open ended questions. These can be created in a collaborative fashion. Multiple Flashcards can be combined into custom stacks called Notebooks that can be accessed in study Groups that belong to the user institution. The system provides a Study Mode that features text markers, text notes, timers and color-coded content prioritization based on self-assessment of open ended questions presented in a Quiz Mode. Time spent studying and Perception of knowledge are displayed for each student and peers using charts. Computer supported collaborative learning is achieved by allowing for simultaneous creation of Notebooks and self-assessment questions by many users in a pre-defined Group. Past personal performance data is retrieved when studying new Notebooks containing previously studied Flashcards. Self-report surveys showed that students highly agreed that the system was useful and were willing to use it as a reference tool.

CONCLUSIONS

The platform employs various instructional design and learning object principles in a computer supported collaborative learning platform for medical students that allows for study management. The application broadens student insight over learning results and supports informed decisions based on past learning performance. It serves as a potential educational model for the medical education setting that has gathered strong positive feedback from students at our school.This platform provides a case study on how effective blending of instructional design and learning object principles can be brought together to manage study, and takes an important step towards bringing information management tools to support study decisions and improving learning outcomes.

A methodological quality synthesis of systematic reviews on computer-mediated continuing education for healthcare providers

BACKGROUND

Healthcare providers use continuing education (CE) to meet professional development requirements and to ensure optimal patient care. There has been a dramatic increase in computer-mediated CE (CMCE) programs.

AIMS

To synthesize the literature regarding the current state of the science on the efficacy of CMCE for healthcare professionals, particularly as it relates to provider learning and patient outcomes. Specifically, this review assesses the methodological quality of existing systematic reviews and meta-analyses.

METHODS

A literature search was conducted using Cochrane Library, PubMed, and CINAHL. Review articles evaluating the efficacy of CMCE for healthcare providers were included. Publications were searched between 2002 and 2013 and limited to those printed in English. An objective measurement tool, AMSTAR, was used to assess the methodological quality of each review. AMSTAR is an 11-item instrument, in which individual criteria were evaluated and a composite score of all 11 components was determined for each review. Outcomes of each review were also categorized based on Kirkpatrick's levels for summative evaluation: (i) Learner satisfaction, (ii) Learning outcomes, (iii) Performance improvement, (iv) Patient/health outcomes.

RESULTS

Starting with 231 articles, 11 met the inclusion criteria for this evaluation. AMSTAR quality scores of the reviews ranged from 7 to 11, with 11 indicating the strongest quality. Although weak research design of many studies and heterogeneous topics covered make summative evaluations difficult, there were some common themes covered in the articles reviewed. Healthcare providers were largely satisfied with using CMCE programs. Overall, the studies comparing CMCE to traditional CE methods found the impact on learning outcomes to be comparable, with neither method necessarily superior. Additionally, all reviews lacked evaluation of practice outcomes.

LINKING EVIDENCE TO ACTION

While results of this review show promise for CMCE, further evaluation and more rigorously conducted research is necessary. Particular focus is needed to determine the effects of CMCE on health outcomes.

Effectiveness of E-learning in pharmacy education

Over the past 2 decades, e-learning has evolved as a new pedagogy within pharmacy education. As learners and teachers increasingly seek e-learning opportunities for an array of educational and individual benefits, it is important to evaluate the effectiveness of these programs. This systematic review of the literature examines the quality of e-learning effectiveness studies in pharmacy, describes effectiveness measures, and synthesizes the evidence for each measure. E-learning in pharmacy education effectively increases knowledge and is a highly acceptable instructional format for pharmacists and pharmacy students. However, there is limited evidence that e-learning effectively improves skills or professional practice. There is also no evidence that e-learning is effective at increasing knowledge long term; thus, long-term follow-up studies are required. Translational research is also needed to evaluate the benefits of e-learning at patient and organizational levels.

Suicide Prevention E-Learning Modules Designed for Gatekeepers

Background: E-learning modules can be a useful method for educating gatekeepers in suicide prevention and awareness. Aims: To review and provide an overview of e-learning modules on suicide prevention designed for gatekeepers and assess their effectiveness. Method: Two strategies were used. First, articles were systematically searched in databases of PubMed, Web of Science, and PsycINFO. Second, Google search was used to find e-learning modules on the Web. Results: The literature search resulted in 448 papers, of which none met the inclusion criteria of this study. The Google search resulted in 130 hits, of which 23 met the inclusion criteria of this review. Organizations that owned the modules were contacted, of which 13 responded and nine were included in this study. The effectiveness of two e-learning modules is currently being tested in a randomized controlled trial (RCT), one organization is planning to test the effectiveness of their module, and one organization has compared their face-to-face training with their online training. Furthermore, the included modules have different characteristics. Conclusion: There is a need for RCTs to study the effectiveness of online modules in this area and to understand which characteristics are essential to create effective e-learning modules to educate gatekeepers in suicide prevention.

[Implementation and evaluation of a blended learning course on gastroesophageal reflux disease for physicians in Latin America]

Integrating evidence-based clinical practice guidelines on gastroesophageal reflux disease into medical practice is of prime importance in Latin America, given its high prevalence in this region. The aim of this project was to implement and assess an educational intervention on gastroesophageal reflux disease, aimed at primary care physicians in Latin America, with contents based on current clinical guidelines. The course included initial activities, whether face-to-face or through distance learning, and a 2-month period of Internet study and interaction. A pilot test was carried out in Uruguay, which was then repeated in 5 countries (Mexico, Colombia, Venezuela, Argentina and again in Uruguay). A global template was designed, which was then adapted to each of the countries: this was done with the participation of local institutions and leaders. Local credits were given for recertification. Participation was free. Of 3,110 physicians invited to participate, 1,143 (36.8%) started the course. Of these, 587 (51.4%) accessed at least half the contents of the course and 785 (68.7%) took part in the clinical discussions. A total of 338 (29.6%) completed all the requirements of the course and received a certificate. Among physicians who took both the pre- and post-intervention knowledge tests, scores improved from 60 to 80% (P<.001). Ninety-two percent of planned changes in clinical practice were related to the pedagogic aims of the course. In conclusion, a multifaceted, 2-phase continuing education course was successfully imparted in Latin America, with an overall design that was adapted to each country. Determination of specific needs and the participation of national experts were fundamental to the success of the course.

The development of an internet-based knowledge exchange platform for pediatric critical care clinicians worldwide*

OBJECTIVES

Advances in Internet technology now enable unprecedented global collaboration and collective knowledge exchange. Up to this time, there have been limited efforts to use these technologies to actively promote knowledge exchange across the global pediatric critical care community. To develop an open-access, peer-reviewed, not-for-profit Internet-based learning application, OPENPediatrics, a collaborative effort with the World Federation of Pediatric Intensive and Critical Care Societies, was designed to promote postgraduate educational knowledge exchange for physicians, nurses, and others caring for critically ill children worldwide.

DESIGN

Description of program development.

SETTING

International multicenter tertiary pediatric critical care units across six continents.

SUBJECTS

Multidisciplinary pediatric critical care providers.

INTERVENTIONS

A software application, providing information on demand, curricular pathways, and videoconferencing, downloaded to a local computer.

MEASUREMENTS AND MAIN RESULTS

In 2010, a survey assessing postgraduate educational needs was distributed through World Federation of Pediatric Intensive and Critical Care Societies to constituent societies. Four hundred and twenty-nine critical care providers from 49 countries responded to the single e-mail survey request. Respondents included 68% physicians and 28% nurses who care for critically ill children. Fifty-two percent of respondents reported accessing the Internet at least weekly to obtain professional educational information. The five highest requests were for educational content on respiratory care [mechanical ventilation] (48% [38%]), sepsis (28%), neurology (25%), cardiology (14%), extracorporeal membrane oxygenation (10%), and ethics (8%). Based on these findings, and in collaboration with researchers in adult learning and online courseware, an application was developed and is currently being used by 770 registered users in 60 countries.

CONCLUSIONS

We describe here the development and implementation of an Internet-based application which is among the first efforts designed to promote global knowledge exchange for physicians and nurses caring for critically ill children. This application has the potential to evolve new methods in postgraduate education. Ongoing assessment of the efficacy of Internet-based learning platforms will be necessary.

Pre-Course Simulation as a Predictor of Satisfaction with an Emergency Nursing Clinical Course

Recent research suggests that simulation education can effectively improve nursing students’ practical competence and can enhance educational outcomes. But very few studies have identified the relationships between pre-course simulation and course satisfaction. The purpose of this study was to determine whether pre-course simulations and other advanced learning modalities (i.e. pre-course e-learning, observation, and clinical placement skill performance) predicted students’ satisfaction with an emergency nursing clinical course. Second-year Korean nursing students (N = 284) participated in an integrated clinical course consisting of self-directed pre-course e-learning, a 2-hour pre-course simulation, and an 80-hour emergency room clinical placement with observation. Multiple regression analyses found that pre-course simulation, clinical placement skill performance, observation during the clinical placement, and pre-course e-learning accounted for 47.2% of the variance in course satisfaction. Notably, pre-course simulation made the largest contribution to course satisfaction, accounting for 29.1% of the variance. Pre-course simulation, skill performance, observation, and pre-course e-learning all significantly influenced learner satisfaction. Findings suggest that integrating simulation into the clinical curriculum may enhance clinical course satisfaction.

Test-enhanced web-based learning: optimizing the number of questions (a randomized crossover trial)

PURPOSE

Questions enhance learning in Web-based courses, but preliminary evidence suggests that too many questions may interfere with learning. The authors sought to determine how varying the number of self-assessment questions affects knowledge outcomes in a Web-based course.

METHOD

The authors conducted a randomized crossover trial in one internal medicine and one family medicine residency program between January 2009 and July 2010. Eight Web-based modules on ambulatory medicine topics were developed, with varying numbers of self-assessment questions (0, 1, 5, 10, or 15). Participants completed modules in four different formats each year, with sequence randomly assigned. Participants completed a pretest for half their modules. Outcomes included knowledge, completion time, and module ratings.

RESULTS

One hundred eighty residents provided data. The mean (standard error) percent correct knowledge score was 53.2 (0.8) for pretests and 73.7 (0.5) for posttests. In repeated-measures analysis pooling all data, mean posttest knowledge scores were highest for the 10- and 15-question formats (75.7 [1.1] and 74.4 [1.0], respectively) and lower for 0-, 1-, and 5-question formats (73.1 [1.3], 72.9 [1.0], and 72.8 [1.5], respectively); P = .04 for differences across all modules. Modules with more questions generally took longer to complete and were rated higher, although differences were small. Residents most often identified 10 questions as ideal. Posttest knowledge scores were higher for modules that included a pretest (75.4 [0.9] versus 72.2 [0.9]; P = .0002).

CONCLUSIONS

Increasing the number of self-assessment questions improves learning until a plateau beyond which additional questions do not add value.

Developing the Serious Games potential in nursing education

Shortened hospital stays, high patient acuity and technological advances demand that nurses increasingly make decisions under conditions of uncertainty and risk (Ebright et al., 2003). With rising trends towards out-patient care, nurses will need to perform complex problem-solving within a dynamic and changing environment for which there is not one clear solution (Schofield et al., 2010; Wolff et al., 2009). The development of sharp clinical reasoning skills, as well as skills in detection, monitoring, investigation and evaluation are therefore essential (Aitken et al., 2002). Yet few nursing students have long-term exposure to home-care and community situations. This is primarily due to scarce human resources and the time-consuming requirements of student supervision (Duque et al., 2008). When students are given the opportunity to experience home-care or community visits these tend to be unstructured leading to wide variations in their competencies. New pedagogical tools are needed to adequately and consistently prepare nurses for the skills they will need to care for patients outside acute care settings. Advances in Information and Communications Technologies (ICT) offer an opportunity to explore innovative pedagogical solutions that could help students develop these skills in a safe environment. A three-phased project is underway that aims to create and test a Serious Game to improve nurses' clinical reasoning and detection skills in home-care and community settings. The first phase of this project involves the development of a scenario, the game engine and the graphic design and will be the focus of this paper. The second and third phases will test the Serious Game as an educational intervention and will be reported in subsequent papers.

Introducing e-learning/teaching in a physiology course for medical students: acceptance by students and subjective effect on learning

Retrieval of information has substantially changed within the last two decades. Naturally, this has also affected learning/teaching techniques, and methods that are commonly referred to as "e-learning" have become an important part in modern education. Institutions have to decide if (and how) to implement this new form of teaching but face the problem that little subject-specific research has been published for different teaching modes and methods. The present study compares a course module of the physiology laboratory course for medical students in the preclinical phase before and after the introduction of computer-aided course instructions (CACI). Students were provided with an online questionnaire containing Likert items evaluating workspace redesign, acceptance of course instructions, incentive to actively participate in the course, and subjective gain of knowledge. CACI was clearly preferred over the previously used paper workbook. However, the questionnaire also revealed that the gain in knowledge, as subjectively perceived by the students, had not improved, which is in agreement with several studies that neglected a beneficial effect of e-learning on learning success. We conclude that the CACI meet today's student's expectations and that introducing this system seems justified from this perspective.

Online learning for faculty development: a review of the literature

BACKGROUND

With the growing presence of computers and Internet technologies in personal and professional lives, it seems prudent to consider how online learning has been and could be harnessed to promote faculty development.

AIMS

Discuss advantages and disadvantages of online faculty development, synthesize what is known from studies involving health professions faculty members, and identify next steps for practice and future research.

METHOD

We searched MEDLINE for studies describing online instruction for developing teaching, leadership, and research skills among health professions faculty, and synthesized these in a narrative review.

RESULTS

We found 20 articles describing online faculty development initiatives for health professionals, including seven quantitative comparative studies, four studies utilizing defined qualitative methods, and nine descriptive studies reporting anecdotal lessons learned. These programs addressed diverse topics including clinical teaching, educational assessment, business administration, financial planning, and research skills. Most studies enrolled geographically-distant learners located in different cities, provinces, or countries. Evidence suggests that online faculty development is at least comparable to traditional training, but learner engagement and participation is highly variable. It appears that success is more likely when the course addresses a relevant need, facilitates communication and social interaction, and provides time to complete course activities.

CONCLUSIONS

Although we identified several practical recommendations for success, the evidence base for online faculty development is sparse and insubstantial. Future research should include rigorous, programmatic, qualitative and quantitative investigations to understand the principles that govern faculty member engagement and success.

Development of a web-based, work-related asthma educational tool for patients with asthma

BACKGROUND

Asthma is a common chronic condition. Work-related asthma (WRA) has a large socioeconomic impact and is increasing in prevalence but remains under-recognized. Although international guidelines recommend patient education, no widely available educational tool exists.

OBJECTIVE

To develop a WRA educational website for adults with asthma.

METHODS

An evidence-based database for website content was developed, which applied evidence-based website design principles to create a website prototype. This was subsequently tested and serially revised according to patient feedback in three moderated phases (one focus group and two interview phases), followed by face validation by asthma educators.

RESULTS

Patients (n=10) were 20 to 28 years of age; seven (70%) were female, three (30%) were in university, two (20%) were in college and five (50%) were currently employed. Key format preferences included: well-spaced, bulleted text; movies (as opposed to animations); photos (as opposed to cartoons); an explicit listing of website aims on the home page; and an exploding tab structure. Participants disliked integrated games and knowledge quizzes. Desired informational content included a list of triggers, prevention⁄control methods, currently available tools and resources, a self-test for WRA, real-life scenario presentations, compensation information, information for colleagues on how to react during an asthma attack and a WRA discussion forum.

CONCLUSIONS

The website met the perceived needs of young asthmatic patients. This resource could be disseminated widely and should be tested for its effects on patient behaviour, including job choice, workplace irritant⁄allergen avoidance and⁄or protective equipment, asthma medication use and physician prompting for management of WRA symptoms.

Simulation-based bronchoscopy training: systematic review and meta-analysis

BACKGROUND

Simulation-based bronchoscopy training is increasingly used, but effectiveness remains uncertain. We sought to perform a comprehensive synthesis of published work on simulation-based bronchoscopy training.

METHODS

We searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web of Science, and Scopus for eligible articles through May 11, 2011. We included all original studies involving health professionals that evaluated, in comparison with no intervention or an alternative instructional approach, simulation-based training for flexible or rigid bronchoscopy. Study selection and data abstraction were performed independently and in duplicate. We pooled results using random effects meta-analysis.

RESULTS

From an initial pool of 10,903 articles, we identified 17 studies evaluating simulation-based bronchoscopy training. In comparison with no intervention, simulation training was associated with large benefits on skills and behaviors (pooled effect size, 1.21 [95% CI, 0.82-1.60]; n=8 studies) and moderate benefits on time (0.62 [95% CI, 0.12-1.13]; n=7). In comparison with clinical instruction, behaviors with real patients showed nonsignificant effects favoring simulation for time (0.61 [95% CI, -1.47 to 2.69]) and process (0.33 [95% CI, -1.46 to 2.11]) outcomes (n=2 studies each), although variation in training time might account for these differences. Four studies compared alternate simulation-based training approaches. Inductive analysis to inform instructional design suggested that longer or more structured training is more effective, authentic clinical context adds value, and animal models and plastic part-task models may be superior to more costly virtual-reality simulators.

CONCLUSIONS

Simulation-based bronchoscopy training is effective in comparison with no intervention. Comparative effectiveness studies are few.

Reframing clinical workplace learning using the theory of distributed cognition

In medicine, knowledge is embodied and socially, temporally, spatially, and culturally distributed between actors and their environment. In addition, clinicians increasingly are using technology in their daily work to gain and share knowledge. Despite these characteristics, surprisingly few studies have incorporated the theory of distributed cognition (DCog), which emphasizes how cognition is distributed in a wider system in the form of multimodal representations (e.g., clinical images, speech, gazes, and gestures) between social actors (e.g., doctors and patients) in the physical environment (e.g., with technological instruments and computers). In this article, the authors provide an example of an interaction between medical actors. Using that example, they then introduce the important concepts of the DCog theory, identifying five characteristics of clinical representations-that they are interwoven, co-constructed, redundantly accessed, intersubjectively shared, and substantiated-and discuss their value for learning. By contrasting these DCog perspectives with studies from the field of medical education, the authors argue that researchers should focus future medical education scholarship on the ways in which medical actors use and connect speech, bodily movements (e.g., gestures), and the visual and haptic structures of their own bodies and of artifacts, such as technological instruments and computers, to construct complex, multimodal representations. They also argue that future scholarship should "zoom in" on detailed, moment-by-moment analysis and, at the same time, "zoom out" following the distribution of cognition through an overall system to develop a more integrated view of clinical workplace learning.

Development and evaluation of an interactive electronic laboratory manual for cooperative learning of medical histology

This article describes the development of an interactive computer-based laboratory manual, created to facilitate the teaching and learning of medical histology. The overarching goal of developing the manual is to facilitate self-directed group interactivities that actively engage students during laboratory sessions. The design of the manual includes guided instruction for students to navigate virtual slides, exercises for students to monitor learning, and cases to provide clinical relevance. At the end of the laboratory activities, student groups can generate a laboratory report that may be used to provide formative feedback. The instructional value of the manual was evaluated by a questionnaire containing both closed-ended and open-ended items. Closed-ended items using a five-point Likert-scale assessed the format and navigation, instructional contents, group process, and learning process. Open-ended items assessed student's perception on the effectiveness of the manual in facilitating their learning. After implementation for two consecutive years, student evaluation of the manual was highly positive and indicated that it facilitated their learning by reinforcing and clarifying classroom sessions, improved their understanding, facilitated active and cooperative learning, and supported self-monitoring of their learning.

An integrative review and evidence-based conceptual model of the essential components of pre-service education

BACKGROUND

With decreasing global resources, a pervasive critical shortage of skilled health workers, and a growing disease burden in many countries, the need to maximize the effectiveness and efficiency of pre-service education in low-and middle-income countries has never been greater.

METHODS

We performed an integrative review of the literature to analyse factors contributing to quality pre-service education and created a conceptual model that shows the links between essential elements of quality pre-service education and desired outcomes.

RESULTS

The literature contains a rich discussion of factors that contribute to quality pre-service education, including the following: (1) targeted recruitment of qualified students from rural and low-resource settings appears to be a particularly effective strategy for retaining students in vulnerable communities after graduation; (2) evidence supports a competency-based curriculum, but there is no clear evidence supporting specific curricular models such as problem-based learning; (3) the health workforce must be well prepared to address national health priorities; (4) the role of the preceptor and preceptors' skills in clinical teaching, identifying student learning needs, assessing student learning, and prioritizing and time management are particularly important; (5) modern, Internet-enabled medical libraries, skills and simulation laboratories, and computer laboratories to support computer-aided instruction are elements of infrastructure meriting strong consideration; and (6) all students must receive sufficient clinical practice opportunities in high-quality clinical learning environments in order to graduate with the competencies required for effective practice. Few studies make a link between PSE and impact on the health system. Nevertheless, it is logical that the production of a trained and competent staff through high-quality pre-service education and continuing professional development activities is the foundation required to achieve the desired health outcomes. Professional regulation, deployment practices, workplace environment upon graduation and other service delivery contextual factors were analysed as influencing factors that affect educational outcomes and health impact.

CONCLUSIONS

Our model for pre-service education reflects the investments that must be made by countries into programmes capable of leading to graduates who are competent for the health occupations and professions at the time of their entry into the workforce.

Virtual patient design: exploring what works and why. A grounded theory study

OBJECTIVES

Virtual patients (VPs) are online representations of clinical cases used in medical education. Widely adopted, they are well placed to teach clinical reasoning skills. International technology standards mean VPs can be created, shared and repurposed between institutions. A systematic review has highlighted the lack of evidence to support which of the numerous VP designs may be effective, and why. We set out to research the influence of VP design on medical undergraduates.

METHODS

This is a grounded theory study into the influence of VP design on undergraduate medical students. Following a review of the literature and publicly available VP cases, we identified important design properties. We integrated them into two substantial VPs produced for this research. Using purposeful iterative sampling, 46 medical undergraduates were recruited to participate in six focus groups. Participants completed both VPs, an evaluation and a 1-hour focus group discussion. These were digitally recorded, transcribed and analysed using grounded theory, supported by computer-assisted analysis. Following open, axial and selective coding, we produced a theoretical model describing how students learn from VPs.

RESULTS

We identified a central core phenomenon designated 'learning from the VP'. This had four categories: VP Construction; External Preconditions; Student-VP Interaction, and Consequences. From these, we constructed a three-layer model describing the interactions of students with VPs. The inner layer consists of the student's cognitive and behavioural preconditions prior to sitting a case. The middle layer considers the VP as an 'encoded object', an e-learning artefact and as a 'constructed activity', with associated pedagogic and organisational elements. The outer layer describes cognitive and behavioural change.

CONCLUSIONS

This is the first grounded theory study to explore VP design. This original research has produced a model which enhances understanding of how and why the delivery and design of VPs influence learning. The model may be of practical use to authors, institutions and researchers.

A unique, interactive and web-based pediatric rheumatology teaching module: residents' perceptions

BACKGROUND

The limited availability of pediatric rheumatologists for teaching in pediatric residency programs negatively impacts resident education about rheumatology. At present, there are no educational websites available for trainees to learn about pediatric rheumatology. We are planning to develop an interactive web-based teaching module to improve resident learning about rheumatology ("POINTER": Pediatric Online INteractive TEaching in Rheumatology). The aim of this study was to perform a needs assessment of pediatric residents who will be using POINTER.

METHODS

Pediatric residents (n = 60) at The Hospital for Sick Children were emailed an online survey. This was designed to assess prior use of online teaching modules, the utility of an online teaching module for rheumatology and which technologies should be included on such a site.

RESULTS

Forty-seven residents participated in the survey (78.3% response rate). Ninety-one percent of the respondents thought that an interactive teaching website would enhance their learning and should include case-based teaching modules. Several web-based technologies were felt to be important for inclusion on the teaching modules. These included graphics and animation (86.4%), interactivity (93.2%), pictures (100%), live digital videos (88.9%) and links to articles and research (88.6%).

CONCLUSIONS

An interactive web-based rheumatology teaching module would be well utilized by pediatric residents. Residents showed preference for case-based teaching modules as well as multimedia modalities for learning a detailed musculoskeletal examination.

Effective or just practical? An evaluation of an online postgraduate module on evidence-based medicine (EBM)

BACKGROUND

Teaching the steps of evidence-based medicine (EBM) to undergraduate as well as postgraduate health care professionals is crucial for implementation of effective, beneficial health care practices and abandonment of ineffective, harmful ones. Stellenbosch University in Cape Town, South Africa, offers a 12-week, completely online module on EBM within the Family Medicine division, to medical specialists in their first year of training. The aim of this study was to formatively evaluate this module; assessing both the mode of delivery; as well as the perceived effectiveness and usefulness thereof.

METHODS

We used mixed methods to evaluate this module: A document review to assess whether the content of the module reflects important EBM competencies; a survey of the students to determine their experiences of the module; and semi-structured interviews with the tutors to explore their perspectives of the module. Ethics approval was obtained.

RESULTS

The document review indicated that EBM competencies were covered adequately, although critical appraisal only focused on randomised controlled trials and guidelines. Students had a positive attitude towards the module, but felt that they needed more support from the tutors. Tutors felt that students engaged actively in discussions, but experienced difficulties with understanding certain concepts of EBM. Furthermore, they felt that it was challenging explaining these via the online learning platform and saw the need to incorporate more advanced technology to better connect with the students. In their view the key to successful learning of EBM was to keep it relevant and applicable to everyday practice. Tutors also felt that an online module on EBM was advantageous, since doctors from all over the world were able to participate.

CONCLUSION

Our study has shown that the online module on EBM was effective in increasing EBM knowledge and skills of postgraduate students and was well received by both students and tutors. Students and tutors experienced generic challenges that accompany any educational intervention of EBM (e.g. understanding difficult concepts), but in addition had to deal with challenges unique to the online learning environment. Teachers of EBM should acknowledge these so as to enhance and successfully implement EBM teaching and learning for all students.

HistoViewer: an interactive e-learning platform facilitating group and peer group learning

Understanding tissue architecture and the morphological characteristics of cells is a central prerequisite to comprehending the basis of physiological tissue function in healthy individuals and relating this to disease states. Traditionally, medical curricula include courses where students examine glass slides of cytological or tissue samples under a light microscope. However, it is challenging to implement group and peer group learning in these courses and to give students sufficient time to study specimens. An increasing number of medical schools have thus started to implement digital slide viewers, so-called virtual microscopes, in histology and histopathology. These websites are mostly based on standard commercial software and offer limited adaptation to the special needs of first-year students. An e-learning platform has therefore been developed for use in cytology and histology courses. This virtual microscopy tool is coupled to a central database in which students can label and store the positions of individual structures for later repetition. As learning in pairs and peer groups has been shown to provide a high learning outcome, identified structures can be shared and discussed with students' peers or faculty via a built-in communication module. This website has the possibility of opening an arbitrary number of frames which all can actively be moved and changed in magnification to enable the comparison of specimens and thus encourage a more global understanding of related tissues. HistoViewer is thus suggested as an e-learning tool combining several modern teaching concepts.

A novel Internet-based blended learning programme providing core competency in clinical research

RATIONALE, AIMS AND OBJECTIVES

We developed a novel Internet-based blended learning programme that allows busy health care professionals to attain core competency in clinical research. This study details the educational strategies and learning outcomes of the programme.

METHOD

This study was conducted at Kyoto University and seven satellite campuses from September 2009 to March 2010. A total of 176 health care professionals who had never attempted to attain core competency in clinical research were enrolled. The participants were supplied with a novel programme comprising the following four strategies: online live lectures at seven satellite campuses, short examinations after each lecture, an Internet-based feedback system and an end-of-course examination. We assessed the proportion of attendance at the lectures as the main outcome. In addition, we evaluated interaction via the feedback system and scores for end-of-course examination.

RESULTS

Of the 176 participants, 134 (76%) reported working more than 40 hours per week. The mean proportion of attendance over all 23 lectures was 82%. A total of 156 (89%) participants attended more than 60% of all lectures and were eligible for the end-of-course examination. A total of the participants accessed the feedback system 3564 times and asked 284 questions. No statistically significant differences were noted in the end-of-course scores among medical doctors, pharmacists, registered nurses and other occupations.

CONCLUSIONS

We developed an Internet-based blended learning programme providing core competency in clinical research. Most busy health care professionals completed the programme successfully. In addition, the participants could attain the core competency effectively, regardless of their occupation.

What are effects of a spaced activation of virtual patients in a pediatric course?

BACKGROUND

Virtual patients (VPs) have a long tradition in the curriculum of the medical faculty at the Ludwig-Maximilians-University (LMU) Munich. However, the pediatric VPs were not well integrated into the curriculum and hardly used by students.

METHODS

Therefore we created and implemented a self-contained E-learning module based on virtual patients (VPs), which was embedded into the pediatric curriculum.Students taking this course were divided into two groups. For Group A the virtual patients were activated in a timed order ("spaced activation"), whereas Group B could work on all VPs from the beginning.We investigated the performance of these two groups concerning usage pattern including number of sessions and session duration, score on questions integrated into the VP and results of the intermediate exam.

RESULTS

The integration of the VPs into the pediatric course was successful for both groups. The usage pattern for the spaced activation turned out to be more balanced, however we did not find any significant differences in the results of the intermediate exam, the score on questions included in the VPs nor in the time students spent working on the VPs.

CONCLUSIONS

Our study showed that the spaced activation led to a more balanced VP usage pattern with a lower peak of sessions at the end of the course. Further studies will have to investigate whether a spaced activation of VPs leads to favorable long-term learning outcomes.

A global model for effective use and evaluation of e-learning in health

Healthcare systems worldwide face a wide range of challenges, including demographic change, rising drug and medical technology costs, and persistent and widening health inequalities both within and between countries. Simultaneously, issues such as professional silos, static medical curricula, and perceptions of "information overload" have made it difficult for medical training and continued professional development (CPD) to adapt to the changing needs of healthcare professionals in increasingly patient-centered, collaborative, and/or remote delivery contexts. In response to these challenges, increasing numbers of medical education and CPD programs have adopted e-learning approaches, which have been shown to provide flexible, low-cost, user-centered, and easily updated learning. The effectiveness of e-learning varies from context to context, however, and has also been shown to make considerable demands on users' motivation and "digital literacy" and on providing institutions. Consequently, there is a need to evaluate the effectiveness of e-learning in healthcare as part of ongoing quality improvement efforts. This article outlines the key issues for developing successful models for analyzing e-health learning.

Development of an online education program for midwives in australia to improve perinatal oral health

It is recommended that all pregnant women should receive a comprehensive oral health evaluation because poor maternal oral health may affect pregnancy outcomes and the general health of the woman and her baby. Midwives are well placed to provide dental health advice and referral. However, in Australia, little emphasis has been placed on the educational needs of midwives to undertake this role. This article outlines the development of an online education program designed to improve midwives' dental health knowledge, prepare them to assess the oral health of women, refer when required, and provide appropriate dental education to women and their families. The program consists of reading and visual material to assist with the oral health assessment process and includes competency testing.

vTrain: A Novel Curriculum for Patient Surge Training in a Multi-User Virtual Environment (MUVE)

Introduction

During a pandemic influenza, emergency departments will be overwhelmed with a large influx of patients seeking care. Although all hospitals should have a written plan for dealing with this surge of health care utilization, most hospitals struggle with ways to educate the staff and practice for potentially catastrophic events.

Hypothesis/Problem

To better prepare hospital staff for a patient surge, a novel educational curriculum was developed utilizing an emergency department for a patient surge functional drill.

Methods

A multidisciplinary team of medical educators, evaluators, emergency preparedness experts, and technology specialists developed a curriculum to: (1) train novice users to function in their job class in a multi-user virtual environment (MUVE); (2) obtain appropriate pre-drill disaster preparedness training; (3) perform functional team exercises in a MUVE; and (4) reflect on their performance after the drill.

Results

A total of 14 students participated in one of two iterations of the pilot training program; seven nurses completed the emergency department triage course, and seven hospital administrators completed the Command Post (CP) course. All participants reported positive experiences in written course evaluations and structured verbal debriefings, and self-reported increase in disaster preparedness knowledge. Students also reported improved team communication, planning, team decision making, and the ability to visualize and reflect on their performance.

Conclusion

Data from this pilot program suggest that the immersive, virtual teaching method is well suited to team-based, reflective practice and learning of disaster management skills.

GreciLS, RamlollR, HurstS, GarmanK, BeedasyJ, PieperEB, HuangR, HigginbothamE, AghaZ. vTrain: a novel curriculum for patient surge training in a multi-user virtual environment (MUVE). Prehosp Disaster Med.2013;28(3):1-8.

Perspective: Reconsidering the focus on "outcomes research" in medical education: a cautionary note

Researchers in medical education have been placing increased emphasis on "outcomes research," or the observable impact of educational interventions on patient care. However, although patient outcomes are obviously important, they should not be the sole focus of attention in medical education research. The purpose of this perspective is both to highlight the limitations of outcomes research in medical education and to offer suggestions to facilitate a proper balance between learner-centered and patient-centered assessments. The authors cite five challenges to research using patient outcomes in medical education, namely (1) dilution (the progressively attenuated impact of education as filtered through other health care providers and systems), (2) inadequate sample size, (3) failure to establish a causal link, (4) potentially biased outcome selection, and (5) teaching to the test. Additionally, nonpatient outcomes continue to hold value, particularly in theory-building research and in the evaluation of program implementation. To educators selecting outcomes and instruments in medical education research, the authors offer suggestions including to clarify the study objective and conceptual framework before selecting outcomes, and to consider the development and use of behavioral and other intermediary outcomes. Deliberately weighing the available options will facilitate informed choices during the design of research that, in turn, informs the art and science of medical education.

Asynchronous web-based learning, a practical method to enhance teaching in emergency medicine

Abstract Objective: To compare medical knowledge acquisition among emergency medicine (EM) residents who attend weekly core content lectures with those absent but asynchronously viewing the same lectures in a Web-based electronic platform.

SUBJECTS AND METHODS

During the study period all EM residents attending or absent from weekly educational conferences were given a quiz on the covered material. During Phase 1, absentees were not given supplemental educational content for missed lectures. During Phase 2, absentees were sent a link to an online multimedia module containing an audiovisual recording of the actual missed lecture with presentation slides. Scores between attendees and absentees during both phases were compared using a repeated-measures analysis to evaluate the effect of the supplemental online module on knowledge acquisition.

RESULTS

Thirty-nine EM residents (equally distributed in postgraduate years 1-4) were studied during a 15-week period. Overall and after adjusting for sex and postgraduate year level, both lecture attendance (b=27; 95% confidence interval, 22-32; p<0.0001) and Web-based learning (b=32; 95% confidence interval, 26-37; p<0.0001) were associated with significant increases in test scores compared with residents who were absent and not receiving supplemental Web-based learning. Neither the self-perceived level of mastery with the lecture topic nor the amount of reported reading was found to be a predictor of test scores.

CONCLUSIONS

In an EM residency program, asynchronous Web-based learning may result in medical knowledge acquisition similar to or better than attending traditional core content lectures. The percentage of curriculum delivery by asynchronous learning that may be used to achieve overall terminal learning objectives in medical knowledge acquisition requires further study.

PBL and beyond: trends in collaborative learning

Building upon the disruption to lecture-based methods triggered by the introduction of problem-based learning, approaches to promote collaborative learning are becoming increasingly diverse, widespread and generally well accepted within medical education. Examples of relatively new, structured collaborative learning methods include team-based learning and just-in-time teaching. Examples of less structured approaches include think-pair share, case discussions, and the flipped classroom. It is now common practice in medical education to employ a range of instructional approaches to support collaborative learning. We believe that the adoption of such approaches is entering a new and challenging era. We define collaborate learning by drawing on the broader literature, including Chi's ICAP framework that emphasizes the importance of sustained, interactive explanation and elaboration by learners. We distinguish collaborate learning from constructive, active, and passive learning and provide preliminary evidence documenting the growth of methods that support collaborative learning. We argue that the rate of adoption of collaborative learning methods will accelerate due to a growing emphasis on the development of team competencies and the increasing availability of digital media. At the same time, the adoption collaborative learning strategies face persistent challenges, stemming from an overdependence on comparative-effectiveness research and a lack of useful guidelines about how best to adapt collaborative learning methods to given learning contexts. The medical education community has struggled to consistently demonstrate superior outcomes when using collaborative learning methods and strategies. Despite this, support for their use will continue to expand. To select approaches with the greatest utility, instructors must carefully align conditions of the learning context with the learning approaches under consideration. Further, it is critical that modifications are made with caution and that instructors verify that modifications do not impede the desired cognitive activities needed to support meaningful collaborative learning.

Educational technology in medical education

This article aims to review the past practices of educational technology and envision future directions for medical education. The discussion starts with a historical review of definitions and perspectives of educational technology, in which the authors propose that educators adopt a broader process-oriented understanding of educational technology. Future directions of e-learning, simulation, and health information technology are discussed based on a systems view of the technological process. As new technologies continue to arise, this process-oriented understanding and outcome-based expectations of educational technology should be embraced. With this view, educational technology should be valued in terms of how well the technological process informs and facilitates learning, and the acquisition and maintenance of clinical expertise.

Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis

BACKGROUND

Although technology-enhanced simulation is increasingly used in health professions education, features of effective simulation-based instructional design remain uncertain.

AIMS

Evaluate the effectiveness of instructional design features through a systematic review of studies comparing different simulation-based interventions.

METHODS

We systematically searched MEDLINE, EMBASE, CINAHL, ERIC, PsycINFO, Scopus, key journals, and previous review bibliographies through May 2011. We included original research studies that compared one simulation intervention with another and involved health professions learners. Working in duplicate, we evaluated study quality and abstracted information on learners, outcomes, and instructional design features. We pooled results using random effects meta-analysis.

RESULTS

From a pool of 10,903 articles we identified 289 eligible studies enrolling 18,971 trainees, including 208 randomized trials. Inconsistency was usually large (I2 > 50%). For skills outcomes, pooled effect sizes (positive numbers favoring the instructional design feature) were 0.68 for range of difficulty (20 studies; p < 0.001), 0.68 for repetitive practice (7 studies; p = 0.06), 0.66 for distributed practice (6 studies; p = 0.03), 0.65 for interactivity (89 studies; p < 0.001), 0.62 for multiple learning strategies (70 studies; p < 0.001), 0.52 for individualized learning (59 studies; p < 0.001), 0.45 for mastery learning (3 studies; p = 0.57), 0.44 for feedback (80 studies; p < 0.001), 0.34 for longer time (23 studies; p = 0.005), 0.20 for clinical variation (16 studies; p = 0.24), and -0.22 for group training (8 studies; p = 0.09).

CONCLUSIONS

These results confirm quantitatively the effectiveness of several instructional design features in simulation-based education.

Developing an interactive web-based learning program on skin cancer: the learning experiences of clinical educators

Web-based learning in medical education is rapidly growing. However, there are few firsthand accounts on the rationale for and development of web-based learning programs. We present the experience of clinical educators who developed an interactive online skin cancer detection and management course in a time-efficient and cost-efficient manner without any prior skills in computer programming or technical construction of web-based learning programs. We review the current state of web-based learning including its general advantages and disadvantages as well as its specific utility in dermatology. We then detail our experience in developing an interactive online skin cancer curriculum for primary care clinicians. Finally, we describe the main challenges faced and lessons learned during the process. This report may serve medical educators who possess minimal computer programming and web design skills but want to employ the many strengths of web-based learning without the huge costs associated with hiring a professional development team.

An interprofessional Web-based resource for health professions preceptors

OBJECTIVE

To develop a Web-based preceptor education resource for healthcare professionals and evaluate its usefulness.

METHODS

Using an open source platform, 8 online modules called "E-tips for Practice Education" (E-tips) were developed that focused on topics identified relevant across healthcare disciplines. A cross-sectional survey design was used to evaluate the online resource. Ninety preceptors from 10 health disciplines affiliated with the University of British Columbia evaluated the E-tips.

RESULTS

The modules were well received by preceptors, with all participants indicating that they would recommend these modules to their colleagues, over 80% indicating the modules were very to extremely applicable, and over 60% indicating that E-tips had increased their confidence in their ability to teach.

CONCLUSION

Participants reported E-tips to be highly applicable to their teaching role as preceptors. Given their multidisciplinary focus, these modules address a shared language and ideas about clinical teaching among those working in multi-disciplinary settings.

Adoption of computer-assisted learning in medical education: the educators' perspective

CONTEXT

Computer-assisted learning (CAL) in medical education has been shown to be effective in the achievement of learning outcomes, but requires the input of significant resources and development time. This study examines the key elements and processes that led to the widespread adoption of a CAL program in undergraduate medical education, the Computer-assisted Learning in Paediatrics Program (CLIPP). It then considers the relative importance of elements drawn from existing theories and models for technology adoption and other studies on CAL in medical education to inform the future development, implementation and testing of CAL programs in medical education.

METHODS

The study used a mixed-methods explanatory design. All paediatric clerkship directors (CDs) using CLIPP were recruited to participate in a self-administered, online questionnaire. Semi-structured interviews were then conducted with a random sample of CDs to further explore the quantitative results.

RESULTS

Factors that facilitated adoption included CLIPP's ability to fill gaps in exposure to core clinical problems, the use of a national curriculum, development by CDs, and the meeting of CDs' desires to improve teaching and student learning. An additional facilitating factor was that little time and effort were needed to implement CLIPP within a clerkship. The quantitative findings were mostly corroborated by the qualitative findings.

CONCLUSIONS

This study indicates issues that are important in the consideration and future exploration of the development and implementation of CAL programs in medical education. The promise of CAL as a method of enhancing the process and outcomes of medical education, and its cost, increase the need for future CAL funders and developers to pay equal attention to the needs of potential adopters and the development process as they do to the content and tools in the CAL program. Important questions that remain on the optimal design, use and integration of CAL should be addressed in order to adequately inform future development. Support is needed for studies that address these critical areas.

A novel educational strategy targeting health care workers in underserved communities in Central America to integrate HIV into primary medical care

Background

Current educational strategies to integrate HIV care into primary medical care in Central America have traditionally targeted managers or higher-level officials, rather than local health care workers (HCWs). We developed a complementary online and on-site interactive training program to reach local HCWs at the primary care level in underserved communities.

Methods

The training program targeted physicians, nurses, and community HCWs with limited access to traditional onsite training in Panama, Nicaragua, Dominican Republic, and Guatemala. The curriculum focused on principles of HIV care and health systems using a tutor-supported blended educational approach of an 8-week online component, a weeklong on-site problem-solving workshop, and individualized project-based interventions.

Results

Of 258 initially active participants, 225 (225/258 = 87.2%) successfully completed the online component and the top 200 were invited to the on-site workshop. Of those, 170 (170/200 = 85%) attended the on-site workshop. In total, 142 completed all three components, including the project phase. Quantitative and qualitative evaluation instruments included knowledge assessments, reflexive essays, and acceptability surveys. The mean pre and post-essay scores demonstrating understanding of social determinants, health system organization, and integration of HIV services were 70% and 87.5%, respectively, with an increase in knowledge of 17.2% (p<0.001). The mean pre- and post-test scores evaluating clinical knowledge were 70.9% and 90.3%, respectively, with an increase in knowledge of 19.4% (p<0.001). A survey of Likert scale and open-ended questions demonstrated overwhelming participant satisfaction with course content, structure, and effectiveness in improving their HIV-related knowledge and skills.

Conclusion

This innovative curriculum utilized technology to target HCWs with limited access to educational resources. Participants benefited from technical skills acquired through the process, and could continue working within their underserved communities while participating in the online component and then implement interventions that successfully converted theoretical knowledge to action to improve integration of HIV care into primary care.

Evaluation of an e-PBL model to promote individual reasoning

AIM

Medical educators should promote the development of student clinical reasoning toward independence in clinical settings. The objective of this study was to evaluate an online problem-based learning (e-PBL) model designed to promote student individual reasoning in supplement to traditional PBL.

METHODS

Twelve e-PBL modules were added to the fully problem-based curriculum for Year 2 at Sungkyunkwan University School of Medicine (SKKUSOM). In this e-PBL, students worked on the problems individually in an online setting, followed by face-to-face discussions in a colloquium. The cases were presented using interactive multimedia to enhance the authenticity of the case and stimulate student interest in learning. A formative evaluation study was conducted to determine student satisfaction with e-PBL and its effectiveness as perceived by the students using both quantitative and qualitative methods. A cohort of Year 2 students at SKKUSOM (n = 38) took part in this study.

RESULTS

Students perceived e-PBL significantly more positively after they had taken a module in terms of its ability to foster problem-solving skills and its ability to allow them to learn in ways suited to individual learning styles. Additionally, student survey and interview revealed that a vast majority of students were satisfied with the overall learning process in e-PBL and perceived it positively in fostering knowledge acquisition and clinical reasoning. Moreover, students found the cases realistic and engaging.

CONCLUSIONS

The results show the potential of e-PBL to enhance traditional PBL by promoting the development of individual reasoning in a flexible online-learning environment and offering cases in an interactive multimedia format, which warrants further investigation into its impact on student learning outcomes.

Revisiting cognitive and learning styles in computer-assisted instruction: not so useful after all

In a previous systematic review, the author proposed that adaptation to learners' cognitive and learning styles (CLSs) could improve the efficiency of computer-assisted instruction (CAI). In the present article, he questions that proposition, arguing that CLSs do not make a substantive difference in CAI. To support this argument, the author performed an updated systematic literature search, pooled new findings with those from the previous review, and reinterpreted this evidence with a focus on aptitude-treatment interactions. (An aptitude-treatment interaction occurs when a student with attribute 1 learns better with instructional approach A than with approach B, whereas a student with attribute 2 learns better with instructional approach B).Of 65 analyses reported in 48 studies, only 9 analyses (14%) showed significant interactions between CLS and instructional approach. It seems that aptitude-treatment interactions with CLSs are at best infrequent and small in magnitude. There are several possible explanations for this lack of effect. First, the influence of strong instructional methods likely dominates the impact of CLSs. Second, current methods for assessing CLSs lack validity evidence and are inadequate to accurately characterize the individual learner. Third, theories are vague, and empiric evidence is virtually nonexistent to guide the planning of style-targeted instructional designs. Adaptation to learners' CLSs thus seems unlikely to enhance CAI. The author recommends that educators focus on employing strong instructional methods. Educators might also consider assessing and adapting to learners' prior knowledge or allowing learners to select among alternate instructional approaches.

Impact on learning of an e-learning module on leukaemia: a randomised controlled trial

BACKGROUND

e-learning resources may be beneficial for complex or conceptually difficult topics. Leukaemia is one such topic, yet there are no reports on the efficacy of e-learning for leukaemia. This study compared the learning impact on senior medical students of a purpose-built e-learning module on leukaemia, compared with existing online resources.

METHODS

A randomised controlled trial was performed utilising volunteer senior medical students. Participants were randomly allocated to Study and Control groups. Following a pre-test on leukaemia administered to both groups, the Study group was provided with access to the new e-learning module, while the Control group was directed to existing online resources. A post-test and an evaluation questionnaire were administered to both groups at the end of the trial period.

RESULTS

Study and Control groups were equivalent in gender distribution, mean academic ability, pre-test performance and time studying leukaemia during the trial. The Study group performed significantly better than the Control group in the post-test, in which the group to which the students had been allocated was the only significant predictor of performance. The Study group's evaluation of the module was overwhelmingly positive.

CONCLUSIONS

A targeted e-learning module on leukaemia had a significant effect on learning in this cohort, compared with existing online resources. We believe that the interactivity, dialogic feedback and integration with the curriculum offered by the e-learning module contributed to its impact. This has implications for e-learning design in medicine and other disciplines.

Does an offer for a free on-line continuing medical education (CME) activity increase physician survey response rate? A randomized trial

BACKGROUND

Achieving a high response rate in a physician survey is challenging. Monetary incentives increase response rates but obviously add cost to a survey project. We wondered whether an offer of a free continuing medical education (CME) activity would be effective in improving survey response rate.

RESULTS

As part of a survey of a national sample of physicians, we randomized half to an offer for a free on-line CME activity upon completion of a web-based survey and the other half to no such offer. We compared response rates between the groups. A total of 1214 out of 8477 potentially eligible physicians responded to our survey, for an overall response rate of 14.3%. The response rate among the control group (no offer of CME credit) was 16.6%, while among those offered the CME opportunity, the response rate was 12.0% (p < 0.0001).

CONCLUSIONS

An offer for a free on-line CME activity did not improve physician survey response rate. On the contrary, the offer for a free CME activity actually appeared to worsen the response rate.

The impact of an interactive Web-based module on residents' knowledge and clinical practice of injury prevention

OBJECTIVE

To determine the effectiveness of an interactive Web-based module on knowledge acquisition, retention, and clinical practice by residents.

METHODS

Residents were randomized to complete an interactive Web-based module on injury prevention or a noninteractive Web-based module of identical content. Acquisition and retention of medical knowledge were measured by pretest, posttest, and long-term test scores, and change in clinical practice was measured by videotaped clinical encounters.

RESULTS

Fifty-seven residents completed the modules. The control group had higher posttest scores than the intervention group (P = .036). Thirty-seven residents completed the long-term test with scores that were significantly higher than pretest scores (P = .00). Thirty-six residents had videotaped encounter scores (232 visits), with no difference in these scores after the intervention (P = .432).

CONCLUSION

The noninteractive module was more effective in promoting knowledge acquisition. Residents successfully demonstrated knowledge retention with completion of either module. The modules were insufficient to change clinical practice.