Comparison of directed and self-directed learning in evidence-based medicine: a randomised controlled trial

The effectiveness of evidence-based healthcare educational interventions on healthcare professionals' knowledge, skills, attitudes, professional practice and healthcare outcomes: Systematic review and meta-analysis

OBJECTIVE

The primary aim of this systematic review is to assess the effectiveness of evidence-based healthcare (EBHC) educational interventions on healthcare professionals' knowledge, skills, attitudes, behaviour of EBHC, clinical process and care outcomes. A secondary aim of the review is to assess the effects of important pedagogical moderating factors for EBHC educational interventions.

METHOD

This systematic review used a forward and backward citation search strategy on the Web of Science platform (date of inception to 28 April 2023). Only randomised controlled trials (RCTs) and cluster RCTs which compared EBHC educational interventions for healthcare professionals were included. A random effects meta-analysis was undertaken for EBHC compared with an active and nonactive control for all outcomes.

RESULTS

Sixty-one RCTs were identified which included a total of 5208 healthcare professionals. There was a large effect for EBHC educational interventions compared with waiting list/no treatment/sham control on knowledge (SMD, 2.69; 95% CI, 1.26-4.14, GRADE Low), skills (SMD, 0.88; 95% CI, 0.25-1.73, Very Low Certainty), attitude (SMD, 0.81; 95% CI, 0.16-1.47, Very Low Certainty) and behaviour of EBHC (SMD, 0.82; 95% CI, 0.25-1.40, Very Low Certainty). Over time the effect of EBHC educational interventions substantially decreased with no evidence of effect at 6 months for any outcome except behaviour (SMD,1.72; 95% CI, 0.74-2.71, Low Certainty). There was some evidence that blended learning, active learning and consistency in the individual delivering the intervention may be important positive moderating factors.

CONCLUSION

These findings suggest that EBHC educational interventions may have a large short-term effect on improving healthcare professionals' knowledge, skills, attitude and behaviour of EBHC. These effects may be longer-lasting regarding EBHC behaviour. In terms of pedagogy, blended learning, active learning, and consistency of the individual delivering the intervention may be important positive moderating factors.

Methods of teaching evidence-based practice: a systematic review

BACKGROUND

To identify the effectiveness of different teaching modalities on student evidence-based practice (EBP) competency.

METHODS

Electronic searches were conducted in MEDLINE, Cochrane central register of controlled trials, PsycINFO, CINAHL, ERIC, A + Education and AEI through to November 2021. We included randomised-controlled trials comparing EBP teaching modes on EBP knowledge, skills, attitudes or behaviour in undergraduate and post-graduate health professions education. Risk of bias was determined using the Cochrane risk of bias tool.

RESULTS

Twenty-one studies were included in the review. Overall, no single teaching modality was identified as being superior to others at significantly increasing learner competency in EBP. Changes in learner knowledge, skills, attitudes and behaviour were conflicting, with studies either reporting no change, or a moderate increase in EBP behavioural outcomes when directly compared to another intervention.

CONCLUSION

Current evidence highlights the lack of a single teaching modality that is superior than others regarding learner competency in EBP, regardless of health professions discipline or graduate status. The poor quality, heterogeneity of interventions and outcome measures limited conclusions. Further research should focus on the development of high-quality studies and use of psychometrically validated tools to further explore the impact of different EBP teaching modalities.

Quality, methods, and recommendations of systematic reviews on measures of evidence-based practice: an umbrella review

OBJECTIVES

The objective of the review was to estimate the quality of systematic reviews on evidence-based practice measures across health care professions and identify differences between systematic reviews regarding approaches used to assess the adequacy of evidence-based practice measures and recommended measures.

INTRODUCTION

Systematic reviews on the psychometric properties of evidence-based practice measures guide researchers, clinical managers, and educators in selecting an appropriate measure for use. The lack of psychometric standards specific to evidence-based practice measures, in addition to recent findings suggesting the low methodological quality of psychometric systematic reviews, calls into question the quality and methods of systematic reviews examining evidence-based practice measures.

INCLUSION CRITERIA

We included systematic reviews that identified measures that assessed evidence-based practice as a whole or of constituent parts (eg, knowledge, attitudes, skills, behaviors), and described the psychometric evidence for any health care professional group irrespective of assessment context (education or clinical practice).

METHODS

We searched five databases (MEDLINE, Embase, CINAHL, PsycINFO, and ERIC) on January 18, 2021. Two independent reviewers conducted screening, data extraction, and quality appraisal following the JBI approach. A narrative synthesis was performed.

RESULTS

Ten systematic reviews, published between 2006 and 2020, were included and focused on the following groups: all health care professionals (n = 3), nurses (n = 2), occupational therapists (n = 2), physical therapists (n = 1), medical students (n = 1), and family medicine residents (n = 1). The overall quality of the systematic reviews was low: none of the reviews assessed the quality of primary studies or adhered to methodological guidelines, and only one registered a protocol. Reporting of psychometric evidence and measurement characteristics differed. While all the systematic reviews discussed internal consistency, feasibility was only addressed by three. Many approaches were used to assess the adequacy of measures, and five systematic reviews referenced tools. Criteria for the adequacy of individual properties and measures varied, but mainly followed standards for patient-reported outcome measures or the Standards of Educational and Psychological Testing. There were 204 unique measures identified across 10 reviews. One review explicitly recommended measures for occupational therapists, three reviews identified adequate measures for all health care professionals, and one review identified measures for medical students. The 27 measures deemed adequate by these five systematic reviews are described.

CONCLUSIONS

Our results suggest a need to improve the overall methodological quality and reporting of systematic reviews on evidence-based practice measures to increase the trustworthiness of recommendations and allow comprehensive interpretation by end users. Risk of bias is common to all the included systematic reviews, as the quality of primary studies was not assessed. The diversity of tools and approaches used to evaluate the adequacy of evidence-based practice measures reflects tensions regarding the conceptualization of validity, suggesting a need to reflect on the most appropriate application of validity theory to evidence-based practice measures.

SYSTEMATIC REVIEW REGISTRATION NUMBER

PROSPERO CRD42020160874.

Simulated Randomized Controlled Trial to Learn Critical Appraisal (SiRCA): A Randomized Controlled Study of Effectiveness Among Undergraduate Medical Students

Introduction: The ideal method to teach evidence-based medicine (EBM) to medical students is unclear. We determined the effectiveness of a simulated randomized controlled trial (RCT) in improving critical appraisal and EBM skills among medical students compared to traditional training.

Methods: One hundred and eighteen medical students were randomized into two groups. Sixty-one students (immersion arm) were trained in critical appraisal using a simulated RCT aimed at determining efficacy of a “brainy pill” on ability to crack puzzles. Fifty-seven students (traditional group) were trained using a journal club with a checklist. Primary outcome of change in knowledge and skills of critical appraisal and EBM was determined by comparing scores on pre- and post-intervention Fresno tests.

Results: Mean age of students was 21.76 (SD - 0.78) years. Seventy (59.3%) were females and 48 (40.7%) males. Mean pre-test scores of traditional and immersion groups were 8.0 (SD - 4.88) and 9.31 (SD - 5.49) respectively and post-test scores were 50.2 (SD - 16.2) and 68.12 (SD - 14.72) respectively (post-intervention mean difference - 17.92; 95% CI 12.26 - 23.57; p<0.0000001). Odds of achieving 65% or more in post-intervention Fresno test score was significantly higher in immersion group (29.8% vs 8.2%; OR 4.76; 95% CI 1.62-13.97; p = 0.001). Perceived competence regarding EBM skills improved significantly in immersion group.

Conclusions: Simulated RCT is effective in imparting critical appraisal and EBM practice skills to medical students. Trainers should consider integrating and reinforcing this approach in EBM curriculum to make learning contextual and immersive. 

Effectiveness of Modalities to Teach Evidence Based Medicine to Pediatric Clerkship Students: A Randomized Controlled Trial

OBJECTIVE

To evaluate the effectiveness of a traditional didactic session (TDS) as compared to a self-paced, interactive, multimedia module (SPM) on the application of evidence-based medicine (EBM) skills among medical students during their inpatient pediatric rotation.

METHODS

We conducted a randomized controlled trial from June, 2017 to June, 2018 at a quaternary care children's hospital. Students were randomized to TDS or SPM during each 2-week block. All students completed a critical appraisal tool (CAT) of evidence related to a clinical question in a standardized appraisal form and self-reflected about the EBM process. The primary outcome was the numeric score of the CAT derived by using the validated Fresno tool. Secondary outcomes of knowledge, attitudes, confidence, and self-reported behaviors related to EBM were measured using validated surveys. Statistical analysis was performed using Student's t test for CAT scores and mixed-model procedure (PROC MIXED), with subject as random effect and time as repeated measure for the secondary outcomes.

RESULTS

One hundred twenty-seven clerkship students were included. Overall, there was no significant difference in mean CAT scores for TDS (n = 59) versus SPM (n = 66) groups (90.3 vs 92.0, P = .65). There were no significant differences between SPM and TDS groups for knowledge (P = .66), attitudes (P = .97), confidence (P  = .55), and accessing evidence (P = .27). Both groups showed significant gains in knowledge, attitudes, confidence, and accessing evidence from baseline to postcourse. Improvements in knowledge and confidence were sustained at 3-months.

CONCLUSION

A SPM learning module is as effective as a TDS module for application of EBM concepts and knowledge to patient care.

Self-directed learning: assessment of students' abilities and their perspective

The introduction of Competency-Based Medical Education Curriculum in India has endorsed many new concepts, like foundation course, self-directed learning (SDL), early clinical exposure, etc. Emphasis is being given to active teaching-learning approaches. One such approach is SDL. SDL is an active learning approach in which the students are responsible for their own learning outcome, with teacher acting as a facilitator of learning. A medical graduate, being a lifelong learner, should inculcate the habit of SDL. In the present study, the SDL abilities of first year Bachelor of Medicine, Bachelor of Surgery students were assessed using a questionnaire. Based on their experience, students were also asked about the prerequisites of SDL, how it can be promoted, and their expectations from the teachers. Students scored high in most of the SDL skills. However, they felt they need improvement in time management. Furthermore, the students are required to develop their interpersonal communication skills, and they also find it difficult to express messages effectively in oral presentations. Most of the students felt they need help in finding the correct learning resources. According to them, the students should be focused, motivated and stress-free, have time management skills, and be able to search learning resources for successful implementation of SDL. They felt that events that encourage active participation by students, if organized at regular intervals, could promote SDL. Some felt that evaluation of SDL would motivate them to take it seriously. According to the students, teacher should act as a facilitator, a mentor, as well as an evaluator.

Development and evaluation of an evidence-based medicine module in the undergraduate medical curriculum

BACKGROUND

Evidence-based medicine (EBM) is a core competence in both undergraduate and postgraduate medical curricula. However, its integration into curricula varies widely. Our study will help medical colleges develop, implement and evaluate their EBM courses. We assessed the effectiveness of workshops in improving critical appraisal skills among medical students.

METHODS

A before-and-after study design without a control group was used. A 5-week short EBM module including lectures, workshops, and online search sessions was conducted with 52 fourth-year medical students during their primary healthcare course at the College of Medicine, Princess Nourah bint Abdulrahman University. Statistical analysis was performed using SPSS statistical software (version 20, SPSS Inc., Chicago, US). Parametric tests as well as Student's paired t-test for pre- and post-test comparisons were used.

RESULTS

Forty-nine (49) participants completed the pre- and post-training Fresno tests, and 44.9% of the participants had a GPA of 4.0 or higher. The mean Fresno test score increased from 45.63 (SD 21.89) on the pre-test to 64.49 (SD 33.31) on the post-test, with significant improvements in the following items: search strategies, relevance, internal validity, magnitude and significance of results, statistical values of diagnosis studies (sensitivity, specificity, and LR), statistical values of therapy studies (ARR, RRR, and NNT), and best study design for diagnosis and prognosis (P < 0.05).

CONCLUSION

This study supports that a short course in EBM that is incorporated into the undergraduate curriculum, especially in the clinical years, might be effective in improving medical students' knowledge and skills in EBM. However, prospective studies are necessary to assess the long-term impact of these interventions and ultimately their effectiveness for clinical decision making.

A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education

BACKGROUND

The importance of teaching the skills and practice of evidence-based medicine (EBM) for medical professionals has steadily grown in recent years. Alongside this growth is a need to evaluate the effectiveness of EBM curriculum as assessed by competency in the five 'A's': asking, acquiring, appraising, applying and assessing (impact and performance). EBM educators in medical education will benefit from a compendium of existing assessment tools for assessing EBM competencies in their settings. The purpose of this review is to provide a systematic review and taxonomy of validated tools that evaluate EBM teaching in medical education.

METHODS

We searched MEDLINE, EMBASE, Cochrane library, Educational Resources Information Centre (ERIC), Best Evidence Medical Education (BEME) databases and references of retrieved articles published between January 2005 and March 2019. We have presented the identified tools along with their psychometric properties including validity, reliability and relevance to the five domains of EBM practice and dimensions of EBM learning. We also assessed the quality of the tools to identify high quality tools as those supported by established interrater reliability (if applicable), objective (non-self-reported) outcome measures and achieved ≥ 3 types of established validity evidence. We have reported our study in accordance with the PRISMA guidelines.

RESULTS

We identified 1719 potentially relevant articles of which 63 full text articles were assessed for eligibility against inclusion and exclusion criteria. Twelve articles each with a unique and newly identified tool were included in the final analysis. Of the twelve tools, all of them assessed the third step of EBM practice (appraise) and four assessed just that one step. None of the twelve tools assessed the last step of EBM practice (assess). Of the seven domains of EBM learning, ten tools assessed knowledge gain, nine assessed skills and-one assessed attitude. None addressed reaction to EBM teaching, self-efficacy, behaviours or patient benefit. Of the twelve tools identified, six were high quality. We have also provided a taxonomy of tools using the CREATE framework, for EBM teachers in medical education.

CONCLUSIONS

Six tools of reasonable validity are available for evaluating most steps of EBM and some domains of EBM learning. Further development and validation of tools that evaluate all the steps in EBM and all educational outcome domains are needed.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42018116203.

Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured

BACKGROUND

Despite the established interest in evidence-based practice (EBP) as a core competence for clinicians, evidence for how best to teach and evaluate EBP remains weak. We sought to systematically assess coverage of the five EBP steps, review the outcome domains measured, and assess the properties of the instruments used in studies evaluating EBP educational interventions.

METHODS

We conducted a systematic review of controlled studies (i.e. studies with a separate control group) which had investigated the effect of EBP educational interventions. We used citation analysis technique and tracked the forward and backward citations of the index articles (i.e. the systematic reviews and primary studies included in an overview of the effect of EBP teaching) using Web of Science until May 2017. We extracted information on intervention content (grouped into the five EBP steps), and the outcome domains assessed. We also searched the literature for published reliability and validity data of the EBP instruments used.

RESULTS

Of 1831 records identified, 302 full-text articles were screened, and 85 included. Of these, 46 (54%) studies were randomised trials, 51 (60%) included postgraduate level participants, and 63 (75%) taught medical professionals. EBP Step 3 (critical appraisal) was the most frequently taught step (63 studies; 74%). Only 10 (12%) of the studies taught content which addressed all five EBP steps. Of the 85 studies, 52 (61%) evaluated EBP skills, 39 (46%) knowledge, 35 (41%) attitudes, 19 (22%) behaviours, 15 (18%) self-efficacy, and 7 (8%) measured reactions to EBP teaching delivery. Of the 24 instruments used in the included studies, 6 were high-quality (achieved ≥3 types of established validity evidence) and these were used in 14 (29%) of the 52 studies that measured EBP skills; 14 (41%) of the 39 studies that measured EBP knowledge; and 8 (26%) of the 35 studies that measured EBP attitude.

CONCLUSIONS

Most EBP educational interventions which have been evaluated in controlled studies focus on teaching only some of the EBP steps (predominantly critically appraisal of evidence) and did not use high-quality instruments to measure outcomes. Educational packages and instruments which address all EBP steps are needed to improve EBP teaching.

Integration of mentored self-directed learning (MSDL) through both group and individual presentations in an accelerated modified block program

BACKGROUND AND PURPOSE

Project aim was to examine the feasibility and logistics of mentored self-directed learning (MSDL) through group and individual presentations in an accelerated modified block curriculum. Perspectives of students and faculty members toward the incorporation of MSDL were also explored.

EDUCATIONAL ACTIVITY AND SETTING

During a two-week pharmacotherapy block, students made group presentations requiring two elements: a case presentation on curricular content (Element-1) and an inclusion of "novel" information students did not receive didactically (Element-2). Curricular content for Element-1 stemmed from a pharmacotherapy course on gastroenterology and nutrition, and individual presentations were scheduled during a semester-long skill-based course. Surveys on student perspectives were conducted at baseline, after group presentations, and after individual presentations. Faculty members also provided feedback and evaluations.

FINDINGS

Whereas 58% of students considered a case presentation (Element-1) more valuable for their learning than inclusion of Element-2, 78% of faculty's responses indicated the incorporation of both Elements was valuable. For the following individual presentations, 73% of students were willing and able to present a topic not extensively addressed in the didactic curriculum by employing MSDL. Students improved their confidence in preparing and making presentations for peers and faculty/preceptors through the MSDL activities (p < 0.025). At the end of this project, the faculty determined 88% of students were ready to give a presentation considered appropriate for Advanced Pharmacy Practice Experience.

DISCUSSION

MSDL through group and individual presentation activities were feasible and provided a valuable learning experience for students in an accelerated modified block curriculum.

Student-led objective tutorials in Pharmacology: An interventional study

OBJECTIVES

Students learn in a better way if they are involved in active learning. Hence, the study was designed to introduce student-led objective tutorials (SLOTs) as an alternative to conventional tutorials (CTs) in pharmacology and to compare SLOT and CT on outcomes such as improved score in tests, active involvement of students, and faculty requirement of each.

MATERIALS AND METHODS

Didactic lectures taken on a topic in pharmacology were followed by a preintervention test for a batch of the 2nd year medical undergraduates. They were allotted either in SLOT or CT group. For a SLOT session, students of Group A (interventional group) were divided into teams and each team prepared five multiple choice questions on the given topic in PowerPoint format, which were presented to other teams and audience. The proceedings were facilitated by two lecturers. Group B undertook CT (controls). A postintervention test was then taken for both groups. Feedback was sought from students and teachers on SLOT.

RESULTS

The total marks for the test were 20. The mean marks in Group A improved by 31% (from 5.1 to 11.2). In Group B, they improved by 11% (from 5 to 7.2). Academic performance following SLOT was better than CT. Students (63%) favored SLOT as it stimulated their interest in the topic, improved self-learning skills, and teamwork. The teachers also favored SLOT for similar reasons.

CONCLUSION

SLOT leads to greater satisfaction and better performance in tests. SLOT is an effective alternative to CT to promote active learning among students through group work. It helps overcome the logistic difficulties due to faculty shortage.

A survey of the perceptions and behaviors of chiropractic interns pertaining to evidence-based principles in clinical decision making

OBJECTIVE

This study explored how chiropractic interns applied evidenced-based concepts, the sources of evidence they used, and how useful they perceived these sources to be in clinical decision making.

METHODS

A questionnaire containing 13 items in a Likert 5-point scale was administered to 28 chiropractic interns to gather information on the evidence types they commonly accessed and their perceived usefulness of these sources in clinical decision making. The interns were in the 8th semester of the training program.

RESULTS

There was a 93% (n = 26) response rate. Clinical guidelines were rated as the most helpful resource in clinical decision making (81%), followed by lecture materials (77%), journals (54%), databases (50%), and textbooks (35%). Students recognized scientific evidence as the most important aspect in clinical decision making. They found their personal experience and the views of their clinician to be equally important and patient preference the least.

CONCLUSION

Interns routinely employed high-quality levels of evidence in clinical decision making. They also considered their early, limited clinical experience as important as that of their clinical supervisor in decision making. This finding should be investigated further.

Evidence-based practice instruction by faculty members and librarians in North American optometry and ophthalmology programs

North American optometry and ophthalmology faculty members and vision science librarians were surveyed online (14% response rate) about teaching evidence-based practice (EBP). Similar to studies of other health care programs, all five EBP steps (Ask, Acquire, Appraise, Apply, Assess) were taught to varying degrees. Optometry and ophthalmology EBP educators may want to place further emphasis on (1) the Apply and Assess steps, (2) faculty- and student-generated questions and self-assessment in clinical settings, (3) online teaching strategies, (4) programmatic integration of EBP learning objectives, and (5) collaboration between faculty members and librarians.

Effectiveness of teaching evidence-based medicine to undergraduate medical students: a BEME systematic review

BACKGROUND

Despite the widespread teaching of evidence-based medicine (EBM) to medical students, the relevant literature has not been synthesized appropriately as to its value and effectiveness.

AIM

To systematically review the literature regarding the impact of teaching EBM to medical students on their EBM knowledge, attitudes, skills and behaviors.

METHODS

MEDLINE, SCOPUS, Web of science, ERIC, CINAHL and Current Controlled Trials up to May 2011 were searched; backward and forward reference checking of included and relevant studies was also carried out. Two investigators independently extracted data and assessed the quality of the studies.

RESULTS

10,111 potential studies were initially found, of which 27 were included in the review. Six studies examined the effect of clinically integrated methods, of which five had a low quality and the other one used no validated assessment tool. Twelve studies evaluated the effects of seminars, workshops and short courses, of which 11 had a low quality and the other one lacked a validated assessment tool. Six studies examined e-learning, of which five having a high or acceptable quality reported e-learning to be as effective as traditional teaching in improving knowledge, attitudes and skills. One robust study found problem-based learning less effective compared to usual teaching. Two studies with high or moderate quality linked multicomponent interventions to improved knowledge and attitudes. No included study assessed the long-term effects of the teaching of EBM.

CONCLUSIONS

Our findings indicated that some EBM teaching strategies have the potential to improve knowledge, attitudes and skills in undergraduate medical students, but the evidenced base does not demonstrate superiority of one method. There is no evidence demonstrating transfer to clinical practice.

The effectiveness of self-directed learning (SDL) for teaching physiology to first-year medical students

BACKGROUND

Self-directed learning (SDL) has become popular in medical curricula and has been advocated as an effective learning strategy for medical students to develop competence in knowledge acquisition.

AIMS

The primary aim was to find out if there was any benefit of supplementing self-directed learning activity with a traditional lecture on two different topics in physiology for first-year medical students.

METHOD

Two batches of first-year Bachelor of Medicine and Bachelor of Surgery (MBBS) (Batch A and Batch B) comprising 125 students each, received an SDL session on Morphological classification of anaemia. The students belonging to Batch A received a one-hour lecture on the same topic three days prior to the SDL session. The students were given a 10 multiple choice questions (MCQ) test for a maximum of 10 marks immediately following the SDL session. The next topic, Conducting system of the heart, disorders and conduction blocks was taught to both batches in traditional lecture format. This was followed by an SDL session on the same topic for Batch A only. The students were evaluated with a MCQ test for a maximum of 10 marks.

RESULTS

The mean test scores on the first topic were 4.38±2.06 (n=119) and 4.17±1.71 (n=118) for Batch A and Batch B, respectively. The mean test scores on the second topic were 5.4± 1.54 (n=112) and 5.15±1.37 (n=107) for Batch A and Batch B, respectively. There was no significant difference between the groups.

CONCLUSION

For first-year medical students, SDL is an effective teaching strategy for learning physiology. However, no additional benefit is gained by supplementing SDL with a lecture to facilitate learning physiology.

A systematic review of how studies describe educational interventions for evidence-based practice: stage 1 of the development of a reporting guideline

BACKGROUND

The aim of this systematic review was to identify which information is included when reporting educational interventions used to facilitate foundational skills and knowledge of evidence-based practice (EBP) training for health professionals. This systematic review comprised the first stage in the three stage development process for a reporting guideline for educational interventions for EBP.

METHODS

The review question was 'What information has been reported when describing educational interventions targeting foundational evidence-based practice knowledge and skills?'MEDLINE, Academic Search Premier, ERIC, CINAHL, Scopus, Embase, Informit health, Cochrane Library and Web of Science databases were searched from inception until October - December 2011. Randomised and non-randomised controlled trials reporting original data on educational interventions specific to developing foundational knowledge and skills of evidence-based practice were included.Studies were not appraised for methodological bias, however, reporting frequency and item commonality were compared between a random selection of studies included in the systematic review and a random selection of studies excluded as they were not controlled trials. Twenty-five data items were extracted by two independent reviewers (consistency > 90%).

RESULTS

Sixty-one studies met the inclusion criteria (n = 29 randomised, n = 32 non-randomised). The most consistently reported items were the learner's stage of training, professional discipline and the evaluation methods used (100%). The least consistently reported items were the instructor(s) previous teaching experience (n = 8, 13%), and student effort outside face to face contact (n = 1, 2%).

CONCLUSION

This systematic review demonstrates inconsistencies in describing educational interventions for EBP in randomised and non-randomised trials. To enable educational interventions to be replicable and comparable, improvements in the reporting for educational interventions for EBP are required. In the absence of a specific reporting guideline, there are a range of items which are reported with variable frequency. Identifying the important items for describing educational interventions for facilitating foundational knowledge and skills in EBP remains to be determined. The findings of this systematic review will be used to inform the next stage in the development of a reporting guideline for educational interventions for EBP.

Offline eLearning for undergraduates in health professions: A systematic review of the impact on knowledge, skills, attitudes and satisfaction

BACKGROUND

The world is short of 7.2 million health-care workers and this figure is growing. The shortage of teachers is even greater, which limits traditional education modes. eLearning may help overcome this training need. Offline eLearning is useful in remote and resource-limited settings with poor internet access. To inform investments in offline eLearning, we need to establish its effectiveness in terms of gaining knowledge and skills, students' satisfaction and attitudes towards eLearning.

METHODS

We conducted a systematic review of offline eLearning for students enrolled in undergraduate, health-related university degrees. We included randomised controlled trials that compared offline eLearning to traditional learning or an alternative eLearning method. We searched the major bibliographic databases in August 2013 to identify articles that focused primarily on students' knowledge, skills, satisfaction and attitudes toward eLearning, and health economic information and adverse effects as secondary outcomes. We also searched reference lists of relevant studies. Two reviewers independently extracted data from the included studies. We synthesized the findings using a thematic summary approach.

FINDINGS

Forty-nine studies, including 4955 students enrolled in undergraduate medical, dentistry, nursing, psychology, or physical therapy studies, met the inclusion criteria. Eleven of the 33 studies testing knowledge gains found significantly higher gains in the eLearning intervention groups compared to traditional learning, whereas 21 did not detect significant differences or found mixed results. One study did not test for differences. Eight studies detected significantly higher skill gains in the eLearning intervention groups, whilst the other 5 testing skill gains did not detect differences between groups. No study found offline eLearning as inferior. Generally no differences in attitudes or preference of eLearning over traditional learning were observed. No clear trends were found in the comparison of different modes of eLearning. Most of the studies were small and subject to several biases.

CONCLUSIONS

Our results suggest that offline eLearning is equivalent and possibly superior to traditional learning regarding knowledge, skills, attitudes and satisfaction. Although a robust conclusion cannot be drawn due to variable quality of the evidence, these results justify further investment into offline eLearning to address the global health care workforce shortage.

Methods of teaching medical trainees evidence-based medicine: a systematic review

CONTEXT

The principles of evidence-based medicine (EBM) provide clinicians with the ability to identify, source, appraise and integrate research evidence into medical decision making. Despite the mantra of EBM encouraging the use of evidence to inform practice, there appears little evidence available on how best to teach EBM to medical trainees. A systematic review was performed to identify what type of educational method is most effective at increasing medical trainees' competency in EBM.

METHODS

A systematic review of randomised controlled trials (RCTs) was performed. Electronic searches were performed across three databases. Two reviewers independently searched, extracted and reviewed the articles. The quality of each study was assessed using the Cochrane Collaboration's risk of bias assessment tool.

RESULTS

In total, 177 citations were returned, from which 14 studies were RCTs and examined for full text. Nine of the studies met the inclusion criteria and were included in this review. Learner competency in EBM increased post-intervention across all studies. However, no difference in learner outcomes was identified across a variety of educational modes, including lecture versus online, direct versus self-directed, multidisciplinary versus discipline-specific groups, lecture versus active small group facilitated learning.

CONCLUSIONS

The body of evidence available to guide educators on how to teach EBM to medical trainees is small, albeit of a good quality. The major limitation in assessing risk of bias was the inability to blind participants to an educational intervention and lack of clarity regarding certain aspects within studies. Further evidence, and transparency in design, is required to guide the development and implementation of educational strategies in EBM, including modes of teaching and the timing of delivering EBM content within the broader medical curriculum. Further research is required to determine the effects of timing, content and length of EBM courses and teaching methods.

Adopting a blended learning approach to teaching evidence based medicine: a mixed methods study

BACKGROUND

Evidence Based Medicine (EBM) is a core unit delivered across many medical schools. Few studies have investigated the most effective method of teaching a course in EBM to medical students. The objective of this study was to identify whether a blended-learning approach to teaching EBM is more effective a didactic-based approach at increasing medical student competency in EBM.

METHODS

A mixed-methods study was conducted consisting of a controlled trial and focus groups with second year graduate medical students. Students received the EBM course delivered using either a didactic approach (DID) to learning EBM or a blended-learning approach (BL). Student competency in EBM was assessed using the Berlin tool and a criterion-based assessment task, with student perceptions on the interventions assessed qualitatively.

RESULTS

A total of 61 students (85.9%) participated in the study. Competency in EBM did not differ between the groups when assessed using the Berlin tool (p = 0.29). Students using the BL approach performed significantly better in one of the criterion-based assessment tasks (p = 0.01) and reported significantly higher self-perceived competence in critical appraisal skills. Qualitative analysis identified that students had a preference for the EBM course to be delivered using the BL approach.

CONCLUSIONS

Implementing a blended-learning approach to EBM teaching promotes greater student appreciation of EBM principles within the clinical setting. Integrating a variety of teaching modalities and approaches can increase student self-confidence and assist in bridging the gap between the theory and practice of EBM.

Effectiveness of national evidence-based medicine competition in Taiwan

BACKGROUND

Competition and education are intimately related and can be combined in many ways. The role of competition in medical education of evidence-based medicine (EBM) has not been investigated. In order to enhance the dissemination and implementation of EBM in Taiwan, EBM competitions have been established among healthcare professionals. This study was to evaluate the impact of competition in EBM learning.

METHODS

The EBM competition used PICO (patient, intervention, comparison, and outcome) queries to examine participants' skills in framing an answerable question, literature search, critical appraisal and clinical application among interdisciplinary teams. A structured questionnaire survey was conducted to investigate EBM among participants in the years of 2009 and 2011. Participants completed a baseline questionnaire survey at three months prior to the competition and finished the same questionnaire right after the competition.

RESULTS

Valid questionnaires were collected from 358 participants, included 162 physicians, 71 nurses, 101 pharmacists, and 24 other allied healthcare professionals. There were significant increases in participants' knowledge of and skills in EBM (p<0.001). Their barriers to literature searching and forming answerable questions significantly decreased (p<0.01). Furthermore, there were significant increases in their access to the evidence-based retrieval databases, including the Cochrane Library (p<0.001), MD Consult (p<0.001), ProQuest (p<0.001), UpToDate (p=0.001), CINAHL (p=0.001), and MicroMedex (p=0.024).

CONCLUSIONS

The current study demonstrates a method that successfully enhanced the knowledge of, skills in, and behavior of EBM. The data suggest competition using PICO queries may serve as an effective way to facilitate the learning of EBM.

Critical appraisal training increases understanding and confidence and enhances the use of evidence in diverse categories of learners

BACKGROUND

Training in evidence-based medicine is most commonly offered to physicians, medical students and health-care decision-makers.

SETTING AND PARTICIPANTS

We partnered with community organizations to recruit participants and develop trainings for consumers, non-physician health-care providers and journalists in California.

INTERVENTION

We conducted half-day and one-day workshops in critical appraisal of health evidence. Workshops consisted of didactic presentations, small-group practice sessions and class discussions.

OUTCOME MEASURES

We measured knowledge and confidence immediately before and after the workshops and at follow-up 6 months later. We also asked participants to describe their use of health evidence before the workshops and at follow-up.

RESULTS

At baseline, 41% of the consumers, 45% of the providers and 57% of the journalists correctly answered questions about health evidence. Scores increased by about 20% (P < 0.05) in all groups at the end of the workshops and remained significantly over baseline at follow-up. At baseline, 26% of the participants were confident in their understanding of critical appraisal concepts, significantly increasing to 54% after the workshops and sustained (53%) at follow-up. During discussions, participants' comments often focused on funding and the potential effects of financial conflicts of interest on study findings. Participants did not use evidence more frequently at follow-up but said that they applied workshop skills in evaluating research, communicating with others and making decisions about health care.

CONCLUSION

It is possible to successfully conduct critical appraisal workshops to aid health-related decision making for groups who have previously not had access to this kind of training.

Longitudinal teaching of evidence-based decision making

OBJECTIVE

To determine whether longitudinal design and delivery of evidence-based decision making (EBDM) content was effective in increasing students' knowledge, skills, and confidence as they progressed through a doctor of pharmacy (PharmD) curriculum.

DESIGN

Three student cohorts were followed from 2005 to 2009 (n=367), as they learned about EBDM through lectures, actively researching case-based questions, and researching and writing answers to therapy-based questions generated in practice settings.

ASSESSMENT

Longitudinal evaluations included repeated multiple-choice examinations, confidence surveys, and written answers to practice-based questions (clinical inquiries). Students' knowledge and perception of EBDM principles increased over each of the 3 years. Students' self-efficacy (10-items, p<0.0001) and perceived skills (7-items, p<0.0001) in applying EBDM skills to answer practice-based questions also increased. Graded clinical inquiries verified that students performed satisfactorily in the final 2 years of the program.

CONCLUSIONS

This study demonstrated a successful integration of EBDM throughout the curriculum. EBDM can effectively be taught by repetition, use of real examples, and provision of feedback.

Teaching of evidence-based medicine to medical students in Mexico: a randomized controlled trial

BACKGROUND

Evidence-Based Medicine (EBM) is an important competency for the healthcare professional. Experimental evidence of EBM educational interventions from rigorous research studies is limited. The main objective of this study was to assess EBM learning (knowledge, attitudes and self-reported skills) in undergraduate medical students with a randomized controlled trial.

METHODS

The educational intervention was a one-semester EBM course in the 5th year of a public medical school in Mexico. The study design was an experimental parallel group randomized controlled trial for the main outcome measures in the 5th year class (M5 EBM vs. M5 non-EBM groups), and quasi-experimental with static-groups comparisons for the 4th year (M4, not yet exposed) and 6th year (M6, exposed 6 months to a year earlier) groups. EBM attitudes, knowledge and self-reported skills were measured using Taylor's questionnaire and a summative exam which comprised of a 100-item multiple-choice question (MCQ) test.

RESULTS

289 Medical students were assessed: M5 EBM=48, M5 non-EBM=47, M4=87, and M6=107. There was a higher reported use of the Cochrane Library and secondary journals in the intervention group (M5 vs. M5 non-EBM). Critical appraisal skills and attitude scores were higher in the intervention group (M5) and in the group of students exposed to EBM instruction during the previous year (M6). The knowledge level was higher after the intervention in the M5 EBM group compared to the M5 non-EBM group (p<0.001, Cohen's d=0.88 with Taylor's instrument and 3.54 with the 100-item MCQ test). M6 Students that received the intervention in the previous year had a knowledge score higher than the M4 and M5 non-EBM groups, but lower than the M5 EBM group.

CONCLUSIONS

Formal medical student training in EBM produced higher scores in attitudes, knowledge and self-reported critical appraisal skills compared with a randomized control group. Data from the concurrent groups add validity evidence to the study, but rigorous follow-up needs to be done to document retention of EBM abilities.

Assisting undergraduate nursing students to learn evidence-based practice through self-directed learning and workshop strategies during clinical practicum

To equip undergraduate nursing students with basic knowledge and skills and foster positive attitudes toward evidence-based practice (EBP), a pilot learning program during their clinical practicum was developed in a teaching hospital in China. This article describes the specific learning process through which self-directed learning and workshop strategies were used, and a pre- and post-intervention survey were conducted to evaluate the effectiveness of the learning strategies. The findings show a significant improvement in their perceptions of EBP knowledge, attitudes and beliefs, and behavior levels. Beginning competencies in EBP were achieved. Participants reported great satisfaction and have found this program helpful in promoting their analytical and problem-solving abilities, independent learning ability, and cooperative and communication abilities as well.

Engaging and developing research leaders in practice: creating a foundation for a culture of clinical inquiry

This article describes the first formative year experience of a research council in a children's hospital within a Magnet-designated hospital system. The vision, transformational leadership structure, and implementation strategies used during the first year of formation of a Nursing Research and Evidence-Based Practice Council (NREBPC) are delineated and reflect Magnet components and sources of evidence (American Nurses Credentialing Center [ANCC], 2008). The use of the nursing excellence framework (ANCC, 2008) coupled with principles of adult learning to expand the knowledge and skills of nurses on the NREBPC are described and examples provided. Initial outcomes in terms of nurses' leadership for research studies and planned documentation of additional metrics that have the potential to improve care through the development of a culture of inquiry are proposed.

A multi-professional evidence-based practice course improved allied health students' confidence and knowledge

PURPOSE

To evaluate the effectiveness of a semester-long multi-professional university course teaching evidence-based practice principles to allied health students in terms of changes in attitudes, confidence, and perceived and actual knowledge regarding evidence-based practice.

METHODS

This was a pre-post study of allied health students who completed a multi-professional university course that taught evidence-based practice skills and concepts. The course was run over a 13-week period (2 hours per week) and utilized didactic lectures, tutorial and workshop formats, and a hands-on database searching session. Participants completed a questionnaire which assessed their attitudes, confidence, and perceived and actual knowledge regarding evidence-based practice on the first and last day of the course.

RESULTS

Ninety-one students participated in the study; however, complete data sets were available for only 59 participants. Attitudes towards evidence-based practice did not significantly improve; however, attitudes were already positive prior to undertaking the course. There was a statistically significant improvement in confidence with a mean increase of 9.02 [score range 6-30, 95% confidence interval (CI) 8.21, 9.82]. Perceived knowledge improved with a statistically significant mean increase of 14.15 (score range 5-25, 95% CI 12.55, 15.75) and there was a statistically significant mean increase in actual knowledge of 3.56 (score range 0-10, 95% CI 2.83, 4.29).

CONCLUSIONS

Teaching evidence-based practice skills and concepts to allied health students within a multi-professional university curriculum improved confidence and perceived and actual knowledge regarding evidence-based practice. Further research is needed to determine if these changes result in long-term behaviour change once students graduate, and to consider optimal methods for multi- and interprofessional delivery of evidence-based practice training.

International web survey of chiropractic students about evidence-based practice: a pilot study

BACKGROUND

Positive attitude toward evidence-based practice (EBP) principles in healthcare education may be one of the first steps for motivating a healthcare professional student to later apply EBP principles in clinical decision-making. The objectives for this project were to pilot an international web-based survey of chiropractic students and to describe student attitudes, behaviors, and knowledge about EBP principles.

METHODS

We used SurveyMonkey™ to develop our survey based on an existing questionnaire used to measure basic knowledge, skills and beliefs about EBP among allied healthcare professionals and CAM practitioners. We invited 26 chiropractic educational institutions teaching in English and accredited by official organizations to participate. Academic officials and registrars at participating institutions forwarded an invitation email and two reminders to students between July and September 2010. The invitation contained a link to the 38-item web-based questionnaire. Descriptive statistics were performed for analysis.

RESULTS

Fourteen institutions from Australia, Canada, US, Denmark and New Zealand participated. Among an estimated 7,142 student recipients of invitation letters, 674 participated in the survey for an estimated response rate of 9.4%. Most respondents reported having access to medical/healthcare literature through the internet, but only 11% read literature every week and 21% did not read literature at all. Respondents generally agreed that the use of research evidence in chiropractic was important. Although 76% of respondents found it easy to understand research evidence and 81% had some level of confidence assessing the general worth of research articles, 71% felt they needed more training in EBP to be able to apply evidence in chiropractic care. Respondents without previous training in research methods had lower confidence in assessing published papers. While more than 60% marked the correct answer for two knowledge items, the mean number of correct answers to the five knowledge questions was 1.3 (SD 0.9).

CONCLUSIONS

Although it is feasible to conduct an international web survey of chiropractic students, significant stakeholder participation is important to improve response rates. Students had relatively positive attitudes toward EBP. However, participants felt they needed more training in EBP and based on the knowledge questions they may need further training about basic research concepts.

The effectiveness of self-directed learning in health professions education: a systematic review

OBJECTIVES

Given the continuous advances in the biomedical sciences, health care professionals need to develop the skills necessary for life-long learning. Self-directed learning (SDL) is suggested as the methodology of choice in this context. The purpose of this systematic review is to determine the effectiveness of SDL in improving learning outcomes in health professionals.

METHODS

We searched MEDLINE, EMBASE, ERIC and PsycINFO through to August 2009. Eligible studies were comparative and evaluated the effect of SDL interventions on learning outcomes in the domains of knowledge, skills and attitudes. Two reviewers working independently selected studies and extracted data. Standardised mean difference (SMD) and 95% confidence intervals (95% CIs) were estimated from each study and pooled using random-effects meta-analysis.

RESULTS

The final analysis included 59 studies that enrolled 8011 learners. Twenty-five studies (42%) were randomised. The overall methodological quality of the studies was moderate. Compared with traditional teaching methods, SDL was associated with a moderate increase in the knowledge domain (SMD 0.45, 95% CI 0.23-0.67), a trivial and non-statistically significant increase in the skills domain (SMD 0.05, 95% CI-0.05 to 0.22), and a non-significant increase in the attitudes domain (SMD 0.39, 95% CI-0.03 to 0.81). Heterogeneity was significant in all analyses. When learners were involved in choosing learning resources, SDL was more effective. Advanced learners seemed to benefit more from SDL.

CONCLUSIONS

Moderate quality evidence suggests that SDL in health professions education is associated with moderate improvement in the knowledge domain compared with traditional teaching methods and may be as effective in the skills and attitudes domains.

Physician numeracy as the basis for an evidence-based medicine curriculum

Most medical schools and postgraduate programs devote some time to teaching evidence-based medicine (EBM). EBM encompasses five essential skills, including constructing a sound clinical question, literature searching, critical appraisal, gaining a full understanding of study results, and integration of results into patient care. Gaining a full understanding of results requires understanding the statistical aspects of and terminology associated with the design, analysis, and results of original research--hereby referred to as physician numeracy. Physicians and physicians-in-training recognize the importance of these concepts but are uncomfortable with and demonstrate poor knowledge of the quantitative aspects of research. This is not surprising since few curricula include physician numeracy. Current approaches to teaching EBM rely on journal clubs, which have not been shown to improve participants' self-perceived EBM skills. In this paper we describe a novel approach to teaching EBM which makes use of five guiding principles: (1) Journal clubs have important limitations, (2) understanding the quantitative aspects of research promotes an in-depth understanding of papers, (3) physician numeracy can form the basis of an EBM course, (4) consumers of original research ought to determine what is useful about a paper rather than whether or not it is useful, and (5) numeracy should encompass only those concepts needed to accurately interpret evidence and apply it to individual patients. An EBM curriculum based on physician numeracy is described, together with the challenges inherent to this approach.

Undergraduate medical student perceptions and use of Evidence Based Medicine: a qualitative study

BACKGROUND

Many medical schools teach the principles of Evidence Based Medicine (EBM) as a subject within their medical curriculum. Few studies have explored the barriers and enablers that students experience when studying medicine and attempting to integrate EBM in their clinical experience. The aim of this study was to identify undergraduate medical student perceptions of EBM, including their current use of its principles as students and perceived future use as clinicians.

METHODS

Third year medical students were recruited via email to participate in focus group discussions. Four focus groups were conducted separately across four hospital sites. All focus groups were conducted by the same facilitator. All discussions were transcribed verbatim, and analysed independently by the two authors according to the principles of thematic analysis.

RESULTS

Focus group discussions were conducted with 23 third-year medical students, representing three metropolitan and one rural hospital sites. Five key themes emerged from the analysis of the transcripts: (1) Rationale and observed use of EBM in practice, (2) Current use of EBM as students, (3) Perceived use of EBM as future clinicians, (4) Barriers to practicing EBM, and (5) Enablers to facilitate the integration of EBM into clinical practice. Key facilitators for promoting EBM to students include competency in EBM, mentorship and application to clinical disciplines. Barriers to EBM implementation include lack of visible application by senior clinicians and constraints by poor resourcing.

CONCLUSIONS

The principles and application of EBM is perceived by medical students to be important in both their current clinical training and perceived future work as clinicians. Future research is needed to identify how medical students incorporate EBM concepts into their clinical practice as they gain greater clinical exposure and competence.

Integrating evidence based medicine into undergraduate medical education: combining online instruction with clinical clerkships

BACKGROUND

Incorporation of evidence based medicine into the undergraduate curriculum varies from school to school. The purpose of this study was to determine if an online course in evidence based medicine run concurrently with the clinical clerkships in the 3rd year of undergraduate medical education provided effective instruction in evidence based medicine (EBM).

DESCRIPTION

During the first 18 weeks of the 3rd year, students completed 6 online, didactic modules. Over the next 24 weeks, students developed questions independently from patients seen during clerkships and then retrieved and appraised relevant evidence. Online, faculty mentors reviewed student assignments submitted throughout the course to monitor progress. Mastery of the skills of EBM was assessed prior to and at the conclusion of the course using the Fresno test of competency.

EVALUATION

Paired data were available from 139 students. Postcourse test scores (M= 77.7; 95% CI = 59-96.4) were significantly higher than precourse scores (M= 66.6; 95% CI = 46.5-86.7), p< .001. Paired evaluations demonstrated an average improvement of 11.1 +/- 20.0 points. All of the students submitted 4 independently derived questions and successfully retrieved and appraised evidence.

CONCLUSIONS

Medical students successfully acquired and independently applied EBM skills following extended, online, faculty mentored instruction. This method of instruction provided uniform instruction across geographic sites and medical specialties and permitted efficient use of faculty time.

Teaching paediatric epilepsy to medical students: A randomised crossover trial

AIM

Research has shown computerised tutorial to be as effective as face-to-face teaching in promoting knowledge acquisition. Subsequently, the clinician must synthesise and interpret data (clinical reasoning). This study extends previous research and compares the effectiveness of interactive lecture and computerised tutorial in promoting observational skills and clinical reasoning in the evaluation of paroxysmal events.

METHODS

The modalities were compared through a randomised crossover trial teaching epilepsy to third and fourth year medical students. The content matter (history and video clip) and format were identical for each topic (Topic 1: altered awareness, Topic 2: movement and posturing) in both modalities (interactive lecture and computerised tutorial). Structured worksheets promoted and evaluated skills of observation and clinical reasoning. Responses in both domains were compared with gold standard qualitative scores. Participants rated modality preference and perceptions of teaching.

RESULTS

One-hundred and fifty-seven medical students participated. Interactive lecture and computerised tutorial were both effective in promoting observational skills and clinical reasoning with no differences between modalities. Participants preferred the interactive lecture and rated it more enjoyable and effective. Twenty-five participants randomised to the computerised tutorial for Topic 1, elected to withdraw participation. Both modalities promoted interest and willingness to further learn.

CONCLUSION

This is the first randomised crossover trial evaluating the teaching of clinical reasoning in comparative medical education research. Interactive lecturing and computerised tutorial were both effective in teaching observational skills and clinical reasoning. Interactive lecture is the preferred method, and may influence initial engagement in learning.

A randomised-controlled trial of two educational modes for undergraduate evidence-based medicine learning in Asia

BACKGROUND

As the overall evidence for the effectiveness of teaching of evidence based medicine (EBM) is not strong, and the impact of cultural and societal influences on teaching method is poorly understood, we undertook a randomised-controlled trial to test the effectiveness and learning satisfaction with two different EBM teaching methods (usual teaching vs. problem based learning (PBL)) for undergraduate medical students.

METHODS

A mixed methods study that included a randomised-controlled crossover trial with two intervention arms (usual teaching and PBL) and a nested qualitative study with focus groups to explore student perceptions of learning and to assess the effectiveness and utility of the two teaching methods.All 129 second-year medical students at the University of Hong Kong in 2007.The main outcomes measures were attitudes towards EBM; personal application and current use of EBM; EBM knowledge; future use of EBM.

RESULTS

PBL was less effective at imparting knowledge than usual teaching consisting of a lecture followed by a group tutorial. After usual teaching students showed improvement in scores for 'attitudes towards EBM', 'personal application and current use of EBM' and 'EBM knowledge, which were not evident after PBL. In contrast to the usual teaching, students found PBL difficult as they lacked the statistical knowledge necessary to support discussion, failed to understand core concepts, and lost direction.

CONCLUSION

The evidence presented here would suggest that the teaching of EBM within an Asian environment should adopt a format that facilitates both the acquisition of knowledge and encourages enquiry.

Development and validation of a questionnaire to evaluate medical students' evidence-based medicine competencies

PURPOSE

The purpose of the study was to develop and validate a questionnaire to evaluate medical students' knowledge of, attitude towards and practice of evidence-based medicine (EBM).

METHODS

The participants of the study were 418 medical students enrolled in the Kyung Hee University School of Medicine in Seoul, Korea. To examine construct validity of the questionnaire, an exploratory factor analysis (EFA) was performed with 118 participants; a confirmatory factor analysis (CFA) was conducted with the remaining 281 participants. We developed 41 items with a 4-point Likert scale. An EFA was performed to verify the emergence of four dimensions of EBM competencies. The principal axis factoring method and the direct oblimin rotation method were used. To confirm construct validity, a CFA was conducted with the remaining 281 participants. To evaluate model fitness, root mean square error of approximation (RMSEA) and comparative fit index (CFI) were used as fit indices. We conducted ANOVA with Scheffe as discriminant validation, and calculated Cronbach's alpha of 4 subscales as reliability checkup.

RESULTS

After refinement procedure, factor analysis of the 32 items in therevised questionnaire yielded 4 factors. The Scree plot supported a 4 factor solution explaining 53.5% of the variance. The 4 components derived were: factor 1_knowledge on EBM (11 items; Cronbach's alpha=0.92); factor 2_ pursuit towards EBM (10; 0.88); factor 3_reluctance on EBM (7; 0.78); factor 4_practice of EBM (4; 0.75). The questionnaire could discriminate competence differences among 1-3 yr students. Satisfactory Cronbach's alpha scores were noted for each factor as well.

CONCLUSION

The EBM competency questionnaire was validated.

Teaching Evidence-based Practice: Perspectives from the Undergraduate and Post-graduate Viewpoint

Introduction: Evidence-based practice (EBP) involves making clinical decisions informed by the most relevant and valid evidence available. It has been suggested that the outcomes of teaching EBP skills may differ between undergraduates and post-graduates due to different determinants in learning. This paper reviews the current literature and discusses the impact of the teaching environment (undergraduate or post-graduate) for teaching EBP and its impact on EBP competency. Methods: A search of the literature was performed across the MEDLINE, CINAHL, PsychInfo and ERIC databases. Randomised controlled trials (RCTs) and non-randomised trials were eligible for inclusion in the paper. Studies were included for review if they explored the impact of teaching on participants’ EBP competency, consisting of critical appraisal skills, knowledge and/or behaviour. Results: Ten articles were eligible for inclusion for this review, of which 7 met all inclusion criteria. EBP competency was shown to increase regardless of whether EBP is delivered to medical students at an undergraduate or post-graduate level. EBP taught to a non-medical undergraduate audience did not modify participants’ EBP competency. No study directly compared teaching EBP to an undergraduate and post-graduate audience. Conclusions: Given the limited amount of studies included in this review, further research incorporating high- level methodologies is required to establish a clear recommendation on the research question. Key words: Competency-based education, Evidence-based practice, Graduate medical educa- tion, Undergraduate medical education

Evaluation of different delivery modes of an interactive e-learning programme for teaching cultural diversity

OBJECTIVE

UK medical schools find it challenging to provide standardised teaching to expanding year intakes. In addition, developing and implementing diversity training can cause difficulties. This paper describes the evaluation of an interactive e-learning programme to raise awareness and understanding of communication difficulties in diversity consultations.

METHODS

The programme was part of an undergraduate portfolio-based community module. Three hundred and two students were assigned to one of three delivery methods--a large group setting, small groups with a facilitator, and as part of distance learning while on community placement. The evaluation included analysis of their coursework marks, a self-completed evaluation questionnaire, and small group discussions.

RESULTS

Two hundred and twenty-three students took part in the evaluation. They were able to apply the concepts they learnt to clinical examples from their own experiences. Type of delivery did not affect coursework marks, but students tended to prefer the e-learning as part of a distance learning package. They offered helpful suggestions to improve its complexity and range.

CONCLUSION

The acceptability and utility of this e-learning module both in face to face teaching and remote placement has been demonstrated, and evaluation by the students has provided valuable information for its further development.

PRACTICE IMPLICATIONS

All medical schools should include some diversity training, and further research should concentrate on the effects of this type of learning on longer term outcomes such as attitude and performance tests. Such tools could reduce demands on staff time in facilitation of small groupwork, and their cost effectiveness could be increased by making them available to other medical schools.

Teaching doctors how to diagnose paroxysmal events: a comparison of two educational methods

OBJECTIVES

Two educational methods, facilitated case discussion and a computerised tutorial, were compared for teaching about childhood epilepsy. We used a comprehensive and clinically relevant assessment method to evaluate the hypothesis that a computerised tutorial more effectively increases knowledge acquisition than a facilitated case discussion.

METHODS

Paediatric trainees (n = 66) were arbitrarily allocated to facilitated case discussion or computerised tutorial. The analysis of paroxysmal events was taught by the same teacher, using a standardised protocol and principles of active learning. Outcome measures included knowledge acquisition, clinical confidence and usefulness pre- and post-teaching, and at 3 months follow-up.

RESULTS

Computerised tutorial participants scored significantly higher on knowledge acquisition post-teaching. There was gain in clinical confidence in both modalities post-teaching which did not differ between the groups. Confidence and knowledge were not related post-teaching. Both groups found the teaching relevant to clinical practice. However, facilitated case discussion participants rated the session as more enjoyable, and more useful in reinforcing and acquiring knowledge, and felt more motivated for further learning. At 3 months follow-up, participants in both modalities showed significant increases in knowledge acquisition, with no difference between modalities.

CONCLUSIONS

The computerised tutorial more effectively imparted knowledge immediately post-teaching. However, facilitated case discussion is the preferred modality in terms of participant enjoyment and perceived usefulness.

Self-directed Learning in Health Professions Education

Introduction: Self-directed learning has been recommended as a promising methodology for lifelong learning in medicine. However, the concept of self-directed learning continues to be elusive, with students and educators finding difficulty in defining it and agreeing on its worth. Methods: In this paper we review the literature of self-directed learning in health professions education and present a framework based on Malcolm Knowles’ key components of self-directed learning. Results: The key components of self-directed learning are: the educator as a facilitator, identification of learning needs, development of learning objectives, identification of appropriate resources, implementation of the process, commitment to a learning contract and evaluation of learning. Several but not all of these components are often described in the published literature. Conclusion: Although the presented framework provides some consistency for educators interested in applying SDL methods, future studies are needed to standardise self-directed learning curricula and to determine the effectiveness of these components on educational outcomes. Key words: Independent study, Medical education, Self-assessment, Self-directed learning, Selfeducation

Comparison of a web-based package with tutor-based methods of teaching respiratory medicine: subjective and objective evaluations

BACKGROUND

Respiratory disease is a major cause of morbidity and mortality not only in the United Kingdom, but globally. A good understanding of respiratory disease and its treatment is essential for all medical graduates. As a result of changes in clinical practice, patients with some common respiratory illnesses are less often admitted to hospital, restricting the experience available to undergraduate students. Combined with a potential shortage of clinical teachers, this means that new methods of teaching need to be developed and appraised. The aim of this study was to establish whether a web-based package on the diagnosis of respiratory disease would be as effective and as acceptable to final year medical students as tutor-led methods of teaching the same material.

METHODS

137 out of 315 final year undergraduate students in a single medical school volunteered to take part. Each received up to two hours of tutor-lead interactive, tutor-lead didactic or electronic, Web-based teaching on the accurate diagnosis and management of respiratory disease. Post teaching performance was assessed by multiple true/false questions and data interpretation exercises, whilst students' teaching preferences were assessed by questionnaire.

RESULTS

Despite a high knowledge baseline before the study, there was a small, but statistically significant increase in knowledge score after all forms of teaching. Similarly, data interpretation skills improved in all groups, irrespective of teaching format, Although paradoxically most students expressed a preference for interactive tutor-lead teaching, spirometry interpretation in those receiving web-based teaching improved significantly more [p = 0.041] than in those in the interactive group.

CONCLUSION

Web-based teaching is at least as good as other teaching formats, but we need to overcome students' reluctance to engage with this teaching method.

Evidence-based Medicine in Clinical Curriculum

Introduction: The teaching of evidence-based medicine (EBM) has now been incorporated as an integral part of medical curriculum at the Faculty of Medicine, Ramathibodi Hospital but there is little research into the effectiveness of the course. The purpose of this report is to evaluate the EBM skills of medical students and competency of the faculty member. Materials and Methods: The EBM course was created by the EBM Working Group at the Faculty of Medicine, Ramathibodi Hospital for 3rd- to 6th-year medical students. The principles of EBM, clinical epidemiology and biostatistics were gradually instilled during the 4 years of medical school. Information technology infrastructure was also provided to facilitate critical appraisal skills. At the end of the Community Medicine clerkship, students anonymously evaluated aspects of the course regarding their EBM skills and faculty member competency with Likert scale questions. Results: Medical students generally gave high evaluations to all aspects of the EBM course taught in the Community Medicine Department. For each of the evaluation questions, the means were higher for faculty member competency. Conclusions: The teaching of EBM course at the Faculty of Medicine, Ramathibodi Hospital is useful for medical students to enhance their critical thinking skills, and they seem to value the sessions positively. Key words: Community Medicine, Critical thinking skill, Evaluation, Medical curriculum