A survey to determine the prevalence and characteristics of training in Evidence-Based Medicine in emergency medicine residency programs

Effectiveness of Journal Club Presentation as a Learning Modality in the Endocrinology and Endocrine Surgery Module in an Integrative Undergraduate Medical Curriculum

Introduction

The journal club is widely used in most postgraduate programs of medical institutes; however, the use of journal clubs in undergraduate medical programs is nearly absent or very rare.

Aim

The aim of this work is to document the insertion of the journal club as a method for learning in the undergraduate starting with the endocrinology/endocrine surgery module to be fully implemented in all modules of the MBBS of FMBU. In addition, the study aimed to outline the steps of designing a journal club by following specific procedures and Identification of students' and faculty satisfaction through 5-years implementation of the journal club.

Material and Methods

A total of 453 students representing the five consecutive batches of medical students from 2019 to 2023 who studied the endocrinology/endocrine surgery module were entered into the study. Following guidelines for implementation of the journal clubs that were adopted by the quality and accreditation committee, the faculty select the types of papers from the articles chosen by students. The papers discussed were case reports, original research, and review articles. The students were asked to formulate critical appraisal topics, PICO, for each paper. A 20-question test was applied to all participants. The students' attendance, scores, and students/faculty satisfaction were estimated.

Results

A total of 50 papers were discussed in the 5-year journal club 15 case reports (30%), 26 original research (52%), and 9 review articles (18%). The student's attendance ranged from 72.53±3.74 to 98.07±3.15. The students and faculty's satisfaction were 3.52 and 3.82 respectively. The mean Students' score in A 20-question test in a 5-year journal club was 76.93 ± 9.78 and the lowest score was in the 2nd batch (online batch).

Conclusion

The insertion of a well-structured journal club in the undergraduate medical program is necessary to improve the knowledge including knowledge among students. In addition, journal clubs inspire students to be lifelong learners.

Influence of research evidence on the use of cardiovascular clinical prediction rules in primary care: an exploratory qualitative interview study

BACKGROUND

Cardiovascular clinical prediction rules (CPRs) are widely used in primary care. They accumulate research evidence through derivation, external validation, and impact studies. However, existing knowledge about the influence of research evidence on the use of CPRs is limited. Therefore, we explored how primary care clinicians' perceptions of and experiences with research influence their use of cardiovascular CPRs.

METHODS

We conducted an exploratory qualitative interview study with thematic analysis. Primary care clinicians were recruited from the WWAMI (Washington, Wyoming, Alaska, Montana and Idaho) region Practice and Research Network (WPRN). We used purposeful sampling to ensure maximum variation within the participant group. Data were collected by conducting semi-structured online interviews. We analyzed data using inductive thematic analysis to identify commonalities and differences within themes.

RESULTS

Of 29 primary care clinicians who completed the questionnaire, 15 participated in the interview. We identified two main themes relating to the influence of clinicians' perceptions of and experiences with cardiovascular CPR research on their decisions about using cardiovascular CPRs: "Seek and judge" and "be acquainted and assume." When clinicians are familiar with, trust, and feel confident in using research evidence, they might actively search and assess the evidence, which may then influence their decisions about using cardiovascular CPRs. However, clinicians, who are unfamiliar with, distrust, or find it challenging to use research evidence, might be passively acquainted with evidence but do not make their own judgment on the trustworthiness of such evidence. Therefore, these clinicians might not rely on research evidence when making decisions about using cardiovascular CPRs.

CONCLUSIONS

Clinicians' perceptions and experiences could influence how they use research evidence in decisions about using cardiovascular CPRs. This implies, when promoting evidence-based decisions, it might be useful to target clinicians' unfamiliarity, distrust, and challenges regarding the use of research evidence rather than focusing only on their knowledge and skills. Further, because clinicians often rely on evidence-unrelated factors, guideline developers and policymakers should recommend cardiovascular CPRs supported by high-quality evidence.

Pain Medicine Education in Emergency Medicine Residency Programs

Background Pain is a common complaint in the emergency department (ED), yet there is a lack of robust pain curricula in emergency medicine (EM) residency programs. In this study, we investigated pain education in EM residencies and various factors related to educational development. Methodology This was a prospective study collecting online survey results sent to Program Directors, Associate Program Directors, and Assistant Program Directors of EM residencies in the United States. Descriptive analyses with nonparametric tests were performed to investigate relationships between these factors, including educational hours, level of educational collaboration with pain medicine specialists, and multimodal therapy utilization. Results The overall individual response rate was 39.8% (252 out of 634 potential respondents), representing 164 out of 220 identified EM residencies with 110 (50%) Program Directors responding. Traditional classroom lectures were the most common modality for the delivery of pain medicine content. EM textbooks were the most common resource utilized for curriculum development. An average of 5.7 hours per year was devoted to pain education. Up to 46.8% of respondents reported poor or absent educational collaboration with pain medicine specialists. Greater collaboration levels were associated with greater hours devoted to pain education (p = 0.01), perceived resident interest in acute and chronic pain management education (p < 0.001), and resident utilization of regional anesthesia (p = <0.01). Faculty and resident interest in acute and chronic pain management education were similar to each other and high on the Likert scale, with higher scores correlating to greater hours devoted to pain education (p = 0.02 and 0.01, respectively). Faculty expertise in pain medicine was rated the most important factor in improving pain education in their programs. Conclusions Pain education is a necessity for residents to adequately treat pain in the ED, but remains challenging and undervalued. Faculty expertise was identified as a factor limiting pain education among EM residents. Collaboration with pain medicine specialists and recruitment of EM faculty with expertise in pain medicine are ways to improve pain education of EM residents.

Evidence-Based Medicine Training in United States-Based Physiatry Residency Programs

ABSTRACT

Although the physiatric community increasingly embraces evidence-based medicine (EBM), the current state of EBM training for trainees in physiatry is unclear. The purposes of this article are to report the results of the Association of Academic Physiatrists' surveys of physiatry residency programs in the United States, to discuss the implications of their findings, and to better delineate the "baseline" upon which sound and clear recommendations for systematic EBM training can be made. The two Association of Academic Physiatrists surveys of US physiatry residency programs reveal that most survey respondents report that they include EBM training in their programs that covers the five recommended steps of EBM core competencies. However, although most respondents reported using traditional pedagogic methods of training such as journal club, very few reported that their EBM training used a structured and systematic approach. Future work is needed to support and facilitate physiatry residency programs interested in adopting structured EBM training curricula that include recommended EBM core competencies and the evaluation of their impact.

Emergency physicians' perceptions of critical appraisal skills: a qualitative study

BACKGROUND

Critical appraisal of medical research is a valuable skill set that emergency physicians must learn in order to become competent clinicians. Despite the need for effective critical appraisal skills training, these skills have remained difficult to teach and assess. This study aimed to explore emergency physicians' perceptions of the barriers and motivations for learning critical appraisal skills in order to develop more successful critical appraisal training methods for Emergency Medicine (EM) residents.

METHODS

This qualitative study involved in-depth, semi-structured interviews with emergency physicians interested in education and administration at an urban academic hospital. Transcribed interviews were descriptively coded by three main reviewers. A coding template was developed after coding an initial set of interviews and used to code the remaining transcripts. A thematic analysis of the codes was conducted to create a summary report which was given to the interviewees as part of a member checking process to further solidify themes.

RESULTS

Fourteen emergency physicians participated in the study. They described time limitations, perceived difficulty, and disinterest as major barriers to learning critical appraisal. Physicians noted patient care as well as professional identity goals of being a good educator or researcher as motivations for developing critical appraisal skills.

CONCLUSION

There remain significant challenges to learning critical appraisal skills as well as an increasing need to build these skills during residency. Educational theories and a greater emphasis on professional identity formation during residency can be incorporated to create a more effective approach to teaching critical appraisal skills despite these barriers.

The Journal Club 3.0: A qualitative, multisite study examining a new educational paradigm in the era of open educational resources

BACKGROUND

The journal club is a ubiquitous and time-honored tradition within medical education. However, in recent years, open educational resources (OERs) have become increasingly influential in how physicians interact with the medical literature across multiple specialties. The authors sought to explore how emergency medicine (EM) resident physicians reconcile different perspectives across OERs into their educational experience at the journal club.

METHODS

From January 2018 to September 2019, the authors enrolled 25 EM residents from four teaching sites associated with the University of British Columbia, Canada, to participate in either a focus group (seven residents) or individual interviews (18 residents). The authors used a snowball sampling technique. Using a constructivist grounded theory analysis, two investigators independently reviewed transcripts, meeting regularly to discuss themes until sufficiency was achieved.

RESULTS

The study data expand the theoretical understanding of the resident journal club experience. Residents used multiple sources including OERs to learn about new evidence in the specialty. The rise of OERs helped residents to focus on developing critical appraisal skills and social bonds during the journal club. The local journal club gained a new relevancy in acting as a quality control mechanism against the premature adoption of research findings discussed in OERs.

DISCUSSION

To date, most educators assume that residents prepare for a journal club by reading the selected articles and applying knowledge from their previous education. Instead, our findings suggest a more dynamic experience that integrates OERs. OERs enhance the journal club experience by allowing junior residents to more easily participate in discussions and to broaden the discussion to multiple clinical settings. Understanding these processes could inform future educational strategies around the journal club.

Does shifting to professional emergency department staffing affect the decision for chest radiography?

BACKGROUND

The study aims to determine whether shifting to professional emergency department (ED) teams leads to a higher rate of radiologic workup.

METHODS

We retrospectively analyzed a total of 2,000 patients presenting to the ED of a tertiary teaching hospital in two time periods: group 1 (G1) comprised 1,000 consecutive patients enrolled from December 21, 2012 to January 5, 2013 (all patients were examined by an internal medicine specialist); group 2 (G2) comprised 1,000 consecutive patients enrolled from December 21, 2018 to January 3, 2019 (all patients were examined by an emergency physician).

RESULTS

The chest X-ray (CXR) was performed in 40.6% of all patients. There was no difference in the frequency of CXR (38.9% in G1 vs. 42.3% in G2, P=0.152). More CXRs were performed in G2 patients older than 65 years, in female patients older than 65 years, in patients presenting during the evening and night shifts or off-hours, in patients with a history of malignancy, in patients with gastrointestinal bleeding, and in patients with bradycardia, but fewer in patients presenting with arrhythmia. No difference in the rates of pathological CXR was found (47.3% in G1 vs. 52.2% in G2, P=0.186). Compared with G2, higher sensitivity and specificity were obtained for the binary logistic regression model predicting pathological findings in G1.

CONCLUSIONS

Shifting to professional ED teams does not increase radiologic workup. By implementing deliberate usage of ultrasound, some self-governing procedures, case-oriented investigations, and center-specific recommendations, unnecessary radiologic workup can be avoided. Professional ED teams could lead to a higher standard of emergency care.

Appropriateness of Computed Tomography and Ultrasound for Abdominal Complaints in the Emergency Department

OBJECTIVE

The purpose of this study was to evaluate the appropriateness of ultrasound (US) and computed tomography (CT) examinations ordered in the emergency department (ED) for abdominal complaints.

MATERIALS AND METHODS

We reviewed 154 CTs and 154 US orders for appropriateness using evidence-based recommendations by the American College of Radiology. The sample was powered to show a prevalence of inappropriate orders of 25% with a margin of error of 7.5%. Findings in the final reports were compared to the initial clinical diagnosis classified in 4 categories: normal, compatible with initial diagnosis, alternative diagnosis, and inconclusive. We also evaluated the frequency in which a second imaging modality was ordered on the same visit.

RESULTS

A total of 135 CT and 143 US examinations had complete clinical information to allow evaluation of order appropriateness. The rate of inappropriate orders was 36.3% for CT and 84.4% for US. The final report of appropriate orders was significantly more likely to demonstrate findings compatible with the initial diagnosis for both CT (76.7% vs 20.4%, P < 0.0001) and US (38.9% vs 14.4%, P = 0.0093). Inappropriately ordered CT scans were more likely to show no abnormalities (46.9 vs 16.3%, P = 0.0001). An additional imaging order with a secondary modality was requested in 20% of the inappropriate US orders, and 8.2% of the inappropriate CT orders.

CONCLUSION

The prevalence of inappropriate examinations in the ED was 36.3% for CT and 84.4% for US. Appropriately ordered exams were more likely to yield imaging findings compatible with the initial diagnosis for both modalities.

Analysing the literature: A research primer for low- and middle-income countries

Effective critical appraisal of medical research requires training and practice. Evidence-based medicine provides a framework for standardised review of manuscripts of nearly any research design. Online resources and communities exist to provide free access to electronic search engines and critical appraisal of emergency medicine and non-emergency medicine research. An emerging array of Free Online Open Access medical education (FOAMed) resources also provide opportunities to observe Evidence-based medicine critical appraisal in written or audio format and to actively participate as a learner. This chapter will highlight accessible resources that provide both methodological background and virtual mentoring for readers to develop EBM skills.

Evidence-Based Medicine Curriculum Improves Pediatric Emergency Fellows' Scores on In-Training Examinations

OBJECTIVES

The aim of this study was to determine if implementation of our evidence-based medicine (EBM) curriculum had an effect on pediatric emergency medicine fellows' scores on the relevant section of the in-training examination (ITE).

METHODS

We obtained deidentified subscores for 22 fellows over 6 academic years for the Core Knowledge in Scholarly Activities (SA) and, as a balance measure, Emergencies Treated Medically sections. We divided the subscores into the following 3 instruction periods: "baseline" for academic years before our current EBM curriculum, "transition" for academic years with use of a research method curriculum with some overlapping EBM content, and "EBM" for academic years with our current EBM curriculum. We analyzed data using the Kruskal-Wallis test, the Mann-Whitney U test, and multivariate mixed-effects linear models.

RESULTS

The SA subscore median was higher during the EBM period in comparison with the baseline and transition periods. In contrast, the Emergencies Treated Medically subscore median was similar across instruction periods. Multivariate modeling demonstrated that our EBM curriculum had the following independent effects on the fellows' SA subscore: (1) in comparison with the transition period, the fellows' SA subscore was 21 percentage points higher (P = 0.005); and (2) in comparison to the baseline period, the fellows' SA subscore was 28 percentage points higher during the EBM curriculum instruction period (P < 0.001).

CONCLUSIONS

Our EBM curriculum was associated with significantly higher scores on the SA section of the ITE. Pediatric emergency medicine educators could consider using fellows' scores on this section of the ITE to assess the effect of their EBM curricula.

Perceptions, knowledge, and perceived barriers of Yemeni pharmacists and pharmacy technicians towards evidence-based practice

RATIONAL, AIMS, AND OBJECTIVE

The aim of this study was to assess the knowledge and perception towards evidence-based practice (EBP) and identify the perceived barriers to practicing EBP among Yemeni pharmacists and pharmacy technicians.

METHODS

A cross-sectional survey study was carried out among 153 Yemeni pharmacists and pharmacy technicians who are working in hospitals or community pharmacies. This study took place between the 15th of August and the 8th of November 2017 using a self-administered validated questionnaire. The study was approved by the ethics committee/scientific research center of Yemen University, Yemen (Reference number: ERC/2017/103).

RESULTS

Completed questionnaires were received from 153 (46.6% response rate). Most of the respondents showed a positive attitude towards EBP; however, their understanding of the basic terms used in EBP was poor (34.6%). The types of source that the respondent used in high percentage to make their decisions were own judgement and consulting the colleagues that can no longer be accurate and evidence based. The barriers to practicing EBP identified by most respondents were the limited access to EBP sources and lack of personal time.

CONCLUSION

These results reveal strong support for EBP among pharmacists and pharmacy technicians in Yemen but only a minority indicated that they understood the technical terms of EBP. Training and continuing education programs on EBP and guidelines for pharmacists are strongly needed. These findings may help in planning the use and the application of EBP process in pharmacy practice.

Are all after-hours diagnostic imaging appropriate? An Australian Emergency Department pilot study

BACKGROUND

This study was aimed at determining the extent to which after-hours diagnostic imaging is appropriate within the case hospital's Emergency Department. This was amid growing concerns of the inappropriateness of some medical investigations within the Australian health-care system.

METHODS

After-hours referral data and patient notes were used in reviewing the clinical case. Diagnostic imaging was deemed appropriate if reflective of clinical guidelines, and if not reflective, whether the investigation changed the patient's ongoing management.

RESULTS

Results indicated that 96.37% of after-hours diagnostic imaging adhered to clinical guidelines and was appropriately requested, with 95.85% changing the ongoing management of the patient. The most sought after diagnostic imaging procedures were Chest X-Ray (30.83%), and CT Brain (16.58%), with 99.16% and 98.44 appropriateness respectively. Chest pain (14.49%) and motor vehicle accidents (8.12%) were the leading reason for ordering after-hours imaging.

CONCLUSION

This study provided an Emergency Department example as it relates to after-hours diagnostic imaging appropriateness. This study found that most after-hours referrals were appropriate.

Emergency physician perceptions of medically unnecessary advanced diagnostic imaging

OBJECTIVES

The objective was to determine emergency physician (EP) perceptions regarding 1) the extent to which they order medically unnecessary advanced diagnostic imaging, 2) factors that contribute to this behavior, and 3) proposed solutions for curbing this practice.

METHODS

As part of a larger study to engage physicians in the delivery of high-value health care, two multispecialty focus groups were conducted to explore the topic of decision-making around resource utilization, after which qualitative analysis was used to generate survey questions. The survey was extensively pilot-tested and refined for emergency medicine (EM) to focus on advanced diagnostic imaging (i.e., computed tomography [CT] or magnetic resonance imaging [MRI]). The survey was then administered to a national, purposive sample of EPs and EM trainees. Simple descriptive statistics to summarize physician responses are presented.

RESULTS

In this study, 478 EPs were approached, of whom 435 (91%) completed the survey; 68% of respondents were board-certified, and roughly half worked in academic emergency departments (EDs). Over 85% of respondents believe too many diagnostic tests are ordered in their own EDs, and 97% said at least some (mean = 22%) of the advanced imaging studies they personally order are medically unnecessary. The main perceived contributors were fear of missing a low-probability diagnosis and fear of litigation. Solutions most commonly felt to be "extremely" or "very" helpful for reducing unnecessary imaging included malpractice reform (79%), increased patient involvement through education (70%) and shared decision-making (56%), feedback to physicians on test-ordering metrics (55%), and improved education of physicians on diagnostic testing (50%).

CONCLUSIONS

Overordering of advanced imaging may be a systemic problem, as many EPs believe a substantial proportion of such studies, including some they personally order, are medically unnecessary. Respondents cited multiple complex factors with several potential high-yield solutions that must be addressed simultaneously to curb overimaging.

Medical students' attitudes on and experiences with evidence-based medicine: a qualitative study

RATIONALE, AIMS AND OBJECTIVES

This qualitative study was designed to determine the attitudes towards and experiences of medical students on evidence-based medicine (EBM).

METHODS

The study was conducted using the phenomenological method. Medical students' attitudes about and experiences with evidence-based medicine were determined through semi-structured interviews. Forty senior medical students were chosen by purposive sampling from medical sciences students of Tabriz University and Shahid Beheshti University. The context of interviews was analysed using the content analysis method.

RESULTS

Medical students' attitudes and experiences were ascertained through four main questions, and their answers were divided in to 12 categories and 31 subcategories. According to the subjects of the study, two basic concepts that they understood about EBM were its being up to date and requiring research skills. To the question what is necessary for EBM, the students' answers were summarized as follows: access to information, teamwork and faculty members who could provide modeling and organizational support. Students reported having used EBM for problem solving, thinking and self-confidence. On the other hand, lack of equipment and facilities, human factors and organizational factors were considered the main barriers to EBM use.

CONCLUSION

According to the results of this study, providing suitable conditions and appropriate planning to address identified barriers and encouraging students can promote EBM practice. Also, more extensive EBM integration in medical curricula and clinical settings by leading faculty members would prompt medical students to use EBM in their daily practice.

Surgical journal club as a community of practice: a case study

BACKGROUND

Journal club has become a signature pedagogy in postgraduate medical education. In this article, social learning theory, through the lens of "communities of practice" (CoP), is applied to elucidate the process of learning in journal club.

MATERIALS AND METHODS

The study is a case study of a surgical journal club. Video recordings of 2 journal club sessions were followed by semistructured audio-recorded interviews with a sample of journal club participants. Thematic content analysis was performed, mapping data to themes arising based on the key tenets of CoP.

RESULTS

Features of the 4 tenets of CoP learning (community, meaning, identity, and practice) were identified in both the video recordings of journal club and the participant interviews. A shared enterprise and common sense of purpose (community) was seen throughout the video recordings, but feelings of belonging to the community were much stronger for senior members (consultants/attending staff and senior trainees) compared with junior members (junior trainees and students). Experiences and perspectives were more commonly exchanged between senior trainees and consultants, with junior trainees not partaking in discussions, an example of newcomers beginning at the periphery. The main impediment to learning was found with low senior member attendance at journal club, thus limiting access to narratives of senior experience of practice and feedback.

CONCLUSIONS

In attempting to improve journal club design for learning, ensuring the participation of senior community members and thus access to narratives of experience along with active engagement of junior members to allow them develop their own meaning should be incorporated into the journal club design.

The prevalence of lesbian, gay, bisexual, and transgender health education and training in emergency medicine residency programs: what do we know?

BACKGROUND

The Institute of Medicine, The Joint Commission, and the U.S. Department of Health and Human Services all have recently highlighted the need for cultural competency and provider education on lesbian, gay, bisexual, and transgender (LGBT) health. Forty percent of LGBT patients cite lack of provider education as a barrier to care. Only a few hours of medical school curriculum are devoted to LGBT education, and little is known about LGBT graduate medical education.

OBJECTIVES

The objective of this study was to perform a needs assessment to determine to what degree LGBT health is taught in emergency medicine (EM) residency programs and to determine whether program demographics affect inclusion of LGBT health topics.

METHODS

An anonymous survey link was sent to EM residency program directors (PDs) via the Council of Emergency Medicine Residency Directors listserv. The 12-item descriptive survey asked the number of actual and desired hours of instruction on LGBT health in the past year. Perceived barriers to LGBT health education and program demographics were also sought.

RESULTS

There were 124 responses to the survey out of a potential response from 160 programs (response rate of 78%). Twenty-six percent of the respondents reported that they have ever presented a specific LGBT lecture, and 33% have incorporated topics affecting LGBT health in the didactic curriculum. EM programs presented anywhere from 0 to 8 hours on LGBT health, averaging 45 minutes of instruction in the past year (median = 0 minutes, interquartile range [IQR] = 0 to 60 minutes), and PDs support inclusion of anywhere from 0 to 10 hours of dedicated time to LGBT health, with an average of 2.2 hours (median = 2 hours, IQR = 1 to 3.5 hours) recommended. The majority of respondents have LGBT faculty (64.2%) and residents (56.2%) in their programs. The presence of LGBT faculty and previous LGBT education were associated with a greater number of desired hours on LGBT health.

CONCLUSIONS

The majority of EM residency programs have not presented curricula specific to LGBT health, although PDs desire inclusion of these topics. Further curriculum development is needed to better serve LGBT patients.

Characteristics of evidence-based medicine training in Royal College of Physicians and Surgeons of Canada emergency medicine residencies - a national survey of program directors

BACKGROUND

Recent surveys suggest few emergency medicine (EM) training programs have formal evidence-based medicine (EBM) or journal club curricula. Our primary objective was to describe the methods of EBM training in Royal College of Physicians and Surgeons of Canada (RCPSC) EM residencies. Secondary objectives were to explore attitudes regarding current educational practices including e-learning, investigate barriers to journal club and EBM education, and assess the desire for national collaboration.

METHODS

A 16-question survey containing binary, open-ended, and 5-pt Likert scale questions was distributed to the 14 RCPSC-EM program directors. Proportions of respondents (%), median, and IQR are reported.

RESULTS

The response rate was 93% (13/14). Most programs (85%) had established EBM curricula. Curricula content was delivered most frequently via journal club, with 62% of programs having 10 or more sessions annually. Less than half of journal clubs (46%) were led consistently by EBM experts. Four programs did not use a critical appraisal tool in their sessions (31%). Additional teaching formats included didactic and small group sessions, self-directed e-learning, EBM workshops, and library tutorials. 54% of programs operated educational websites with EBM resources. Program directors attributed highest importance to two core goals in EBM training curricula: critical appraisal of medical literature, and application of literature to patient care (85% rating 5 - "most importance", respectively). Podcasts, blogs, and online journal clubs were valued for EBM teaching roles including creating exposure to literature (4, IQR 1.5) and linking literature to clinical practice experience (4, IQR 1.5) (1-no merit, 5-strong merit). Five of thirteen respondents rated lack of expert leadership and trained faculty educators as potential limitations to EBM education. The majority of respondents supported the creation of a national unified EBM educational resource (4, IQR 1) (1-no support, 5- strongly support).

CONCLUSIONS

RCPSC-EM programs have established EBM teaching curricula and deliver content most frequently via journal club. A lack of EBM expert educators may limit content delivery at certain sites. Program directors supported the nationalization of EBM educational resources. A growing usage of electronic resources may represent an avenue to link national EBM educational expertise, facilitating future collaborative educational efforts.

Factors that influence effective evidence-based medicine instruction

Evidence-based medicine (EBM) as a health care practice is being incorporated into education programs across the spectrum of medical education to develop lifelong learning skills and to enhance the practice of evidence-based health care. Since improving the quality of patient care is the ultimate goal of EBM, EBM learning must be integrated with clinical application, and resulted outcomes must be reflected in learning transfer (or EBM practice) within the context of solving patient problems. Different factors may constitute the context or environment in which EBM is learned, practiced, and sustained. However, these contextual factors are seldom considered and examined in the development, implementation, and evaluation of EBM instruction for learners at different levels. This article will introduce several contextual factors as tips and strategies that affect EBM learning and transfer. Also included in the article are recommended practices for designing effective EBM instruction that would contribute to a sustainable change in learner behavior.

Best Evidence in Emergency Medicine (BEEM) rater scores correlate with publications' future citations

BACKGROUND

The "BEEM" (best evidence in emergency medicine) rater scale was created for emergency physicians (EPs) to evaluate the physician-derived clinical relevance score of recently published, emergency medicine (EM)-related studies. BEEM therefore is designed to help make EPs aware of studies most likely to confirm or change current clinical practice.

OBJECTIVES

The objective was to validate the BEEM rater score as a predictor of literature citation, using a bibliometric construct of clinical relevance to EM based on author-, document-, and journal-level measures (first and last author h-indices, number of authors including corporate and group authors, citations from date of publication to 2011, and journal impact factor scores) and study characteristics (design, category, and sample size).

METHODS

Each month from 2007 through 2012, approximately 200 EPs from around the world voluntarily reviewed the titles and conclusions of recently published EM-related studies identified by BEEM faculty via the McMaster Health Information Research Unit. Using the BEEM rater scale, a reliable seven-item instrument that evaluates the clinical relevance of studies, raters independently assigned BEEM scores to approximately 10 to 20 articles each month. Two investigators independently abstracted the bibliometric indices for these articles. A citation rate for each article was calculated by dividing the Thomson Reuters Web of Science (WoS) total citation count by the number of years in publication. BEEM rater scores were correlated with the citation rate using Spearman's rho. The performance of the BEEM rater score was assessed for each article using negative binomial regression with composite citation count as the criterion standard, while controlling for other independent bibliometric variables in three models.

RESULTS

The BEEM raters evaluated 605 articles with a mean (±SD) BEEM score of 3.84 (±0.7) and a median BEEM score of 3.85 (interquartile range = 3.38 to 4.30). Articles were primarily therapeutic (59%) and diagnostic (27%), with various designs, including 37% systematic reviews, 32% randomized controlled trials (RCTs), and 30% observational designs. The citation rate and BEEM rater score correlated positively (0.144), while the BEEM rater score and the Journal Citation Report (JCR) impact factor score were minimally correlated (0.053). In the first model, the BEEM rater score significantly predicted WoS citation rate (p < 0.0001) with an odds ratio (OR) of 1.24 (95% confidence interval [CI] = 1.106 to 1.402). In subsequent models adjusting for the JCR impact factor score, the h-indices of the first and last authors, number of authors, and study design, the BEEM rater score was not significant (p = 0.08).

CONCLUSIONS

To the best of our knowledge, the BEEM rater score is the only known measure of clinical relevance. It has a high interrater reliability and face validity and correlates with future citations. Future research should assess this instrument against alternative constructs of clinical relevance.

A novel approach to incorporating evidence-based medicine into an emergency medicine clerkship

OBJECTIVES

Despite the growing emphasis of evidence-based medicine (EBM) in the medical school curriculum, and the recognition of EBM's role in the practice of emergency medicine (EM), there are no current guidelines on how to teach EBM to fourth-year medical students during their EM rotations. The goal was to create a unique EM clerkship curriculum that teaches students to incorporate EBM into their clinical decision-making and complies with the core curriculum recommendations of the Clerkship Directors in Emergency Medicine (CDEM).

PROJECT DESCRIPTION

Prior to a scheduled, case-based small group discussion, students are provided with a clinically relevant question to investigate. Case discussions are led by EM faculty with each case highlighting a core EM topic developed by CDEM. During the case discussion, the assigned clinical question is addressed and a plan of care is presented based on the tenets of EBM. Faculty members function as moderators for these discussions and provide individual feedback regarding search strategies, appraisal of the literature findings, and applicability to the patient population. This multifaceted approach to EBM through the incorporation of individual student literature searches, clinical vignettes, small group discussion with consensus building, and faculty moderation with timely feedback is an innovative educational technique. Future educational research must explore the efficacy of this curriculum and whether or not the model produces greater long-term understanding of EBM by students and if similar curricula can be executed at other institutions.

CONCLUSIONS

The authors have developed a novel fourth-year EM clerkship curriculum that integrates EBM through the use of a highly interactive, faculty-led, small group-learning environment that encourages students to develop the necessary skills to integrate EBM into their clinical practice.

Teaching evidence based medicine to surgery residents-is journal club the best format? A systematic review of the literature

OBJECTIVE

Systematic reviews were performed to assess methods of teaching the evidence-based medicine (EBM) process and determine which format or what components of journal club appear to be most effective in teaching critical appraisal skills to surgical residents and have the highest user satisfaction.

DESIGN

MEDLINE, Embase, Web of Science, AMED, PsychINFO, PubMed, Cochrane Library, and Google scholar were searched to identify relevant articles. To be included, studies had to provide details about the format of their EBM curriculum or journal club and report on the effectiveness or participant satisfaction. Potentially relevant articles were independently reviewed by 2 authors and data were extracted on separate data forms.

RESULTS

Seven studies met the inclusion criteria for assessment of teaching EBM and 8 studies (including 3 in the EBM systematic review) met criteria for assessment of journal club format. Overall, study quality was poor. Only 2 studies were randomized controlled trials. Five were before-after studies, which showed significant improvement in critical appraisal skills or statistical knowledge following an EBM course or journal club. The 2 randomized controlled trials (RCTs) compared teaching EBM or critical appraisal skills in lecture format or journal club to online learning. There was no significant difference in mean scores in 1 study whereas the other reported significantly better scores in the journal club format. Four studies reported high participant satisfaction with the EBM course or journal club format.

CONCLUSIONS

There is some evidence that courses with or without the addition of journal clubs lead to improved knowledge of the EBM process although the impact on patient care is unknown. Journal clubs seem to be the preferred way of teaching critical appraisal skills but while some components of journal clubs are favored by participants, it remains unclear which elements are most important for resident learning.

The status of evidence-based medicine education in urology residency

INTRODUCTION

Evidence-based medicine (EBM) is the conscientious, explicit, and judicious use of the current best evidence in decision-making for the care of patients. Teaching best evidence practice in residency should include both formal or freestanding content, as well as integration into clinical scenarios and patient care. We sought to assess the attitudes, experience and knowledge of EBM in urology residency training across Canada.

METHODS

An anonymous, cross-sectional, self-report questionnaire was completed by a convenience sample of 29 residents, including all chief urology residents in English-speaking programs across Canada. The survey included both open-ended and closed-ended questions designed to assess familiarity and attitudes towards EBM and potential barriers to developing EBM skills in a surgical training program. Questions were formatted to determine the understanding of statistical and analytical concepts, as well as familiarity of available EBM resources. Descriptive and correlative statistics were used to analyze the responses.

RESULTS

The response rate was 100%. An overwhelming majority of residents felt that EBM is an important component of the urology residency and journal club was the most common vehicle for discussing best evidence concepts. However, there was significant variation in the presence of freestanding, formal curricula across programs, with only 28% of residents signifying that they received any formal training in their program. The apparent level of understanding of important EBM terminology and resources appears to be limited. The most frequently stated barriers to incorporating EBM curricula into urology training were time constraints and a perceived lack of expert educators.

CONCLUSION

This self-report survey of urology chief residents identified the overwhelming acceptance of the importance of EBM in their training. Although best evidence practices appears to be addressed in journal clubs and in real-life clinical experiences, the obvious lack of familiarity and understanding of EBM content and resources would suggest a need for redoubling efforts to ensure appropriate exposure and instruction in our training programs.

Incorporating evidence-based medicine into resident education: a CORD survey of faculty and resident expectations

BACKGROUND

The Accreditation Council for Graduate Medical Education (ACGME) invokes evidence-based medicine (EBM) principles through the practice-based learning core competency. The authors hypothesized that among a representative sample of emergency medicine (EM) residency programs, a wide variability in EBM resident training priorities, faculty expertise expectations, and curricula exists.

OBJECTIVES

The primary objective was to obtain descriptive data regarding EBM practices and expectations from EM physician educators. Our secondary objective was to assess differences in EBM educational priorities among journal club directors compared with non-journal club directors.

METHODS

A 19-question survey was developed by a group of recognized EBM curriculum innovators and then disseminated to Council of Emergency Medicine Residency Directors (CORD) conference participants, assessing their opinions regarding essential EBM skill sets and EBM curricular expectations for residents and faculty at their home institutions. The survey instrument also identified the degree of interest respondents had in receiving a free monthly EBM journal club curriculum.

RESULTS

A total of 157 individuals registered for the conference, and 98 completed the survey. Seventy-seven (77% of respondents) were either residency program directors or assistant/associate program directors. The majority of participants were from university-based programs and in practice at least 5 years. Respondents reported the ability to identify flawed research (45%), apply research findings to patient care (43%), and comprehend research methodology (33%) as the most important resident skill sets. The majority of respondents reported no formal journal club or EBM curricula (75%) and do not utilize structured critical appraisal instruments (71%) when reviewing the literature. While journal club directors believed that resident learners' most important EBM skill is to identify secondary peer-reviewed resources, non-journal club directors identified residents' ability to distinguish significantly flawed research as the key skill to develop. Interest in receiving a free monthly EBM journal club curriculum was widely accepted (89%).

CONCLUSIONS

Attaining EBM proficiency is an expected outcome of graduate medical education (GME) training, although the specific domains of anticipated expertise differ between faculty and residents. Few respondents currently use a formalized curriculum to guide the development of EBM skill sets. There appears to be a high level of interest in obtaining EBM journal club educational content in a structured format. Measuring the effects of providing journal club curriculum content in conjunction with other EBM interventions may warrant further investigation.

Mapping cognitive overlaps between practice-based learning and improvement and evidence-based medicine: an operational definition for assessing resident physician competence

PURPOSE

The complex competency labeled practice-based learning and improvement (PBLI) by the Accreditation Council for Graduate Medical Education (ACGME) incorporates core knowledge in evidence-based medicine (EBM). The purpose of this study was to operationally define a "PBLI-EBM" domain for assessing resident physician competence.

METHOD

The authors used an iterative design process to first content analyze and map correspondences between ACGME and EBM literature sources. The project team, including content and measurement experts and residents/fellows, parsed, classified, and hierarchically organized embedded learning outcomes using a literature-supported cognitive taxonomy. A pool of 141 items was produced from the domain and assessment specifications. The PBLI-EBM domain and resulting items were content validated through formal reviews by a national panel of experts.

RESULTS

The final domain represents overlapping PBLI and EBM cognitive dimensions measurable through written, multiple-choice assessments. It is organized as 4 subdomains of clinical action: Therapy, Prognosis, Diagnosis, and Harm. Four broad cognitive skill branches (Ask, Acquire, Appraise, and Apply) are subsumed under each subdomain. Each skill branch is defined by enabling skills that specify the cognitive processes, content, and conditions pertinent to demonstrable competence. Most items passed content validity screening criteria and were prepared for test form assembly and administration.

CONCLUSIONS

The operational definition of PBLI-EBM competence is based on a rigorously developed and validated domain and item pool, and substantially expands conventional understandings of EBM. The domain, assessment specifications, and procedures outlined may be used to design written assessments to tap important cognitive dimensions of the overall PBLI competency, as given by ACGME. For more comprehensive coverage of the PBLI competency, such instruments need to be complemented with performance assessments.

Evidence-based medicine among hospital doctors in Jordan: awareness, attitude and practice

OBJECTIVES

The aim of this cross-sectional study was to determine the awareness and attitude of hospital doctors towards evidence-based medicine (EBM) and their related educational needs.

METHODS

A questionnaire study was performed on a randomly selected sample of 386 hospital doctors from both a teaching hospital and the Ministry of Health general hospitals in Jordan. Attitude towards EBM, best method of moving from opinion-based medicine to EBM, accessing and interpreting evidence and perceived barriers to practise EBM among participants were the main outcome measures.

RESULTS

Participants welcomed promotion of EBM and 91.2% agreed that research findings are helpful in daily management of patients. About one-third of respondents (32.7%) thought that the most appropriate way to move towards EBM was by seeking and applying EBM summaries. About one half of participants (47.9%) were unaware of Cochrane database and only 5% used it to help in clinical decision making. More than half (53.7%) reported that they had access to the Internet at their office. Only minority understand the technical terms used in EBM. The major barriers to practising EBM were threat to clinical freedom/judgement, limited resources and facilities, patient overload absence of library in the locally and lack of personal time.

CONCLUSIONS

Although there is a high support among doctors for the promotion of EBM, there is a deficit in knowledge and skills of EBM. Hence, the time appears ripe for planning and implementing an effective EBM educational programme for both undergraduate and postgraduate doctors.

Do workshops in evidence-based practice equip participants to identify and answer questions requiring consideration of clinical research? A diagnostic skill assessment

Evidence-based practice (EBP) requires practitioners to identify and formulate questions in response to patient encounters, and to seek, select, and appraise applicable clinical research. A standardized workshop format serves as the model for training of medical educators in these skills. We developed an evaluation exercise to assess the ability to identify and solve a problem requiring the use of targeted skills and administered it to 47 North American junior faculty and residents in various specialties at the close of two short workshops in EBP. Prior to the workshop, subjects reported prior training in EBP and completed a previously validated knowledge test. Our post-workshop exercise differed from the baseline measures and required participants to spontaneously identify a suitable question in response to a simulated clinical encounter, followed by a description of a stepwise approach to answering it. They then responded to successively more explicitly prompted queries relevant to their question. We analyzed responses to identify areas of skill deficiency and potential reasons for these deficiencies. Twelve respondents (26%) initially failed to identify a suitable question in response to the clinical scenario. Ability to choose a suitable question correlated with the ability to connect an original question to an appropriate study design. Prior EBP training correlated with the pretest score but not with performance on our exercise. Overall performance correlated with ability to correctly classify their questions as pertaining to therapy, diagnosis, prognosis, or harm. We conclude that faculty and residents completing standard workshops in EBP may still lack the ability to initiate and investigate original clinical inquiries using EBP skills.

Prospective, controlled assessment of the impact of formal evidence-based medicine teaching workshop on ability to appraise the medical literature

BACKGROUND

The ability to critically appraise the calibre of studies in medical literature is increasingly important for medical professionals.

AIM

This prospective controlled study evaluated the impact of a 6-h Evidence Based Medicine (EBM) Workshop on the critical appraisal skills of medical trainees.

METHODS

Individuals attended three 2-h workshops over a 3-week period, incorporating didactic lectures in statistics, clinical trial design, appraising research papers and practical examples. Appraisal skills were assessed pre- and post-training based on grading the quality of randomised control studies (level 1 evidence), cohort studies (level 2 evidence) and case-control studies (level 3 evidence) [From Oxford Centre for Evidence Based Medicine Levels of Evidence (2001), http://www.cebm.net/critical_appraisal.asp ].

RESULTS

Overall grading improved from 39% (pre-course) to 74% (post-course), P = 0.002, with grading of levels 1, 2 and 3 studies improving from 42 to 75%, 53 to 61% and 21 to 84%, respectively.

CONCLUSIONS

We conclude that a 6-h formal EBM workshop is effective in enhancing the critical appraisal skills of medical trainees.

Evidence-based medicine training in residency: a survey of urology programme directors

OBJECTIVE

To investigate whether and in what format urology residents receive formal training in evidence-based clinical practice.

METHODS

In 2007 we conducted a survey of the Accreditation Council for Graduate Medical Education (ACGME)-accredited urology residency programmes in the USA. The survey instrument was sent to all programmes, using postal mailing, e-mail and a web-based interface. Programme director and coordinator names and basic demographic information such as programme size and length were retrieved from the institutions' websites and the ACGME database.

RESULTS

Of 117 ACGME-accredited urology programmes, 108 responded (92.3%). Most respondents either agreed or strongly agreed with statements that formal evidence-based medicine (EBM) training was valuable to urology residents (97, 89.8%) and should be part of all residency programme curricula (91, 84.3%). Eighty-four programmes (77.8%) indicated that their curricula included formal educational activities related to EBM. These programmes provided a median (interquartile range) of 10 (4.8-25.0) h of EBM teaching per academic year. Most programmes (65.9%) provided fewer hours of EBM training than programme directors perceived as ideal. Asked what would make it easier to integrate EBM into the programme, respondents identified urology-specific educational materials (33.3%), a formal curriculum (24.4%) and faculty development (16.3%) as central needs.

CONCLUSION

In this survey we found that most programme directors recognize formal EBM teaching as an important aspect of urology residency training. However, most programmes devote less time to EBM training than they would like, and urology-specific resources have been lacking. These findings support increased efforts to provide urology residents with opportunities to learn EBM-related knowledge and skills in a variety of educational formats.

Teaching critical appraisal and statistics in anesthesia journal club

BACKGROUND

This study was designed to assess the effectiveness of a series of journal clubs held for anesthesiology residents in promoting their awareness of research methods and statistical analysis, as well as their skills in critical thinking and appraisal.

MATERIAL AND METHODS

Twenty-four journal club sessions were held between September 2006 and August 2007 for 16 residents of anesthesiology. A 31 multiple-choice question (MCQ) was taken as pretest and posttest to evaluate the participants' level of awareness in research methodology and statistical analysis. Their competence in critical thinking and appraisal was also evaluated by evaluating a randomized controlled trial paper using the CONSORT checklist before and after the course.

RESULTS

Residents' awareness in the application of information improved (P = 0.012), as well as research methodology (combined study design and application of information, P = 0.017). Their ability in critical appraisal did also significantly rise at the end of the course (P < 0.001).

CONCLUSION

Journal clubs can enable residents to develop the knowledge, expertise and enthusiasm needed to undertake research plans and can also enhance their ability in critical thinking and scientific reading.