Development of the Canadian Physiotherapy Assessment of Clinical Performance: A New Tool to Assess Physiotherapy Students' Performance in Clinical Education

PURPOSE

To develop the first draft of a Canadian tool to assess physiotherapy (PT) students' performance in clinical education (CE). Phase 1: to gain consensus on the items within the new tool, the number and placement of the comment boxes, and the rating scale; Phase 2: to explore the face and content validity of the draft tool.

METHODS

Phase 1 used the Delphi method; Phase 2 used cognitive interviewing methods with recent graduates and clinical instructors (CIs) and detailed interviews with clinical education and measurement experts.

RESULTS

Consensus was reached on the first draft of the new tool by round 3 of the Delphi process, which was completed by 21 participants. Interviews were completed with 13 CIs, 6 recent graduates, and 7 experts. Recent graduates and CIs were able to interpret the tool accurately, felt they could apply it to a recent CE experience, and provided suggestions to improve the draft. Experts provided salient advice.

CONCLUSIONS

The first draft of a new tool to assess PT students in CE, the Canadian Physiotherapy Assessment of Clinical Performance (ACP), was developed and will undergo further development and testing, including national consultation with stakeholders. Data from Phase 2 will contribute to developing an online education module for CIs and students.

Outcomes of the Northern Ontario School of Medicine's distributed medical education programmes: protocol for a longitudinal comparative multicohort study

INTRODUCTION

The Northern Ontario School of Medicine (NOSM) has a social accountability mandate to serve the healthcare needs of the people of Northern Ontario, Canada. A multiyear, multimethod tracking study of medical students and postgraduate residents is being conducted by the Centre for Rural and Northern Health Research (CRaNHR) in conjunction with NOSM starting in 2005 when NOSM first enrolled students. The objective is to understand how NOSM's selection criteria and medical education programmes set in rural and northern communities affect early career decision-making by physicians with respect to their choice of medical discipline, practice location, medical services and procedures, inclusion of medically underserved patient populations and practice structure.

METHODS AND ANALYSIS

This prospective comparative longitudinal study follows multiple cohorts from entry into medical education programmes at the undergraduate (UG) level (56-64 students per year at NOSM) or postgraduate (PG) level (40-60 residents per year at NOSM, including UGs from other medical schools and 30-40 NOSM UGs who go to other schools for their residency training) and continues at least 5 years into independent practice. The study compares learners who experience NOSM UG and NOSM PG education with those who experience NOSM UG education alone or NOSM PG education alone. Within these groups, the study also compares learners in family medicine with those in other specialties. Data will be analysed using descriptive statistics, χ(2) tests, logistic regression, and hierarchical log-linear models.

ETHICS AND DISSEMINATION

Ethical approval was granted by the Research Ethics Boards of Laurentian University (REB #2010-08-03 and #2012-01-09) and Lakehead University (REB #031 11-12 Romeo File #1462056). Results will be published in peer-reviewed scientific journals, presented at one or more scientific conferences, and shared with policymakers and decision-makers and the public through 4-page research summaries and social media such as Twitter (@CRaNHR, @NOSM) or Facebook.

Gamification in thoracic surgical education: Using competition to fuel performance

OBJECTIVES

In an effort to stimulate residents and trainers to increase their use of simulation training and the Thoracic Surgery Curriculum, a gamification strategy was developed in a friendly but competitive environment.

METHODS

"Top Gun." Low-fidelity simulators distributed annually were used for the technical competition. Baseline and final video assessments were performed, and 5 finalists were invited to compete in a live setting from 2013 to 2015. "Jeopardy." A screening examination was devised to test knowledge contained in the Thoracic Surgery Curriculum. The top 6 2-member teams were invited to compete in a live setting structured around the popular game show Jeopardy.

RESULTS

"Top Gun." Over 3 years, there were 43 baseline and 34 final submissions. In all areas of assessment, there was demonstrable improvement. There was increasing evidence of simulation as seen by practice and ritualistic behavior. "Jeopardy." Sixty-eight individuals completed the screening examination, and 30 teams were formed. The largest representation came from the second-year residents in traditional programs. Contestants reported an average in-training examination percentile of 72.9. Finalists reported increased use of the Thoracic Surgery Curriculum by an average of 10 hours per week in preparation. The live competition was friendly, engaging, and spirited.

CONCLUSIONS

This gamification approach focused on technical and cognitive skills, has been successfully implemented, and has encouraged the use of simulators and the Thoracic Surgery Curriculum. This framework may capitalize on the competitive nature of our trainees and can provide recognition of their achievements.

Identifying gaps in the surgical training curriculum in Rwanda through evaluation of operative activity at a teaching hospital

OBJECTIVE

To define the operations performed by surgical residents at a tertiary referral hospital in Rwanda to help guide development of the residency program.

DESIGN

Cross-sectional study of all patients operated by surgical residents from October 2012 to September 2013.

SETTING

University Teaching Hospital of Kigali (Centre Hospitalier Universitaire de Kigali [CHUK]), a public, tertiary referral hospital in Kigali, Rwanda.

PARTICIPANTS

All patient data were entered into the operative database by surgical residents at CHUK. A total of 2833 cases were entered into the surgical database. Of them, 53 cases were excluded from further analysis because no surgical resident was listed as the primary or assistant surgeon, leaving 2780 cases for analysis.

RESULTS

There were 2780 operations involving surgical residents. Of them, 51% of procedures were classified under general surgery, 38% orthopedics, 7% neurosurgery, and 4% urology. Emergency operations accounted for 64% of the procedures, with 56% of those being general surgery and 35% orthopedic. Further, 50% of all operations were trauma, with 71% of those orthopedic and 21% general surgery. Surgical faculty were involved in 45% of operations as either the primary or the assistant surgeons, while the remainder of operations did not involve surgical faculty. Residents were primary surgeons in 68% of procedures and assistant surgeons in 84% of procedures.

CONCLUSIONS

The operative experience of surgery residents at CHUK primarily involves emergency and trauma procedures. Although this likely reflects the demographics of surgical care within Rwanda, more focus should be placed on elective procedures to ensure that surgical residents are broadly trained.

Simulation Activity in Otolaryngology Residencies

OBJECTIVES

Simulation has become a valuable tool in medical education, and several specialties accept or require simulation as a resource for resident training or assessment as well as for board certification or maintenance of certification. This study investigates current simulation resources and activities in US otolaryngology residency programs and examines interest in advancing simulation training and assessment within the specialty.

STUDY DESIGN

Web-based survey.

SETTING

US otolaryngology residency training programs.

SUBJECTS AND METHODS

An electronic web-based survey was disseminated to all US otolaryngology program directors to determine their respective institutional and departmental simulation resources, existing simulation activities, and interest in further simulation initiatives. Descriptive results are reported.

RESULTS

Responses were received from 43 of 104 (43%) residency programs. Simulation capabilities and resources are available in most respondents' institutions (78.6% report onsite resources; 73.8% report availability of models, manikins, and devices). Most respondents (61%) report limited simulation activity within otolaryngology. Areas of simulation are broad, addressing technical and nontechnical skills related to clinical training (94%). Simulation is infrequently used for research, credentialing, or systems improvement. The majority of respondents (83.8%) expressed interest in participating in multicenter trials of simulation initiatives.

CONCLUSION

Most respondents from otolaryngology residency programs have incorporated some simulation into their curriculum. Interest among program directors to participate in future multicenter trials appears high. Future research efforts in this area should aim to determine optimal simulators and simulation activities for training and assessment as well as how to best incorporate simulation into otolaryngology residency training programs.

Construction of a competence-based curriculum for internship in obstetrics and gynecology within the medical course at the Federal University of Ceará (Sobral campus)

CONTEXT AND OBJECTIVE

This research project arose from a proposal made to the teachers by the students of a medical course at a federal university in Brazil, from their personal experiences regarding the skills and competencies that should be developed during the obstetrics and gynecology (OBG) stage of the internship. The objective here was to develop the matrix of skills necessary for training good general physicians in the medical course.

DESIGN AND SETTING

Exploratory qualitative study conducted in a federal university in Brazil.

METHODS

The basis for developing these competencies among OBG interns was "The Competency Matrix for Medical Internship" developed by Bollela and Machado. The instrument was presented to, analyzed by and modified by a set of OBG specialists, at two sessions.

RESULTS

The specific competencies expected from students over the internship in OBG were framed within overall topics that had previously been determined and listed: healthcare, decision-making, communication and interpersonal relationships, management and organization of the Brazilian National Health System (Sistema Único de Saúde, SUS) and professionalism.

CONCLUSIONS

A competency matrix that standardizes the minimum requirements that interns should be capable of putting into practice after concluding the OBG stage is a valuable tool for ensuring student performance and a fair and rigorous assessment for them, thereby seeking to train good general physicians who meet the community's needs.

Survey of Applicant Experience and Cost in the Urology Match: Opportunities for Reform

PURPOSE

The urology match is highly competitive but there is a paucity of published data regarding the costs and barriers that applicants face. We gathered data on contributors to cost in the 2014 urology residency match.

MATERIALS AND METHODS

A survey was sent to all applicants offered an interview at each of 18 participating institutions. Information on demographics, interview related costs, access to financial aid, frequency of away rotations and second look invitations was collected.

RESULTS

A total of 173 respondents spent a median of $7,000 on the urology match. Applicants attended a mean of 14 interviews with an average per interview cost of $500. Overall 95% of respondents did at least 1 away rotation and 79% reported being asked to return for a second look interview at least once. Of the respondents 66% did not receive any financial aid for interviews and only 28% believed their financial aid departments provided adequate financial planning. Of those surveyed 20% indicated that their financial situation limited the number of interviews they attended.

CONCLUSIONS

We estimate that $3,122,000 was spent by applicants on the 2014 urology match. One in 5 applicants reported limiting the number of interviews they attended due to financial concerns. Adequate financial planning resources were not widely available. Nearly all applicants went on an away rotation and encouragement to return for second look interviews was common. These factors may contribute to financial and regional bias in the match process, and are potential targets for reform.

Estimating the residency expansion required to avoid projected primary care physician shortages by 2035

PURPOSE

The purpose of this study was to calculate the projected primary care physician shortage, determine the amount and composition of residency growth needed, and estimate the impact of retirement age and panel size changes.

METHODS

We used the 2010 National Ambulatory Medical Care Survey to calculate utilization of ambulatory primary care services and the US Census Bureau to project demographic changes. To determine the baseline number of primary care physicians and the number retiring at 66 years, we used the 2014 American Medical Association Masterfile. Using specialty board and American Osteopathic Association figures, we estimated the annual production of primary care residents. To calculate shortages, we subtracted the accumulated primary care physician production from the accumulated number of primary care physicians needed for each year from 2015 to 2035.

RESULTS

More than 44,000 primary care physicians will be needed by 2035. Current primary care production rates will be unable to meet demand, resulting in a shortage in excess of 33,000 primary care physicians. Given current production, an additional 1,700 primary care residency slots will be necessary by 2035. A 10% reduction in the ratio of population per primary care physician would require more than 3,000 additional slots by 2035, whereas changing the expected retirement age from 66 years to 64 years would require more than 2,400 additional slots.

CONCLUSIONS

To eliminate projected shortages in 2035, primary care residency production must increase by 21% compared with current production. Delivery models that shift toward smaller ratios of population to primary care physicians may substantially increase the shortage.

Enhanced Patient-Centred Care: Physiotherapists' Perspectives on the Impact of International Clinical Internships on Canadian Practice

PURPOSE

To explore the perspectives of physiotherapists who participated in an international clinical internship (ICI) in low- or middle-income countries (LMICs) during their physiotherapy (PT) training in a Canadian PT programme regarding the ICI's impact on their PT practice in Canada.

METHODS

This qualitative descriptive study used in-depth semi-structured interviews. Data were organized using NVivo; inductive and deductive coding were used to analyze data and develop broader themes.

RESULTS

The 13 practising Canadian physiotherapists interviewed described three enhanced capacities: (1) critical reflection on culture, values and practice; (2) communication skills; and (3) creativity and resourcefulness. These capacities were perceived to transfer to Canadian practice by enhancing participants' ability to deliver patient-centred care, specifically through an enhanced understanding of patients' values and social determinants of health, regardless of the Canadian setting or patient population.

CONCLUSIONS

For PT students considering an ICI, the study findings provide insight into the perceived impact of ICIs on Canadian practice. For PT academic programmes, the findings can guide decisions on the extent of investment in ICIs as learning opportunities that will enhance practice in Canada.

Development of a surgical skills curriculum for the training and assessment of manual skills in orthopedic surgical residents

OBJECTIVE

To develop and conduct a pilot study of a curriculum of 4 surrogate bone training modules to assess and track progress in basic orthopedic manual skills outside the operating room.

DESIGN

Four training modules were developed with faculty and resident input. The modules include (1) cortical drilling, (2) drill trajectory, (3) oscillating saw, and (4) pedicle probing. Orthopedic resident's performance was evaluated. Validity and reliability results were calculated using standard analysis of variance and multivariate regression analysis accounting for postgraduate year (PGY) level, number of attempts, and specific outcome target results specific to the simulation module.

SETTING

St. Mary's Medical Center in San Francisco, CA.

PARTICIPANTS

These modules were tested on 15 orthopedic surgery residents ranging from PGY 1 to PGY 5 experience.

RESULTS

The cortical drilling module had a mean success rate of 56% ± 5%. There was a statistically significant difference in performance according to the diameter of the drill used from 33% ± 7% with large diameter to 70% ± 6% with small diameter. The drill trajectory module had a success rate of 85% ± 3% with a trend toward improvement across PGY level. The oscillating saw module had a mean success rate of 25% ± 5% (trajectory) and 84% ± 6% (depth). We observed a significant improvement in trajectory performance during the second attempt. The pedicle probing module had a success rate of 46% ± 10%.

CONCLUSION

The results of this pilot study on a small number of residents are promising. The modules were inexpensive and easy to administer. Conclusions of statistical significance include (1) residents who could easily detect changes in surrogate bone thickness with a smaller diameter drill than with a larger diameter drill and (2) residents who significantly improved saw trajectory with an additional attempt at the module.

Fostering and assessing professionalism and communication skills in neurosurgical education

INTRODUCTION

Incorporation of the 6 ACGME core competencies into surgical training has proven a considerable challenge particularly for the two primarily behavioral competencies, professionalism and interpersonal and communication skills. We report on experience with two specific interventions to foster the teaching and continuous evaluation of these competencies for neurosurgery residents.

MATERIAL AND METHODS

In 2010, the Society of Neurological Surgeons (SNS) organized the first comprehensive Neurosurgery Boot Camp courses, held at six locations throughout the US and designed to assess and teach not only psychomotor skills but also components of all six Accreditation Council for Graduate Medical Education (ACGME) core competencies. These courses are comprised of various educational methodologies, including online material, faculty lectures, clinical scenario and group discussions, manual skills stations, and pre- and post-course assessments. Resident progress in each of the 6 ACGME competencies is now tracked using the neurosurgical Milestones, developed by the ACGME in collaboration with the SNS. In addition, the Milestones drafting group for neurosurgery has formulated a milestone-compatible evaluation system to directly populate Milestone reports. These evaluations utilize formative, summative, and 360-degree evaluations that are considered by a faculty core competency committee in finalizing milestones levels for each resident.

RESULTS

Initial attendance at the 2010 Boot Camp course was 94% of the incoming resident class and in subsequent years, 100%. Pre- and post-course surveys demonstrated a significant and sustained increase in knowledge. The value of these courses has been recognized by the ACGME, which requires Boot Camp or equivalent participation prior to acting with indirect supervision during clinical activities. Neurosurgery was one of 7 early Milestone adopter specialties, beginning use in July, 2013. Early milestone data will establish benchmarks prior to utilization for "high stake" decisions such as promotion, graduation, and termination.

CONCLUSIONS

The full impact of the neurosurgical Boot Camps and Milestones on residency education remains to be measured, although published data from the first years of the Boot Camp Courses demonstrate broad acceptance and early effectiveness. A complementary junior resident course has now been introduced for rising second-year residents. The Milestones compatible evaluation system now provides for multi-source formative and summative evaluation of neurosurgical residents within the new ACGME reporting rubric. Combined with consensus milestone assignments, this system provides new specificity and objectivity to resident evaluations. The correlation of milestone level assignments with other measurements of educational outcome awaits further study.

Models for integrating behavioral medicine on a family medicine in-patient teaching service

Training physicians to effectively assess, diagnose, and treat patients' behavioral health concerns begin in residency. While this training is increasingly more common in outpatient educational settings, there is also a great need to teach physicians to practice behavioral medicine with patients who are hospitalized. However, teaching family medicine resident physicians to understand, value, and practice essential behavioral health knowledge and skills during inpatient rotations can be a challenge for both residents and educators. In this article, we describe three models of inpatient behavioral medicine teaching, each with examples of practical content and teaching methods. We discuss strategies for success and potential barriers to overcome while teaching in the inpatient setting. Helping patients choose to change their health behaviors, which likely contribute in part to the reasons for their hospitalizations in the first place, should begin while patients are still in the hospital. Models of teaching, such as those presented here, can help improve the way we train physicians to address behavioral health needs with hospitalized patients.

Interventions to cultivate physician empathy: a systematic review

BACKGROUND

Physician empathy is both theoretically and empirically critical to patient health, but research indicates that empathy declines throughout medical school and is lower than ideal among physicians. In this paper, we synthesize the published literature regarding interventions that were quantitatively evaluated to detect changes in empathy among medical students, residents, fellows and physicians.

METHODS

We systematically searched PubMed, EMBASE, Web of Science and PsychINFO in June of 2014 to identify articles that quantitatively assessed changes in empathy due to interventions among medical students, residents, fellows and physicians.

RESULTS

Of the 1,415 articles identified, 64 met inclusion criteria. We qualitatively synthesized the findings of qualified studies by extracting data for ten study metrics: 1) source population, 2) sample size, 3) control group, 4) random assignment, 5) intervention type, 6) intervention duration, 7) assessment strategy, 8) type of outcome measure, 9) outcome assessment time frame, and 10) whether a statistically significant increase in empathy was reported. Overall, the 64 included studies were characterized by relatively poor research designs, insufficient reporting of intervention procedures, low incidence of patient-report empathy assessment measures, and inadequate evaluations of long-term efficacy. 8 of 10 studies with highly rigorous designs, however, found that targeted interventions did increase empathy.

CONCLUSIONS

Physician empathy appears to be an important aspect of patient and physician well-being. Although the current empathy intervention literature is limited by a variety of methodological weaknesses, a sample of high-quality study designs provides initial support for the notion that physician empathy can be enhanced through interventions. Future research should strive to increase the sample of high-quality designs through more randomized, controlled studies with valid measures, explicit reporting of intervention strategies and procedures, and long-term efficacy assessments.

Burnout, anxiety, depression, and social skills in medical residents

The medical residency is recognized as a risk period for the development of burnout and mental health problems, such as anxiety and depression, which have impact on the physician and clientele alike. There is a need for studies that address conditions of risk and protection for the development of such problems. This study aimed to verify the rates of burnout, anxiety, and depression presented by resident physicians, as well as the associations of these problems with social skills, as potential protective factors. The hypothesis was defined that the problems (burnout, anxiety, and depression) would be negatively associated with social skills. A total of 305 medical residents, of both genders, of different specialties, from clinical and surgical areas of a Brazilian university hospital were evaluated using the following standardized self-report instruments: Burnout Syndrome Inventory, Social Skills Inventory, and the Patient Health Questionnaire-4. High rates of burnout and mental health problems were verified and social skills were negatively associated with burnout dimensions such as emotional exhaustion, emotional detachment, and dehumanization, but positively associated with personal accomplishment. Furthermore, residents with indicators of problems presented significantly lower social skills means than those of residents without indicators of burnout, anxiety, or depression. More studies are needed, which include other types of instruments in addition to self-report ones and evaluate not only social skills but also social competence in the professional practice. These should adopt intervention and longitudinal designs that allow the continuity or overcoming of the problems to be verified. Since social skills can be learned, the results of the study highlight the importance of developing the interpersonal skills of the professionals during the training of resident physicians in order to improve their practice.

Preserving operative volume in the setting of the 2011 ACGME duty hour regulations

OBJECTIVES

The reported influence of Accreditation Council for Graduate Medical Education resident duty hour limitations on operative case volume has been mixed. Additional restrictions instituted in July 2011 further limited the work hours of postgraduate year 1 (PGY-1) residents, threatening to reduce availability for educational and operative activities. In this study, we evaluate our novel intern call schedule, which we hypothesized would preserve operative experience despite these increased restrictions.

DESIGN

A retrospective analysis of PGY-1 operative reports was conducted. Operations outside of major case categories were excluded. Operative case volumes in the Section of General Surgery for the same period were analyzed, as were average duty hours for each resident. Comparative statistics were generated using Wilcoxon rank sum tests.

SETTING

Single-institution study conducted at the University of Michigan, a tertiary-care academic hospital.

PARTICIPANTS

Overall, 50 categorical general surgery residents from 2005 to present were included. Three residents were subsequently excluded as they were preliminary interns rather than categorical; 2 residents were excluded having completed their intern years at other institutions.

RESULTS

The median number of major cases done during the PGY-1 for all evaluated residents was 89 (interquartile range [IQR]: 72-101). For interns between the years 2005 and 2011, the median number of major cases was 87 (IQR: 73-101), whereas interns in the 2011 to 2013 academic years performed 91.5 (IQR: 69.5-101.5, p = 0.91). Although case volume varied between intern classes, no significant differences were observed between any 2 individual classes in the study. Analysis of annual case volumes among each PGY revealed a relative increase of 29% (p < 0.001) among PGY-2 residents, and 20% (p = 0.02) by PGY-3 residents. Relative increases among senior residents (8% for both PGY-4 and PGY-5) did not reach statistical significance.

CONCLUSIONS

Our novel call schedule attempts to minimize prolonged night-float coverage responsibilities for interns in hopes of preserving their operative experience. In spite of increased duty hour restrictions, PGY-1 operative volume has not decreased significantly at our institution. However, in the same time period, PGY-2 and PGY-3 case volume has increased. Our findings highlight the challenges faced by surgical residencies in light of these new restrictions, particularly the 16-hour limit. Additional rigorously designed prospective studies should be conducted to better understand the influence of the most recent Accreditation Council for Graduate Medical Education work hour limitations on the subjective and objective experiences of surgical residents.

Patient safety in the era of the 80-hour workweek

OBJECTIVE

In 2003, duty-hour regulations (DHR) were initially implemented for residents in the United States to improve patient safety and protect resident's well-being. The effect of DHR on patient safety remains unclear. The study objective was to evaluate the effect of DHR on patient safety.

DESIGN

Using an interrupted time series analysis, we analyzed selected patient safety indicators (PSIs) for 376 million discharges in teaching (T) vs nonteaching (NT) hospitals before and after implementation of DHR in 2003 that restricted resident work hours to 80 hours per week. The PSIs evaluated were postoperative pulmonary embolus or deep venous thrombosis (PEDVT), iatrogenic pneumothorax (PTx), accidental puncture or laceration, postoperative wound dehiscence (WD), postoperative hemorrhage or hematoma, and postoperative physiologic or metabolic derangement. Propensity scores were used to adjust for differences in patient comorbidities between T and NT hospitals and between discharge quarters. The primary outcomes were differences in the PSI rates before and after DHR implementation. The PSI differences between T and NT institutions were the secondary outcome.

SETTING

T and NT hospitals in the United States.

PARTICIPANTS

Participants were 376 million patient discharges from 1998 to 2007 in the Nationwide Inpatient Sample.

RESULTS

Declining rates of PTx in both T and NT hospitals preintervention slowed only in T hospitals postintervention (p = 0.04). Increasing PEDVT rates in both T and NT hospitals increased further only in NT hospitals (p = 0.01). There were no differences in the PSI rates over time for hemorrhage or hematoma, physiologic or metabolic derangement, accidental puncture or laceration, or WD. T hospitals had higher rates than NT hospitals both preintervention and postintervention for all the PSIs except WD.

CONCLUSIONS

Trends in rates for 2 of the 6 PSIs changed significantly after DHR implementation, with PTx rates worsening in T hospitals and PEDVT rates worsening in NT hospitals. Lack of consistent patterns of change suggests no measurable effect of the policy change on these PSIs.

Surgical residents' perceptions of patient safety climate in Dutch teaching hospitals

RATIONALE, AIMS AND OBJECTIVES

Explicit attention to patient safety during surgical training is needed to improve patient safety. A positive safety climate is associated with greater patient safety and is a requisite for safety teaching at the workplace. The Safety Climate Survey (SCS) measures perceptions of safety climate. This study aims to take a first step in validating the SCS for use among surgical residents in the Netherlands and to highlight opportunities for safety climate improvement through changes in surgical training in the Netherlands. It therefore assesses (1) if the SCS can be used to assess surgical residents' perceptions of the safety climate in Dutch teaching hospitals; and (2) how, according to SCS results, these residents perceive the safety climate in Dutch teaching hospitals.

METHODS

In a cross-sectional study conducted in February 2011, a Dutch translation of the SCS was administered to all general surgical residents in the Netherlands. Face validity and internal consistency were assessed, as were overall mean, means per item and significant differences in means between different groups of respondents.

RESULTS

In total, 306 of 390 (78%) residents completed the questionnaire. The SCS showed good face validity and internal consistency (Cronbach's alpha = 0.87). Residents reported an overall mean of 3.95 (standard deviation 0.51) out of a maximum score of 5.00, and 52% reported an overall mean of 4.00 or higher. Women and residents working in university hospitals gave significantly lower scores. Significant differences were also found among hospitals and among regions. Majority of the items scored less than 4.00.

CONCLUSIONS

The SCS is potentially useful to measure surgical residents' perceptions of the patient safety climate in Dutch teaching hospitals. There is considerable room for improvement of the patient safety climate. Surgical training should include better feedback, formal patient safety teaching sessions at the workplace and specific attention to patient safety during the introduction in a new hospital, and supervisors should encourage surgical residents to report any patient safety concern they may have.

Competency champions in the clinical competency committee: a successful strategy to implement milestone evaluations and competency coaching

OBJECTIVES

To create a clinical competency committee (CCC) that (1) centers on the competency-based milestones, (2) is simple to implement, (3) creates competency expertise, and (4) guides remediation and coaching of residents who are not progressing in milestone performance evaluations.

DESIGN

We created a CCC that meets monthly and at each meeting reviews a resident class for milestone performance, a competency (by a faculty competency champion), a resident rotation service, and any other resident or issue of concern.

SETTING

University surgical residency program.

PARTICIPANTS

The CCC members include the program director, associate program directors, director of surgical curriculum, competency champions, departmental chair, 2 at-large faculty members, and the administrative chief residents.

RESULTS

Seven residents were placed on remediation (later renamed as coaching) during the academic year after falling behind on milestone progression in one or more competencies. An additional 4 residents voluntarily placed themselves on remediation for medical knowledge after receiving in-training examination scores that the residents (not the CCC membership) considered substandard. All but 2 of the remediated/coached residents successfully completed all area milestone performance but some chose to stay on the medical knowledge competency strategy.

CONCLUSIONS

Monthly meetings of the CCC make milestone evaluation less burdensome. In addition, the expectations of the residents are clearer and more tangible. "Competency champions" who are familiar with the milestones allow effective coaching strategies and documentation of clear performance improvements in competencies for successful completion of residency training. Residents who do not reach appropriate milestone performance can then be placed in remediation for more formal performance evaluation. The function of our CCC has also allowed us opportunity to evaluate the required rotations to ensure that they offer experiences that help residents achieve competency performance necessary to be safe and effective surgeons upon completion of training.

The effect of patient care order sets on medical resident education: a prospective before-after study

BACKGROUND

Patient care order sets are increasingly being used to optimize care. While studies have evaluated the impact of order sets on provider performance and patient outcomes, their impact on postgraduate medical trainee knowledge remains unknown. We sought to evaluate the impact of order sets on respirology knowledge, order-writing skills, and self-reported learning.

METHODS

We conducted a prospective before-after study. Postgraduate trainees completing a Respirology rotation at a quaternary-care hospital 6 months before (no order set period) and 12 months after (order set period) order set introduction. Guideline-based admission order sets with educational prompts detailing recommended management of cystic fibrosis and chronic obstructive pulmonary disease were implemented on the respirology ward. Each resident completed a test before and after the rotation assessing knowledge and order-writing. Residents in the order set period additionally completed a questionnaire regarding the impact of order set use on their learning.

ANALYSIS

The primary outcome, the difference between pre and post rotation scores was compared between residents in the no order set period and residents in the order set period, using univariate linear regression. Test validity was assessed with a 2-sample t-test, analysis of variance and Pearson's correlation coefficient. Self-reported impact of order set use were descriptively analyzed, and written responses were collated and coded.

RESULTS

Investigators consecutively recruited 11 subjects before and 28 subjects after order set implementation. Residents in the order set period had a greater improvement in post-rotation test scores than residents in the no order set period (p = 0.04); after adjustment for baseline scores, this was not significant (p = 0.3). The questionnaire demonstrated excellent convergent, discriminant and construct validity. Residents reported that order sets improved their knowledge and skills and provided a systematic approach to care.

CONCLUSIONS

Order sets do not appear to impair resident education, and may impart a benefit. This will require validation in larger studies and across diseases.

Utilizing a novel tool for the comprehensive assessment of resident operative performance

PURPOSE

A mechanism for more effective and comprehensive assessment of surgical residents' performance in the operating room (OR) is needed, especially in light of the new requirements issued by the American Board of Surgery. Furthermore, there is an increased awareness that assessments need to be more meaningful by including not only procedure-specific and general technical skills, but also nontechnical skills (NOTECHS), such as teamwork and communication skills. Our aims were to develop a methodology and create a tool that comprehensively assesses residents' operative performance.

METHODS

A procedure-specific technical skill assessment for laparoscopic colon resections was created through use of task analysis. Components of previously validated tools were added to broaden the assessment to include general technical skills and NOTECHS. Our instrument was then piloted in the OR to measure face and content validity through an iterative process with faculty evaluators. Once the tool was finalized, postgraduate 3 (PG3) and PG5 residents on a 2-month long rotation were assessed by 1 of 4 colorectal surgeons immediately after completing a case together. Construct validity was measured by evaluating the difference in scores between PG3 and PG5 residents' performance as well as the change in scores over the course of the rotation.

RESULTS

Sixty-three assessments were performed. All evaluations were completed within 48 hours of the operation. There was a statistically significant difference between the PG3 and PG5 scores on procedure-specific performance, general technical skills, NOTECHS, and overall performance. Over the course of the rotation, a statistically significant improvement was found in residents' scores on the procedure-specific portion of the assessment but not on the general surgical skills or NOTECHS.

CONCLUSION

This is a feasible, valid, and reliable assessment tool for the comprehensive evaluation of resident performance in the OR. We plan to use this tool to assess resident operative skill development and to improve direct resident feedback.

[Burnout and quality of life in medical residents]

BACKGROUND

burnout and quality of life are poorly studied phenomena in postgraduate students, and its effects are unknown. The aim was to investigate the relationship between quality of life and burnout in medical residents.

METHODS

a longitudinal study was performed. We included medical residents who began their postgraduate studies in 2010. The Spanish version of the Quality of Life Profile for the Chronically Ill (PLC, according to its initials in German), and the Maslach Burnout Inventory specific to physicians were applied at the beginning, and six and 12 months later. Descriptive statistics were used for nominal variables. Chi-square and ANOVA were applied to numerical variables.

RESULTS

we included 45 residents, the average age was 26.9 ± 2.93 years, 18 (40 %) were female and 27 (60 %) were male. The PLC survey found significant decrease in four of the six scales assessed in the three measurements. The Maslach Burnout Inventory found high levels of emotional exhaustion in the three tests, low levels of depersonalization and low personal gains at the beginning, rising at six and 12 months. The most affected specialty was Internal Medicine.

CONCLUSIONS

burnout and impaired quality of life for residents exist in postgraduate physicians and it is maintained during the first year of residency.

Current concepts of team training in surgical residency: a survey of North American program directors

OBJECTIVES

The purpose of the present survey was to (1) establish the prevalence of Crew Resource Management (CRM)- and team-training interventions among general surgery residency programs of the United States and Canada; (2) to characterize current approaches to training and assessment of nontechnical skills; and (3) to inquire about program directors' (PDs') recommendations for future curricula in graduate medical education.

DESIGN

An online questionnaire was developed by the authors and distributed via email to the directors of all accredited general surgery residency programs across the United States and Canada. After 3 email reminders, paper versions were sent to all nonresponders.

PARTICIPANTS AND SETTING

PDs of accredited general surgery residency programs in the United States and Canada.

RESULTS

One hundred twenty (47%) PDs from the United States and 9 (53%) from Canada responded to the survey. Of all respondents, 32% (n = 40) indicated conducting designated team-training interventions for residents. Three main instructional strategies were identified: combined approaches using simulation and didactic methods (42%, n = 16); predominantly simulation-based approaches (37%, n = 14); and didactic approaches (21%, n = 8). Correspondingly, 83% (n = 93) of respondents recommended a combination of didactic methods and opportunities for practice for future curricula. A high agreement between responding PDs was shown regarding learning objectives for a proposed team-based training curriculum (α = 0.95).

CONCLUSIONS

The self-reported prevalence of designated CRM- and team-training interventions among responding surgical residency programs was low. For the design of future curricula, the vast majority of responding PDs advocated for the combination of interactive didactic methods and opportunities for practice.

Medical residents' job satisfaction and their related factors

PURPOSE

This study was conducted to investigate medical residents' job satisfaction and their related factors to improve the quality of residency program.

METHODS

The study subjects were 159 medical residents being trained at Chonnam National University Hospital, South Korea, in 2011. The participants were asked to complete a short form Minnesota satisfaction questionnaire (MSQ).

RESULTS

The mean score for 20 items on the short form MSQ varied between 2.91 and 3.64 on a 5-point Likert scale. The assessment of related factors with job satisfaction revealed that medical residents had higher levels for job satisfaction, particularly those who were women (beta=0.200, p=0.022), and those who had mentorship experience (beta=0.219, p=0.008).

CONCLUSION

This study results indicate that we should expand and support the mentorship program during medical residency to promote job satisfaction.

Clinic teaching made easy: a prospective study of the American Academy of Dermatology core curriculum in primary care learners

BACKGROUND

Dermatology instruction for primary care learners is limited, and the American Academy of Dermatology (AAD) has developed a new core curriculum for dermatology.

OBJECTIVE

This study sought to prospectively evaluate short-term knowledge acquisition and long-term knowledge retention after using the AAD core curriculum during a clinical dermatology clerkship.

METHODS

Resident physicians and physician assistant students performing clerkships at military dermatology clinics were given access to the AAD core curriculum teaching modules before their public availability. Knowledge acquisition was measured with pretests and posttests, and a follow-up quiz was given up to a year after the dermatology rotation to assess knowledge retention.

RESULTS

In all, 82 primary care learners met inclusion criteria. Knowledge improved significantly from pretest to posttest (60.1 vs 77.4, P < .01). Of the 10 factors evaluated, only high use of the World Wide Web site was significantly associated with improved posttest scores (70.8 vs 82.2, P = .003). Long-term follow-up scores available from 38 participants were only slightly lower than their posttest scores (70.5 vs 78.9, P < .01) at a median time of 6.8 months after the clerkship. Students found the online modules clear, engaging, and worth their time and preferred them to other teaching methods such as textbook reading and lectures.

LIMITATIONS

The nonrandomized study was voluntary, so individual performance may be influenced by selection bias.

CONCLUSION

The more learners used the online curriculum, the better they scored on the posttest. This demonstrates the efficacy of the AAD core curriculum in teaching its goals and objectives for primary care learners performing a dermatology clerkship.

Comparing Attitudes toward Disclosing Medical Errors between Medical Students and Interns

PURPOSE

The purpose of this study was to compare attitudes toward disclosing medical errors between medical students and interns.

METHODS

The questionnaires were administrated to 164 medical students and interns. The questionnaires consist of 3 major concepts: knowledge, attitudes toward disclosure of medical error, barriers to the disclosure of medical error.

RESULTS

Interns (56.1%) took medical errors less seriously than medical students (74.8%). Medical students (75.6%) believed that patients would want to be informed of any kind of medical errors while Interns (46.3%) thought so. Medical students (83.1%) considered that serious medical errors should be disclosed to patients. On the contrary, only 46.3% of interns believed so. Medical students (16.3%) and interns (19.5%) believed disclosing medical error would increase patients trust in doctors. Both medical students and interns pointed out worries about malpractice suits as the biggest barrier to disclosing medical error.

CONCLUSION

The attitudes toward disclosing medical error between medical students and interns were significantly different in many aspects. Interns show more negative attitudes about disclosing medical errors than medical students. And they also take medical errors less seriously than medical students. In particular, the attitudes of the subjects in this study were greatly different from the results of a previous patients' attitudes study. These perspectives differences could work against achieving patient-centered care which is the upmost priority in the current trends in health care. The efforts to bridge these perspective gaps between patients and doctors should start from medical school by teaching medical students the importance of the disclosing medical errors.