Feasibility of Formal Mindfulness-Based Stress-Resilience Training Among Surgery Interns: A Randomized Clinical Trial

Importance

Among surgical trainees, burnout and distress are prevalent, but mindfulness has been shown to decrease the risk of depression, suicidal ideation, burnout, and overwhelming stress. In other high-stress populations, formal mindfulness training has been shown to improve mental health, yet this approach has not been tried in surgery.

Objective

To test the feasibility and acceptability of modified Mindfulness-Based Stress Reduction (MBSR) training during surgical residency.

Design, Setting, and Participants

A pilot randomized clinical trial of modified MBSR vs an active control was conducted with 21 surgical interns in a residency training program at a tertiary academic medical center, from April 30, 2016, to December 2017.

Interventions

Weekly 2-hour, modified MBSR classes and 20 minutes of suggested daily home practice over an 8-week period.

Main Outcomes and Measures

Feasibility was assessed along 6 domains (demand, implementation, practicality, acceptability, adaptation, and integration), using focus groups, interviews, surveys, attendance, daily practice time, and subjective self-report of experience.

Results

Of the 21 residents included in the analysis, 13 were men (62%). Mean (SD [range]) age of the intervention group was 29.0 (2.4 [24-31]) years, and the mean (SD [range]) age of the control group was 27.4 (2.1 [27-33]) years. Formal stress-resilience training was feasible through cultivation of stakeholder support. Modified MBSR was acceptable as evidenced by no attrition; high attendance (12 of 96 absences [13%] in the intervention group and 11 of 72 absences [15%] in the control group); no significant difference in days per week practiced between groups; similar mean (SD) daily practice time between groups with significant differences only in week 1 (control, 28.15 [12.55] minutes; intervention, 15.47 [4.06] minutes; P = .02), week 2 (control, 23.89 [12.93] minutes; intervention, 12.61 [6.06] minutes; P = .03), and week 4 (control, 26.26 [13.12] minutes; intervention, 15.36 [6.13] minutes; P = .04); course satisfaction (based on interviews and focus group feedback); and posttraining-perceived credibility (control, 18.00 [4.24]; intervention, 20.00 [6.55]; P = .03). Mindfulness skills were integrated into personal and professional settings and the independent practice of mindfulness skills continued over 12 months of follow-up (mean days [SD] per week formal practice, 3 [1.0]).

Conclusions and Relevance

Formal MBSR training is feasible and acceptable to surgical interns at a tertiary academic center. Interns found the concepts and skills useful both personally and professionally and participation had no detrimental effect on their surgical training or patient care.

Trial Registration

ClinicalTrials.gov identifier: NCT03141190.

Understanding Clerkship Student Roles in the Context of 21st-Century Healthcare Systems and Curricular Reform

Phenomenon: Preclerkship medical education has undergone extensive reform, and the clerkship years are growing targets for curricular innovation. As institutions implement new preclerkship curricula to better prepare medical students to practice medicine in the context of modern healthcare systems, the perspective of clerkship leaders regarding clerkship student roles and potential for change will facilitate redefining these roles so that preclerkship educational innovations can continue into clerkships. Approach: In this qualitative exploratory study, authors conducted semistructured interviews with clerkship and site directors for eight core clerkships from April to May 2016. Questions addressed how clerkship leaders perceive current student roles and the potential for change. Through iterative consensus building, authors identified themes describing current ideal clerkship student roles applicable to future roles. Findings: Twenty-three of 24 (96%) directors participated. Findings fell into four themes: factors influencing the clerkship role, clerkship student role archetypes, workplace authenticity and value, and potential for change. Student, supervisor, and context factors determine the clerkship student role. Three role archetypes emerged: the apprentice (an assistant completing concrete patient care tasks), the academic (a researcher bringing literature back to the team), and the communicator (an interdisciplinary and patient liaison). Each archetype was considered authentic and valuable. Positive attitudes toward preclerkship curricular changes were associated with openness to evolution of the clerkship students' role. These emerging roles mapped to the archetypes. Insights: Clerkship leaders perceive that student, supervisor, and context factors result in varying emphasis on role archetypes, which in turn lead to different types of learning. Medical educators can use the archetypes to articulate how expanded student roles align learning with clinical needs, particularly as they relate to health systems science and inquiry.

Using Technological Advances to Improve Surgery Curriculum: Experience With a Mobile Application

OBJECTIVE

Our previous home-video basic surgical skills curriculum required substantial faculty time and resources, and was limited by delayed feedback and technical difficulties. Consequently, we integrated that curriculum with a mobile application platform. Our purpose is to describe this application and learner satisfaction.

MATERIALS AND METHODS

The mobile platform incorporates a patented pedagogical design based on Ericsson's deliberate practice and Bandura's social learning theory. Instructors built step-wise skills modules. During the challenge phase, learners watched a video of surgical tasks completed by experts and uploaded a video of themselves performing the same task. In the Peer Review phase, they used a grading rubric to provide feedback. In the Recap stage, learners received individual feedback and could review their own videos. Two groups of learners, graduating medical students and matriculating surgical residents, participated in this independent learning platform, along with 2 to 4 laboratory sessions, and completed a survey about their experience. Survey responses were summarized descriptively and comments analyzed using content analysis.

RESULTS

Fifty learners submitted videos of assigned tasks and completed peer reviews. Learners reported positive experiences specifically for the Peer Review Stage, structured home practice, ease of mobile access to submit and review videos, and ongoing immediate feedback. Over half of the learners reported spending at least 10 to 30 minute practicing skills before recording their videos and over 80% rerecorded at least 2 times before submission. Content analysis revealed learners engaged with the educational concepts designed into the platform.

CONCLUSION

Learners easily used and were satisfied with a mobile-technology teaching platform that maintained the fundamental content, educational theories, and organizational structure of our previously effective surgical skills curriculum. Prior challenges were directly addressed through the mobile application's ease of use, support of deliberate practice, and improved timeliness of feedback.

Developing End-of-Training Entrustable Professional Activities for Psychiatry: Results and Methodological Lessons

PURPOSE

To develop entrustable professional activities (EPAs) for psychiatry and to demonstrate an innovative, validity-enhancing methodology that may be relevant to other specialties.

METHOD

A national task force employed a three-stage process from May 2014 to February 2017 to develop EPAs for psychiatry. In stage 1, the task force used an iterative consensus-driven process to construct proposed EPAs. Each included a title, full description, and relevant competencies. In stage 2, the task force interviewed four nonpsychiatric experts in EPAs and further revised the EPAs. In stage 3, the task force performed a Delphi study of national experts in psychiatric education and assessment. All survey participants completed a brief training program on EPAs. Quantitative and qualitative analysis led to further modifications. Essentialness was measured on a five-point scale. EPAs were included if the content validity index was at least 0.8 and the lower end of the asymmetric confidence interval was not lower than 4.0.

RESULTS

Stages 1 and 2 yielded 24 and 14 EPAs, respectively. In stage 3, 31 of the 39 invited experts participated in both rounds of the Delphi study. Round 1 reduced the proposed EPAs to 13. Ten EPAs met the inclusion criteria in Round 2.

CONCLUSIONS

The final EPAs provide a strong foundation for competency-based assessment in psychiatry. Methodological features such as critique by nonpsychiatry experts, a national Delphi study with frame-of-reference training, and stringent inclusion criteria strengthen the content validity of the findings and may serve as a model for future efforts in other specialties.

Translating Theory Into Practice: Implementing a Program of Assessment

PROBLEM

A program of assessment addresses challenges in learner assessment using a centrally planned, coordinated approach that emphasizes assessment for learning. This report describes the steps taken to implement a program of assessment framework within a medical school.

APPROACH

A literature review on best practices in assessment highlighted six principles that guided implementation of the program of assessment in 2016-2017: (1) a centrally coordinated plan for assessment aligns with and supports a curricular vision; (2) multiple assessment tools used longitudinally generate multiple data points; (3) learners require ready access to information-rich feedback to promote reflection and informed self-assessment; (4) mentoring is essential to facilitate effective data use for reflection and learning planning; (5) the program of assessment fosters self-regulated learning behaviors; and (6) expert groups make summative decisions about grades and readiness for advancement. Implementation incorporated stakeholder engagement, use of multiple assessment tools, design of a coaching program, and creation of a learner performance dashboard.

OUTCOMES

The assessment team monitors adherence to principles defining the program of assessment and gathers and responds to regular feedback from key stakeholders, including faculty, staff, and students.

NEXT STEPS

Next steps include systematically collecting evidence for validity of individual assessments and the program overall. Iterative review of student performance data informs curricular improvements. The program of assessment also highlights technology needs that will be addressed with information technology experts. The outcome ultimately will entail showing evidence of validity that the program produces physicians who engage in lifelong learning and provide high-quality patient care.

A Sequential Implementation Model for Workforce Development: A Case Study of Medical Residency Training for Substance Use Concerns

PROBLEM

In graduate medical education, residency programs are often educationally isolated from each other, with varying needs and patient populations, so strategies are needed when attempting to implement training in evidence-based practices across multiple residencies.

INTERVENTION

Using implementation science as a guide, we adapted a community development model to sequentially implement an evidence-based intervention, Screening, Brief Intervention, and Referral to Treatment (SBIRT) for alcohol and drug use problems, across internal medicine, pediatrics, emergency medicine, psychiatry, and obstetrics and gynecology residency programs.

CONTEXT

A grant-funded "executive" team coordinated the implementation, enrolled a new residency program annually, and served as the consultative team to span the programs. The team was attentive to aligning implementation with the needs of each program. To assist in planning, the team included a program champion 1 year prior to SBIRT implementation to provide the opportunity to develop resources and work with peers. We evaluated this model through an implementation science lens using a case study approach that included interviews and quantitative tabulation of products and resident perceptions.

OUTCOME

We successfully instituted SBIRT training in all 5 residency programs through the use of a supported local champion model. Teams developed 90 curricular products and had 57 presentations and publications. Residents reported satisfaction with the SBIRT activities. Champions reported that SBIRT was a useful approach and that they gained valuable knowledge and relationships from working with the executive team when designing learning materials appropriate for their residency. Champions successfully incorporated SBIRT into routine clinical practice.

LESSONS LEARNED

Having a strong team to support subsequent SBIRT champions was essential for implementation. The champions needed financial support to have the necessary time to implement training. The strategy of building a peer network across programs was critical for sustaining the implementation. Collecting and sharing resources aided the champions in developing their materials.

Developing and rewarding teachers as educators and scholars: remarkable progress and daunting challenges

CONTEXT

This article describes the scholarly work that has addressed the fifth recommendation of the 1988 World Conference on Medical Education: 'Train teachers as educators, not content experts alone, and reward excellence in this field as fully as excellence in biomedical research or clinical practice'.

PROGRESS

Over the past 30 years, scholars have defined the preparation needed for teaching and other educator roles, and created faculty development delivery systems to train teachers as educators. To reward the excellence of educators, scholars have expanded definitions of scholarship, defined educator roles and criteria for judging excellence, and developed educator portfolios to make achievements visible for peer review. Despite these efforts, the scholarship of discovery continues to be more highly prized and rewarded than the scholarship of teaching. These values are deeply embedded in university culture and policies.

CHALLENGES

To remedy the structural inequalities between researchers and educators, a holistic approach to rewarding the broad range of educational roles and educational scholarship is needed. This requires strong advocacy to create changes in academic rewards and support policies, provide a clear career trajectory for educators using learning analytics, expand programmes for faculty development, support health professions education scholarship units and academies of medical educators, and create mechanisms to ensure high standards for all educators.

Learner, Patient, and Supervisor Features Are Associated With Different Types of Cognitive Load During Procedural Skills Training: Implications for Teaching and Instructional Design

PURPOSE

Cognitive load theory, focusing on limits of the working memory, is relevant to medical education; however, factors associated with cognitive load during procedural skills training are not well characterized. The authors sought to determine how features of learners, patients/tasks, settings, and supervisors were associated with three types of cognitive load among learners performing a specific procedure, colonoscopy, to identify implications for procedural teaching.

METHOD

Data were collected through an electronically administered survey sent to 1,061 U.S. gastroenterology fellows during the 2014-2015 academic year; 477 (45.0%) participated. Participants completed the survey immediately following a colonoscopy. Using multivariable linear regression analyses, the authors identified sets of features associated with intrinsic, extraneous, and germane loads.

RESULTS

Features associated with intrinsic load included learners (prior experience and year in training negatively associated, fatigue positively associated) and patient/tasks (procedural complexity positively associated, better patient tolerance negatively associated). Features associated with extraneous load included learners (fatigue positively associated), setting (queue order positively associated), and supervisors (supervisor engagement and confidence negatively associated). Only one feature, supervisor engagement, was (positively) associated with germane load.

CONCLUSIONS

These data support practical recommendations for teaching procedural skills through the lens of cognitive load theory. To optimize intrinsic load, level of experience and competence of learners should be balanced with procedural complexity; part-task approaches and scaffolding may be beneficial. To reduce extraneous load, teachers should remain engaged, and factors within the procedural setting that may interfere with learning should be minimized. To optimize germane load, teachers should remain engaged.

Teachers as Learners: Developing Professionalism Feedback Skills via Observed Structured Teaching Encounters

This Conversations Starter article presents a selected research abstract from the 2017 Association of American Medical Colleges Southern Region Group on Educational Affairs annual spring meeting. The abstract is paired with the integrative commentary of 4 experts who shared their thoughts stimulated by the study. These thoughts explore the value of the Observed Structured Teaching Encounter in providing structured opportunities for medical students to engage with the complexities of providing peer feedback on professionalism.

Systems-Oriented Workplace Learning Experiences for Early Learners: Three Models

PURPOSE

Early workplace learning experiences may be effective for learning systems-based practice. This study explores systems-oriented workplace learning experiences (SOWLEs) for early learners to suggest a framework for their development.

METHOD

The authors used a two-phase qualitative case study design. In Phase 1 (spring 2014), they prepared case write-ups based on transcribed interviews from 10 SOWLE leaders at the authors' institution and, through comparative analysis of cases, identified three SOWLE models. In Phase 2 (summer 2014), studying seven 8-week SOWLE pilots, the authors used interview and observational data collected from the seven participating medical students, two pharmacy students, and site leaders to construct case write-ups of each pilot and to verify and elaborate the models.

RESULTS

In Model 1, students performed specific patient care activities that addressed a system gap. Some site leaders helped students connect the activities to larger systems problems and potential improvements. In Model 2, students participated in predetermined systems improvement (SI) projects, gaining experience in the improvement process. Site leaders had experience in SI and often had significant roles in the projects. In Model 3, students worked with key stakeholders to develop a project and conduct a small test of change. They experienced most elements of an improvement cycle. Site leaders often had experience with SI and knew how to guide and support students' learning.

CONCLUSIONS

Each model could offer systems-oriented learning opportunities provided that key elements are in place including site leaders facile in SI concepts and able to guide students in SOWLE activities.

The Health Professions Education Pathway: Preparing Students, Residents, and Fellows to Become Future Educators

PROBLEM

Training the next generation of health professionals requires leaders, innovators, and scholars in education. Although many medical schools and residencies offer education electives or tracks focused on developing teaching skills, these programs often omit educational innovation, scholarship, and leadership and are narrowly targeted to one level of learner.

INTERVENTION

The University of California San Francisco created the Health Professions Education Pathway for medical students, residents, and fellows as well as learners from other health professional schools. The Pathway applies the theoretical framework of communities of practice in its curricular design to promote learner identity formation as future health professions educators. It employs the strategies of engagement, imagination, and alignment for identity formation.

CONTEXT

Through course requirements, learners engage and work with members of the educator community of practice to develop the knowledge and skills required to participate in the community. Pathway instructors are faculty members who model a breadth of educator careers to help learners imagine personal trajectories. Last, learners complete mentored education projects, adopting scholarly methods and ethics to align with the broader educator community of practice.

OUTCOME

From 2009 to 2014, 117 learners participated in the Pathway. Program evaluations, graduate surveys, and web-based searches revealed positive impacts on learner career development. Learners gained knowledge and skills for continued engagement with the educator community of practice, confirmed their career aspirations (imagination), joined an educator-in-training community (engagement/imagination), and disseminated via scholarly meetings and peer-reviewed publications (alignment).

LESSONS LEARNED

Learners identified engagement with the learner community as the most powerful aspect of the Pathway; it provided peer support for imagining and navigating the development of their dual identities in the clinician and educator communities of practice. Also important for learner success was alignment of their projects with the goals of the local educator community of practice. Our community of practice approach to educator career development has shown promising early outcomes by nurturing learners' passion for teaching; expanding their interest in educational leadership, innovation, and scholarship; and focusing on their identity formation as future educators.

The Relationship Between the Use of Health Clinics in Rural Mississippi Schools and the CHIP-AE Adolescent Health Profile

School health clinics are one way to meet the objectives in Healthy People 2010 for adolescent health. To determine the relationship between adolescent health status and use of the school health clinics in four Mississippi high schools, the Child Health and Illness Profile–Adolescent Edition (CHIP-AE) was used. The CHIP-AE identifies health status, giving scores on resilience, comfort, risks, and satisfaction, resulting in health profiles. One hundred seventy-one 9th-graders participated in this descriptive study. Students with the highest discomfort and risk scores had no use of the school health clinic. Students with fair health profiles were the highest users of the school health clinic when compared to all other profiles. Of those students with very poor health status, 60% reported the school health clinic was their only source of health care. In this study, the term school health clinic refers to the health office staffed by a nurse without an advanced degree.

Performance of a cognitive load inventory during simulated handoffs: Evidence for validity

BACKGROUND

Advancing patient safety during handoffs remains a public health priority. The application of cognitive load theory offers promise, but is currently limited by the inability to measure cognitive load types.

OBJECTIVE

To develop and collect validity evidence for a revised self-report inventory that measures cognitive load types during a handoff.

METHODS

Based on prior published work, input from experts in cognitive load theory and handoffs, and a think-aloud exercise with residents, a revised Cognitive Load Inventory for Handoffs was developed. The Cognitive Load Inventory for Handoffs has items for intrinsic, extraneous, and germane load. Students who were second- and sixth-year students recruited from a Dutch medical school participated in four simulated handoffs (two simple and two complex cases). At the end of each handoff, study participants completed the Cognitive Load Inventory for Handoffs, Paas' Cognitive Load Scale, and one global rating item for intrinsic load, extraneous load, and germane load, respectively. Factor and correlational analyses were performed to collect evidence for validity.

RESULTS

Confirmatory factor analysis yielded a single factor that combined intrinsic and germane loads. The extraneous load items performed poorly and were removed from the model. The score from the combined intrinsic and germane load items associated, as predicted by cognitive load theory, with a commonly used measure of overall cognitive load (Pearson's r = 0.83, p < 0.001), case complexity (beta = 0.74, p < 0.001), level of experience (beta = -0.96, p < 0.001), and handoff accuracy (r = -0.34, p < 0.001).

CONCLUSION

These results offer encouragement that intrinsic load during handoffs may be measured via a self-report measure. Additional work is required to develop an adequate measure of extraneous load.

How Residents Develop Trust in Interns: A Multi-Institutional Mixed-Methods Study

PURPOSE

Although residents trust interns to provide patient care, little is known about how trust forms.

METHOD

Using a multi-institutional mixed-methods study design, the authors interviewed (March-September 2014) internal medicine (IM) residents in their second or third postgraduate year at a single institution to address how they develop trust in interns. Transcript analysis using grounded theory yielded a model for resident trust. Authors tested (January-March 2015) the model with residents from five IM programs using a two-section quantitative survey (38 items; 31 rated 0 = not at all to 100 = very much; 7 rated 0 = strongly disagree to 100 = strongly agree) to identify influences on how residents form trust.

RESULTS

Qualitative analysis of 29 interviews yielded 14 themes within five previously identified factors of trust (resident, intern, relationship, task, and context). Of 478 residents, 376 (78.7%) completed the survey. Factor analysis yielded 11 factors that influence trust. Respondents rated interns' characteristics (reliability, competence, and propensity to make errors) highest when indicating importance to trust (respective means 86.3 [standard deviation = 9.7], 76.4 [12.9], and 75.8 [20.0]). They also rated contextual factors highly as influencing trust (access to an electronic medical record, duty hours, and patient characteristics; respective means 79.8 [15.3], 73.1 [14.4], and 71.9 [20.0]).

CONCLUSIONS

Residents form trust based on primarily intern- and context-specific factors. Residents appear to consider trust in a way that prioritizes interns' execution of essential patient care tasks safely within the complexities and constraints of the hospital environment.

Identity formation and motivation of new faculty developers: A replication study in a resource constrained university

INTRODUCTION

Previous studies on the identity development and motivation of faculty developers have occurred with seasoned developers in a research-rich environment. We sought to determine if the findings of those studies could be replicated with novice faculty developers in a resource-constrained environment.

METHODS

We interviewed 15 novice faculty developers from Muhimbili University of Health and Allied Sciences (MUHAS) who, at the time, had led faculty development activities for no more than two years. We conducted a qualitative analysis sensitized by the previous findings.

RESULTS

Results were very similar to the previous work. The developers described compartmentalized, hierarchical, and merged identities. The impact was on their teaching as well as on others at MUHAS and on the institution itself. The motivations related to mastery, purpose, duty, satisfaction, and relatedness.

CONCLUSION

This replication led us to conclude that identity development as a faculty developer occurs even in novice developers who do faculty development as only part of their work and despite constrained resources and a different culture. These developers find the work richly rewarding and their motivations benefit the institution. This body of research highlights how faculty development provides benefits to the institution as well as engaging career opportunities.

Influence of learner knowledge and case complexity on handover accuracy and cognitive load: results from a simulation study

CONTEXT

The handover represents a high-risk event in which errors are common and lead to patient harm. A better understanding of the cognitive mechanisms of handover errors is essential to improving handover education and practice.

OBJECTIVES

This paper reports on an experiment conducted to study the effects of learner knowledge, case complexity (i.e. cases with or without a clear diagnosis) and their interaction on handover accuracy and cognitive load.

METHODS

Participants were 52 Dutch medical students in Years 2 and 6. The experiment employed a repeated-measures design with two explanatory variables: case complexity (simple or complex) as the within-subject variable, and learner knowledge (as indicated by illness script maturity) as the between-subject covariate. The dependent variables were handover accuracy and cognitive load. Each participant performed a total of four simulated handovers involving two simple cases and two complex cases.

RESULTS

Higher illness script maturity predicted increased handover accuracy (p < 0.001) and lower cognitive load (p = 0.007). Case complexity did not independently affect either outcome. For handover accuracy, there was no interaction between case complexity and illness script maturity. For cognitive load, there was an interaction effect between illness script maturity and case complexity, indicating that more mature illness scripts reduced cognitive load less in complex cases than in simple cases.

CONCLUSIONS

Students with more mature illness scripts performed more accurate handovers and experienced lower cognitive load. For cognitive load, these effects were more pronounced in simple than complex cases. If replicated, these findings suggest that handover curricula and protocols should provide support that varies according to the knowledge of the trainee.

The Value of Student-Run Clinics for Premedical Students: A Multi-Institutional Study

INTRODUCTION

Research has shown that student-run clinics (SRCs) are ideal experiential learning arenas for medical students, but no studies have characterized the impact of SRC participation on premedical students.

METHODS

We conducted a retrospective cohort study with newly matriculated first-year medical students at five California medical schools to determine the impact of premedical involvement in SRCs. Participants completed an anonymous one-time online survey that included demographic information and questions regarding SRC involvement prior to medical school.

RESULTS

Two-hundred eighty-seven out of 588 (48.2%) newly matriculated first-year medical students responded, with 17.4% of respondents reporting that they had volunteered in SRCs prior to medical school. These students identified SRCs as meaningful venues for developing patient interaction skills and finding medical student and physician mentors.

DISCUSSION

Prior to medical school matriculation, SRC experiences may be important experiential learning arenas, providing premedical students with an authentic clinical setting and access to mentors.

Content Validation of the Organizational Climate for Research Integrity (OCRI) Survey

The purpose of this study was to develop and establish content validity of an instrument designed to measure the organizational climate for research integrity in academic health centers. Twenty-seven research integrity scholars and administrators evaluated 64 survey items for relevance and clarity, as well as overall comprehensiveness of the constructs that are measured (organizational inputs, structures, processes and outcomes). Both quantitative and qualitative methods were used, particularly content validity indices (CVI) and analyses of respondents' comments. The content validity index for the overall survey was initially high (CVI = .83) and improved (CVI = .90) when 17 marginal-to-poor items were removed. This study resulted in the Organizational Climate for Research Integrity (OCRI) survey, a 43-item fixed-response survey with established content validity.

Social Workers as Workplace-Based Instructors of Alcohol and Drug Screening, Brief Intervention, and Referral to Treatment (SBIRT) for Emergency Medicine Residents

PROBLEM

Residency education is challenged by a shortage of personnel and time, particularly for teaching behavioral interventions such as screening, brief intervention, and referral to treatment (SBIRT) to reduce hazardous drinking and drug use. However, social workers may be well placed to teach SBIRT in clinical training settings.

INTERVENTION

We describe a curriculum with social workers as SBIRT trainers of emergency medicine (EM) residents during actual clinical shifts in an EM residency training program. The curriculum required 1 EM faculty member working with social workers and 1 additional hour of formal residency conference teaching time.

CONTEXT

We implemented the curriculum at both a university tertiary care hospital emergency department and a county trauma center. We trained 8 social workers at both sites as SBIRT superusers to teach and assess EM resident SBIRT performance with actual patients. We measured the length and number of sessions to attain SBIRT competence, residents' satisfaction, and resident comments (coded by authors).

OUTCOME

Five of the 8 social workers trained residents between June 2013 and May 2014, 31 EM residents trained to a level indicating SBIRT competence with 114 patients. Each patient interaction averaged 8.8 minutes and residents averaged 3.13 patients. Twenty-four (77%) residents gave ratings of 1.58 (SD = .58) for the quality of teaching, 2.33 (SD = .87) for recommending the training to a colleague, 1.38 (SD = .49) for superusers' knowledge, 1.88 (SD = .95) for usefulness of instruction, 1.54 (SD = .72) for workplace learning, and 1.58 (SD = .78) for valuing learning from social workers (on a scale of 1 [very satisfied/strongly agree] to 5 [very dissatisfied/strongly disagree]). Residents preferred learning SBIRT during the 1st and 2nd training years and in the workplace.

LESSONS LEARNED

Social work colleagues can be effective in teaching SBIRT to residents in the workplace, and our residents highly valued learning from social workers, who all had prior training in motivational interviewing. In the implementation of this curriculum, the clinical demands of residents must be taken into account when teaching occurs, and having multiple social worker instructors was instrumental.

Evaluation of a Surgery-Based Adjunct Course for Senior Medical Students Entering Surgical Residencies

BACKGROUND

Preparatory courses for senior medical students aim to ease the transition from medical school to residency. We designed a novel adjunct curriculum to enhance students' readiness for surgical internship. This study addresses the feasibility and outcomes of this course.

MATERIALS AND METHODS

A curriculum was designed based on ACGME surgical milestones. Students participated in 8 (3h) sessions held over 4 weeks as an adjunct to a well-established intern preparatory course. Course activities involved interactive simulation cases to emphasize care of surgical patients, and skills sessions focused on knot tying and suturing, which were reinforced with home video assignments. Students rated confidence on 14 management skills using a 5-point Likert scale (5 = high confidence). Faculty graded students' technical performance using a global scale (0-10) for 5 suturing exercises. Comparisons between precourse and postcourse data collected for all measures were made using t-tests (α = 0.05).

RESULTS

A total of 11 students entering 4 different surgical fields participated. Overall confidence in patient management improved from 2.41 to 3.89 (standard deviation = 0.49, 0.35; p < 0.05). Students' scores on all 5 suturing tasks increased (p < 0.05).

CONCLUSIONS

We developed a surgery-specific component to the existing preparatory course at our institution. Students demonstrated increased confidence in ward management skills and increased technical scores in all exercises. Although only 3 sessions were dedicated to technical skills, improvements may highlight the benefit of home video assignments. This course serves as a specialty-specific model for schools with existing preparatory courses. Our curriculum highlights skills specific for surgical residency, while maximizing resources.

Perceptions of Peer-to-Peer Interprofessional Feedback Among Students in the Health Professions

PURPOSE

Interprofessional teamwork should include interprofessional feedback to optimize performance and collaboration. Social identity theory predicts that hierarchy and stereotypes may limit receptiveness to interprofessional feedback, but literature on this is sparse. This study explores perceptions among health professions students regarding interprofessional peer feedback received after a team exercise.

METHOD

In 2012-2013, students from seven health professions schools (medicine, pharmacy, nursing, dentistry, physical therapy, dietetics, and social work) participated in a team-based interprofessional exercise early in clinical training. Afterward, they wrote anonymous feedback comments for each other. Each student subsequently completed an online survey to rate the usefulness and positivity (on five-point scales) of feedback received and guessed each comment's source. Data analysis included analysis of variance to examine interactions (on usefulness and positivity ratings) between profession of feedback recipients and providers.

RESULTS

Of 353 study participants, 242 (68.6%) accessed the feedback and 221 (62.6%) completed the survey. Overall, students perceived the feedback as useful (means across professions = 3.84-4.27) and positive (means = 4.17-4.86). There was no main effect of profession of the feedback provider, and no interactions between profession of recipient and profession of provider regardless of whether the actual or guessed provider profession was entered into the analysis.

CONCLUSIONS

These findings suggest that students have positive perceptions of interprofessional feedback without systematic bias against any specific group. Whether students actually use interprofessional feedback for performance improvement and remain receptive toward such feedback as they progress in their professional education deserves further study.

Measuring cognitive load during procedural skills training with colonoscopy as an exemplar

OBJECTIVES

Few studies have investigated cognitive factors affecting learning of procedural skills in medical education. Cognitive load theory, which focuses on working memory, is highly relevant, but methods for measuring cognitive load during procedural training are not well understood. Using colonoscopy as an exemplar, we used cognitive load theory to develop a self-report instrument to measure three types of cognitive load (intrinsic, extraneous and germane load) and to provide evidence for instrument validity.

METHODS

We developed the instrument (the Cognitive Load Inventory for Colonoscopy [CLIC]) using a multi-step process. It included 19 items measuring three types of cognitive load, three global rating items and demographics. We then conducted a cross-sectional survey that was administered electronically to 1061 gastroenterology trainees in the USA. Participants completed the CLIC following a colonoscopy. The two study phases (exploratory and confirmatory) each lasted for 10 weeks during the 2014-2015 academic year. Exploratory factor analysis determined the most parsimonious factor structure; confirmatory factor analysis assessed model fit. Composite measures of intrinsic, extraneous and germane load were compared across years of training and with global rating items.

RESULTS

A total of 477 (45.0%) invitees participated (116 in the exploratory study and 361 in the confirmatory study) in 154 (95.1%) training programmes. Demographics were similar to national data from the USA. The most parsimonious factor structure included three factors reflecting the three types of cognitive load. Confirmatory factor analysis verified that a three-factor model was the best fit. Intrinsic, extraneous and germane load items had high internal consistency (Cronbach's alpha 0.90, 0.87 and 0.96, respectively) and correlated as expected with year in training and global assessment of cognitive load.

CONCLUSIONS

The CLIC measures three types of cognitive load during colonoscopy training. Evidence of validity is provided. Although CLIC items relate to colonoscopy, the development process we detail can be used to adapt the instrument for use in other learning settings in medical education.

Ensuring Resident Competence: A Narrative Review of the Literature on Group Decision Making to Inform the Work of Clinical Competency Committees

Background The expectation for graduate medical education programs to ensure that trainees are progressing toward competence for unsupervised practice prompted requirements for a committee to make decisions regarding residents' progress, termed a clinical competency committee (CCC). The literature on the composition of these committees and how they share information and render decisions can inform the work of CCCs by highlighting vulnerabilities and best practices. Objective We conducted a narrative review of the literature on group decision making that can help characterize the work of CCCs, including how they are populated and how they use information. Methods English language studies of group decision making in medical education, psychology, and organizational behavior were used. Results The results highlighted 2 major themes. Group member composition showcased the value placed on the complementarity of members' experience and lessons they had learned about performance review through their teaching and committee work. Group processes revealed strengths and limitations in groups' understanding of their work, leader role, and information-sharing procedures. Time pressure was a threat to the quality of group work. Conclusions Implications of the findings include the risks for committees that arise with homogeneous membership, limitations to available resident performance information, and processes that arise through experience rather than deriving from a well-articulated purpose of their work. Recommendations are presented to maximize the effectiveness of CCC processes, including their membership and access to, and interpretation of, information to yield evidence-based, well-reasoned judgments.

Does source matter? Nurses' and Physicians' perceptions of interprofessional feedback

OBJECTIVE

Receptiveness to interprofessional feedback, which is important for optimal collaboration, may be influenced by 'in-group or out-group' categorisation, as suggested by social identity theory. We used an experimental design to explore how nurses and resident physicians perceive feedback from people within and outside their own professional group.

METHODS

Paediatric residents and nurses participated in a simulation-based team exercise. Two nurses and two physicians wrote anonymous performance feedback for each participant. Participants each received a survey containing these feedback comments with prompts to rate (i) the usefulness (ii) the positivity and (iii) their agreement with each comment. Half of the participants received feedback labelled with the feedback provider's profession (two comments correctly labelled and two incorrectly labelled). Half received unlabelled feedback and were asked to guess the provider's profession. For each group, we performed separate three-way anovas on usefulness, positivity and agreement ratings to examine interactions between the recipient's profession, actual provider profession and perceived provider profession.

RESULTS

Forty-five out of 50 participants completed the survey. There were no significant interactions between profession of the recipient and the actual profession of the feedback provider for any of the 3 variables. Among participants who guessed the source of the feedback, we found significant interactions between the profession of the feedback recipient and the guessed source of the feedback for both usefulness (F1,48 = 25.6; p < 0.001; η(2) = 0.35) and agreement ratings (F1,48 = 8.49; p < 0.01; η(2) = 0.15). Nurses' ratings of feedback they guessed to be from nurses were higher than ratings of feedback they guessed to be from physicians, and vice versa. Among participants who received labelled feedback, we noted a similar interaction between the profession of the feedback recipient and labelled source of feedback for usefulness ratings (F1,92 = 4.72; p < 0.05; η(2) = 0.05).

CONCLUSION

Our data suggest that physicians and nurses are more likely to attribute favourably perceived feedback to the in-group than to the out-group. This finding has potential implications for interprofessional feedback practices.

Measuring cognitive load: mixed results from a handover simulation for medical students

INTRODUCTION

The application of cognitive load theory to workplace-based activities such as patient handovers is hindered by the absence of a measure of the different load types. This exploratory study tests a method for measuring cognitive load during handovers.

METHODS

The authors developed the Cognitive Load Inventory for Handoffs (CLI4H) with items for intrinsic, extraneous, and germane load. Medical students completed the measure after participating in a simulated handover. Exploratory factor and correlation analyses were performed to collect evidence for validity.

RESULTS

Results yielded a two-factor solution for intrinsic and germane load that explained 50 % of the variance. The extraneous load items performed poorly and were removed from the model. The score for intrinsic load correlated with the Paas Cognitive Load scale (r = 0.31, p = 0.004) and was lower for students with more prior handover training (p = 0.036). Intrinsic load did not, however, correlate with performance. Germane load did not correlate with the Paas Cognitive Load scale but did correlate as expected with performance (r = 0.30, p = 0.005) and was lower for those students with more prior handover training (p = 0.03).

CONCLUSIONS

The CLI4H yielded mixed results with some evidence for validity of the score from the intrinsic load items. The extraneous load items performed poorly and the use of only a single item for germane load limits conclusions. The instrument requires further development and testing. Study results and limitations provide guidance to future efforts to measure cognitive load during workplace-based activities, such as handovers.

Unpacking the Complexity of Patient Handoffs Through the Lens of Cognitive Load Theory

ISSUE

The transfer of a patient from one clinician to another is a high-risk event. Errors are common and lead to patient harm. More effective methods for learning how to give and receive sign-out is an important public health priority.

EVIDENCE

Performing a handoff is a complex task. Trainees must simultaneously apply and integrate clinical, communication, and systems skills into one time-limited and highly constrained activity. The task demands can easily exceed the information-processing capacity of the trainee, resulting in impaired learning and performance. Appreciating the limits of working memory can help identify the challenges that instructional techniques and research must then address. Cognitive load theory (CLT) identifies three types of load that impact working memory: intrinsic (task-essential), extraneous (not essential to task), and germane (learning related). The authors generated a list of factors that affect a trainee's learning and performance of a handoff based on CLT. The list was revised based on feedback from experts in medical education and in handoffs. By consensus, the authors associated each factor with the type of cognitive load it primarily effects. The authors used this analysis to build a conceptual model of handoffs through the lens of CLT.

IMPLICATIONS

The resulting conceptual model unpacks the complexity of handoffs and identifies testable hypotheses for educational research and instructional design. The model identifies features of a handoff that drive extraneous, intrinsic, and germane load for both the sender and the receiver. The model highlights the importance of reducing extraneous load, matching intrinsic load to the developmental stage of the learner and optimizing germane load. Specific CLT-informed instructional techniques for handoffs are explored. Intrinsic and germane load are especially important to address and include factors such as knowledge of the learner, number of patients, time constraints, clinical uncertainties, overall patient/panel complexity, interacting comorbidities or therapeutics, experience or specialty gradients between the sender and receiver, the maturity of the evidence base for the patient's disease, and the use of metacognitive techniques. Research that identifies which cognitive load factors most significantly affect the learning and performance of handoffs can lead to novel, contextually adapted instructional techniques and handoff protocols. The application of CLT to handoffs may also help with the further development of CLT as a learning theory.

What's in a learning environment? Recognizing teachers' roles in shaping a learning environment to support competency

None

Medical Students' Perceptions of Surgeons: Implications for Teaching and Recruitment

OBJECTIVE

The purpose of this study was to assess first-year medical students' implicit perceptions of surgeons, focusing on the roles of gender and demeanor (communal = supportive, associated with women; agentic = assertive, associated with men).

DESIGN

Survey study. Each survey had 1 of 8 possible scenarios; all began with a short description of a surgeon who was described as accomplished and well trained, then varied by surgeon gender (male/female), surgeon demeanor (agentic/communal), and type of surgery (breast cancer/lung cancer). Using a 0 to 5 scale, respondents rated their perception of the surgeon through 5 questions. These 5 items were averaged to create a composite perception score scaled from 0 to 5.

SETTING

Surveys were administered at the University of California, San Francisco, and the University of California, Los Angeles.

PARTICIPANTS

We administered surveys to 333 first-year medical students who could read English and voluntarily agreed to participate.

RESULTS

A total of 238 students responded (71.5%). They preferred the communal vs agentic surgeon (4.2 ± 0.7 vs 3.9 ± 0.7, p = 0.002) and male medical students perceived surgeons more favorably than female medical students did (4.2 ± 0.6 vs 4.0 ± 0.8, p = 0.036). The preference score did not differ according to surgeon gender (female 4.12 vs male 3.98, p = 0.087). There were no significant interactions between the factors of student gender, surgeon gender, or demeanor. Students who reported an interest in surgery as a career did not perceive surgeons more favorably than the students interested in other fields (4.3 ± 0.7 vs 4.0 ± 0.7 respectively, p = 0.066).

CONCLUSIONS

Based on our findings, surgeon educators would likely find success in teaching and recruiting medical students by employing a communal demeanor in their interactions with all students, regardless of the students' gender or stated interest in surgery.

What motivates occasional faculty developers to lead faculty development workshops? A qualitative study

PURPOSE

The demand for faculty development is ongoing, and many medical schools will need to expand their pool of faculty developers to include physicians and scientists whose primary expertise is not education. Insight into what motivates occasional faculty developers can guide recruitment and retention strategies. This study was designed to understand the motivations of faculty developers who occasionally (one to three times each year) lead faculty development workshops.

METHOD

Qualitative data were collected in March and April 2012 from interviews with faculty developers who occasionally taught workshops from 2007 to 2012 in the University of California, San Francisco, School of Medicine's faculty development program. The interviews were audiotaped and transcribed. The authors thematically analyzed the transcripts using a general inductive approach and developed codes sensitized by motivation theories.

RESULTS

The authors interviewed 29/30 (97%) occasional faculty developers and identified five themes: mastery (desire to learn and develop professionally), relatedness (enjoyment of working with and learning from others), duty (sense of obligation to give back and be a good academic citizen), purpose (commitment to improving local teaching and ultimately patient care), and satisfaction (fun and enjoyment).

CONCLUSIONS

Four of the themes the authors found are well addressed in motivation theory literature: mastery, relatedness, duty, and purpose. Whereas these four are motivators for occasional faculty developers, it is the fifth theme-satisfaction-that the authors feel is foundational and links the others together. Armed with this understanding, individuals leading faculty development programs can develop strategies to recruit and retain occasional faculty developers.

Reviewing residents' competence: a qualitative study of the role of clinical competency committees in performance assessment

PURPOSE

Clinical competency committees (CCCs) are now required in graduate medical education. This study examined how residency programs understand and operationalize this mandate for resident performance review.

METHOD

In 2013, the investigators conducted semistructured interviews with 34 residency program directors at five public institutions in California, asking about each institution's CCCs and resident performance review processes. They used conventional content analysis to identify major themes from the verbatim interview transcripts.

RESULTS

The purpose of resident performance review at all institutions was oriented toward one of two paradigms: a problem identification model, which predominated; or a developmental model. The problem identification model, which focused on identifying and addressing performance concerns, used performance data such as red-flag alerts and informal information shared with program directors to identify struggling residents.In the developmental model, the timely acquisition and synthesis of data to inform each resident's developmental trajectory was challenging. Participants highly valued CCC members' expertise as educators to corroborate the identification of struggling residents and to enhance credibility of the committee's outcomes. Training in applying the milestones to the CCC's work was minimal.Participants were highly committed to performance review and perceived the current process as adequate for struggling residents but potentially not for others.

CONCLUSIONS

Institutions orient resident performance review toward problem identification; a developmental approach is uncommon. Clarifying the purpose of resident performance review and employing efficient information systems that synthesize performance data and engage residents and faculty in purposeful feedback discussions could enable the meaningful implementation of milestones-based assessment.

How clinical supervisors develop trust in their trainees: a qualitative study

CONTEXT

Clinical supervisors oversee trainees' performance while granting them increasing opportunities to work independently. Although the factors contributing to supervisors' trust in their trainees to conduct clinical work have been identified, how the development of trust is shaped by these factors remains less clear.

OBJECTIVES

This study was designed to determine how supervisors develop and experience trust in resident (postgraduate years 2 and 3) trainees in the clinical workplace.

METHODS

Internal medicine in-patient supervisors at two institutions were interviewed about the meaning and experience of developing trust in resident trainees. Transcribed data were coded and analysed using a phenomenographic approach.

RESULTS

Forty-three supervisors participated. Supervisors characterised the meaning of trust from the perspectives of trainee competence and leadership or from their own perspective of needing to provide more or less supervision. Supervisors initially considered trust to be usually independent of prior knowledge of the resident, and then used sources of information about trust to develop their judgements of trust. Sources, which incorporated inference, included supervisors' comparisons with a standard, direct observation of the trainee as a team leader or care provider, and stakeholder input from team members, patients and families. Barriers against and accelerators to trust formation related to the resident, supervisor, resident-supervisor relationship, context and task. Trust formation had implications for supervisors' roles, residents' increasingly independent provision of care, and team functioning.

CONCLUSIONS

From a general starting point, supervisors develop trust in residents informed by observation, inference and information gathered from the team and patients. Judgements of trust yield outcomes defined by supervisors' changing roles, the increasingly independent provision of care by residents, and team functioning. The implications of these findings for graded resident autonomy aligned with learning needs can inform the design of training environments to enable readiness for unsupervised practice.

Essential steps in developing best practices to assess reflective skill: A comparison of two rubrics

PURPOSE

Medical education lacks best practices for evaluating reflective writing skill. Reflection assessment rubrics include the holistic, reflection theory-based Reflection-on-Action and the analytic REFLECT developed from both reflection and narrative-medicine literatures. To help educators move toward best practices, we evaluated these rubrics to determine (1) rater requirements; (2) score comparability; and (3) response to an intervention.

METHODS

One-hundred and forty-nine third-year medical students wrote reflections in response to identical prompts. Trained raters used each rubric to score 56 reflections, half written with structured guidelines and half without. We used Pearson's correlation coefficients to associate overall rubric levels and independent t-tests to compare structured and unstructured reflections.

RESULTS

Reflection-on-Action training required for two hours; two raters attained an interrater-reliability = 0.91. REFLECT training required six hours; three raters achieved an interrater-reliability = 0.84. Overall rubric correlation was 0.53. Students given structured guidelines scored significantly higher (p < 0.05) on both rubrics.

CONCLUSIONS

Reflection-on-Action and REFLECT offer unique educational benefits and training challenges. Reflection-on-Action may be preferred for measuring overall quality of reflection given its ease of use. Training on REFLECT takes longer but it yields detailed data on multiple dimensions of reflection that faculty can reference when providing feedback.

Improving interprofessional collaboration: evaluation of implicit attitudes in the surgeon-nurse relationship

BACKGROUND

Optimizing the surgeon-nurse relationship to improve interprofessional communication is increasingly recognized as an essential component of patient care. The increasing number of women surgeons has altered the surgeon-nurse dynamic, which has traditionally been a male-female relationship. In particular, this shift has raised the issue of whether implicit perceptions regarding gender and demeanor influence the interactions between surgeons and nurses. Therefore, the purpose of this study was to understand nurses' implicit perceptions of surgeons, with a particular focus on gender and gender-normative demeanor. We defined two types of demeanor: communal, which is classically associated with women and includes being supportive and nurturing, and agentic, which is a male-associated trait that includes being direct and assertive.

METHODS

We administered surveys to 1701 nurses at the main campus of our institution. Each survey had one of eight possible scenarios; all began with a short description of a surgeon who was described as accomplished and well-trained, then varied by surgeon gender (male/female), surgeon demeanor (agentic/communal) and type of surgery (breast cancer/lung cancer). Using a 0 to 5 scale, respondents rated their perception of the surgeon through five questions. These five items were averaged to create a composite perception score scaled from 0 to 5.

RESULTS

We received 493 surveys. The overall average perception score was 3.8±0.99. Respondents had a statistically significant preference for the communal surgeon (4.1±0.91) versus the agentic surgeon (3.6±1.0, p<0.001). There were no significant main effects of surgeon gender or surgery type.

CONCLUSION

Nurses demonstrated a significant preference for communal surgeons, regardless of surgeon gender.

Identity formation of occasional faculty developers in medical education: a qualitative study

PURPOSE

Faculty developers play a crucial role in preparing faculty members for their instructional responsibilities. In some programs, faculty developers are clinicians and scientists who only occasionally conduct workshops. The authors examine the identity formation of such part-time faculty developers.

METHOD

From April 2012 through March 2012, structured interviews were conducted with full-time faculty members who, from 2007 to 2012, periodically volunteered to teach workshops in the University of California, San Francisco School of Medicine's faculty development program. This qualitative study used a modified grounded theory approach.

RESULTS

The authors interviewed 29 occasional faculty developers who had 1 to 22 years of experience conducting faculty development programs. All faculty had an educator identity along with their professional identity. The additional faculty developer identity generally evolved over time and aligned with their identity in one of four ways: compartmentalized, hierarchical, parallel, or merged. Their roles as faculty developers enhanced their status in their work community and influenced the way they worked with others and advanced their careers. Faculty development influences the institutional culture, and the institutional culture supports faculty development.

CONCLUSIONS

Most occasional faculty developers possessed a merged identity that developed over time and was moderated by the topic that they taught. Although experience contributed to this development, both junior and senior faculty developers could have a merged identity. Those who lead faculty development programs can use these findings to recruit and retain faculty developers.

Impact of student-run clinics on preclinical sociocultural and interprofessional attitudes: a prospective cohort analysis

INTRODUCTION

Descriptive studies suggest student-run clinics (SRCs) positively affect preclinical students' sociocultural and interprofessional attitudes, but few studies use validated measures.

METHODS

In a pre-post design, first-year medical, nursing, and pharmacy students who did and did not participate in SRCs completed demographic and open-ended questions, as well as two validated surveys, the Sociocultural Attitudes in Medicine Inventory (SAMI) and Readiness for Interprofessional Learning Scale (RIPLS), at the beginning and end of the year.

RESULTS

With 68% (n=182/267) matched surveys we found no significant differences between groups over time (SAMI p=.53, RIPLS p≥.28 for each subcategory). However, of SRC participants, 99% reported commitment to the underserved and 57% reported improved interprofessional attitudes.

DISCUSSION

Students participating in SRCs perceive positive benefits, but do not score differently from those who do not. The SRC experiences may not be frequent enough to affect these measures, particularly since our students were high-scoring upon entry.

Understanding trust as an essential element of trainee supervision and learning in the workplace

Clinical supervision requires that supervisors make decisions about how much independence to allow their trainees for patient care tasks. The simultaneous goals of ensuring quality patient care and affording trainees appropriate and progressively greater responsibility require that the supervising physician trusts the trainee. Trust allows the trainee to experience increasing levels of participation and responsibility in the workplace in a way that builds competence for future practice. The factors influencing a supervisor's trust in a trainee are related to the supervisor, trainee, the supervisor-trainee relationship, task, and context. This literature-based overview of these five factors informs design principles for clinical education that support the granting of entrustment. Entrustable professional activities offer promise as an example of a novel supervision and assessment strategy based on trust. Informed by the design principles offered here, entrustment can support supervisors' accountability for the outcomes of training by maintaining focus on future patient care outcomes.

Perceptions of surgeons: what characteristics do women surgeons prefer in a colleague?

BACKGROUND

Perceptions underlie bias and drive behavior. This study assessed female surgeons' implicit perceptions of surgeons, with a focus on the roles of sex and demeanor (communal = supportive, associated with women; agentic = assertive, associated with men).

METHODS

Electronic surveys were administered via the Association of Women Surgeons e-mail listserve to 550 post-training female surgeons. Each survey had one of the 4 possible scenarios that varied by surgeon sex (male/female) and surgeon demeanor (agentic/communal). Respondents rated their perception of the surgeon through 5 questions regarding preference and 5 questions regarding professional opinion (1 to 5 scale).

RESULTS

We received 212 surveys. In both preference and professional scores, female surgeons were rated significantly higher compared with their male counterparts (4.7 vs 4.4 and 4.3 vs 4.0, respectively). Communal surgeons were rated significantly higher versus agentic surgeons in both scores (4.7 vs 4.4 and 4.6 vs 3.7).

CONCLUSIONS

Female surgeons demonstrated a significant preference for female surgeons and for communal surgeons.

Health professions educators as agents of change in Tanzania: creativity to implement new curricula

Muhimbili University of Health and Allied Sciences (MUHAS) strives to instill in its graduates skills and competencies appropriate to serving the Tanzanian population well. MUHAS leadership, working in collaboration with educators from the University of California San Francisco (UCSF), selected and trained an interdisciplinary group of faculty members to promote effective teaching. We describe the development of this group of faculty change agents - now known as the Health Professions Educators Group (HPEG). The HPEG invigorated the education environment at MUHAS by: engaging many colleagues in special training events that introduced new methods for teaching and assessment; encouraging innovation; and developing strong mentoring relationships. HPEG members piloted courses in education to prepare all postgraduate students as peer educators, teaching assistants, and as candidates for faculty future appointments. Creation of a 'teaching commons' reinforces the new focus on innovative teaching as faculty members share experiences and gain recognition for their contributions to quality education.

Patient perceptions of female surgeons: how surgeon demeanor and type of surgery affect patient preference

BACKGROUND

As more women become surgeons, knowledge of patient perceptions is necessary to educate this new pool of surgeons on how to maximize patient trust and foster the optimal surgeon-patient relationship.

MATERIALS AND METHODS

Patients in a general medicine clinic in San Francisco were surveyed. Study respondents read one of the eight short scenarios that differed by surgeon gender, surgery type (lung cancer versus breast cancer), and surgeon demeanor (more masculine--agentic versus more feminine--communal). In all scenarios, the surgeon was described as accomplished and well trained. After reading the short description, respondents rated five items from 0-5, which were averaged to create a measure of preference.

RESULTS

Based on the 476 completed surveys, respondents did not have a significant preference for either female or male surgeons (P = 0.76). We found a significant interaction in respondent choice between the surgeon demeanor and the type of surgery (P < 0.05). Respondents preferred an agentic surgeon for lung cancer surgery and a communal surgeon for breast cancer surgery regardless of surgeon or respondent gender. No other interactions or main effects were statistically significant.

CONCLUSIONS

Our respondents did not overtly prefer a surgeon based on gender, which suggests that patients may not contribute to the traditional gender biases reported by female surgeons. Further work needs to be done to determine if our results can be replicated in different geographic regions and if there is gender stereotyping within the field of surgery.

Developing entrustable professional activities as the basis for assessment of competence in an internal medicine residency: a feasibility study

BACKGROUND

Graduate medical education programs assess trainees' performance to determine readiness for unsupervised practice. Entrustable professional activities (EPAs) are a novel approach for assessing performance of core professional tasks.

AIM

To describe a pilot and feasibility evaluation of two EPAs for competency-based assessment in internal medicine (IM) residency.

SETTING/PARTICIPANTS

Post-graduate year-1 interns (PGY-1s) and attendings at a large internal medicine (IM) residency program.

PROGRAM DESCRIPTION

Two Entrustable professional activities (EPA) assessments (Discharge, Family Meeting) were piloted.

PROGRAM FEASIBILITY EVALUATION

Twenty-eight out of 43 (65.1 %) PGY-1 s and 32/43 (74.4 %) attendings completed surveys about the Discharge EPA experience. Most who completed the EPA assessment (10/12, 83.8 %, PGY-1s; 9/11, 83.3 %, attendings) agreed it facilitated useful feedback discussions. For the Family Meeting EPA, 16/26 (61.5 %) PGY-1s completed surveys, and most who participated (9/12 PGY1s, 75 %) reported it improved attention to family meeting education, although only half recommended continuing the EPA assessment.

DISCUSSION

From piloting two EPA assessments in a large IM residency, we recognized our reminder systems and time dedicated for completing EPA requirements as inadequate. Collaboration around patient safety and palliative care with relevant clinical services has enhanced implementation and buy-in. We will evaluate how well EPA-based assessment serves the intended purpose of capturing trainees' trustworthiness to conduct activities unsupervised.

Systems-based practice learning opportunities in student-run clinics: a qualitative analysis of student experiences

PURPOSE

Student-run clinics (SRCs) provide preclerkship medical students with systems-based practice (SBP) experiences as they engage in patient care and manage clinic operations. This study explored the types and context of SBP activities students participate in at SRCs.

METHOD

Between November 2011 and February 2012, the authors conducted in-depth, semistructured interviews with a purposive sample of medical students who served as volunteers and coordinators (student leadership role) at four independently run SRCs within the University of California, San Francisco, School of Medicine. They also interviewed SRC faculty advisors. Interviews focused on student roles in SRCs, SBP learning opportunities in SRCs, and comparisons of SBP experiences in SRCs with those in the formal preclerkship curriculum. The authors used thematic analysis techniques to code and synthesize data.

RESULTS

Data from interviews with 8 volunteers, 14 coordinators, and 4 faculty suggested six major domains related to SBP learning opportunities in SRCs: interprofessional roles and collaboration; clinic organization; patient factors affecting access to care; awareness of the larger health care system and continuity of care; resource acquisition and allocation; and systems improvement. Coordinators, who managed SRCs, demonstrated greater depth of SBP understanding than volunteers, who provided patient care. Students and faculty agreed that SRCs provided students with SBP learning opportunities beyond those available in the formal curriculum.

CONCLUSIONS

Preclerkship students' participation in SRCs provides opportunities for in-depth learning of SBP, particularly among students who take on leadership roles. SRCs may model ways to effectively introduce key components of SBP to early medical learners.

Perceptions of a mobile technology on learning strategies in the anatomy laboratory

Mobile technologies offer new opportunities to improve dissection learning. This study examined the effect of using an iPad-based multimedia dissection manual during anatomy laboratory instruction on learner's perception of anatomy dissection activities and use of time. Three experimental dissection tables used iPads and three tables served as a control for two identical sessions. Trained, non-medical school anatomy faculty observers recorded use of resources at two-minute intervals for 20 observations per table. Students completed pre- and post-perception questionnaires. We used descriptive and inferential analyses. Twenty-one control and 22 experimental students participated. Compared with controls, experimental students reported significantly (P < 0.05) less reliance on paper and instructor resources, greater ability to achieve anatomy laboratory objectives, and clarity of the role of dissection in learning anatomy. Experimental students indicated that the iPad helped them in dissection. We observed experimental students more on task (93% vs. 83% of the time) and less likely to be seeking an instructor (2% vs. 32%). The groups received similar attention from instructors (33% vs. 37%). Fifty-nine percent of the time at least one student was looking at the iPad. Groups clustered around the iPad a third of their time. We conclude that the iPad-manual aided learner engagement, achieved instructional objectives, and enhanced the effectiveness and efficiency of dissection education.

Assessing systems-based practice

The conceptual definition of systems-based practice (SBP) does not easily translate into directly observable actions or behaviors that can be easily assessed. At the Academic Emergency Medicine consensus conference on education research in emergency medicine (EM), a breakout group presented a review of the literature on existing assessment tools for SBP, discussed the recommendations for research tool development during breakout sessions, and developed a research agenda based on this discussion.

Using needs assessment to develop curricula for screening, brief intervention, and referral to treatment (SBIRT) in academic and community health settings

This article describes the use of a brief needs assessment survey in the development of alcohol and drug screening, brief intervention, and referral to treatment (SBIRT) curricula in 2 health care settings in the San Francisco Bay Area. The samples included university medical center faculty (n = 27) and nonphysician community health and social service providers in a nearby suburban county (n = 21). Informed by curriculum development theory and motivational interviewing strategies, questions regarding clinical and educational priorities, perceived importance and confidence with screening and intervention techniques, and referral resource availability were included. Medical center faculty expressed greater concern about limited appointment time (P = .003), adequacy of training (P = .025), and provider confidence (P = .038) as implementation obstacles and had lower confidence in delivering SBIRT (P = .046) and providing treatment referrals (P = .054) than community providers. The authors describe their approach to integrating needs assessment results into subsequent curriculum development. Findings highlight potential differences between physician and nonphysician training needs.

A comparison of two methods of teaching reflective ability in Year 3 medical students

CONTEXT

Little is known about best practices for teaching and learning reflection. We hypothesised that reflective ability scores on written reflections would be higher in students using critical reflection guidelines, or receiving feedback on reflective skill in addition to reflection content, or both, compared with those in students who received only a definition of reflection or feedback on reflection content alone.

METHODS

Using a 2 (guidelines) × 2 (feedback) × 2 (time) design, we randomly assigned half of our sample of 149 Year 3 medical students to receive critical reflection guidelines and the other half to receive only a definition of critical reflection. We then randomly divided both groups in half again so that one half of each group received feedback on both the content and reflective ability in their reflections, and the other received content feedback alone. The learners' performance was measured on the first and third written reflections of the academic year using a previously validated scoring rubric. We calculated descriptive statistics for the reflection scores and conducted a repeated-measures analysis of variance with two between-groups factors, guidelines and feedback, and one within-group factor, occasion, using the measure of reflective ability as the dependent variable.

RESULTS

We failed to find a significant interaction between guidelines and feedback (F = 0.51, d.f. = 1, 145, p = 0.48). However, the provision of critical reflection guidelines improved reflective ability compared with the provision of a definition of critical reflection only (F = 147.1, d.f. = 1, 145, p < 0.001). Feedback also improved reflective ability, but only when it covered reflective skill in addition to content (F = 6.5, d.f. = 1, 145, p = 0.012).

CONCLUSIONS

We found that the provision of critical reflection guidelines improved performance and that feedback on both content and reflective ability also improved performance. Our study demonstrates that teaching learners the characteristics of deeper, more effective reflection and helping them to acquire the skills they need to reflect well improves their reflective ability as measured by performance on reflective exercises.