Feedback for Learners in Medical Education: What Is Known? A Scoping Review

Beyond "Read More": An Intervention to Improve Faculty Written Feedback to Learners

BACKGROUND

High-quality feedback is necessary for learners' development. It is most effective when focused on behavior and should also provide learners with specific next steps and desired outcomes. Many faculty struggle to provide this high-quality feedback.

OBJECTIVE

To improve the quality of written feedback by faculty in a department of medicine, we conducted a 1-hour session using a novel framework based on education literature, individual review of previously written feedback, and deliberate practice in writing comments.

METHODS

Sessions were conducted between August 2015 and June 2018. Participants were faculty members who teach medical students, residents, and/or fellows. To measure the effects of our intervention, we surveyed participants and used an a priori coding scheme to determine how feedback comments changed after the session.

RESULTS

Faculty from 7 divisions participated (n = 157). We surveyed 139 participants postsession and 55 (40%) responded. Fifty-three participants (96%) reported learning new information. To more thoroughly assess behavioral changes, we analyzed 5976 feedback comments for students, residents, and fellows written by 22 randomly selected participants before the session and compared these to 5653 comments written by the same participants 1 to 12 months postsession. Analysis demonstrated improved feedback content; comments providing nonspecific next steps decreased, and comments providing specific next steps, reasons why, and outcomes increased.

CONCLUSIONS

Combining the learning of a simple feedback framework with an immediate review of written comments that individual faculty members previously provided learners led to measured improvement in written comments.

A Focus on Feedback: Improving Learner Engagement and Faculty Delivery of Feedback in Hospital Medicine

Feedback is an integral part of medical education. However, there is great variation of training and effectiveness of feedback delivery, especially in the inpatient setting. The unique learning environment provided in hospital medicine allows teachers the opportunity to provide feedback on learner performance under several longitudinal observations in areas such as direct patient care, procedural tasks, and interdisciplinary team leadership skills. Most important, feedback should occur on more than one occasion to truly empower change in knowledge, attitude, and skills. This article aims to provide the reader with foundational theories on feedback and strategies to use best practices for delivery.

Using conversation analysis to explore feedback on resident performance

Feedback on clinical performance of residents is seen as a fundamental element in postgraduate medical education. Although literature on feedback in medical education is abundant, many supervisors struggle with providing this feedback and residents experience feedback as insufficiently constructive. With a detailed analysis of real-world feedback conversations, this study aims to contribute to the current literature by deepening the understanding of how feedback on residents' performance is provided, and to formulate recommendations for improvement of feedback practice. Eight evaluation meetings between program directors and residents were recorded in 2015-2016. These meetings were analyzed using conversation analysis. This is an ethno-methodological approach that uses a data-driven, iterative procedure to uncover interactional patterns that structure naturally occurring, spoken interaction. Feedback in our data took two forms: feedback as a unidirectional activity and feedback as a dialogic activity. The unidirectional feedback activities prevailed over the dialogic activities. The two different formats elicit different types of resident responses and have different implications for the progress of the interaction. Both feedback formats concerned positive as well as negative feedback and both were often mitigated by the participants. Unidirectional feedback and mitigating or downplaying feedback is at odds with the aim of feedback in medical education. Dialogic feedback avoids the pitfall of a program director-dominated conversation and gives residents the opportunity to take ownership of their strengths and weaknesses, which increases chances to change resident behavior. On the basis of linguistic analysis of our real-life data we suggest implications for feedback conversations.

Entrustable professional activities in health care education: a scoping review

CONTEXT

The shift in medical education from time-based learning to outcome-based learning has drawn much attention to entrustable professional activities (EPAs) as an ideal assessment framework to translate competencies into clinical practice. Given the relative novelty of EPAs, this review aims to highlight research gaps and explore and consolidate available evidence pertaining to the development and implementation of EPAs in health care.

METHOD

Arksey and O'Malley's scoping review framework was used to present the findings. The authors performed a systematic search of PubMed, Embase, CINAHL, Scopus, MedNar, OpenGrey and ProQuest Dissertation and Theses for English articles published from the inception of each database to May 2018. A manual search of the reference lists of the included studies was conducted and an expert panel was consulted. Two reviewers screened the articles for eligibility using the inclusion criteria. All authors extracted key data and analysed the data descriptively. Thematic analysis was used to categorise the results into themes.

RESULTS

Eighty articles were included in the review. All articles were published between 2010 and 2018. Three major themes and eight sub-themes were generated: (i) development of EPAs (frameworks for EPA development and implementation, identifying core or specialty-specific EPAs, and EPAs for faculty development), (ii) evaluation of EPAs and EPA entrustment factors (revised curriculum, entrustment decisions for professional activities, and feedback on implemented EPAs and the development process), and (iii) future directions and recommendations for EPAs (implementation of EPAs in undergraduate medical education and specific disciplines, and other criticisms and recommendations for EPAs).

CONCLUSIONS

Entrustable professional activities are an essential means to translate competencies into observable and measurable clinical practice. However, high-level evidence-based research on the efficacy, development and implementation of EPAs for specific target groups (i.e. undergraduates and staff) and geographical regions (i.e. Asia and Africa) is still lacking, which suggests a direction for future research.

Milestone Implementation's Impact on Narrative Comments and Perception of Feedback for Internal Medicine Residents: a Mixed Methods Study

BACKGROUND

Feedback is a critical element of graduate medical education. Narrative comments on evaluation forms are a source of feedback for residents. As a shared mental model for performance, milestone-based evaluations may impact narrative comments and resident perception of feedback.

OBJECTIVE

To determine if milestone-based evaluations impacted the quality of faculty members' narrative comments on evaluations and, as an extension, residents' perception of feedback.

DESIGN

Concurrent mixed methods study, including qualitative analysis of narrative comments and survey of resident perception of feedback.

PARTICIPANTS

Seventy internal medicine residents and their faculty evaluators at the University of Utah.

APPROACH

Faculty narrative comments from 248 evaluations pre- and post-milestone implementation were analyzed for quality and Accreditation Council for Graduate Medical Education competency by area of strength and area for improvement. Seventy residents were surveyed regarding quality of feedback pre- and post-milestone implementation.

KEY RESULTS

Qualitative analysis of narrative comments revealed nearly all evaluations pre- and post-milestone implementation included comments about areas of strength but were frequently vague and not related to competencies. Few evaluations included narrative comments on areas for improvement, but these were of higher quality compared to areas of strength (p < 0.001). Overall resident perception of quality of narrative comments was low and did not change following milestone implementation (p = 0.562) for the 86% of residents (N = 60/70) who completed the pre- and post-surveys.

CONCLUSIONS

The quality of narrative comments was poor, and there was no evidence of improved quality following introduction of milestone-based evaluations. Comments on areas for improvement were of higher quality than areas of strength, suggesting an area for targeted intervention. Residents' perception of feedback quality did not change following implementation of milestone-based evaluations, suggesting that in the post-milestone era, internal medicine educators need to utilize additional interventions to improve quality of feedback.

Twelve tips to promote a feedback culture with a growth mind-set: Swinging the feedback pendulum from recipes to relationships

Feedback in medical education has traditionally showcased techniques and skills of giving feedback, and models used in staff development have focused on feedback providers (teachers) not receivers (learners). More recent definitions have questioned this approach, arguing that the impact of feedback lies in learner acceptance and assimilation of feedback with improvement in practice and professional growth. Over the last decade, research findings have emphasized that feedback conversations are complex interpersonal interactions influenced by a multitude of sociocultural factors. However, feedback culture is a concept that is challenging to define, thus strategies to enhance culture are difficult to pin down. In this twelve tips paper, we have attempted to define elements that constitute a feedback culture from four different perspectives and describe distinct strategies that can be used to foster a learning culture with a growth mind-set.

Clinical learning in the context of uncertainty: a multi-center survey of emergency department residents' and attending physicians' perceptions of clinical feedback

BACKGROUND

Feedback is an essential part of clinical teaching and learning, yet it is often perceived as unsatisfactory in busy clinical settings. Clinical teachers need to balance the competing demands of clinical duty and feedback provision. The influence of the clinical environment and the mutual relationship between feedback giving and seeking has been inadequately investigated. This study therefore aimed to quantify the adequacy, perceptions, and influential factors of feedback provision during resident training in emergency departments (EDs).

METHODS

A multicenter online questionnaire study was undertaken. The respondents comprised ED residents and clinical teachers from four teaching hospitals in Taiwan. The questionnaire was developed via an expert panel, and a pilot study ensured validity. Ninety clinical teachers and 54 residents participated.

RESULTS

The respondents reported that the majority of feedback, which usually lasted 1-5 min, was initiated by the clinical teachers. Feedback satisfaction was significantly lower for the clinical teachers than for the residents (clinical teachers M = 13.8, SD = 1.83; residents M = 15.3, SD = 2.14; p < 0.0001), and positive feedback was provided infrequently in clinical settings (31.1%). Both groups of participants admitted hesitating between providing/seeking feedback and completing clinical work. Being busy, the teachers' clinical abilities, the learners' attitudes, and the relationship between both parties were reported as the most influential factors in feedback provision.

CONCLUSION

ED clinical feedback provision is often short, circumstantial, and initiated by clinical teachers. Providing or seeking feedback appears to be an important part of clinical learning in the context of uncertainty. The importance of the relationship between the feedback seeker and the provider highlights the interactive, reciprocal nature of clinical feedback provision.

Student feedback experiences in a cross-border medical education curriculum

OBJECTIVES

To determine non-Western situated health professional student experiences and preferences for feedback in workplace-based settings.

METHODS

We conducted five focus groups with 27 students of Arab-origin enrolled in a Canadian-accredited cross-border pharmacy program in Qatar. Transcripts of recorded discussions were analyzed using the framework method.  Hofstede's and Hall's cultural dimension models were employed to understand described feedback encounters and behaviours.

RESULTS

We identified three themes associated with cultural influences on student feedback experiences, namely: 1) collectivism; 2) power distance; and 3) context.  Trainees described clinical supervisors who inadequately recognized individual performance, rejected critique, and insufficiently documented feedback onto the written in-training evaluation report. Conversely, students expected specific and timely feedback, invited criticism for learning, and desired clear written commentary.

CONCLUSIONS

Feedback behaviours of clinical supervisors, but not those of trainees, were consistent with local cultural norms as described by Hofstede and Hall.  Instead, feedback expectations of pharmacy students in Qatar largely echo those of other trainees enrolled in professional curricula situated outside the Middle East. Principles for optimal feedback in clinical training largely arise from Western perspectives but are not necessarily universal. Our work demonstrates that practices, in part, may be subject to local socio-cultural influences.  This is of particular importance in the experiential training component of cross-border medical education programs adopted by overseas institutions. Our findings also further add to the growing body of literature reporting suboptimal feedback in workplace-based learning, reinforcing the need to cultivate more student-centered practices in health professional training globally.

Understanding how to enhance efficacy and effectiveness of feedback via e-portfolio: a realist synthesis protocol

INTRODUCTION

The validity of feedback as one of the defining components for electronic portfolios (e-portfolios) to be effective and efficacious has yet to be demonstrated. While the literature has shown individual beneficial features of e-portfolios and feedback per se, evidence of feedback as mediated through technology directly resulting in improved educational practice is scarce. The explanation of how feedback via e-portfolio improves educational practice is particularly vague.

METHODS AND ANALYSIS

The aim of this research is to unpack how and why feedback via e-portfolio is likely to flourish or wither in its path. Given the complexity of intervention, we will apply a theory-driven approach for evidence synthesis called realist synthesis. Informed by realist philosophy of science, it seems the most appropriate method because it explores observed outcomes (O) in terms of causal relationship between relevant contexts (C) and generating mechanisms (M). Initial programme theory will be developed through literature scoping. Later on it will be tested against purposively gathered evidence (through database and journal search), which simultaneously will be evaluated for rigour and relevance (whether method used are trustworthy and whether data contributes to theory building). We strive to (1) uncover 'context sensitive' mechanisms that generate feedback via e-portfolio to be (in) effective and (2) define in what circumstances is this mostly likely to occur.

ETHICS AND DISSEMINATION

The synthesis report will be written according to the RAMESES guidelines and its findings will be published in peer reviewed articles and presented at relevant conferences. The aim is to inform: (1) policy and decision makers for future-course design; (2) medical educators/clinical supervisors and learners for improved educational use. No formal ethical approval is required.

PROSPERO REGISTRATION NUMBER

120863.

Identifying coaching skills to improve feedback use in postgraduate medical education

OBJECTIVES

Coaching in medical education has recently gained prominence, but minimal attention has been given to key skills and determining how they work to effectively ensure residents are progressing and developing self-assessment skills. This study examined process-oriented and content-oriented coaching skills used in coaching sessions, with particular attention to how supervisors use them to enhance resident acceptance of feedback to enhance learning.

METHODS

This qualitative study analysed secondary audiotaped data from 15 supervisors: resident dyads during two feedback sessions, 4 months apart. The R2C2 model was used to engage the resident, build a relationship, explore reactions to feedback, explore resident perceptions of content, and coach for change. Framework analysis was used, including familiarisation with the data, identifying the thematic framework, indexing and charting the data and mapping and interpretation.

RESULTS

Process skills included preparation, relationship development, using micro communication skills and techniques to promote reflection and self-assessment by the resident and supervisor flexibility. Content skills related to the specific feedback content included engaging the resident in discussion, ensuring the discussion was collaborative and focused on goal setting, co-developing a Learning Change Plan, ensuring resident commitment and following up on the plan. Together, these skills foster agency in the resident learner. Three overarching themes emerged from the analysis: the interconnectedness of process and content; tensions between encouraging self-direction and ensuring progress and competence; and balancing a coaching dialogue and a teaching monologue.

CONCLUSIONS

Effective coaching by supervisors requires a combination of specific process and content skills that are chosen depending on the needs of the individual resident. Mastering these skills helps residents engage and develop agency in their own professional development. These outcomes depend on faculty maintaining a balance between coaching and teaching, encouraging resident self-direction and ensuring progression to competence.

Teaching the Social Determinants of Health in Undergraduate Medical Education: a Scoping Review

BACKGROUND

To provide optimal care, medical students should understand that the social determinants of health (SDH) impact their patients' well-being. Those charged with teaching SDH to future physicians, however, face a paucity of curricular guidance.

OBJECTIVE

This review's objective is to map key characteristics from publications about teaching SDH to students in undergraduate medical education (UME).

METHODS

In 2016, the authors searched PubMed, Embase, Web of Science, the Cochrane and ERIC databases, bibliographies, and MedEdPORTAL for articles published between January 2010 and November 2016. Four reviewers screened articles for eligibility then extracted and analyzed data descriptively. Scoping review methodology was used to map key concepts and curricular logistics as well as educator and student characteristics.

RESULTS

The authors screened 3571 unique articles of which 22 were included in the final review. Many articles focused on community engagement (15). Experiential learning was a common instructional strategy (17) and typically took the form of community or clinic-based learning. Nearly half (10) of the manuscripts described school-wide curricula, of which only three spanned a full year. The majority of assessment was self-reported (20) and often related to affective change. Few studies objectively assessed learner outcomes (2).

CONCLUSIONS

The abundance of initial articles screened highlights the growing interest in SDH in medical education. The small number of selected articles with sufficient detail for abstraction demonstrates limited SDH curricular dissemination. A lack of accepted tools or practices that limit development of robust learner or program evaluation was noted. Future research should focus on identifying and evaluating effective instructional and assessment methodologies to address this gap, exploring additional innovative teaching frameworks, and examining the specific contexts and characteristics of marginalized and underserved populations and their coverage in medical education.

Trainees' perspectives of assessment messages: a narrative systematic review

OBJECTIVES

This study was designed as a narrative systematic literature review of medical specialist trainees' perspectives of the assessment messages they receive in the context of clinical performance assessments. The aim of the study was to determine if trainees value the information they receive through the formats designed to promote their development and, if not, the reasons for this.

METHODS

The authors searched the ERIC, EMBASE, Ovid MEDLINE and PsycINFO databases for articles published up to 16 June 2018 that present original data on trainees' perspectives of the assessment messages they receive in the context of work-based assessments (WBAs) and in-training assessments (ITAs) used within their training programmes. All authors screened 938 abstracts and 139 full-text articles were assessed after this. Descriptions of quantitative data and thematic analysis of qualitative data were used to present the opinions of trainees.

RESULTS

Thirty-three articles met the inclusion criteria. Twenty-six articles (79%) described trainees' perspectives in the context of WBA and the remaining articles referred to ITA formats. Wide-ranging opinions were reported. The analysis categorised these into three themes: trainees value developmental assessment messages; trainees become disengaged when assessment messages are not developmental, and trainees' views depend on the environment, the assessor and themselves. Some trainees reported that the assessment messages were valuable and provided input on their performance to guide their development, but many disagreed. In particular, the trainee's own level of engagement with the assessments influenced his or her perspectives on the messages received.

CONCLUSIONS

Trainees do not universally perceive that clinical performance assessments provide them with the valuable developmental input on their performance they were designed to do. Factors related to the environment, the assessor and themselves influence their perspectives.

'I did not check if the teacher gave feedback': a qualitative analysis of Taiwanese postgraduate year 1 trainees' talk around e-portfolio feedback-seeking behaviours

OBJECTIVES

Despite feedback being an extensively researched and essential component of teaching and learning, there is a paucity of research examining feedback within a medical education e-portfolio setting including feedback-seeking behaviours (FSBs). FSBs can be understood within a cost-value perspective. The objective of this research is to explore the factors that influence postgraduate year 1 (PGY1) trainee doctors' FSBs via e-portfolios.

SETTING

Postgraduate education provision in the largest teaching hospital in Taiwan.

PARTICIPANTS

Seventy-one PGY1s (66% male).

METHODS

A qualitative semistructured one-to-one interview method was adopted. Interviews were audio recorded, transcribed verbatim, anonymised and checked for completeness. Data were analysed inductively via thematic framework analysis and deductively informed using FSB theory. The process comprised data familiarisation, identification of the themes, charting and data interpretation.

RESULTS

Two main themes of FSB related and e-portfolio related were identified. We present the theme focussing on FSB here to which n=32 (22 males, 10 females) of the n=71 participants contributed meaningfully. Subthemes include factors variously affecting PGY1s' positive and negative FSBs via e-portfolios at the individual, process and technological levels. These factors include learner-related (internal values vs social influence, forced reflection); teacher-related (committed educators vs superficial feedback); technology-related (face-saving vs lagging systems; inadequate user-interface) and process-related (delayed feedback, too frequent feedback) factors.

CONCLUSIONS

Our findings reveal the complexity of PGY1s' FSBs in an e-portfolio context and the interaction of numerous facilitating and inhibiting factors. Further research is required to understand the range of facilitating and inhibiting factors involved in healthcare learners' FSBs across different learning, social, institutional and national cultural settings.

The Art (and Artifice) of Seeking Feedback: Clerkship Students' Approaches to Asking for Feedback

PURPOSE

As attention has shifted to learners as significant partners in feedback interactions, it is important to explore what feedback-seeking behaviors medical students use and how the faculty-student relationship affects feedback-seeking behaviors.

METHOD

This qualitative study was inspired by the organizational psychology literature. Third-year medical students were interviewed at Maine Medical Center in April-May 2017 after completing a traditional block rotation clerkship or a nine-month longitudinal integrated clerkship (LIC). A constructivist grounded theory approach was used to analyze transcripts and develop themes.

RESULTS

Fourteen students participated (eight LIC, six block rotation). Themes associated with why students sought feedback included goal orientations, perceived benefits and costs, and student and feedback provider characteristics. Factors influencing the way students sought feedback included busy environments, timing, and cues students were attuned to. Students described more inquiry than monitoring approaches and used various indirect and noninquiry techniques (artifice) in asking for feedback. Students did not find summative feedback as helpful as seeking feedback themselves, and they suggested training in seeking feedback would be beneficial. Faculty-student relationship dynamics included several aspects affecting feedback-seeking behaviors, and relationship differences in the LIC and block models affected feedback-seeking behaviors.

CONCLUSIONS

Medical students have many motives to seek feedback and adapt their feedback-seeking behaviors to actively participate in an intricate dialogic interaction with feedback providers. Students gradually refine the art (and artifice) of obtaining the specific feedback information that meets their needs. The authors offer a prototype curriculum that may facilitate students' development of feedback-seeking skills.

The R2C2 Model in Residency Education: How Does It Foster Coaching and Promote Feedback Use?

PURPOSE

The authors previously developed and tested a reflective model for facilitating performance feedback for practice improvement, the R2C2 model. It consists of four phases: relationship building, exploring reactions, exploring content, and coaching. This research studied the use and effectiveness of the model across different residency programs and the factors that influenced its effectiveness and use.

METHOD

From July 2014-October 2016, case study methodology was used to study R2C2 model use and the influence of context on use within and across five cases. Five residency programs (family medicine, psychiatry, internal medicine, surgery, and anesthesia) from three countries (Canada, the United States, and the Netherlands) were recruited. Data collection included audiotaped site assessment interviews, feedback sessions, and debriefing interviews with residents and supervisors, and completed learning change plans (LCPs). Content, thematic, template, and cross-case analysis were conducted.

RESULTS

An average of nine resident-supervisor dyads per site were recruited. The R2C2 feedback model, used with an LCP, was reported to be effective in engaging residents in a reflective, goal-oriented discussion about performance data, supporting coaching, and enabling collaborative development of a change plan. Use varied across cases, influenced by six general factors: supervisor characteristics, resident characteristics, qualities of the resident-supervisor relationship, assessment approaches, program culture and context, and supports provided by the authors.

CONCLUSIONS

The R2C2 model was reported to be effective in fostering a productive, reflective feedback conversation focused on resident development and in facilitating collaborative development of a change plan. Factors contributing to successful use were identified.

An Evaluation of the Use of Student Response Systems in Teaching Diagnostic Reasoning for Physicians

Background

Feedback is an aspect of teaching strategy that facilitates the learners to achieve expertise in the necessary skills for effective diagnostic reasoning. Several studies have demonstrated that student response systems (SRSs) are useful for enhancing learner engagement and obtaining immediate feedback. We aimed to examine the experiences of learners who used SRSs in a diagnostic reasoning class.

Methods

In 2016, an observational study was conducted on a 4-hour training course on "improving physicians' diagnostic process" that included 34 physicians. The Zuvio multimedia online interactive system was used. The learners could use smartphones to respond to the questions. A 5-point Likerttype scale quantitative questionnaire was designed to explore the viewpoints of the learners regarding the students' engagement, feedback, and outcomes. The learners were requested to complete a brief qualitative feedback form that included the following two sections: (1) the benefi ts and (2) the challenges of using SRSs. Qualitative and quantitative methods were used for data analyses.

Results

Total 32 participants (response rate: 94%) completed the questionnaire. Most respondents reported that using the SRSs enabled them to concentrate more effectively, express themselves in a stressfree environment, strengthen their interactions with peers and teachers, improve their participation in discussions, and obtain useful feedback. Three themes were identified from the qualitative results: (1) facilitating learning, (2) hardware limitations, and (3) question-development skills.

Conclusion

The SRSs can be easily implemented and positively affect the teaching of diagnostic reasoning. However, teachers should develop question-development skills so that the systems function more effectively in the instruction of diagnostic reasoning.

The Feedback Tango: An Integrative Review and Analysis of the Content of the Teacher-Learner Feedback Exchange

PURPOSE

To conduct an integrative review and analysis of the literature on the content of feedback to learners in medical education.

METHOD

Following completion of a scoping review in 2016, the authors analyzed a subset of articles published through 2015 describing the analysis of feedback exchange content in various contexts: audiotapes, clinical examination, feedback cards, multisource feedback, videotapes, and written feedback. Two reviewers extracted data from these articles and identified common themes.

RESULTS

Of the 51 included articles, about half (49%) were published since 2011. Most involved medical students (43%) or residents (43%). A leniency bias was noted in many (37%), as there was frequently reluctance to provide constructive feedback. More than one-quarter (29%) indicated the feedback was low in quality (e.g., too general, limited amount, no action plans). Some (16%) indicated faculty dominated conversations, did not use feedback forms appropriately, or provided inadequate feedback, even after training. Multiple feedback tools were used, with some articles (14%) describing varying degrees of use, completion, or legibility. Some articles (14%) noted the impact of the gender of the feedback provider or learner.

CONCLUSIONS

The findings reveal that the exchange of feedback is troubled by low-quality feedback, leniency bias, faculty deficient in feedback competencies, challenges with multiple feedback tools, and gender impacts. Using the tango dance form as a metaphor for this dynamic partnership, the authors recommend ways to improve feedback for teachers and learners willing to partner with each other and engage in the complexities of the feedback exchange.

Trainees' Perceptions of Feedback: Validity Evidence for Two FEEDME (Feedback in Medical Education) Instruments

Construct: Medical educators consider feedback a core component of the educational process. Effective feedback allows learners to acquire new skills, knowledge, and attitudes. Learners' perceptions of feedback are an important aspect to assess with valid methods in order to improve the feedback skills of educators and the feedback culture.

BACKGROUND

Although guidelines for delivering effective feedback have existed for several decades, medical students and residents often indicate that they receive little feedback. A recent scoping review on feedback in medical education did not reveal any validity evidence on instruments to assess learner's perceptions of feedback. The purpose of our study was to gather validity evidence on two novel FEEDME (Feedback in Medical Education) instruments to assess medical students' and residents' perceptions of the feedback that they receive.

APPROACH

After the authors developed an initial instrument with 54 items, cognitive interviews with medical students and residents suggested that 2 separate instruments were needed, one focused on the feedback culture (FEEDME-Culture) and the other on the provider of feedback (FEEDME-Provider). A Delphi study with 17 medical education experts and faculty members assessed content validity. The response process was explored involving 31 medical students and residents at 2 academic institutions. Exploratory factor analysis and reliability analyses were performed on completed instruments.

RESULTS

Two Delphi consultation rounds refined the wording of items and eliminated several items. Learners found both instruments easy and quick to answer; it took them less than 5 minutes to complete. Learners preferred an electronic format of the instruments over paper. Factor analysis revealed a two- and three-factor solution for the FEEDME-Culture and FEEDME-Provider instruments, respectively. Cronbach's alpha was greater than 0.80 for all factors. Items on both instruments were moderately to highly correlated (range, r = .3-.7).

CONCLUSIONS

Our results provide preliminary validity evidence of 2 novel feedback instruments. After further validation of both FEEDME instruments, sharing the results of the FEEDME-Culture instrument with educational leaders and faculty may improve the culture of feedback on specific educational rotations and at the institutional level. The FEEDME-Provider instrument could be useful for faculty development targeting feedback skills. Additional research studies could assess whether both instruments may be used to help learners receive feedback and prompt reflective learning.

The research contributions of predominantly North American Family Medicine educators to medical learner feedback: a descriptive analysis following a scoping review

BACKGROUND AND OBJECTIVES

In 2016, we performed a scoping review as a means of mapping what is known in the literature about feedback to medical learners. In this descriptive analysis, we explore a subset of the results to assess the contributions of predominantly North American family medicine educators to the feedback literature.

METHODS

Nineteen articles extracted from our original scoping review plus six articles identified from an additional search of the journal Family Medicine are described in-depth.

RESULTS

The proportion of articles involving family medicine educators identified in our scoping review is small (n=19/650, 3%) and the total remains low (25) after including additional articles (n=6) from a Family Medicine search. They encompass a broad range of feedback methods and content areas. They primarily originated in the United States (n=19) and Canada (n=3) within Family Medicine Departments (n=20) and encompass a variety of scientific and educational research methodologies.

CONCLUSIONS

The contributions of predominantly North American Family Medicine educators to the literature on feedback to learners are sparse in number and employ a variety of focus areas and methodological approaches. More studies are needed to assess for areas of education research where family physicians could make valuable contributions.

Positive Change in Feedback Perceptions and Behavior: A 10-Year Follow-up Study

BACKGROUND

Providing and learning from feedback are essential components of medical education, and typically described as resistant to change. But given a decade of change in the clinical context in which feedback occurs, the authors asked if, and how, perceptions of feedback and feedback behaviors might have changed in response to contextual affordances.

METHODS

In 2017, the authors conducted a follow-up, ethnographic study on 2 general pediatric floors at the same children's hospital where another ethnographic study on a general pediatric floor was conducted in 2007. Data sources included (1) 21 and 34 hours of observation in 2007 and 2017, respectively, (2) 35 and 25 interviews with general pediatric attending physicians and residents in 2007 and 2017, respectively, and (3) a review of 120 program documents spanning 2007 to 2017. Data were coded and organized around 3 recommendations for feedback that were derived from 2007 data and served as standards for assessing change in 2017.

RESULTS

Data revealed progress in achieving each recommendation. Compared with 2007, participants in 2017 more clearly distinguished between feedback and evaluation; residents were more aware of in-the-moment feedback, and they had shifted their orientation from evaluation and grades to feedback and learning. Explanations for progress in achieving recommendations, which were derived from the data, pointed to institutional and national influences, namely, the pediatric milestones.

CONCLUSIONS

On the basis of follow-up, ethnographic data, changes in the clinical context of pediatric education may afford positive change in perceptions of feedback and feedback behavior and point to influences within and beyond the institution.

Is feedback to medical learners associated with characteristics of improved patient care?

PURPOSE

To investigate the association of medical learner feedback with patient management and outcomes.

METHODS

The authors investigated 27 articles that utilized patient data or chart reviews as a subset of a prior feedback scoping review. Data extraction was completed by two authors and all authors reviewed the descriptive data analysis.

RESULTS

The studies were predominantly short-term investigations conducted in the US at academic teaching hospitals (89%) with one medical discipline (78%), most commonly internal medicine (56%). Patient-related outcomes primarily involved improved documentation (26%) and adherence to practice guidelines (19%) and were mostly measured through chart reviews (56%) or direct observation (15%). The primary method of feedback delivery involved a written format (30%). The majority of the studies showed a positive effect of feedback on the patient-oriented study outcomes (82%), although most involved a non-rigorous study design.

CONCLUSIONS

Published studies focusing on the relationship between medical learner feedback and patient care are sparse. Most involve a single discipline at a single institution and are of a non-rigorous design. Measurements of improved patient outcomes are restricted to changes in management, procedures and documentation. Well-designed studies that directly link learner feedback to patient outcomes may help to support the use of feedback in teaching clinical outcomes improvement in alignment with competency-based milestones.