Blankush JM, Shah BJ, Barnett SH, Badran G, Mercado A, Karani R, Muller D, Leitman IM. What are the associations between the quantity of faculty evaluations and residents' perception of quality feedback?
Ann Med Surg (Lond) 2017;
16:40-43. [PMID:
28386393 PMCID:
PMC5369264 DOI:
10.1016/j.amsu.2017.03.001]
[Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2017] [Accepted: 03/01/2017] [Indexed: 11/17/2022] Open
Abstract
Objectives
To determine if there is a correlation between the numbers of evaluations submitted by faculty and the perception of the quality of feedback reported by trainees on a yearly survey.
Method
147 ACGME-accredited training programs sponsored by a single medical school were included in the analysis. Eighty-seven programs (49 core residency programs and 38 advanced training programs) with 4 or more trainees received ACGME survey summary data for academic year 2013–2014. Resident ratings of satisfaction with feedback were analyzed against the number of evaluations completed per resident during the same period. R-squared correlation analysis was calculated using a Pearson correlation coefficient.
Results
177,096 evaluations were distributed to the 87 programs, of which 117,452 were completed (66%). On average, faculty submitted 33.9 evaluations per resident. Core residency programs had a greater number of evaluations per resident than fellowship programs (39.2 vs. 27.1, respectively, p = 0.15). The average score for the “satisfied with feedback after assignment” survey questions was 4.2 (range 2.2–5.0). There was no overall correlation between the number of evaluations per resident and the residents' perception of feedback from faculty based on medical, surgical or hospital-based programs.
Conclusions
Resident perception of feedback is not correlated with number of faculty evaluations. An emphasis on faculty summative evaluation of resident performance is important but appears to miss the mark as a replacement for on-going, data-driven, structured resident feedback. Understanding the difference between evaluation and feedback is a global concept that is important for all medical educators and learners.
Residents and fellows do not perceive that regular evaluations are the same as feedback.
The quantity of faculty evaluations does not correlate the resident perception of quality feedback.
A greater emphasis is necessary to instruct faculty on providing regular, timely and data-driven feedback to residents and fellows with specific comments on performance.
Faculty summative evaluation of resident performance is important but this is not a replacement for structured feedback.
Collapse