Sandwich feedback: The empirical evidence of its effectiveness

Comparison of the effects of apprenticeship training by sandwich feedback and traditional methods on final-semester operating room technology students' perioperative competence and performance: a randomized, controlled trial

BACKGROUND

Effective feedback is fundamental in clinical education, as it allows trainers to constantly diagnose the trainees' condition, determine their weaknesses, and intervene at proper times. Recently, different feedback-based approaches have been introduced in clinical training; however, the effectiveness of such interventions still needs to be studied extensively, especially in the perioperative field. Therefore, this study sought to compare the effects of apprenticeship training using sandwich feedback and traditional methods on the perioperative competence and performance of Operating Room (OR) technology students.

METHODS

Thirty final-semester undergraduate OR technology students taking the apprenticeship courses were randomly allocated into experimental (n = 15) and control (n = 15) groups through the stratified randomization approach. The students in the experimental group experienced Feedback-Based Learning (FBL) using a sandwich model, and the students in the control group participated in Traditional-Based Training (TBT) in six five-hour sessions weekly for three consecutive weeks. All students completed the Persian version of the Perceived Perioperative Competence Scale-Revised (PPCS-R) on the first and last days of interventions. Also, a blinded rater completed a checklist to evaluate all students' performance via Direct Observation of Procedural Skills (DOPS) on the last intervention day. Besides, the students in the FBL filled out a questionnaire regarding their attitude toward the implemented program.

RESULTS

The mean total score of the PPCS-R was significantly higher in the FBL than in the TBT on the last intervention day (P < 0.001). Additionally, the increase in mean change of PPCS-R total score from the first to last days was significantly more in the FBL (P < 0.001). Likewise, the FBL students had higher DOPS scores than the TBT ones (P < 0.001). Most FBL students also had a good attitude toward the implemented program (n = 8; 53.3%).

CONCLUSION

Apprenticeship training using a sandwich feedback-based approach was superior to the traditional method for enhancing perioperative competence and performance of final-semester OR technology students. Additional studies are required to identify the sustainability of the findings.

Reconstructing feedback in graduate medical education: development of the REFLECT scale to measure feedback delivery in medical residency training

BACKGROUND

Feedback plays a pivotal role in graduate medical education, where medical residents are expected to acquire a wide range of practical and professional competencies. Assessing the feedback delivery status is a preliminary step for educators to enhance the quality of feedback provided. This study aims to develop an instrument to assess the various aspects of feedback delivery in medical residency training.

METHODS

The fifteen-item REFLECT (Residency Education Feedback Level Evaluation in Clinical Training) questionnaire was developed. The content validity was evaluated according to a panel member consisting of fourteen clinical professors and medical education instructors. After evaluating the test-retest reliability, the questionnaire was distributed to a sample of 154 medical residents and was further assessed in terms of internal consistency and factor analysis.

RESULTS

Content validity analysis resulted in an appropriate content validity ratio and content validity index for the final 15 items. The test-retest reliability resulted in an ICC of 0.949 (95% C.I. 0.870-0.980), indicating excellent reliability. The Cronbach's alpha for the 15-item questionnaire was α = 0.85, demonstrating good internal consistency. The factor analysis resulted in a four-factor structure: "attitude towards feedback", "quality of feedback", "perceived importance of feedback", and "reaction to feedback".

CONCLUSIONS

REFLECT proved to a reliable tool that could be utilized as a quick assessment method of feedback delivery, making it a suitable aid for educational managers and faculties to design necessary interventions aiming to enhance the quantity and quality of feedback provided.

Automatic evaluation-feedback system for automated social skills training

Social skills training (SST), which is a rehabilitation program for improving daily interpersonal communication, has been used for more than 40 years. Although such training's demand is increasing, its accessibility is limited due to the lack of experienced trainers. To tackle this issue, automated SST systems have been studied for years. An evaluation-feedback pipeline of social skills is a crucial component of an SST system. Unfortunately, research that considers both the evaluation and feedback parts of automation remains insufficient. In this paper, we collected and analyzed the characteristics of a human-human SST dataset that consisted of 19 healthy controls, 15 schizophreniacs, 16 autism spectrum disorder (ASD) participants, and 276 sessions with score labels of six clinical measures. From our analysis of this dataset, we developed an automated SST evaluation-feedback system under the supervision of professional, experienced SST trainers. We identified their preferred or most acceptable feedback methods by running a user-study on the following conditions: with/without recorded video of the role-plays of users and different amounts of positive and corrective feedback. We confirmed a reasonable performance of our social-skill-score estimation models as our system's evaluation part with a maximum Spearman's correlation coefficient of 0.68. For the feedback part, our user-study concluded that people understood more about what aspects they need to improve by watching recorded videos of their own performance. In terms of the amount of feedback, participants most preferred a 2-positive/1-corrective format. Since the average amount of feedback preferred by the participants nearly equaled that from experienced trainers in human-human SSTs, our result suggests the practical future possibilities of an automated evaluation-feedback system that complements SSTs done by professional trainers.

Helping healthcare teams to debrief effectively: associations of debriefers' actions and participants' reflections during team debriefings

BACKGROUND

Debriefings help teams learn quickly and treat patients safely. However, many clinicians and educators report to struggle with leading debriefings. Little empirical knowledge on optimal debriefing processes is available. The aim of the study was to evaluate the potential of specific types of debriefer communication to trigger participants' reflection in debriefings.

METHODS

In this prospective observational, microanalytic interaction analysis study, we observed clinicians while they participated in healthcare team debriefings following three high-risk anaesthetic scenarios during simulation-based team training. Using the video-recorded debriefings and INTERACT coding software, we applied timed, event-based coding with DE-CODE, a coding scheme for assessing debriefing interactions. We used lag sequential analysis to explore the relationship between what debriefers and participants said. We hypothesised that combining advocacy (ie, stating an observation followed by an opinion) with an open-ended question would be associated with participants' verbalisation of a mental model as a particular form of reflection.

RESULTS

The 50 debriefings with overall 114 participants had a mean duration of 49.35 min (SD=8.89 min) and included 18 486 behavioural transitions. We detected significant behavioural linkages from debriefers' observation to debriefers' opinion (z=9.85, p<0.001), from opinion to debriefers' open-ended question (z=9.52, p<0.001) and from open-ended question to participants' mental model (z=7.41, p<0.001), supporting our hypothesis. Furthermore, participants shared mental models after debriefers paraphrased their statements and asked specific questions but not after debriefers appreciated their actions without asking any follow-up questions. Participants also triggered reflection among themselves, particularly by sharing personal anecdotes.

CONCLUSION

When debriefers pair their observations and opinions with open-ended questions, paraphrase participants' statements and ask specific questions, they help participants reflect during debriefings.