Self-regulatory learning theory as a lens on how undergraduate and postgraduate learners respond to feedback: A BEME scoping review: BEME Guide No. 66

Protocol for a scoping review study on learning plan use in undergraduate medical education

BACKGROUND

The current paradigm of competency-based medical education and learner-centredness requires learners to take an active role in their training. However, deliberate and planned continual assessment and performance improvement is hindered by the fragmented nature of many medical training programs. Attempts to bridge this continuity gap between supervision and feedback through learner handover have been controversial. Learning plans are an alternate educational tool that helps trainees identify their learning needs and facilitate longitudinal assessment by providing supervisors with a roadmap of their goals. Informed by self-regulated learning theory, learning plans may be the answer to track trainees' progress along their learning trajectory. The purpose of this study is to summarise the literature regarding learning plan use specifically in undergraduate medical education and explore the student's role in all stages of learning plan development and implementation.

METHODS

Following Arksey and O'Malley's framework, a scoping review will be conducted to explore the use of learning plans in undergraduate medical education. Literature searches will be conducted using multiple databases by a librarian with expertise in scoping reviews. Through an iterative process, inclusion and exclusion criteria will be developed and a data extraction form refined. Data will be analysed using quantitative and qualitative content analyses.

DISCUSSION

By summarising the literature on learning plan use in undergraduate medical education, this study aims to better understand how to support self-regulated learning in undergraduate medical education. The results from this project will inform future scholarly work in competency-based medical education at the undergraduate level and have implications for improving feedback and supporting learners at all levels of competence.

SCOPING REVIEW REGISTRATION

Open Science Framework osf.io/wvzbx.

Designing feedback processes in the workplace-based learning of undergraduate health professions education: a scoping review

BACKGROUND

Feedback processes are crucial for learning, guiding improvement, and enhancing performance. In workplace-based learning settings, diverse teaching and assessment activities are advocated to be designed and implemented, generating feedback that students use, with proper guidance, to close the gap between current and desired performance levels. Since productive feedback processes rely on observed information regarding a student's performance, it is imperative to establish structured feedback activities within undergraduate workplace-based learning settings. However, these settings are characterized by their unpredictable nature, which can either promote learning or present challenges in offering structured learning opportunities for students. This scoping review maps literature on how feedback processes are organised in undergraduate clinical workplace-based learning settings, providing insight into the design and use of feedback.

METHODS

A scoping review was conducted. Studies were identified from seven databases and ten relevant journals in medical education. The screening process was performed independently in duplicate with the support of the StArt program. Data were organized in a data chart and analyzed using thematic analysis. The feedback loop with a sociocultural perspective was used as a theoretical framework.

RESULTS

The search yielded 4,877 papers, and 61 were included in the review. Two themes were identified in the qualitative analysis: (1) The organization of the feedback processes in workplace-based learning settings, and (2) Sociocultural factors influencing the organization of feedback processes. The literature describes multiple teaching and assessment activities that generate feedback information. Most papers described experiences and perceptions of diverse teaching and assessment feedback activities. Few studies described how feedback processes improve performance. Sociocultural factors such as establishing a feedback culture, enabling stable and trustworthy relationships, and enhancing student feedback agency are crucial for productive feedback processes.

CONCLUSIONS

This review identified concrete ideas regarding how feedback could be organized within the clinical workplace to promote feedback processes. The feedback encounter should be organized to allow follow-up of the feedback, i.e., working on required learning and performance goals at the next occasion. The educational programs should design feedback processes by appropriately planning subsequent tasks and activities. More insight is needed in designing a full-loop feedback process, in which specific attention is needed in effective feedforward practices.

Training simulated participants for role portrayal and feedback practices in communication skills training: A BEME scoping review: BEME Guide No. 86

BACKGROUND

Providing feedback is a key aspect of simulated participants' (SPs) educational work. In teaching contexts, the ability to provide feedback to learners is central to their role. Suboptimal feedback practices may deny learners the valuable feedback they need to learn and improve. This scoping review systematically maps the evidence related to SPs' role as educators and identifies how SPs prepare for their role and feedback practices.

METHODS

The authors conducted a scoping review and included a group of international stakeholders with experience and expertise in SP methodology. Five online databases were systematically searched and ERIC, MedEdPortal and MedEdPublish were hand searched to identify relevant studies. Inclusion/exclusion criteria were developed. Data screening and subsequently data charting were performed in pairs. The results of data charting were thematically analysed including categories relating to the Association of SP Educators (ASPE) Standards of Best Practice (SOBP).

RESULTS

From 8179 articles identified for the title and abstract screening, 98 studies were included. Studies reported the benefit of SPs' authentic role portrayal and feedback interactions for learners and on the reported learning outcomes. Data was heterogeneous with a notable lack of consistency in the detail regarding the scenario formats for communication skills training interventions, SP characteristics, and approaches to training for feedback and role portrayal.

CONCLUSIONS

The published literature has considerable heterogeneity in reporting how SPs are prepared for role portrayal and feedback interactions. Additionally, our work has identified gaps in the implementation of the ASPE SOBP, which promotes effective SP-learner feedback interactions. Further research is required to identify effective applications of SP methodology to prepare SPs for their role as educators.

The postgraduate medical educational climate assessed by the Danish Residency Educational Climate Test (DK-RECT): a validation and cross-sectional observational study

BACKGROUND

A good educational climate is essential for delivering high-quality training for medical trainees, professional development, and patient care. The aim of this study was to (1) validate the Dutch Residency Educational Climate Test (D-RECT) in a Danish setting and (2) describe and evaluate the educational climate among medical trainees.

METHODS

D-RECT was adopted in a three-step process: translation of D-RECT into Danish (DK-RECT), psychometric validation, and evaluation of educational climate. Trainees from 31 medical specialties at Copenhagen University Hospital - Rigshospitalet, Denmark were asked to complete an online survey in a cross-sectional study.

RESULTS

We performed a forward-backward translation from Dutch to Danish. Confirmatory factor analysis showed that DK-RECT was robust and valid. The reliability analysis showed that only seven trainees from one specialty were needed for a reliable result. With 304 trainees completing DK-RECT, the response rate was 68%. The subsequent analysis indicated a positive overall educational climate, with a median score of 4.0 (interquartile range (IQR): 3.0-5.0) on a five-point Likert scale. Analysis of the subscales showed that the subscale Feedback received the lowest ratings, while Supervision and Peer collaboration were evaluated highest.

CONCLUSIONS

Psychometric validation of D-RECT in a Danish context demonstrated valid results on the educational climate in specialist training. DK-RECT can be used to evaluate the effectiveness of interventions in the future and can facilitate the conversation on the educational climate.

"Tell me what is 'better'!" How medical students experience feedback, through the lens of self-regulatory learning

INTRODUCTION

While feedback aims to support learning, students frequently struggle to use it. In studying feedback responses there is a gap in explaining them in relation to learning theory. This study explores how feedback experiences influence medical students' self-regulation of learning.

METHODS

Final-year medical students across three campuses (Ireland, Bahrain and Malaysia) were invited to share experiences of feedback in individual semi-structured interviews. The data were thematically analysed and explored through the lens of self-regulatory learning theory (SRL).

RESULTS

Feedback interacts with learners' knowledge and beliefs about themselves and about learning. They use feedback to change both their cognitive and behavioural learning strategies, but how they choose which feedback to implement is complex. They struggle to generate learning strategies and expect teachers to make sense of the "how" in addition to the "what"" in planning future learning. Even when not actioned, learners spend time with feedback and it influences future learning.

CONCLUSION

By exploring our findings through the lens of self-regulation learning, we advance conceptual understanding of feedback responses. Learners' ability to generate "next steps" may be overestimated. When feedback causes negative emotions, energy is diverted from learning to processing distress. Perceived non-implementation of feedback should not be confused with ignoring it; feedback that is not actioned often impacts learning.

Undergraduate Skills Training in Pandemic Times: Where Is the Future of Medical Education?

BACKGROUND

The COVID-19 pandemic forced medical programs to rapidly switch to remote teaching from scratch, impacting hands-on skills training. This study compared the efficacy of a hybrid online format to a regular in-person session for a mandatory surgical skills class.

METHODS

Third-year undergraduate medical students attending the surgical skills class in the winter semester of 2020/21 at the Medical University of Graz were randomly assigned to either the hybrid or in-person class, depending on their course schedule and government regulations. The hybrid class involved online videos, one-on-one peer tutoring, and an Objective Structured Clinical Examination (OSCE). Pre- and post-class self-assessments were conducted to evaluate their theoretical and practical knowledge of a single interrupted suture.

RESULTS

The study included 85 students in the regular in-person class and 50 in the hybrid class. A pre-class assessment revealed higher self-assessments in the hybrid class for theoretical and practical knowledge, but a post-class assessment showed no significant difference. The advantages and disadvantages of both modalities were identified, providing valuable insights for future curriculum development.

CONCLUSIONS

Both teaching modes were effective for undergraduate surgical skills training. This study recommends implementing positive aspects of both the hybrid and in-person formats while recognizing their respective limitations.

Feedback literacy as a model to explore how learners respond to feedback

Clinicians spend a considerable part of their time while supervising trainees providing feedback. It is generally accepted that feedback can play a major role in subsequent academic performance. Traditionally it was thought that all feedback was good feedback, that inevitably improved learner outcomes. This has been challenged and it is now understood that feedback can have a beneficial or deleterious effect on the student. A number of factors can affect a learner's response to feedback. The concept of feedback literacy is helpful to understanding these responses - this describes the processes by which a learner makes sense of feedback and subsequently uses it to enhance learning. A learner who is feedback literate can recognise when they are getting feedback and understand how it relates to their progress; they can process it effectively both cognitively and emotionally, and they can put it in to action in ways which benefit their learning. Modifiable and non-modifiable factors can influence feedback literacy, with modifiable factors including feedback standards and supervisor behaviours. Providing clear feedback expectations, ensuring accuracy of feedback messages and focusing on the relationship between the teacher and learner have the most evidence for their effect on facilitating feedback literacy.

Investigating feedback orientation in medical learners

BACKGROUND/PURPOSE

Feedback processes in health professions education (HPE) are not always successful. While recommendations to improve feedback provision dominate the literature, studying specific learner attributes that impact feedback uptake may also improve feedback processes. Feedback orientation is a concept from management science involving four dimensions of learner attributes and attitudes that impact their feedback uptake: utility, accountability, social awareness, and feedback self-efficacy. Feedback orientation may represent a valuable concept in HPE. We aimed to understand medical learners' feedback orientation at different stages in their development.

METHODS

We used the Feedback Orientation Scale, a 20-item survey instrument, for a cross-sectional analysis of feedback orientation in medical students and Internal Medicine residents at one large academic center. We performed descriptive statistics and analysis of variance for data analysis.

RESULTS

We found the same factors (dimensions) to feedback orientation in our population as in management science. Overall feedback orientation scores were high and were largely consistent across trainee levels. Utility was the domain that was highest across learners, whereas feedback self-efficacy was lowest.

CONCLUSIONS

Feedback orientation represents a useful concept to explore medical learners' attitudes toward feedback's role in their development. The four domains can help guide further nuanced feedback research and application.[Box: see text].