The Effects of Resident Peer- and Self-Chart Review on Outpatient Laboratory Result Follow-up

Exploring the use of metacognitive monitoring cues following a diagram completion intervention

Studying texts constitutes a significant part of student learning in health professions education. Key to learning from text is the ability to effectively monitor one's own cognitive performance and take appropriate regulatory steps for improvement. Inferential cues generated during a learning experience typically guide this monitoring process. It has been shown that interventions to assist learners in using comprehension cues improve their monitoring accuracy. One such intervention is having learners to complete a diagram. Little is known, however, about how learners use cues to shape their monitoring judgments. In addition, previous research has not examined the difference in cue use between categories of learners, such as good and poor monitors. This study explored the types and patterns of cues used by participants after being subjected to a diagram completion task prior to their prediction of performance (PoP). Participants' thought processes were studied by means of a think-aloud method during diagram completion and the subsequent PoP. Results suggest that relying on comprehension-specific cues may lead to a better PoP. Poor monitors relied on multiple cue types and failed to use available cues appropriately. They gave more incorrect responses and made commission errors in the diagram, which likely led to their overconfidence. Good monitors, on the other hand, utilized cues that are predictive of learning from the diagram completion task and seemed to have relied on comprehension cues for their PoP. However, they tended to be cautious in their judgement, which probably made them underestimate themselves. These observations contribute to the current understanding of the use and effectiveness of diagram completion as a cue-prompt intervention and provide direction for future research in enhancing monitoring accuracy.

A scoping review of self-monitoring in graduate medical education

BACKGROUND

Physicians and physicians-in-training have repeatedly demonstrated poor accuracy of global self-assessments, which are assessments removed from the context of a specific task, regardless of any intervention. Self-monitoring, an in-the-moment self-awareness of one's performance, offers a promising alternative to global self-assessment. The purpose of this scoping review is to better understand the state of self-monitoring in graduate medical education.

METHODS

We performed a scoping review following Arksey and O'Malley's six steps: identifying a research question, identifying relevant studies, selecting included studies, charting the data, collating and summarising the results and consulting experts. Our search queried Ovid Medline, Web of Science, PsychINFO, Eric and EMBASE databases from 1 January 1999 to 12 October 2022.

RESULTS

The literature search yielded 5363 unique articles. The authors identified 77 articles for inclusion. The search process helped create a framework to identify self-monitoring based on time and context dependence. More than 20 different terms were used to describe self-monitoring, and only 13 studies (17%) provided a definition for the equivalent term. Most research focused on post-performance self-judgements of a procedural skill (n = 31, 42%). Regardless of task, studies focused on self-judgement (n = 66, 86%) and measured the accuracy or impact on performance of self-monitoring (n = 41, 71%). Most self-monitoring was conducted post-task (n = 65, 84%).

CONCLUSION

Self-monitoring is a time- and context-dependent phenomenon that seems promising as a research focus to improve clinical performance of trainees in graduate medical education and beyond. The landscape of current literature on self-monitoring is sparse and heterogeneous, suffering from a lack of theoretical underpinning, inconsistent terminology and insufficiently clear definitions.

Peer observation to develop resident teaching

BACKGROUND

Developing teaching skills is a fundamental part of physician postgraduate training. Although resident-as-teacher curricula are proliferating, there is no clear consensus on how best to train resident physicians as clinical teachers. Peer observation has been shown to be effective in other settings, including faculty development, and could be adopted for resident teaching skill development.

METHODS

The authors developed a 5-day resident-as-teacher training programme, founded on three principles: (i) focused seminars; (ii) authentic teaching experiences; and (iii) peer observation. To provide genuine teaching experiences, course participants taught regularly scheduled curricular sessions. Residents were partnered with a peer; each delivered two teaching sessions and provided two peer observations.

RESULTS

Evaluations revealed the course had a 'major impact' on participants' teaching. Significant improvements were observed in self-reported comfort and confidence with teaching and in providing feedback. Peer observation was cited as the most effective component of the course. Nearly all residents were both comfortable receiving and providing peer-observed feedback. A majority of residents reported that they were more likely to seek feedback as a result of the course. The faculty member time required was limited to 1-2 hours per individual.

DISCUSSION

Peer observation can be used effectively to engage residents and advance clinical teaching skills. Residents were generally comfortable giving and receiving feedback in peer-observer dyads. Employing peer observation also reduced the amount of faculty member time needed to deliver resident-as-teacher programming, thereby facilitating the scalability of the programme. Allowing participants to teach during regular conference time allowed for smooth integration into the pre-existing schedule for the training programme.

Improving Practice Guideline Adherence Through Peer Feedback: Impact of an Ambulatory Cardiology Curriculum

PROBLEM

Graduate medical trainees must be prepared to practice in a quality-driven system that values adherence to and documentation of evidence-based care. Few validated approaches exist to teach these skills. Our objective was to develop, implement, and evaluate an ambulatory practice improvement curriculum capitalizing on peer feedback aimed at improving cardiology fellow guideline knowledge, adherence, and chart documentation.

INTERVENTION

Four outpatient topics were reviewed in dedicated 1-hour sessions: stable ischemic heart disease, heart failure, atrial fibrillation, and aortic valvular disease. Each session began with peer review, critique, and guideline adherence discussion of deidentified outpatient fellow clinic charts, followed by discussion of clinical guidelines. The open discussion of real clinic notes provided a forum for peer feedback exchange. Before each session and after the final session, participants completed a multiple-choice knowledge assessment and self-assessment of comfort with the guidelines. To evaluate the potential effect on patient care, random clinic chart audits were conducted before and after the curriculum using a chart scoring system.

CONTEXT

Although the format is broadly applicable, the specific curriculum content was designed for a cardiology fellowship cohort in a large academic medical center. It was organized and implemented by 2 cardiology fellows under the direction and supervision of program directors. The curriculum was implemented during prescheduled noon conference hours. The intention was to carry forward this ambulatory curriculum in subsequent years and to use the first 4 sessions to study its potential successes and opportunities for improvement.

OUTCOME

All 22 general cardiology fellows attended at least two sessions (M = 3.1). Knowledge test scores rose from 52.6% to 73.0% (20.4% increase, p < .001), 95% confidence interval (CI) [13.6%, 27.2%]. Self-reported guidelines knowledge improved by 15.1% (p = .002), 95% CI [6.2%, 24.0%], and self-reported documentation improved by 12.5% (p = .008), 95% CI [3.8%, 21.7%]. Chart audit scores improved by 17.8% (p < .001), 95% CI [10.6%, 25.0%], driven in part by 16.4% improvement in adherence to Class I therapies (p = .001).

LESSONS LEARNED

A targeted curriculum combining peer chart review, feedback, and guideline discussion was associated with significant improvement in fellows' knowledge and adherence to evidence-based therapies. Peer assessment and group-based education and feedback can be leveraged to improve trainee education and impact patient care.