A scoping review of self-monitoring in graduate medical education

Using MCQ response certainty to determine how aspects of self-monitoring develop through a medical course

INTRODUCTION

Self-monitoring of clinical-decision-making is essential for health care professional practice. Using certainty in responses to assessment items could allow self-monitoring of clinical-decision-making by medical students to be tracked over time. This research introduces how aspects of insightfulness, safety and efficiency could be based on certainty in, and correctness of, multiple-choice question (MCQ) responses. We also show how these measures change over time.

METHODS

With each answer on twice yearly MCQ progress tests, medical students provided their certainty of correctness. An insightful student would be more likely to be correct for those answers given with increasing certainty. A safe student would be expected to have a high probability of being correct for answers given with a high certainty. An efficient student would be expected to have a sufficiently low probability of being correct when they have no certainty. The system was developed using first principles and data from one cohort of students. A dataset from a second cohort was then used as an independent validation sample.

RESULTS

The patterns of aspects of self-monitoring were similar for both cohorts. Almost all the students met the criteria for insightfulness on all tests. Most students had an undetermined outcome for the safety aspect. When a definitive result for safety was obtained, absence of safety was most prevalent in the middle of the course, while the presence of safety increased later. Most of the students met the criteria for efficiency, with the highest prevalence mid-course, but efficiency was more likely to be absent later.

DISCUSSION

Throughout the course, students showed reassuring levels of insightfulness. The results suggest that students may balance safety with efficiency. This may be explained by students learning the positive implications of decisions before the negative implications, making them initially more efficient, but later being more cautious and safer.

The dynamics of self-monitoring in medicine: Safety, efficiency and clinical implications

.@MedEdDoc et al. delve into how the concepts of 'safety' and 'efficiency' in self‐monitoring can be used to influence clinical practice and #MedEd.

Shared decision-making performance of general practice residents: an observational study combining observer, resident, and patient perspectives

BACKGROUND

Shared decision making (SDM) is considered fundamental to person-centred care. However, applying SDM may be a challenge for residents in general practice, since it is a complex competence that requires the integration of knowledge and skills from several competency domains.

OBJECTIVE

To support learning of SDM during medical residency, we aimed to gain insight in Dutch residents' observed and perceived SDM performance in general practice.

METHODS

We evaluated residents' SDM performance from an observer, resident, and patient perspective. Consultations of first- and third-year residents were recorded. Trained observers used the validated Observing Patient Involvement (OPTION5) scale to assess observed SDM performance of residents in 98 actual recorded consultations. Perceived SDM performance was evaluated by residents and patients completing validated SDM questionnaires, supplemented with questions about (the context of) the consultation and perceived relevance of SDM immediately after the consultation. The data were analysed using descriptive statistics (mean, SD, minimums, and maximums) and explorative bivariate analyses.

RESULTS

The residents' observed mean SDM performance was 19.1 (range, 0-100, SD = 10.9), mean resident self-reported SDM performance was 56.9 (range, 0-100, SD = 18.5), and mean patient-reported SDM performance was 73.3 (range, 0-100, SD = 26.8). We found a significant and positive correlation between observed SDM performance and residents' perceived relevance of SDM for the consultation (t = 4.571, P ≤ 0.001) and the duration of the consultation (r = 0.390, P ≤ 0.001).

CONCLUSIONS

This study showed that there is room for increasing awareness of the potential incongruence between observed and perceived SDM performance during medical residency, in order to facilitate the implementation of SDM in clinical practice.

Exploring the use of metacognitive monitoring cues following a diagram completion intervention

Studying texts constitutes a significant part of student learning in health professions education. Key to learning from text is the ability to effectively monitor one's own cognitive performance and take appropriate regulatory steps for improvement. Inferential cues generated during a learning experience typically guide this monitoring process. It has been shown that interventions to assist learners in using comprehension cues improve their monitoring accuracy. One such intervention is having learners to complete a diagram. Little is known, however, about how learners use cues to shape their monitoring judgments. In addition, previous research has not examined the difference in cue use between categories of learners, such as good and poor monitors. This study explored the types and patterns of cues used by participants after being subjected to a diagram completion task prior to their prediction of performance (PoP). Participants' thought processes were studied by means of a think-aloud method during diagram completion and the subsequent PoP. Results suggest that relying on comprehension-specific cues may lead to a better PoP. Poor monitors relied on multiple cue types and failed to use available cues appropriately. They gave more incorrect responses and made commission errors in the diagram, which likely led to their overconfidence. Good monitors, on the other hand, utilized cues that are predictive of learning from the diagram completion task and seemed to have relied on comprehension cues for their PoP. However, they tended to be cautious in their judgement, which probably made them underestimate themselves. These observations contribute to the current understanding of the use and effectiveness of diagram completion as a cue-prompt intervention and provide direction for future research in enhancing monitoring accuracy.

Developing skilled communication: The power of self-monitoring

Because communication is an ongoing process, to become skilled, the author argues it is essential to empower trainees through tailored feedback, activation of self‐monitoring, and awareness of constantly changing context.