Metacognitive hindsight bias

Age-related decreases in global metacognition are independent of local metacognition and task performance

Metacognition refers to a capacity to reflect on and control other cognitive processes, commonly quantified as the extent to which confidence tracks objective performance. There is conflicting evidence about how "local" metacognition (monitoring of individual judgments) and "global" metacognition (estimates of self-performance) change across the lifespan. Additionally, the degree to which metacognition generalises across cognitive domains may itself change with age due to increased experience with one's own abilities. Using a gamified suite of performance-controlled memory and visual perception tasks, we measured local and global metacognition in an age-stratified sample of 304 healthy volunteers (18-83 years; N = 50 in each of 6 age groups). We calculated both local and global metrics of metacognition and quantified how and whether domain-generality changes with age. First-order task performance was stable across the age range. People's global self-performance estimates and local metacognitive bias decreased with age, indicating overall lower confidence in performance. In contrast, local metacognitive efficiency was spared in older age and remained correlated across the two cognitive domains. A stability of local metacognition indicates distinct mechanisms contributing to local and global metacognition. Our study reveals how local and global metacognition change across the lifespan and provide a benchmark against which disease-related changes in metacognition can be compared.

A manifesto for applying behavioural science

Recent years have seen a rapid increase in the use of behavioural science to address the priorities of public and private sector actors. There is now a vibrant ecosystem of practitioners, teams and academics building on each other's findings across the globe. Their focus on robust evaluation means we know that this work has had an impact on important issues such as antimicrobial resistance, educational attainment and climate change. However, several critiques have also emerged; taken together, they suggest that applied behavioural science needs to evolve further over its next decade. This manifesto for the future of applied behavioural science looks at the challenges facing the field and sets out ten proposals to address them. Meeting these challenges will mean that behavioural science is better equipped to help to build policies, products and services on stronger empirical foundations-and thereby address the world's crucial challenges.

Pragmatic, constructive, and reconstructive memory influences on the hindsight bias

In hindsight, when the outcome of an uncertain scenario is already known, we typically feel that this outcome was always likely; hindsight judgments of outcome probabilities exceed foresight judgments of the same probabilities without outcome knowledge. We extend prior accounts of hindsight bias with the influence of pragmatic communication inherent in the task and the consolidation of self-generated responses across time. In a novel 3 × 2 within-participants design, with three sequential judgments of outcome probabilities in two scenarios, we replicated the within-participants hindsight bias observed in the classic memory design and the between-participants hindsight bias in a hypothetical design simultaneously. Moreover, we reversed the classic memory design and showed that subjective probabilities also decreased when participants encountered foresight instructions after hindsight instructions, demonstrating that previously induced outcome knowledge did not prevent unbiased judgments. The constructive impact of self-generated and communicated judgments ("saying is believing") was apparent after a 2-week consolidation period: Not outcome knowledge, but rather the last pragmatic response (either biased or unbiased) determined judgments at the third measurement. These findings highlight the short-term malleability of hindsight influences in response to task pragmatics and has major implications for debiasing.

False certainty in the acquisition of anatomical and physiotherapeutic knowledge

BACKGROUND

Efficient metacognitive monitoring, that is the monitoring of one's own thought processes and specifically one's state of knowledge, is essential for effective clinical reasoning. Knowing what one does and does not know is a competency that students of health professions need to develop. Students often tend to develop false certainty in their own knowledge in the longer course of their education, but the time frame that is required for this effect to occur has remained unclear. We investigated whether students developed false certainty already after one course unit.

METHODS

This study analysed data from one sample of medical students and four samples of physiotherapy students in two formal educational settings (total N = 255) who took knowledge tests before and after a course unit. We examined changes in students' confidence separately for correctly and incorrectly answered questions and analysed their ability to assign higher levels of confidence to correct answers than to incorrect answers (discrimination ability).

RESULTS

Students' knowledge as well as confidence in their correct answers in knowledge tests increased after learning. However, consistently for all samples, confidence in incorrect answers increased as well. Students' discrimination ability improved only in two out of the five samples.

CONCLUSIONS

Our results are in line with recent research on confidence increase of health professions students during education. Extending those findings, our study demonstrated that learning in two different formal educational settings increased confidence not only in correct but also in incorrect answers to knowledge questions already after just one learning session. Our findings highlight the importance of improving metacognition in the education of health professionals-especially their ability to know what they do not know.

Hindsight bias in metamemory: outcome knowledge influences the recollection of judgments of learning

Hindsight bias describes people's tendency to overestimate how accurately they have predicted an event's outcome after obtaining knowledge about it. Outcome knowledge has been shown to influence various forms of judgments, but it is unclear whether outcome knowledge also produces a hindsight bias on Judgments of Learning (JOLs). Three experiments tested whether people overestimated the accuracy of their memory predictions after obtaining knowledge about their actual memory performance. In all experiments, participants studied 60 cue-target word pairs, made a JOL for each word pair, and tried to recall the targets in a cued-recall test. In Experiments 1a and 1b, people recollected their original JOLs after attempting to recall each target, that is, after they obtained outcome knowledge for all items. In Experiments 2 and 3, people recollected their original JOLs in a separate phase after attempting to recall half the targets so that they had outcome knowledge for some but not all items. In all experiments, recollected JOLs were closer to actual memory performance than original JOLs for items with outcome knowledge only. Thus, outcome knowledge produced a hindsight bias on JOLs. Our results demonstrate that people overestimate the accuracy of their memory predictions in hindsight.