Generating keywords improves metacomprehension and self-regulation in elementary and middle school children

The structure of metacognition in middle childhood: Evidence for a unitary metacognition-for-memory factor

It has been debated whether children's metacognitive monitoring and control processes rely on a general resource or whether metacognitive processes are task specific. Moreover, findings about the extent to which metacognitive processes are related to first-order task performance are mixed. The current study aimed to uncover the relationships among children's monitoring (discrimination between correct and incorrect responses), control (accurate withdrawal of wrong answers), and performance across three memory-based learning tasks: Kanji learning, text comprehension, and secret code learning. All tasks consisted of a study phase, a test phase, monitoring (confidence judgments), and control (maintaining/withdrawing responses). Participants were 325 children (151 second graders [Mage = 8.12 years] and 174 fourth graders [Mage = 10.20 years]). Confirmatory factor analyses showed that a model in which monitoring and control loaded on a joint factor and performance on a separate factor provided the best fit to the data. Fourth graders had better monitoring and control accuracy than second graders. However, the factor structure of metacognition was similar for both age groups, contradictory to the assumption that metacognition generalizes across tasks as children grow older. After accounting for task-specific processes, monitoring and control skills for language-based memory tasks appear to be generalizable in middle childhood. In sum, children's monitoring and control for three separate memory tasks appear to reflect a unitary metacognition-for-memory factor related to, but distinguishable from, performance.

Exploring the use of metacognitive monitoring cues following a diagram completion intervention

Studying texts constitutes a significant part of student learning in health professions education. Key to learning from text is the ability to effectively monitor one's own cognitive performance and take appropriate regulatory steps for improvement. Inferential cues generated during a learning experience typically guide this monitoring process. It has been shown that interventions to assist learners in using comprehension cues improve their monitoring accuracy. One such intervention is having learners to complete a diagram. Little is known, however, about how learners use cues to shape their monitoring judgments. In addition, previous research has not examined the difference in cue use between categories of learners, such as good and poor monitors. This study explored the types and patterns of cues used by participants after being subjected to a diagram completion task prior to their prediction of performance (PoP). Participants' thought processes were studied by means of a think-aloud method during diagram completion and the subsequent PoP. Results suggest that relying on comprehension-specific cues may lead to a better PoP. Poor monitors relied on multiple cue types and failed to use available cues appropriately. They gave more incorrect responses and made commission errors in the diagram, which likely led to their overconfidence. Good monitors, on the other hand, utilized cues that are predictive of learning from the diagram completion task and seemed to have relied on comprehension cues for their PoP. However, they tended to be cautious in their judgement, which probably made them underestimate themselves. These observations contribute to the current understanding of the use and effectiveness of diagram completion as a cue-prompt intervention and provide direction for future research in enhancing monitoring accuracy.

Metacognitive Effort Regulation across Cultures

Success in cognitive tasks is associated with effort regulation and motivation. We employed the meta-reasoning approach to investigate metacognitive monitoring accuracy and effort regulation in problem solving across cultures. Adults from China, from Israel, and from Europe and North America (for simplicity: "Western countries") solved nonverbal problems and rated their confidence in their answers. The task involved identifying geometric shapes within silhouettes and, thus, required overcoming interference from holistic processing. The Western group displayed the worst monitoring accuracy, with both the highest overconfidence and poorest resolution (discrimination in confidence between the correct and wrong solutions). The Israeli group resembled the Western group in many respects but exhibited better monitoring accuracy. The Chinese group invested the most time and achieved the best success rates, demonstrating exceptional motivation and determination to succeed. However, their efficiency suffered as they correctly solved the fewest problems per minute of work. Effort regulation analysis based on the Diminishing Criterion Model revealed distinct patterns: the Western participants invested the least amount of time regardless of item difficulty and the Israelis invested more time only when addressing the hardest items. The Chinese group allocated more time throughout but particularly in moderate to difficult items, hinting at their strategic determination to overcome the challenge. Understanding cultural differences in metacognitive processes carries implications for theory (e.g., motivational factors) and practice (e.g., international teams, education). The present findings can serve as a foundation for future research in these and other domains.

Connecting teachers' classroom instructions with children's metacognition and learning in elementary school

Many children have difficulties with accurate self-monitoring and effective regulation of study, and this may cause them to miss learning opportunities. In the classroom, teachers play a key role in supporting children with metacognition and learning. The present study aimed to acquire insights into how teachers' cognitive and metacognitive strategy instruction, as well as teacher-directed and child-centered instructional practices are related to children's self-monitoring accuracy, regulation of study, and learning performance. Twenty-one teachers and 308 children (2nd and 4th grade elementary school) participated. Teachers instructed a secret code task, children had to learn the match between letters of the alphabet and corresponding symbols. Teachers were observed and audio-recordings were made of their instructions. Then, children were asked to (a) make restudy selections, (b) complete a test, and (c) self-monitor test performance. Although teachers both addressed cognitive and metacognitive strategies, they more often instructed children about cognitive strategies. Further, teaching practices were more often teacher-directed than child-centered. Although there were no relations between teachers' instructions for metacognitive strategies and children's outcome measures, teaching cognitive strategies was positively associated with children's performance and self-monitoring accuracy. However, teaching cognitive strategies did not predict effective restudy selections. Rather, child-centered instructions (i.e., giving children autonomy to regulate their own learning) positively predicted children's restudy, and further, children's self-monitoring was more accurate in classrooms where teachers more often used child-centered instructional practices. This seems to imply that not only the content of the instructions itself, but particularly the way these are given, affects children's metacognition.

Children's exploratory play tracks the discriminability of hypotheses

Effective curiosity-driven learning requires recognizing that the value of evidence for testing hypotheses depends on what other hypotheses are under consideration. Do we intuitively represent the discriminability of hypotheses? Here we show children alternative hypotheses for the contents of a box and then shake the box (or allow children to shake it themselves) so they can hear the sound of the contents. We find that children are able to compare the evidence they hear with imagined evidence they do not hear but might have heard under alternative hypotheses. Children (N = 160; mean: 5 years and 4 months) prefer easier discriminations (Experiments 1-3) and explore longer given harder ones (Experiments 4-7). Across 16 contrasts, children's exploration time quantitatively tracks the discriminability of heard evidence from an unheard alternative. The results are consistent with the idea that children have an "intuitive psychophysics": children represent their own perceptual abilities and explore longer when hypotheses are harder to distinguish.

Comparing metacognitive monitoring between native and non-native speaking primary school students

Metacognitive monitoring is a significant predictor of academic achievement and is assumed to be related to language competencies. Hence, it may explain academic performance differences between native and non-native speaking students. We compared metacognitive monitoring (in terms of resolution) between native and non-native speaking fourth graders (~ 10 year olds) in two studies. In Study 1, we matched 30 native and 30 non-native speakers and assessed their monitoring in the context of a paired-associates task, including a recognition test and confidence judgements. Study 1 revealed that recognition and monitoring did not differ between native and non-native speaking children. In Study 2, we matched 36 native and 36 non-native speakers and assessed their monitoring with the same paired-associates task. Additionally, we included a text comprehension task with open-ended questions and confidence judgments. We replicated the findings of Study 1, suggesting that recognition and monitoring do not necessarily differ between native and non-native speakers. However, native speaking students answered more open-ended questions correctly than non-native speaking students did. Nevertheless, the two groups did not differ in monitoring their answers to open-ended questions. Our results indicate that native and non-native speaking children may monitor their metacognitive resolution equally, independent of task performance and characteristics. In conclusion, metacognitive monitoring deficits may not be the primary source of the academic performance differences between native and non-native speaking students.

Improving Metacognition in the Classroom

Abstract. Students are often overconfident in educational settings and struggle to differentiate between well-learned and poorly-learned concepts. The present article reviews current research on strategies that help students assess their understanding, with a focus on research using authentic educational tasks and materials. We propose a framework for these strategies that we refer to as wait-generate-validate. The wait-generate-validate strategies can give students a more objective measure of their learning from lectures, understanding of course concepts, text comprehension, problem-solving ability, and test preparedness. These strategies have been shown to lead to more effective study decisions and greater learning. Lastly, we translate the reviewed research into practical tips for students and teachers and conclude with recommendations for future research regarding how students judge their learning in diverse educational contexts.

To What Extent Do Situation-Model-Approach Interventions Improve Relative Metacomprehension Accuracy? Meta-Analytic Insights

This meta-analysis investigated the extent to which relative metacomprehension accuracy can be increased by interventions that aim to support learners’ use of situation-model cues as a basis for judging their text comprehension. These interventions were delayed-summary writing, delayed-keywords listing, delayed-diagram completion, self-explaining, concept mapping, rereading, and setting a comprehension-test expectancy. First, the general effectiveness of situation-model-approach interventions was examined. The results revealed that, across 28 effect sizes (comprising a total of 2,236 participants), situation-model-approach interventions exerted a medium positive effect (g = 0.46) on relative metacomprehension accuracy. Second, the interventions were examined individually. The results showed that, with the exception of self-explaining, each intervention had a significant positive effect on relative metacomprehension accuracy. Yet, there was a tendency for setting a comprehension-test expectancy to be particularly effective. A further meta-analysis on comprehension in the selected studies revealed that, overall, the situation-model-approach interventions were also beneficial for directly improving comprehension, albeit the effect was small. Taken together, the findings demonstrate the utility of situation-model-approach interventions for supporting self-regulated learning from texts.

Synthesizing Cognitive Load and Self-regulation Theory: a Theoretical Framework and Research Agenda

An exponential increase in the availability of information over the last two decades has asked for novel theoretical frameworks to examine how students optimally learn under these new learning conditions, given the limitations of human processing ability. In this special issue and in the current editorial introduction, we argue that such a novel theoretical framework should integrate (aspects of) cognitive load theory and self-regulated learning theory. We describe the effort monitoring and regulation (EMR) framework, which outlines how monitoring and regulation of effort are neglected but essential aspects of self-regulated learning. Moreover, the EMR framework emphasizes the importance of optimizing cognitive load during self-regulated learning by reducing the unnecessary load on the primary task or distributing load optimally between the primary learning task and metacognitive aspects of the learning task. Three directions for future research that derive from the EMR framework and that are discussed in this editorial introduction are: (1) How do students monitor effort? (2) How do students regulate effort? and (3) How do we optimize cognitive load during self-regulated learning tasks (during and after the primary task)? Finally, the contributions to the current special issue are introduced.

The Role of Mental Effort in Fostering Self-Regulated Learning with Problem-Solving Tasks

Problem-solving tasks form the backbone of STEM (science, technology, engineering, and mathematics) curricula. Yet, how to improve self-monitoring and self-regulation when learning to solve problems has received relatively little attention in the self-regulated learning literature (as compared with, for instance, learning lists of items or learning from expository texts). Here, we review research on fostering self-regulated learning of problem-solving tasks, in which mental effort plays an important role. First, we review research showing that having students engage in effortful, generative learning activities while learning to solve problems can provide them with cues that help them improve self-monitoring and self-regulation at an item level (i.e., determining whether or not a certain type of problem needs further study/practice). Second, we turn to self-monitoring and self-regulation at the task sequence level (i.e., determining what an appropriate next problem-solving task would be given the current level of understanding/performance). We review research showing that teaching students to regulate their learning process by taking into account not only their performance but also their invested mental effort on a prior task when selecting a new task improves self-regulated learning outcomes (i.e., performance on a knowledge test in the domain of the study). Important directions for future research on the role of mental effort in (improving) self-monitoring and self-regulation at the item and task selection levels are discussed after the respective sections.

Development of Children's monitoring and control when learning from texts: effects of age and test format

This study investigated elementary school children's development of monitoring and control when learning from texts. Second (N = 138) and fourth (N = 164) graders were tested in the middle (T₁) and end (T₂) of the school year. The study focused on the cross-sectional and longitudinal development of monitoring and control, and aimed to investigate the development of metacognition for two test formats. After reading expository texts, children completed a comprehension test consisting of open-ended and true-false questions. They monitored their test performance by making confidence judgments, and controlled performance by deciding whether to maintain or withdraw their given answers. Overall, monitoring and control accuracy was higher for open-ended questions than for true-false questions. For open-ended questions, results indicated higher metacognitive accuracy for fourth graders than second graders. No such age effects were found for monitoring and control for true-false questions. Longitudinally, children of both age groups improved their monitoring and control accuracy from T₁ to T₂, for open-ended and true-false questions. For both test types, improvement mainly occurred for the monitoring and controlling of incorrect, rather than correct answers. Additionally, the results indicated inter-individual stability of performance, but no stability of monitoring and control accuracy over time. The findings indicate that developmental as well as task-related factors affect children's metacognitive accuracy.

Teachers' monitoring of students' text comprehension: can students' keywords and summaries improve teachers' judgment accuracy?

We investigated intra-individual monitoring and regulation in learning from text in sixth-grade students and their teachers. In Experiment 1, students provided judgments of learning (JOLs) for six texts in one of three cue-prompt conditions (after writing delayed keywords or summaries or without a cue prompt) and then selected texts for restudy. Teachers also judged their students' learning for each text, while seeing - if present - the keywords or summaries each student had written for each text, and also selected texts for restudy. Overall, monitoring accuracy was low (.10 for students, -.02 for teachers) and did not differ between cue-prompt conditions. Regulation, indexed by the correlation between JOLs and restudy selections, was significant (-.38 for students, -.60 for teachers), but was also not affected by cue-prompt condition. In Experiment 2, teachers judged students' comprehension of six texts without knowing the students' names, so that only the keywords and summaries, not prior impressions, could inform judgments. Again, monitoring accuracy was generally low (.06), but higher for keywords (.23) than for summaries (-.10). These results suggest that monitoring intra-individual differences in students' learning is challenging for teachers. Analyses of the diagnosticity and utilization of keywords suggest that these may contain insufficient cues for improving teacher judgments at this level of specificity.

Metacognitive Monitoring of Text Comprehension: An Investigation on Postdictive Judgments in Typically Developing Children and Children With Reading Comprehension Difficulties

The ability to assess and monitor one's own understanding of a written text is fundamental for learning and academic achievement. In the current paper, postdictive monitoring of text comprehension (i.e., the ability to judge the accuracy of responses previously given to a reading comprehension test) was investigated in both typically developing (TD) children and children with reading comprehension difficulties. Children from primary school (3rd to 5th grade) and secondary school (6th to 8th grade) participated in the study (N = 245). They were administered standardized tasks for reading comprehension, in which they had to read two texts and answer 12 multiple-choice questions after each text; subsequently, they had to provide postdictive judgments evaluating their performance: for each answer they had to select whether they judged it as correct, incorrect or whether they were uncertain. Two scores were calculated: Bias score, indicating the difference between metacognitive judgments of accuracy and actual performance; and Accurate estimation, indicating the sum of correct answers judged as "correct" and incorrect answers judged as "incorrect." Results showed that primary school children were more overconfident than secondary school children and made fewer Accurate estimations especially for "correct" responses. Furthermore, the consideration of a group of children with reading comprehension difficulties showed that these failures are linked to worse metacognitive monitoring ability of comprehension performance in comparison not only to age-matched controls but also to the TD group of third-graders. Implications for learning and achievement are discussed.

Testing and metacognition: retrieval practise effects on metacognitive monitoring in learning from text

Previous research on the testing effect has primarily focussed on the benefits of testing at the cognitive performance level but rather disregarded the potential effects of testing at the metacognitive performance level. In the present study, we examined the potential of retrieval practise during learning to improve the accuracy of confidence judgments in future retrieval. In a learning-from-text experiment with 98 secondary school students, we implemented an initial test as retrieval practise and a final test one week later. Both tests assessed students' correctness of answering and confidence in their answers. The final test comprised items already tested in the initial test (testing condition) and items not tested in the initial test (control condition). In the final test, the proportion of correct answers and the proportion of confident answers were higher in the testing condition compared to the control condition. Moreover, the confidence judgments were more accurate and less biased in the testing condition compared to the control condition. The results are discussed in the context of the functional relations between retrieval practise and metacognitive monitoring.

How restudy decisions affect overall comprehension for seventh-grade students

BACKGROUND

Self-regulated learning requires accurate monitoring and effective regulation of study. Little is known about how effectively younger readers regulate their study.

AIMS

We examined how decisions about which text to restudy affect overall comprehension for seventh-grade students. In addition to a Participant's Choice condition where students were allowed to pick texts for restudy on their own, we compared learning gains in two other conditions in which texts were selected for them. The Test-Based Restudy condition determined text selection using initial test performance - presenting the text with the lowest initial test performance for restudy, thereby circumventing potential problems associated with inaccurate monitoring and ineffective regulation. The Judgement-Based Restudy condition determined text selection using metacognitive judgements of comprehension - presenting the text with the lowest judgement of comprehension, thereby circumventing potential problems associated with ineffective regulation.

SAMPLE

Four hundred and eighty seventh-grade students participated.

METHOD

Students were randomly assigned to conditions in an experimental design.

RESULTS AND CONCLUSIONS

Gains in comprehension following restudy were larger for the Test-Based Restudy condition than for the Judgement-Based Restudy condition or the Participant's Choice condition. No differences in comprehension were seen between the Judgement-Based Restudy and Participant's Choice conditions. These results suggest seventh graders can systematically use their monitoring to make decisions about what to restudy. However, the results highlight how inaccurate monitoring is one reason why younger students fail to benefit from self-regulated study opportunities.

Monitoring and regulation of learning in medical education: the need for predictive cues

CONTEXT

Being able to accurately monitor learning activities is a key element in self-regulated learning in all settings, including medical schools. Yet students' ability to monitor their progress is often limited, leading to inefficient use of study time. Interventions that improve the accuracy of students' monitoring can optimise self-regulated learning, leading to higher achievement. This paper reviews findings from cognitive psychology and explores potential applications in medical education, as well as areas for future research.

COGNITIVE PSYCHOLOGY

Effective monitoring depends on students' ability to generate information ('cues') that accurately reflects their knowledge and skills. The ability of these 'cues' to predict achievement is referred to as 'cue diagnosticity'. Interventions that improve the ability of students to elicit predictive cues typically fall into two categories: (i) self-generation of cues and (ii) generation of cues that is delayed after self-study. Providing feedback and support is useful when cues are predictive but may be too complex to be readily used.

APPLICATION TO MEDICAL EDUCATION

Limited evidence exists about interventions to improve the accuracy of self-monitoring among medical students or trainees. Developing interventions that foster use of predictive cues can enhance the accuracy of self-monitoring, thereby improving self-study and clinical reasoning. First, insight should be gained into the characteristics of predictive cues used by medical students and trainees. Next, predictive cue prompts should be designed and tested to improve monitoring and regulation of learning. Finally, the use of predictive cues should be explored in relation to teaching and learning clinical reasoning.

CONCLUSIONS

Improving self-regulated learning is important to help medical students and trainees efficiently acquire knowledge and skills necessary for clinical practice. Interventions that help students generate and use predictive cues hold the promise of improved self-regulated learning and achievement. This framework is applicable to learning in several areas, including the development of clinical reasoning.

Why are children overconfident? Developmental differences in the implementation of accessibility cues when judging concept learning

Children are often overconfident when monitoring their learning, which is harmful for effective control and learning. The current study investigated children's (N=167, age range 7-12years) judgments of learning (JOLs) when studying difficult concepts. The main aims were (a) to investigate how JOL accuracy is affected by accessibility cues and (b) to investigate developmental changes in implementing accessibility cues in JOLs. After studying different concepts, children were asked to generate novel sentences and then to make JOLs, select concepts for restudy, and take a final test. Overconfidence for incorrect and incomplete test responses was reduced for older children in comparison with younger children. For older age groups, generating a sentence led to greater overconfidence compared with not being able to generate a sentence, which indicates that older children relied more on accessibility cues when making JOLs. This pattern differed in the youngest age group; younger children were generally overconfident regardless of whether they had generated sentences or not. Overconfidence was disadvantageous for effective control of learning for all age groups. These findings imply that instructions to encourage children to avoid metacognitive illusions need to be adapted to children's developmental stage.

Monitoring communication with patients: analyzing judgments of satisfaction (JOS)

Medical students struggle to put into practice communication skills learned in medical school. In order to improve our instructional designs, better insight into the cause of this lack of transfer is foundational. We therefore explored students' cognitions by soliciting self-evaluations of their history-taking skills, coined 'judgments of satisfaction (JOSs)'. Our cognitive-psychological approach was guided by Koriat's cue-utilization framework (J Exp Psychol Gen 126:349-370. doi: 10.1037/0096-3445.126.4.349 , 1997) which rests on the assumption that internal and external cues inform learners' metacognitive judgments, which, in turn, steer their actions. Judgments based on unsuitable cues will cause ineffective behavior. Consequently, students are unable to adequately master these skills or properly apply them in similar situations. For the analysis, we had 524 medical undergraduates select scenes they were satisfied or dissatisfied with from their video-recorded simulated-patient encounters and explain why. Twenty transcripts were sampled for directed content analysis. We found that approximately one-third of students' judgments focused on content (JOS-type-a); about half on the quality of the communication skills (JOS-type-b); and about ten percent targeted the appropriateness of the skills harnessed (JOS-type-c). This lack of reflection on appropriateness may explain why students experience problems adapting to new situations. It was primarily high-performance students who formed type-c judgments; poor performers tended to give type-a and type-b judgments. Future research would benefit from the use of our modified version of Koriat's framework in order to further explore how high and poor performing medical students differ in the way they form JOSs during communications skills training.

Computerized trainings in four groups of struggling readers: Specific effects on word reading and comprehension

Four groups of poor readers were identified among a population of students with learning disabilities attending a special class in secondary school: normal readers; specific poor decoders; specific poor comprehenders, and general poor readers (deficits in both decoding and comprehension). These students were then trained with a software program designed to encourage either their word decoding skills or their text comprehension skills. After 5 weeks of training, we observed that the students experiencing word reading deficits and trained with the decoding software improved primarily in the reading fluency task while those exhibiting comprehension deficits and trained with the comprehension software showed improved performance in listening and reading comprehension. But interestingly, the latter software also led to improved performance on the word recognition task. This result suggests that, for these students, training interventions focused at the text level and its comprehension might be more beneficial for reading in general (i.e., for the two components of reading) than word-level decoding trainings.

Can students evaluate their understanding of cause-and-effect relations? The effects of diagram completion on monitoring accuracy

For effective self-regulated study of expository texts, it is crucial that learners can accurately monitor their understanding of cause-and-effect relations. This study aimed to improve adolescents' monitoring accuracy using a diagram completion task. Participants read six texts, predicted performance, selected texts for restudy, and were tested for comprehension. Three groups were compared, in which learners either completed causal diagrams immediately after reading, completed them after a delay, or received no-diagram control instructions. Accuracy of predictions of performance was highest for learning of causal relations following delayed diagram completion. Completing delayed diagrams focused learners specifically on their learning of causal relations, so this task did not improve monitoring of learning of factual information. When selecting texts for restudy, the participants followed their predictions of performance to the same degree, regardless of monitoring accuracy. Fine-grained analyses also showed that, when completing delayed diagrams, learners based judgments on diagnostic cues that indicated actual understanding of connections between events in the text. Most important, delayed diagram completion can improve adolescents' ability to monitor their learning of cause-and-effect relations.

Building student proficiency with scientific literature using the Zotero reference manager platform

While mastery of the scientific literature is a strongly desirable trait for undergraduate students, the sheer volume of the current literature has complicated the challenge of teaching scientific literacy. Part of the response to this ever-increasing volume of resources includes formal instruction in the use of reference manager software while engaging students with the primary literature. This article describes the incorporation of the reference manager program Zotero into a chemical literature course to facilitate the use of digital resources and to better enable them to use proper citation skills in their technical writing.