From domain-specific to domain-general? The developmental path of metacognition for strategy selection

Evaluation of a New Adolescent Social Communication Assessment: The Transition Pragmatics Interview

PURPOSE

This study evaluated the psychometric functioning of a new criterion-referenced assessment of adolescent social communication, the Transition Pragmatics Interview (TPI), based on the synthesis model of pragmatics. Two ways of interpreting item difficulty were explored: (a) as a function of the synthesis model elements of social communication ability that items were designed to assess, and (b) as a function of the developmental level required for a successful response based on an adapted situational-discourse-semantics (SDS) model (Norris & Hoffman, 1993).

METHOD

Thirty-seven participants aged 14-22 years completed the TPI. Responses were analyzed using Rasch analysis to evaluate the functioning of the scale and to determine item difficulty. Items were coded for the SDS developmental level required for an adequate response. The mean Rasch item difficulty for items at each SDS developmental level was analyzed for the five adapted SDS domains.

RESULTS

Consistent with the first approach for interpreting item difficulty, TPI items varied in difficulty as a function of the element of social communication they were designed to assess (p < .001). Interpreting item difficulty based on the adapted SDS model was not supported: Items requiring higher SDS developmental levels were not more difficult than those requiring less (p = .55).

CONCLUSIONS

The TPI responses fit the Rasch model, supporting the TPI as a unidimensional measure and supporting the use of all items together to compute a single number that summarizes the level of social communication for each examinee. The item ordering from least to most difficult was consistent with prior findings on adolescent social communication development.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.26018545.

The structure of metacognition in middle childhood: Evidence for a unitary metacognition-for-memory factor

It has been debated whether children's metacognitive monitoring and control processes rely on a general resource or whether metacognitive processes are task specific. Moreover, findings about the extent to which metacognitive processes are related to first-order task performance are mixed. The current study aimed to uncover the relationships among children's monitoring (discrimination between correct and incorrect responses), control (accurate withdrawal of wrong answers), and performance across three memory-based learning tasks: Kanji learning, text comprehension, and secret code learning. All tasks consisted of a study phase, a test phase, monitoring (confidence judgments), and control (maintaining/withdrawing responses). Participants were 325 children (151 second graders [Mage = 8.12 years] and 174 fourth graders [Mage = 10.20 years]). Confirmatory factor analyses showed that a model in which monitoring and control loaded on a joint factor and performance on a separate factor provided the best fit to the data. Fourth graders had better monitoring and control accuracy than second graders. However, the factor structure of metacognition was similar for both age groups, contradictory to the assumption that metacognition generalizes across tasks as children grow older. After accounting for task-specific processes, monitoring and control skills for language-based memory tasks appear to be generalizable in middle childhood. In sum, children's monitoring and control for three separate memory tasks appear to reflect a unitary metacognition-for-memory factor related to, but distinguishable from, performance.

Active help-seeking and metacognition interact in supporting children's retention of science facts

Determining when to ask for help is a critical self-regulated strategy that can benefit children's learning. Despite its importance, we have a limited understanding about the developmental mechanisms that support adaptive help-seeking. In the current preregistered study, predominately White children aged 8 to 13 years (N = 69, ngirls = 37) had the option to seek help during an online science learning task. Results revealed that children's ability to adaptively seek help improved throughout childhood and early adolescence. Critically, developing metacognitive skills contributed to greater help-related memory benefits (compared with conditions where help was not previously available). Overall, these findings highlight the role of metacognition in children's ability to adaptively seek and benefit from help during online science learning.

Influence of emotional stimuli on metacognition: A study in arithmetic

We investigate the role of negative emotional stimuli on direct and indirect metacognition, and document age-related differences in this role during adulthood. Participants were presented with negative or neutral pictures while asked to select which of two available strategies was the better strategy to find approximate estimates of two-digit multiplication problems. Following each strategy selection, participants provided either a direct (confidence judgment; Expt. 1) or an indirect (opt-out judgment; Expt. 2) evaluation of their strategy choice. Negative emotional stimuli decreased metacognitive accuracy for arithmetic strategy selection, but only when indirect metacognitive measures were collected. No differences were found when direct metacognitive judgments were requested. The effects of emotional stimuli on indirect metacognition and lack of effects on direct metacognition were found in both young and older adults. These findings have important implications for our understanding of the mechanisms underlying the effects of emotion on metacognition in young and older adults.

Mini managers: Children strategically divide cognitive labor among collaborators, but with a self-serving bias

Strategic collaboration according to the law of comparative advantage involves dividing tasks based on the relative capabilities of group members. Three experiments (N = 405, primarily White and Asian, 45% female, collected 2016-2019 in Canada) examined how this strategy develops in children when dividing cognitive labor. Children divided questions about numbers between two partners. By 7 years, children allocated difficult questions to the skilled partner (Experiment 1, d = 1.42; Experiment 2, d = 0.87). However, younger children demonstrated a self-serving bias, choosing the easiest questions for themselves. Only when engaging in a third-party collaborative task did 5-year-olds assign harder questions to the more skilled individual (Experiment 3, d = 0.55). These findings demonstrate early understanding of strategic collaboration subject to a self-serving bias.

Are children's judgments of another's accuracy linked to their metacognitive confidence judgments?

The world can be a confusing place, which leads to a significant challenge: how do we figure out what is true? To accomplish this, children possess two relevant skills: reasoning about the likelihood of their own accuracy (metacognitive confidence) and reasoning about the likelihood of others' accuracy (mindreading). Guided by Signal Detection Theory and Simulation Theory, we examine whether these two self- and other-oriented skills are one in the same, relying on a single cognitive process. Specifically, Signal Detection Theory proposes that confidence in a decision is purely derived from the imprecision of that decision, predicting a tight correlation between decision accuracy and confidence. Simulation Theory further proposes that children attribute their own cognitive experience to others when reasoning socially. Together, these theories predict that children's self and other reasoning should be highly correlated and dependent on decision accuracy. In four studies (N = 374), children aged 4-7 completed a confidence reasoning task and selective social learning task each designed to eliminate confounding language and response biases, enabling us to isolate the unique correlation between self and other reasoning. However, in three of the four studies, we did not find that individual differences on the two tasks correlated, nor that decision accuracy explained performance. These findings suggest self and other reasoning are either independent in childhood, or the result of a single process that operates differently for self and others.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s11409-021-09263-x.

Anchoring Effect of Performance Feedback on Accuracy of Metacognitive Monitoring in Preschool Children

Preschool children are generally inaccurate at evaluating past and predicting future performance. The present study examines the effect of performance feedback on the accuracy of preschoolers' predictive judgments and tests whether performance feedback acts as an anchor for postdictive judgments. In Experiment 1, preschool children (n = 40) solved number patterns, and in Experiment 2 they solved object patterns (n = 59). The results in both experiments revealed, firstly, that children receiving performance feedback made more accurate predictive judgments and lowered their certainty after their incorrect answer. Secondly, the children relied on performance feedback more than on actual task experience when making postdictive judgments, indicating that performance feedback was used as an anchor for subsequent postdictive judgments.

The neural basis of metacognitive monitoring during arithmetic in the developing brain

In contrast to a substantial body of research on the neural basis of cognitive performance in several academic domains, less is known about how the brain generates metacognitive (MC) awareness of such performance. The existing work on the neurobiological underpinnings of metacognition has almost exclusively been done in adults and has largely focused on lower level cognitive processing domains, such as perceptual decision‐making. Extending this body of evidence, we investigated MC monitoring by asking children to solve arithmetic problems, an educationally relevant higher‐order process, while providing concurrent MC reports during fMRI acquisition. Results are reported on 50 primary school children aged 9–10 years old. The current study is the first to demonstrate that brain activity during MC monitoring, relative to the control task, increased in the left inferior frontal gyrus in children. This brain activity further correlated with children's arithmetic development over a 3‐year time period. These data are in line with the frequently suggested, yet never empirically tested, hypothesis that activity in the prefrontal cortex during arithmetic is related to the higher‐order process of MC monitoring.

Metacognition across domains: Is the association between arithmetic and metacognitive monitoring domain-specific?

Metacognitive monitoring is a critical predictor of arithmetic in primary school. One outstanding question is whether this metacognitive monitoring is domain-specific or whether it reflects a more general performance monitoring process. To answer this conundrum, we investigated metacognitive monitoring in two related, yet distinct academic domains: arithmetic and spelling. This allowed us to investigate whether monitoring in one domain correlated with monitoring in the other domain, and whether monitoring in one domain was predictive of performance in the other, and vice versa. Participants were 147 typically developing 8-9-year-old children (Study 1) and 77 typically developing 7-8-year-old children (Study 2), who were in the middle of an important developmental period for both metacognitive monitoring and academic skills. Pre-registered analyses revealed that within-domain metacognitive monitoring was an important predictor of arithmetic and spelling at both ages. In 8-9-year-olds the metacognitive monitoring measures in different academic domains were predictive of each other, even after taking into account academic performance in these domains. Monitoring in arithmetic was an important predictor of spelling performance, even when arithmetic performance was controlled for. Likewise, monitoring in spelling was an important predictor of arithmetic performance, even when spelling performance was controlled for. In 7-8-year-olds metacognitive monitoring was domain-specific, with neither correlations between the monitoring measures, nor correlations between monitoring in one domain and performance in the other. Taken together, these findings indicate that more domain-general metacognitive monitoring processes emerge over the ages from 7 to 9.

Strategy adoption depends on characteristics of the instruction, learner, and strategy

Why do people change their strategies for solving problems? In this research, we tested whether negative feedback and the context in which learners encounter a strategy influence their likelihood of adopting that strategy. In particular, we examined whether strategy adoption varied when learners were exposed to a target strategy in isolation, in conjunction with their own current strategy, and in conjunction with another novel strategy. We also investigated the roles of individual differences, including learners' need for cognition and their confidence in their current strategies. In Study 1, undergraduate participants who encountered a target strategy in isolation were more likely to adopt it than participants who encountered it in the context of their own current strategy. Negative feedback, low confidence, and high need for cognition also predicted greater adoption. In Study 2, we examined whether rates of strategy adoption depended on the target strategy itself. Indeed, participants were more likely to adopt one strategy than the other, and the effects of feedback also varied across strategies. Individual differences-need for cognition and confidence-also influenced patterns of strategy adoption. These results suggest that strategy adoption depends on the confluence of many factors, including the context in which a target strategy is introduced, characteristics of the learner, and characteristics of the strategy itself.