How Many Dimensions Underlie Judgments of Learning and Recall? Evidence From State-Trace Methodology

Comparing event-related potentials of retrospective and prospective metacognitive judgments during episodic and semantic memory

It is unclear whether metacognitive judgments are made on the basis of domain-generality or domain-specificity. In the current study, we compared both behavioral and event-related potential (ERP) correlates of retrospective (retrospective confidence judgments: RCJs), and prospective (feeling of knowing: FOK) metacognitive judgments during episodic and semantic memory tasks in 82 participants. Behavioral results indicated that FOK judgments reflect a domain-specific process, while RCJ reflect a domain-general process. RCJ and FOK judgments produced similar ERP waveforms within the memory tasks, but with different temporal dynamics; thus supporting the hypothesis that retrospective and prospective metacognitive judgments are distinct processes. Our ERP results also suggest that metacognitive judgments are linked to distributed neural substrates, rather than purely frontal lobe functioning. Furthermore, the role of intra-subject and inter-subject differences in metacognitive judgments across and within the memory tasks are highlighted.

Cooking through perceptual disfluencies: The effects of auditory and visual distortions on predicted and actual memory performance

The current study investigated the joint contribution of visual and auditory disfluencies, or distortions, to actual and predicted memory performance with naturalistic, multi-modal materials through three experiments. In Experiments 1 and 2, participants watched food recipe clips containing visual and auditory information that were either fully intact or else distorted in one or both of the two modalities. They were asked to remember these for a later memory test and made memory predictions after each clip. Participants produced lower memory predictions for distorted auditory and visual information than intact ones. However, these perceptual distortions revealed no actual memory differences across encoding conditions, expanding the metacognitive illusion of perceptual disfluency for static, single-word materials to naturalistic, dynamic, multi-modal materials. Experiment 3 provided naïve participants with a hypothetical scenario about the experimental paradigm used in Experiment 1, revealing lower memory predictions for distorted than intact information in both modalities. Theoretically, these results imply that both in-the-moment experiences and a priori beliefs may contribute to the perceptual disfluency illusion. From an applied perspective, the study suggests that when audio-visual distortions occur, individuals might use this information to predict their memory performance, even when it does not factor into actual memory performance.

Neurobiological basis of feeling of knowing in episodic memory

Feeling of knowing (FOK) is a metacognitive process which allows individuals to predict the likelihood that they will be able to remember, in the future, information which they currently cannot recall. Although FOK provides evidence for the mechanisms of metacognitive systems, the neurobiological basis of FOK is still unclear. We investigated the neural correlates of FOK induced by an episodic memory task in 77 younger adult participants. Data were gathered using event-related potentials (ERPs). ERP components during high, low, extremely high and extremely low FOK judgments were analyzed. Stimulus-locked ERP analyses indicated that FOK judgment was associated with greater positivity for P200 component at frontal, central, and parietal electrode zones and greater negativity for the N200 component at parietal electrode zones. Furthermore, results revealed that amplitude of the ERP components for FOK judgments were affected by the level of FOK judgment. Results suggest that ERP components of FOK judgment observed within a 200 ms time window support the perceptual fluency-based model.

Simultaneous utilization of multiple cues in judgments of learning

There is much evidence that metacognitive judgments, such as people's predictions of their future memory performance (judgments of learning, JOLs), are inferences based on cues and heuristics. However, relatively little is known about whether and when people integrate multiple cues in one metacognitive judgment or focus on a single cue without integrating further information. The current set of experiments systematically addressed whether and to what degree people integrate multiple extrinsic and intrinsic cues in JOLs. Experiment 1 varied two cues: number of study presentations (1 vs. 2) and font size (18 point vs. 48 point). Results revealed that people integrated both cues in their JOLs. Experiment 2 demonstrated that the two word characteristics concreteness (abstract vs. concrete) and emotionality (neutral vs. emotional) were integrated in JOLs. Experiment 3 showed that people integrated all four cues in their JOLs when manipulated simultaneously. Finally, Experiment 4 confirmed integration of three cues that varied on a continuum rather than in two easily distinguishable levels. These results demonstrate that people have a remarkable capacity to integrate multiple cues in metacognitive judgments. In addition, our findings render an explanation of cue effects on JOLs in terms of demand characteristics implausible.

The relatedness effect on judgments of learning: A closer look at the contribution of processing fluency

The cue-utilization view to judgments of learning (JOLs) assumes that both ease of processing during study and people's beliefs about memory may contribute to people's predictions on the likelihood of remembering recently studied information. However, a recent study (Mueller, Tauber, & Dunlosky, Psychonomic Bulletin & Review, 20(2), 378-384, 2013; Experiment 3) found that processing fluency does not contribute to the effect of pair relatedness on JOLs, that is, to higher JOLs for related paired associates as compared to unrelated paired associates. We investigated whether this finding primarily depends on specific aspects of the paired associates employed or on the measure of processing fluency used in the previous study. In our first two experiments, participants therefore studied lists with (a) uniformly high associative strengths versus (b) a wide range of associative strengths. Results showed that processing disfluency--operationalized as number of trials to acquisition in Experiment 1 and as self-paced study time in Experiment 2--partially mediated the effect of relatedness on JOLs for both types of lists. Finally, in Experiment 3, the contribution of processing fluency to the relatedness effect increased with study-test experience. Unlike Mueller et al., we thus found that processing fluency contributes to the relatedness effect on JOLs. These findings are consistent with the assumption that ease of processing is an important basis for JOLs.

The effect of identical word pairs on people's metamemory judgments: What are the contributions of processing fluency and beliefs about memory?

Judgments of learning (JOLs) are higher for identical pairs (dog–dog) than for related pairs (dog–cat). This identical effect may be mediated (a) by processing fluency (i.e., identical pairs are processed faster than related pairs) or (b) by a belief that identical pairs are better remembered or (c) by both factors. In the present work, we assessed the contribution of both factors. We evaluated whether a measure of processing fluency (i.e., self-paced study) mediated the relationship between pair type and JOLs (Experiment 1) and attempted to disrupt processing fluency using an AlTeRnAtInG presentation format (Experiment 2). We also evaluated whether judgments made in the absence of processing fluency demonstrated the identical effect (Experiment 3), and, finally, we had participants read a vignette about an experiment that included both pair types and estimate which pairs would be best remembered (Experiment 4). Evidence from all experiments converged on the conclusion that people's beliefs about how variables affect memory—and not differential fluency—best explain the identical effect, although we cannot entirely rule out the possibility that fluency plays a small role. The outcomes were consistent with the analytic-processing theory of JOLs—namely, when instructed to make JOLs, people adopt an analytic problem-solving approach that involves identifying variation across pairs that plausibly relate to memory and then use this variation to make JOLs.

Recall and response time norms for English-Swahili word pairs and facts about Kenya

In the vast literature exploring learning, many studies have used paired-associate stimuli, despite the fact that real-world learning involves many different types of information. One of the most popular materials used in studies of learning has been a set of Swahili-English word pairs for which Nelson and Dunlosky (Memory 2; 325-335, 1994) published recall norms two decades ago. These norms involved use of the Swahili words as cues to facilitate recall of the English translation. It is unclear whether cueing in the opposite direction (from English to Swahili) would lead to symmetric recall performance. Bilingual research has suggested that translation in these two different directions involves asymmetric links that may differentially impact recall performance, depending on which language is used as the cue (Kroll & Stewart, Journal of Memory and Language 33; 149-174,1994). Moreover, the norms for these and many other learning stimuli have typically been gathered from college students. In the present study, we report recall accuracy and response time norms for Swahili words when they are cued by their English translations. We also report norms for a companion set of fact stimuli that may be used along with the Swahili-English word pairs to assess learning on a broader scale across different stimulus materials. Data were collected using Amazon's Mechanical Turk to establish a sample that was diverse in both age and ethnicity. These different, but related, stimulus sets will be applicable to studies of learning, metacognition, and memory in diverse samples.

Metacognitive Awareness Inventory: Tradução e Validação a partir de uma Análise Fatorial Confirmatória

Resumo Este estudo teve o objetivo de traduzir e validar estatisticamente o Inventário de Consciência Metacognitiva (MAI), instrumento inédito na literatura em língua portuguesa. Foram coletadas 1058 respostas entre estudantes e profissionais de Administração na cidade Salvador, Bahia. A tradução adotou a metodologiaback translation e a validação estatística foi através da Análise Fatorial Confirmatória pelo Modelo de Equações Estruturais. O construto “Consciência Metacognitiva” relacionado ao MAI confirmou que as dimensões “Consciência do Conhecimento das Habilidades e Estratégias Metacognitivas” e “Consciência das Estratégias de Regulação Metacognitivas” apresentaram medidas de confiabilidade composta e a validade discriminante corroborou que as correlações entre estes indicadores e suas respectivas dimensões são mais fortes que as correlações entre as dimensões; ou seja, o construto “Consciência Metacognitiva” reúne validade discriminante, o que permite validar o instrumento traduzido.

Contributions of beliefs and processing fluency to the effect of relatedness on judgments of learning

Discovering how people judge their memories has been a major issue for metacognitive research for over 4 decades; many factors have been discovered that affect people's judgments, but exactly how those effects are mediated is poorly understood. For instance, the effect of word pair relatedness on judgments of learning (JOLs) has been repeatedly demonstrated, yet the underlying basis of this substantial effect is currently unknown. Thus, in three experiments, we assessed the contribution of beliefs and processing fluency. In Experiment 1, participants studied related and unrelated word pairs and made either prestudy JOLs or immediate JOLs. Participants gave higher estimates for related than for unrelated pairs, suggesting that participants' beliefs at least partially drive the relatedness effect on JOLs. Next, we evaluated the contribution of processing fluency to the relatedness effect either (1) by disrupting fluency by presenting half the pairs in an aLtErNaTiNg format (Experiment 2) or (2) by measuring how fluently participants processed pairs at study and statistically estimating the degree to which conceptual fluency mediated the effects of relatedness on JOLs (Experiment 3). Results from both experiments indicated that fluency contributes minimally to the relatedness effect. Taken together, these results indicate that people's beliefs about how relatedness influences memory are responsible for mediating the relationship between relatedness and JOLs. In general, empirically establishing what mediates the effects of other factors on people's judgments remains a major agenda for advancing theory of metacognitive monitoring.

The dimensionality of perceptual category learning: a state-trace analysis

State-trace analysis was used to investigate the effect of concurrent working memory load on perceptual category learning. Initial reanalysis of Zeithamova and Maddox (2006, Experiment 1) revealed an apparently two-dimensional state-trace plot consistent with a dual-system interpretation of category learning. However, three modified replications of the original experiment found evidence of a single resource underlying the learning of both rule-based and information integration category structures. Follow-up analyses of the Zeithamova and Maddox data, restricted to only those participants who had learned the category task and performed the concurrent working memory task adequately, revealed a one-dimensional plot consistent with a single-resource interpretation and the results of the three new experiments. The results highlight the potential of state-trace analysis in furthering our understanding of the mechanisms underlying category learning.

Dimensions in data: testing psychological models using state-trace analysis

Cognitive science is replete with fertile and forceful debates about the need for one or more underlying mental processes or systems to explain empirical observations. Such debates can be found in many areas, including learning, memory, categorization, reasoning and decision-making. Multiple-process models are often advanced on the basis of dissociations in data. We argue and illustrate that using dissociation logic to draw conclusions about the dimensionality of data is flawed. We propose that a more widespread adoption of 'state-trace analysis'--an approach that overcomes these flaws--could lead to a re-evaluation of the need for multiple-process models and to a re-appraisal of how these models should be formulated and tested.

Medial prefrontal cortex plays a critical and selective role in 'feeling of knowing' meta-memory judgments

The frontal lobes are thought to play a role in the monitoring of memory performance, or 'meta-memory', but the specific circuits involved have yet to be definitively established. Medial prefrontal cortex in general and the anterior cingulate cortex in particular, have been implicated in other forms of monitoring, such as error and conflict monitoring. Here, we tested the hypothesis that medial prefrontal cortex plays a critical role in memory monitoring, aiming to determine whether this region contributed to all, or only some classes of meta-memory judgments. We also investigated the relationship between these judgments and memory performance itself. Three types of meta-memory judgment were measured in 5 subjects with focal damage to medial prefrontal cortex, with maximal overlap in dorsal anterior cingulate cortex, compared to 19 healthy, demographically matched control subjects performing a face-name episodic memory task. Judgment-of-learning accuracy was not affected by such damage. In contrast, both recall confidence and feeling-of-knowing judgments were impaired. Memory performance was itself impaired in the patient group, so we performed a second experiment to examine the relationship between memory and meta-memory deficits. In an easier memory task, where patients performed as well as controls, recall confidence accuracy improved to within the control range despite medial prefrontal damage. In contrast, feeling-of-knowing judgments remained less accurate in the patient group. These results argue that medial prefrontal cortex plays a critical role in generating accurate recall confidence and feeling-of-knowing judgments, but is not necessary for judgment-of-learning. The role of this region in feeling-of-knowing seems to be, at least in part, independent of its role in memory itself.