On the relationship between learning strategy and feedback processing in the weather prediction task--Evidence from event-related potentials

Differential effects of bilateral hippocampal CA3 damage on the implicit learning and recognition of complex event sequences

Learning regularities in the environment is a fundament of human cognition, which is supported by a network of brain regions that include the hippocampus. In two experiments, we assessed the effects of selective bilateral damage to human hippocampal subregion CA3, which was associated with autobiographical episodic amnesia extending ~50 years prior to the damage, on the ability to recognize complex, deterministic event sequences presented either in a spatial or a non-spatial configuration. In contrast to findings from related paradigms, modalities, and homologue species, hippocampal damage did not preclude recognition memory for an event sequence studied and tested at four spatial locations, whereas recognition memory for an event sequence presented at a single location was at chance. In two additional experiments, recognition memory for novel single-items was intact, whereas the ability to recognize novel single-items in a different location from that presented at study was at chance. The results are at variance with a general role of the hippocampus in the learning and recognition of complex event sequences based on non-adjacent spatial and temporal dependencies. We discuss the impact of the results on established theoretical accounts of the hippocampal contributions to implicit sequence learning and episodic memory.

Strategy Development and Feedback Processing During Complex Category Learning

In this study, 38 young adults participated in a probabilistic A/B prototype category learning task under observational and feedback-based conditions. The study compared learning success (testing accuracy) and strategy use (multi-cue vs. single feature vs. random pattern) between training conditions. The feedback-related negativity (FRN) and P3a event related potentials were measured to explore the relationships between feedback processing and strategy use under a probabilistic paradigm. A greater number of participants were found to utilize an optimal, multi-cue strategy following feedback-based training than observational training, adding to the body of research suggesting that feedback can influence learning approach. There was a significant interaction between training phase and strategy on FRN amplitude. Specifically, participants who used a strategy in which category membership was determined by a single feature (single feature strategy) exhibited a significant decrease in FRN amplitude from early training to late training, perhaps due to reduced utilization of feedback or reduced prediction error. There were no significant main or interaction effects between valence, training phase, or strategy on P3a amplitude. Findings are consistent with prior research suggesting that learners vary in their approach to learning and that training method influences learning. Findings also suggest that measures of feedback processing during probabilistic category learning may reflect changes in feedback utilization and may further illuminate differences among individual learners.

Individual differences of conflict monitoring and feedback processing during reinforcement learning in a mock forensic context

This study investigated individual differences of conflict monitoring (N2 component), feedback processing (feedback negativity component), and reinforcement learning in a discrimination learning task using a mock (fictitious) forensic scenario to set participants in a semantic task context. We investigated individual differences of anxiety-related, impulsivity-related traits and reasoning ability during trial-and-error learning of mock suspect and nonsuspect faces. Thereby, we asked how the differential investment of cognitive-motivational processes facilitates learning in a mock forensic context. As learning can be studied by means of time-on-task effects (i.e., variations of cognitive processes across task blocks), we investigated the differential investment of cognitive-motivational processes block-wise in N = 100 participants. By performing structural equation modeling, we demonstrate that conflict monitoring decreased across task blocks, whereas the percentage of correct responses increased across task blocks. Individuals with higher reasoning scores and higher impulsivity-related traits relied rather on feedback processing (i.e., external indicators) during reinforcement learning. Individuals with higher anxiety-related traits intensified their conflict monitoring throughout the task to learn successfully. Observation by relevant others intensified conflict monitoring more than nonobservation. Our data highlight that individual differences and social context modulate the intensity of information processing in a discrimination learning task using a mock forensic task scenario. We discuss our data with regard to recent cognitive-motivational approaches and in terms of reinforcement learning.

Cortisol modulates the engagement of multiple memory systems: Exploration of a common NR3C2 polymorphism

Exposure to acute stress has been shown to result in a shift from declarative toward non-declarative learning, presumably mediated by brain mineralocorticoid receptors (MRs). In this study, we aimed to replicate and extend these findings by investigating the role of stress-associated cortisol secretion on learning behavior. Furthermore, we explored the influence of a well-characterized common single nucleotide polymorphism of the MR gene (rs2070951; minor allele frequency: 49.3%) previously shown to influence MR expression and HPA axis activity. Healthy males (n = 74) were exposed to the Trier Social Stress Test or a control condition prior to performing a probabilistic classification task (Weather Prediction Task). The use of a non-declarative learning strategy continuously increased over the course of the learning task after stress exposure, but leveled in the control condition. The shift toward a non-declarative strategy in the stress group was associated with better learning performance. Higher pre-stress cortisol levels favored the adoption of a non-declarative learning strategy. rs2070951 C/C-carriers in contrast to G-allele carriers exhibited a larger secretion of cortisol under stress. Furthermore, control participants homozygous for the C-allele adopted a non-declarative learning strategy less often than stressed participants, whereas the choice of strategy was independent of stress in G-allele carriers. The failure to switch strategies resulted in poorer performance, suggesting a beneficial effect of stress in dependence of MR variation. Consistent with previous findings, the results provide further support for cortisol as a driving force in coordinating the competition between multiple memory systems under stress.

A Haplotype Associated with Enhanced Mineralocorticoid Receptor Expression Facilitates the Stress-Induced Shift from "Cognitive" to "Habit" Learning

Stress induces a shift from hippocampus-dependent "cognitive" toward dorsal striatum-dependent "habit" memory. However, not all individuals are susceptible to this shift under stress. Based on pharmacological studies indicating a critical role of the mineralocorticoid receptor (MR) in the stress-induced bias toward dorsal striatal learning, we hypothesized that MR gene variants contribute to these individual differences. In two experiments, healthy participants were genotyped, exposed to a stressor or control manipulation and performed a learning task that can be solved using hippocampal or dorsal striatal systems, while electroencephalography (EEG; Experiment I) or functional magnetic resonance imaging (fMRI; Experiment II) measurements were taken. Stress led to a shift from hippocampal to dorsal striatal learning which was more pronounced in homo- and heterozygous carriers of a six single nucleotide polymorphisms (SNPs)-comprising haplotype containing the alleles of two MR SNPs associated with increased MR expression and transactivational activity (MR-2G/C C [rs2070951], MR-I180V A [rs5522]). This stress-induced shift toward habit memory was paralleled by an increased feedback-related negativity (FRN), which may reflect striatal processing, and increased caudate activation. Carriers of the MR haplotype showed a reduced P3a, an event-related potential thought to indicate cognitive processing, and reduced hippocampal activity after stress. Moreover, stress resulted in reduced amygdala-hippocampus connectivity and the decrease in amygdala connectivity to the parahippocampal cortex was particularly pronounced in MR haplotype carriers. Our findings indicate that genetic variants associated with enhanced MR expression facilitate a stress-induced shift from hippocampal toward dorsal striatal learning, most likely via impaired hippocampal processing and reduced amygdala-hippocampus cross talk, allowing the dorsal striatum to guide behavior under stress.

Games people play: How video games improve probabilistic learning

Recent research suggests that video game playing is associated with many cognitive benefits. However, little is known about the neural mechanisms mediating such effects, especially with regard to probabilistic categorization learning, which is a widely unexplored area in gaming research. Therefore, the present study aimed to investigate the neural correlates of probabilistic classification learning in video gamers in comparison to non-gamers. Subjects were scanned in a 3T magnetic resonance imaging (MRI) scanner while performing a modified version of the weather prediction task. Behavioral data yielded evidence for better categorization performance of video gamers, particularly under conditions characterized by stronger uncertainty. Furthermore, a post-experimental questionnaire showed that video gamers had acquired higher declarative knowledge about the card combinations and the related weather outcomes. Functional imaging data revealed for video gamers stronger activation clusters in the hippocampus, the precuneus, the cingulate gyrus and the middle temporal gyrus as well as in occipital visual areas and in areas related to attentional processes. All these areas are connected with each other and represent critical nodes for semantic memory, visual imagery and cognitive control. Apart from this, and in line with previous studies, both groups showed activation in brain areas that are related to attention and executive functions as well as in the basal ganglia and in memory-associated regions of the medial temporal lobe. These results suggest that playing video games might enhance the usage of declarative knowledge as well as hippocampal involvement and enhances overall learning performance during probabilistic learning. In contrast to non-gamers, video gamers showed better categorization performance, independently of the uncertainty of the condition.

A Deletion Variant of the α2b-Adrenoceptor Modulates the Stress-Induced Shift from "Cognitive" to "Habit" Memory

Stress induces a shift from hippocampus-based "cognitive" toward dorsal striatum-based "habitual" learning and memory. This shift is thought to have important implications for stress-related psychopathologies, including post-traumatic stress disorder (PTSD). However, there is large individual variability in the stress-induced bias toward habit memory, and the factors underlying this variability are completely unknown. Here we hypothesized that a functional deletion variant of the gene encoding the α2b-adrenoceptor (ADRA2B), which has been linked to emotional memory processes and increased PTSD risk, modulates the stress-induced shift from cognitive toward habit memory. In two independent experimental studies, healthy humans were genotyped for the ADRA2B deletion variant. After a stress or control manipulation, participants completed a dual-solution learning task while electroencephalographic (Study I) or fMRI measurements (Study II) were taken. Carriers compared with noncarriers of the ADRA2B deletion variant exhibited a significantly reduced bias toward habit memory after stress. fMRI results indicated that, whereas noncarriers of the ADRA2B deletion variant showed increased functional connectivity between amygdala and putamen after stress, this increase in connectivity was absent in carriers of the deletion variant, who instead showed overall enhanced connectivity between amygdala and entorhinal cortex. Our results indicate that a common genetic variation of the noradrenergic system modulates the impact of stress on the balance between cognitive and habitual memory systems, most likely via altered amygdala orchestration of these systems.SIGNIFICANCE STATEMENT Stressful events have a powerful effect on human learning and memory. Specifically, accumulating evidence suggests that stress favors more rigid dorsal striatum-dependent habit memory, at the expense of flexible hippocampus-dependent cognitive memory. Although this shift may have important implications for understanding mental disorders, such as post-traumatic stress disorder, little is known about the source of individual differences in the sensitivity for the stress-induced bias toward habit memory. We report here that a common genetic variation of the noradrenergic system, a known risk factor for post-traumatic stress disorder, modulates the stress-induced shift from cognitive to habit memory, most likely through altered crosstalk between the hippocampus and dorsal striatum with the amygdala, a key structure in emotional memory.

An Examination of Strategy Implementation During Abstract Nonlinguistic Category Learning in Aphasia

PURPOSE

Our purpose was to study strategy use during nonlinguistic category learning in aphasia.

METHOD

Twelve control participants without aphasia and 53 participants with aphasia (PWA) completed a computerized feedback-based category learning task consisting of training and testing phases. Accuracy rates of categorization in testing phases were calculated. To evaluate strategy use, strategy analyses were conducted over training and testing phases. Participant data were compared with model data that simulated complex multi-cue, single feature, and random pattern strategies. Learning success and strategy use were evaluated within the context of standardized cognitive-linguistic assessments.

RESULTS

Categorization accuracy was higher among control participants than among PWA. The majority of control participants implemented suboptimal or optimal multi-cue and single-feature strategies by testing phases of the experiment. In contrast, a large subgroup of PWA implemented random patterns, or no strategy, during both training and testing phases of the experiment.

CONCLUSIONS

Person-to-person variability arises not only in category learning ability but also in the strategies implemented to complete category learning tasks. PWA less frequently developed effective strategies during category learning tasks than control participants. Certain PWA may have impairments of strategy development or feedback processing not captured by language and currently probed cognitive abilities.

Different strategies underlying uncertain decision making: higher executive performance is associated with enhanced feedback-related negativity

The aim of the present study was to investigate the role of executive functions (EFs) in different strategies underlying risky decision making. Adult participants from a nonclinical sample were assigned to low or high EF groups based on their performance on EF tasks measuring shifting, updating, and inhibition. ERPs were recorded while participants performed the Balloon Analogue Risk Task (BART). In this task, each balloon pump was associated with either a reward or a balloon pop with unknown probability. The BART behavioral measures did not show between-group differences. However, the feedback-related negativity (FRN) associated with undesirable outcomes was larger in the high EF group than in the low EF group. Since the FRN represents salience prediction error, our results suggest that the high EF group formed internal models that were violated by the outcomes. Thus, we provided ERP evidence for EFs influencing risky decision-making processes.

Goal-directed EEG activity evoked by discriminative stimuli in reinforcement learning

In reinforcement learning (RL), discriminative stimuli (S) allow agents to anticipate the value of a future outcome, and the response that will produce that outcome. We examined this processing by recording EEG locked to S during RL. Incentive value of outcomes and predictive value of S were manipulated, allowing us to discriminate between outcome-related and response-related activity. S predicting the correct response differed from nonpredictive S in the P2. S paired with high-value outcomes differed from those paired with low-value outcomes in a frontocentral positivity and in the P3b. A slow negativity then distinguished between predictive and nonpredictive S. These results suggest that, first, attention prioritizes detection of informative S. Activation of mental representations of these informative S then retrieves representations of outcomes, which in turn retrieve representations of responses that previously produced those outcomes.

Learning and altering behaviours by reinforcement: neurocognitive differences between children and adults

This study examined neurocognitive differences between children and adults in the ability to learn and adapt simple stimulus-response associations through feedback. Fourteen typically developing children (mean age=10.2) and 15 healthy adults (mean age=25.5) completed a simple task in which they learned to associate visually presented stimuli with manual responses based on performance feedback (acquisition phase), and then reversed and re-learned those associations following an unexpected change in reinforcement contingencies (reversal phase). Electrophysiological activity was recorded throughout task performance. We found no group differences in learning-related changes in performance (reaction time, accuracy) or in the amplitude of event-related potentials (ERPs) associated with stimulus processing (P3 ERP) or feedback processing (feedback-related negativity; FRN) during the acquisition phase. However, children's performance was significantly more disrupted by the reversal than adults and FRN amplitudes were significantly modulated by the reversal phase in children but not adults. These findings indicate that children have specific difficulties with reinforcement learning when acquired behaviours must be altered. This may be caused by the added demands on immature executive functioning, specifically response monitoring, created by the requirement to reverse the associations, or a developmental difference in the way in which children and adults approach reinforcement learning.