Learning and altering behaviours by reinforcement: neurocognitive differences between children and adults

Transfer of Learned Cognitive Flexibility to Novel Stimuli and Task Sets

Adaptive behavior requires learning about the structure of one's environment to derive optimal action policies, and previous studies have documented transfer of such structural knowledge to bias choices in new environments. Here, we asked whether people could also acquire and transfer more abstract knowledge across different task environments, specifically expectations about cognitive control demands. Over three experiments, participants (Amazon Mechanical Turk workers; N = ~80 adults per group) performed a probabilistic card-sorting task in environments of either a low or high volatility of task rule changes (requiring low or high cognitive flexibility, respectively) before transitioning to a medium-volatility environment. Using reinforcement-learning modeling, we consistently found that previous exposure to high task rule volatilities led to faster adaptation to rule changes in the subsequent transfer phase. These transfers of expectations about cognitive flexibility demands were both task independent (Experiment 2) and stimulus independent (Experiment 3), thus demonstrating the formation and generalization of environmental structure knowledge to guide cognitive control.

Feedback Processing During Probabilistic Learning in Children With Developmental Language Disorder: An Event-Related Potential Study

PURPOSE

The purpose of this study was to examine feedback processing within the context of probabilistic learning in children with and without developmental language disorder (DLD).

METHOD

The probabilistic category learning task required 28 children ages 8-13 years old to classify novel cartoon animals that differed in five binary features into one of two categories. Performance feedback guided incremental learning of the stimuli classifications. Feedback processing was compared between children with DLD and age-matched children with typical development (TD) by measuring the magnitude of feedback-related event-related potentials. Additionally, the likelihood of each group to repeat a classification of a stimulus following positive feedback ("stay" behavior) and change a classification following negative feedback ("switch" behavior) served as a measure of the consequence of feedback processing.

RESULTS

Children with DLD achieved lower classification accuracy on all learning outcomes compared to their peers with TD. Children with DLD were less likely than those with TD to demonstrate "stay" behavior or to repeat a correct response following positive feedback. "Switch" behavior or changing an incorrect response following negative feedback was found to be at chance level in both groups. Electrophysiological data indicated that children with DLD had a smaller feedback-related negativity effect (i.e., smaller differential processing of positive and negative feedback) when compared to children with TD. Although no differences were found between the two groups in the amplitude of the P3a, strong positive correlations were found between "stay/switch" behavior and the P3a for children in the TD group only.

CONCLUSIONS

Children with DLD do not appear to benefit from incremental corrective feedback to the same extent as their peers with TD. Processing differences are captured in the initial stages of feedback evaluation and in translating information carried by the feedback to inform future actions.

Utility of Linear Mixed Effects Models for Event-Related Potential Research with Infants and Children

Event-related potentials (ERPs) are advantageous for investigating cognitive development. However, their application in infants/children is challenging given children’s difficulty in sitting through the multiple trials required in an ERP task. Thus, a large problem in developmental ERP research is high subject exclusion due to too few analyzable trials. Common analytic approaches (that involve averaging trials within subjects and excluding subjects with too few trials, as in ANOVA and linear regression) work around this problem, but do not mitigate it. Moreover, these practices can lead to inaccuracies in measuring neural signals. The greater the subject exclusion, the more problematic inaccuracies can be. We review recent developmental ERP studies to illustrate the prevalence of these issues. Critically, we demonstrate an alternative approach to ERP analysis—linear mixed effects (LME) modeling—which offers unique utility in developmental ERP research. We demonstrate with simulated and real ERP data from preschool children that commonly employed ANOVAs yield biased results that become more biased as subject exclusion increases. In contrast, LME models yield accurate, unbiased results even when subjects have low trial-counts, and are better able to detect real condition differences. We include tutorials and example code to facilitate LME analyses in future ERP research.

•

Linear Mixed Effects models (LMEs) have advantages for event-related potential analyses.

•

For infant/child ERPs especially, LME is superior to traditional ANOVA models.

•

In simulated ERP data, ANOVAs returned biased results, but LME was unbiased.

•

In real, child ERP data, LME detected condition differences where ANOVA did not.

•

Tutorial and sample codes given to guide use of LMEs in future research.

Electrophysiological Examination of Feedback-Based Learning in 8-11-Year-Old Children

The study aimed at evaluating the extent to which the feedback related negativity (FRN), an ERP component associated with feedback processing, is related to learning in school-age children. Eighty typically developing children between the ages of 8 and 11 years completed a declarative learning task while their EEG was recorded. The study evaluated the predictive value of the FRN on learning retention as measured by accuracy on a follow-up test a day after the session. The FRN elicited by positive feedback was found to be predictive of learning retention in children. The relationship between the FRN and learning was moderated by age. The P3a was also found to be associated with learning, such that larger P3a to negative feedback was associated with better learning retention in children.

A tradeoff relationship between internal monitoring and external feedback during the dynamic process of reinforcement learning

Effective behavior monitoring, including internal monitoring/error detection and external monitoring/feedback, is very pivotal for reinforcement learning. However, less attention has been paid to internal monitoring and the dynamic learning performance in reinforcement learning, and there is still a heated debate on which kind of external feedback is relied on in the reinforcement learning. In order to address these questions, an adaption probabilistic selection task was used to examine the effect of the internal monitoring, external feedback and the relationship between them for approach learners and avoidance learners during dynamic learning process of reinforcement learning and behavior adaption. Error-related negativity (ERN), feedback-related negativity (FRN) and feedback-related P300 are three ERPs components, which can be used as the indexes of internal monitoring, external feedback and behavior adaption. For our results, the ERN effect of avoidance learners become large in block 3, which is earlier than approach learners (block 4). This phenomenon suggests that avoidance learners learned faster than approach learners. In addition, the FRN amplitude of avoidance learners in block 4 was significantly smaller than the other three blocks. The aforementioned results demonstrated a tradeoff relationship between the ERN and FRN effects.

Increased Intra-Subject Variability of Reaction Times and Single-Trial Event-Related Potential Components in Children With Autism Spectrum Disorder

Autism spectrum disorder (ASD) is an increasingly common neurodevelopmental disorder that affects 1 in 59 children. The cognitive profiles of individuals with ASD are varied, and the neurophysiological underpinnings of these developmental difficulties are unclear. While many studies have focused on overall group differences in the amplitude or latency of event related potential (ERP) responses, recent research suggests that increased intra-subject neural variability may also be a reliable indicator of atypical brain function in ASD. This study aimed to identify behavioral and neural variability responses during an emotional inhibitory control task in children with ASD compared to typically developing (TD) children. Children with ASD showed increased variability in response to both inhibitory and emotional stimuli, evidenced by greater reaction time variability and single-trial ERP variability of N200 and N170 amplitudes and/or latencies compared to TD children. These results suggest that the physiological basis of ASD may be more accurately explained by increased intra-subject variability, in addition to characteristic increases or decreases in the amplitude or latency of neural responses. Autism Res 2020, 13:221-229. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: The cognitive functions including memory, attention, executive functions, and perception, of individuals with ASD are varied, and the physiological underpinnings of these profiles are unclear. In this study, children with ASD showed increased intra-subject neural and behavioral variability in response to an emotional inhibitory control task compared to typically developing children. These results suggest that the physiological basis of ASD may also be explained by increased behavioral and neural variability in people with ASD, rather than simply characteristic increases or decreases in averaged brain responses.

Electrophysiology of Inhibitory Control in the Context of Emotion Processing in Children With Autism Spectrum Disorder

Autism Spectrum Disorder (ASD) is an increasingly common developmental disorder that affects 1 in 59 children. Despite this high prevalence of ASD, knowledge regarding the biological basis of its associated cognitive difficulties remains scant. In this study, we aimed to identify altered neurophysiological responses underlying inhibitory control and emotion processing difficulties in ASD, together with their associations with age and various domains of cognitive and social function. This was accomplished by assessing electroencephalographic recordings during an emotional go/nogo task alongside parent rating scales of behavior. Event related potential (ERP) N200 component amplitudes were reduced in children with ASD compared to typically developing (TD) children. No group differences were found, however, for task performance, P300 amplitude or latency, or N170 amplitude or latency, suggesting that individuals with ASD may only present conflict monitoring abnormalities, as reflected by the reduced N200 component, compared to TD individuals. Consistent with previous findings, increased age correlated with improved task performance scores and reduced N200 amplitude in the TD group, indicating that as these children develop, their neural systems become more efficient. These associations were not identified in the ASD group. Results also showed significant associations between increased N200 amplitudes and improved executive control abilities and decreased autism traits in TD children only. The newly discovered findings of decreased brain activation in children with ASD, alongside differences in correlations with age compared to TD children, provide a potential neurophysiological indicator of atypical development of inhibitory control mechanisms in these individuals.

Electrophysiological correlates of reinforcement learning in young people with Tourette syndrome with and without co-occurring ADHD symptoms

Altered reinforcement learning is implicated in the causes of Tourette syndrome (TS) and attention-deficit/hyperactivity disorder (ADHD). TS and ADHD frequently co-occur but how this affects reinforcement learning has not been investigated. We examined the ability of young people with TS (n=18), TS+ADHD (N=17), ADHD (n=13) and typically developing controls (n=20) to learn and reverse stimulus-response (S-R) associations based on positive and negative reinforcement feedback. We used a 2 (TS-yes, TS-no)×2 (ADHD-yes, ADHD-no) factorial design to assess the effects of TS, ADHD, and their interaction on behavioural (accuracy, RT) and event-related potential (stimulus-locked P3, feedback-locked P2, feedback-related negativity, FRN) indices of learning and reversing the S-R associations. TS was associated with intact learning and reversal performance and largely typical ERP amplitudes. ADHD was associated with lower accuracy during S-R learning and impaired reversal learning (significantly reduced accuracy and a trend for smaller P3 amplitude). The results indicate that co-occurring ADHD symptoms impair reversal learning in TS+ADHD. The implications of these findings for behavioural tic therapies are discussed.

WITHDRAWN: Electrophysiological correlates of reinforcement learning in young people with Tourette syndrome with and without co-occurring ADHD symptoms

The Publisher regrets that this article is an accidental duplication of an article that has already been published, http://dx.doi.org/10.1016/j.ijdevneu.2016.04.006. The duplicate article has therefore been withdrawn. The full Elsevier Policy on Article Withdrawal can be found at http://www.elsevier.com/locate/withdrawalpolicy.

Regularization of languages by adults and children: A mathematical framework

The fascinating ability of humans to modify the linguistic input and "create" a language has been widely discussed. In the work of Newport and colleagues, it has been demonstrated that both children and adults have some ability to process inconsistent linguistic input and "improve" it by making it more consistent. In Hudson Kam and Newport (2009), artificial miniature language acquisition from an inconsistent source was studied. It was shown that (i) children are better at language regularization than adults and that (ii) adults can also regularize, depending on the structure of the input. In this paper we create a learning algorithm of the reinforcement-learning type, which exhibits patterns reported in Hudson Kam and Newport (2009) and suggests a way to explain them. It turns out that in order to capture the differences between children's and adults' learning patterns, we need to introduce a certain asymmetry in the learning algorithm. Namely, we have to assume that the reaction of the learners differs depending on whether or not the source's input coincides with the learner's internal hypothesis. We interpret this result in the context of a different reaction of children and adults to implicit, expectation-based evidence, positive or negative. We propose that a possible mechanism that contributes to the children's ability to regularize an inconsistent input is related to their heightened sensitivity to positive evidence rather than the (implicit) negative evidence. In our model, regularization comes naturally as a consequence of a stronger reaction of the children to evidence supporting their preferred hypothesis. In adults, their ability to adequately process implicit negative evidence prevents them from regularizing the inconsistent input, resulting in a weaker degree of regularization.

Adolescent development of context-dependent stimulus-reward association memory and its neural correlates

Expression of learned stimulus-reward associations based on context is essential for regulation of behavior to meet situational demands. Contextual regulation improves during development, although the developmental progression of relevant neural and cognitive processes is not fully specified. We therefore measured neural correlates of flexible, contextual expression of stimulus-reward associations in pre/early-adolescent children (ages 9-13 years) and young adults (ages 19-22 years). After reinforcement learning using standard parameters, a contextual reversal manipulation was used whereby contextual cues indicated that stimulus-reward associations were the same as previously reinforced for some trials (consistent trials) or were reversed on other trials (inconsistent trials). Subjects were thus required to respond according to original stimulus-reward associations vs. reversed associations based on trial-specific contextual cues. Children and young adults did not differ in reinforcement learning or in relevant functional magnetic resonance imaging (fMRI) correlates. In contrast, adults outperformed children during contextual reversal, with better performance specifically for inconsistent trials. fMRI signals corresponding to this selective advantage included greater activity in lateral prefrontal cortex (LPFC), hippocampus, and dorsal striatum for young adults relative to children. Flexible expression of stimulus-reward associations based on context thus improves via adolescent development, as does recruitment of brain regions involved in reward learning and contextual expression of memory. HighlightsEarly-adolescent children and young adults were equivalent in reinforcement learning.Adults outperformed children in contextual expression of stimulus-reward associations.Adult advantages correlated with increased activity of relevant brain regions.Specific neurocognitive developmental changes support better contextual regulation.