Atypical Reinforcement Learning in Developmental Dyslexia

Feedback timing-modulated weather prediction reveals relative deficits in both procedural and declarative learning in adults with dyslexia

A topic of recent debate is the hypothesis that deficits associated with developmental disorders of language, such as reading disability, can be explained by a selective weakness in procedural memory. Adults with (n = 29; RD) and without (n = 29; TD) reading disability completed a weather prediction task under immediate and delayed feedback conditions, that rely on the striatal (procedural) and hippocampal (declarative) circuits, respectively. We examined trial-by-trial accuracy by feedback condition (immediate vs. delayed) and group (RD vs. TD). In the immediate feedback condition, we found the TD group to have a higher learning rate than the RD group. In the delayed feedback condition, we found the TD group reach a high level of accuracy early, and outperform the RD group for the duration of the task. The TD group also made gains in reaction time under both conditions, while the RD group slowed in their responses. Taken together, it appears that while procedural memory is indeed impaired in adults with reading disability, to a lesser extent, declarative memory is also affected. This lends partial support to the PDH, and more broadly to the position that reading disability is associated with general (non-linguistic) difficulties in learning.

Does the procedural deficit hypothesis of dyslexia account for the lack of automatization and the comorbidity among developmental disorders?

We critically examine the procedural deficit hypothesis (PDH) that proposes that a deficit in procedural (as opposed to declarative) learning underlies dyslexia and other developmental disorders. We first note that the existence of dissociated learning disorders (and multiple forms for each disorder) appears incompatible with a general deficit account. Moreover, the PDH formulation appears generally underspecified in terms of predictions to be tested. A particular focus is on the conceptualization of automatization. However, there are alternative views of automaticity, and comparing these different views helps frame the body of findings on the PDH. The insufficient PDH specification led to tasks touching on different skills and selecting target groups based on general diagnostic categories. Accordingly, several recent reviews and meta-analyses reported mixed patterns of findings and reached contradictory conclusions on the PDH. We propose avenues for future research to effectively examine the role of PDH in learning and other developmental disorders.

Auditory Category Learning in Children With Dyslexia

PURPOSE

Developmental dyslexia is proposed to involve selective procedural memory deficits with intact declarative memory. Recent research in the domain of category learning has demonstrated that adults with dyslexia have selective deficits in Information-Integration (II) category learning that is proposed to rely on procedural learning mechanisms and unaffected Rule-Based (RB) category learning that is proposed to rely on declarative, hypothesis testing mechanisms. Importantly, learning mechanisms also change across development, with distinct developmental trajectories in both procedural and declarative learning mechanisms. It is unclear how dyslexia in childhood should influence auditory category learning, a critical skill for speech perception and reading development.

METHOD

We examined auditory category learning performance and strategies in 7- to 12-year-old children with dyslexia (n = 25; nine females, 16 males) and typically developing controls (n = 25; 13 females, 12 males). Participants learned nonspeech auditory categories of spectrotemporal ripples that could be optimally learned with either RB selective attention to the temporal modulation dimension or procedural integration of information across spectral and temporal dimensions. We statistically compared performance using mixed-model analyses of variance and identified strategies using decision-bound computational models.

RESULTS

We found that children with dyslexia have an apparent selective RB category learning deficit, rather than a selective II learning deficit observed in prior work in adults with dyslexia.

CONCLUSION

These results suggest that the important skill of auditory category learning is impacted in children with dyslexia and throughout development, individuals with dyslexia may develop compensatory strategies that preserve declarative learning while developing difficulties in procedural learning.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.25148519.

Reduced Implicit but not Explicit Knowledge of Cross-Situational Statistical Learning in Developmental Dyslexia

Although statistical learning (SL) has been studied extensively in developmental dyslexia (DD), less attention has been paid to other fundamental challenges in language acquisition, such as cross-situational word learning. Such investigation is important for determining whether and how SL processes are affected in DD at the word level. In this study, typically developed (TD) adults and young adults with DD were exposed to a set of trials that contained multiple spoken words and multiple pictures of individual objects, with no information about word-referent correspondences provided within a trial. Nonetheless, cross-trial statistical relations could be exploited to learn word-referent mappings. The degree of within-trial reference uncertainty and the novelty of to-be-learned objects (novel or familiar) were varied under different learning conditions. The results show that across all conditions, young adults with DD were significantly impaired in their ability to exploit cross-trial regularities in co-occurring visual-auditory streams to discover word-referent mappings. Observed impairments were most pronounced when within-trial reference uncertainty was the highest. Subjective measures of knowledge awareness revealed greater development of implicit but not explicit knowledge in the TD group than in the DD group. Together, these findings suggest that the SL deficit in DD affects fundamental language learning challenges at the word level and points to greater reliance on explicit processes due to impaired implicit associative learning among individuals with DD. Such a deficit is likely to influence spoken language acquisition, and in turn affect literacy skills, in people with DD.

Distinct reinforcement learning profiles distinguish between language and attentional neurodevelopmental disorders

BACKGROUND

Theoretical models posit abnormalities in cortico-striatal pathways in two of the most common neurodevelopmental disorders (Developmental dyslexia, DD, and Attention deficit hyperactive disorder, ADHD), but it is still unclear what distinct cortico-striatal dysfunction might distinguish language disorders from others that exhibit very different symptomatology. Although impairments in tasks that depend on the cortico-striatal network, including reinforcement learning (RL), have been implicated in both disorders, there has been little attempt to dissociate between different types of RL or to compare learning processes in these two types of disorders. The present study builds upon prior research indicating the existence of two learning manifestations of RL and evaluates whether these processes can be differentiated in language and attention deficit disorders. We used a two-step RL task shown to dissociate model-based from model-free learning in human learners.

RESULTS

Our results show that, relative to neurotypicals, DD individuals showed an impairment in model-free but not in model-based learning, whereas in ADHD the ability to use both model-free and model-based learning strategies was significantly compromised.

CONCLUSIONS

Thus, learning impairments in DD may be linked to a selective deficit in the ability to form action-outcome associations based on previous history, whereas in ADHD some learning deficits may be related to an incapacity to pursue rewards based on the tasks' structure. Our results indicate how different patterns of learning deficits may underlie different disorders, and how computation-minded experimental approaches can differentiate between them.

Impaired and Spared Auditory Category Learning in Developmental Dyslexia

Categorization has a deep impact on behavior, but whether category learning is served by a single system or multiple systems remains debated. Here, we designed two well-equated nonspeech auditory category learning challenges to draw on putative procedural (information-integration) versus declarative (rule-based) learning systems among adult Hebrew-speaking control participants and individuals with dyslexia, a language disorder that has been linked to a selective disruption in the procedural memory system and in which phonological deficits are ubiquitous. We observed impaired information-integration category learning and spared rule-based category learning in the dyslexia group compared with the neurotypical group. Quantitative model-based analyses revealed reduced use of, and slower shifting to, optimal procedural-based strategies in dyslexia with hypothesis-testing strategy use on par with control participants. The dissociation is consistent with multiple category learning systems and points to the possibility that procedural learning inefficiencies across categories defined by complex, multidimensional exemplars may result in difficulty in phonetic category acquisition in dyslexia.

Probabilistic Decision-Making in Children With Dyslexia

Background

Neurocognitive mechanisms underlying developmental dyslexia (dD) remain poorly characterized apart from phonological and/or visual processing deficits. Assuming such deficits, the process of learning complex tasks like reading requires the learner to make decisions (i.e., word pronunciation) based on uncertain information (e.g., aberrant phonological percepts)-a cognitive process known as probabilistic decision making, which has been linked to the striatum. We investigate (1) the relationship between dD and probabilistic decision-making and (2) the association between the volume of striatal structures and probabilistic decision-making in dD and typical readers.

Methods

Twenty four children diagnosed with dD underwent a comprehensive evaluation and MRI scanning (3T). Children with dD were compared to age-matched typical readers (n = 11) on a probabilistic, risk/reward fishing task that utilized a Bayesian cognitive model with game parameters of risk propensity (γ+) and behavioral consistency (β), as well as an overall adjusted score (average number of casts, excluding forced-fail trials). Volumes of striatal structures (caudate, putamen, and nucleus accumbens) were analyzed between groups and associated with game parameters.

Results

dD was associated with greater risk propensity and decreased behavioral consistency estimates compared to typical readers. Cognitive model parameters associated with timed pseudoword reading across groups. Risk propensity related to caudate volumes, particularly in the dD group.

Conclusion

Decision-making processes differentiate dD, associate with the caudate, and may impact learning mechanisms. This study suggests the need for further research into domain-general probabilistic decision-making in dD, neurocognitive mechanisms, and targeted interventions in dD.

Delaying feedback compensates for impaired reinforcement learning in developmental dyslexia

A theoretical framework suggests that developmental dyslexia is characterized by abnormalities in brain structures underlying the procedural learning and memory systems while the declarative learning and memory systems are presumed to remain intact or even enhanced (Procedural Deficit Hypothesis). This notion has been supported by a substantial body of research, which focused on each system independently. However, less attention has been paid to interactions between these memory systems which may provide insights as to learning situations and conditions in which learning in dyslexia can be improved. The current study was undertaken to examine these important but unresolved issues. To this end, probabilistic reinforcement learning and episodic memory tasks were examined in participants with dyslexia and neurotypicals simultaneously within a single task. Feedback timing presentation was manipulated, building on prior research indicating that delaying feedback timing shifts striatal-based probabilistic learning, to become more hippocampal-dependent. It was hypothesized that if the procedural learning and memory systems are impaired in dyslexia, performance will be impaired under conditions that encourage procedural memory engagement (immediate feedback trials) but not under conditions that promote declarative memory processing (long delayed feedback trials). It was also predicted that the ability to incidentally acquire episodic information would be preserved in dyslexia. The results supported these predictions. Participants with dyslexia were impaired in probabilistic learning of cue-outcome associations compared to neurotypicals in an immediate feedback condition, but not when feedback on choices was presented after a long delay. Furthermore, participants with dyslexia demonstrated similar performance to neurotypicals in a task requiring incidental episodic memory formation. These findings attest to a dissociation between procedural-based and declarative-based learning in developmental dyslexia within a single task, a finding that adds discriminative validity to the Procedural Deficit Hypothesis. Just as important, the present findings suggest that training conditions designed to shift the load from midbrain/striatal systems to declarative memory mechanisms have the potential to compensate for impaired learning in developmental dyslexia.