From altered synaptic plasticity to atypical learning: A computational model of Down syndrome

Chunking as a function of sequence length

Chunking mechanisms are central to several cognitive processes. During the acquisition of visuo-motor sequences, it is commonly reported that these sequences are segmented into chunks leading to more fluid, rapid, and accurate performances. The question of a chunk's storage capacity has been often investigated but little is known about the dynamics of chunk size evolution relative to sequence length. In two experiments, we studied the dynamics and the evolution of a sequence's chunking pattern as a function of sequence length in a non-human primate species (Guinea baboons, Papio papio). Using an operant conditioning device, baboons had to point on a touch screen to a moving target. In Experiment 1, they had to produce repeatedly the same sequence of 4 movements during 2000 trials. In Experiment 2, the sequence was composed of 5 movements and was repeated 4000 times. For both lengths, baboons initially produced small chunks that became fewer and longer with practice. Moreover, the dynamics and the evolution of the chunking pattern varied as a function of sequence length. Finally, with extended practice (i.e., more than 2000 trials), we observed that the mean chunk size reached a plateau indicating that there are fundamental limits to chunking processes that also depend on sequence length. These data therefore provide new empirical evidence for understanding the general properties of chunking mechanisms in sequence learning.

The dynamics of multiword sequence extraction

Being able to process multiword sequences is central for both language comprehension and production. Numerous studies support this claim, but less is known about the way multiword sequences are acquired, and more specifically how associations between their constituents are established over time. Here we adapted the Hebb naming task into a Hebb lexical decision task to study the dynamics of multiword sequence extraction. Participants had to read letter strings presented on a computer screen and were required to classify them as words or pseudowords. Unknown to the participants, a triplet of words or pseudowords systematically appeared in the same order and random words or pseudowords were inserted between two repetitions of the triplet. We found that response times (RTs) for the unpredictable first position in the triplet decreased over repetitions (i.e., indicating the presence of a repetition effect) but more slowly and with a different dynamic compared with items appearing at the predictable second and third positions in the repeated triplet (i.e., showing a slightly different predictability effect). Implicit and explicit learning also varied as a function of the nature of the triplet (i.e., unrelated words, pseudowords, semantically related words, or idioms). Overall, these results provide new empirical evidence about the dynamics of multiword sequence extraction, and more generally about the role of statistical learning in language acquisition.

Simple questions on simple associations: regularity extraction in non-human primates

When human and non-human animals learn sequences, they manage to implicitly extract statistical regularities through associative learning mechanisms. In two experiments conducted with a non-human primate species (Guinea baboons, Papio papio), we addressed simple questions on the learning of simple AB associations appearing in longer noisy sequences. Using a serial reaction time task, we manipulated the position of AB within the sequence, such that it could be either fixed (by appearing always at the beginning, middle, or end of a four-element sequence; Experiment 1) or variable (Experiment 2). We also tested the effect of sequence length in Experiment 2 by comparing the performance on AB when it was presented at a variable position within a sequence of four or five elements. The slope of RTs from A to B was taken for each condition as a measurement of learning rate. While all conditions differed significantly from a no-regularity baseline, we found strong evidence that the learning rate did not differ between the conditions. These results indicate that regularity extraction is not impacted by the position of the regularity within a sequence and by the length of the sequence. These data provide novel general empirical constraints for modeling associative mechanisms in sequence learning.

Computational models of stimulus equivalence: An intersection for the study of symbolic behavior

Stimulus equivalence is a central paradigm in the analysis of symbolic behavior, language, and cognition. It describes emergent relations between stimuli that were not explicitly trained and cannot be explained by primary stimulus generalization. In recent years, researchers have developed computational models to simulate the learning of equivalence relations. These models have been used to address primary theoretical and methodological issues in this field, such as exploring the underlying mechanisms that explain emergent equivalence relations and analyzing the effects of training and testing protocols on equivalence outcomes. Nonetheless, although these models build upon general learning principles, their operation is usually obscure for nonmodelers, and in the field of stimulus equivalence computational models have been developed with a variety of approaches, architectures, and algorithms that make it difficult to understand the scope and contributions of these tools. In this paper, we present the state of the art in computational modeling of stimulus equivalence. We seek to provide concise and accessible descriptions of the models' functioning and operation, highlight their main theoretical and methodological contributions, identify the existing software available for researchers to run experiments, and suggest future directions in the emergent field of computational modeling of stimulus equivalence.

No need to forget, just keep the balance: Hebbian neural networks for statistical learning

Language processing in humans has long been proposed to rely on sophisticated learning abilities including statistical learning. Endress and Johnson (E&J, 2021) recently presented a neural network model for statistical learning based on Hebbian learning principles. This model accounts for word segmentation tasks, one primary paradigm in statistical learning. In this discussion paper we review this model and compare it with the Hebbian model previously presented by Tovar and Westermann (T&W, 2017a; 2017b; 2018) that has accounted for serial reaction time tasks, cross-situational learning, and categorization paradigms, all relevant in the study of statistical learning. We discuss the similarities and differences between both models, and their key findings. From our analysis, we question the concept of "forgetting" in the model of E&J and their suggestion of considering forgetting as the critical ingredient for successful statistical learning. We instead suggest that a set of simple but well-balanced mechanisms including spreading activation, activation persistence, and synaptic weight decay, all based on biologically grounded principles, allow modeling statistical learning in Hebbian neural networks, as demonstrated in the T&W model which successfully covers learning of nonadjacent dependencies and accounts for differences between typical and atypical populations, both aspects that have not been fully demonstrated in the E&J model. We outline the main computational and theoretical differences between the E&J and T&W approaches, present new simulation results, and discuss implications for the development of a computational cognitive theory of statistical learning.

Learning Higher-Order Transitional Probabilities in Nonhuman Primates

The extraction of cooccurrences between two events, A and B, is a central learning mechanism shared by all species capable of associative learning. Formally, the cooccurrence of events A and B appearing in a sequence is measured by the transitional probability (TP) between these events, and it corresponds to the probability of the second stimulus given the first (i.e., p(B|A)). In the present study, nonhuman primates (Guinea baboons, Papio papio) were exposed to a serial version of the XOR (i.e., exclusive-OR), in which they had to process sequences of three stimuli: A, B, and C. In this manipulation, first-order TPs (i.e., AB and BC) were uninformative due to their transitional probabilities being equal to .5 (i.e., p(B|A) = p(C|B) = .5), while second-order TPs were fully predictive of the upcoming stimulus (i.e., p(C|AB) = 1). In Experiment 1, we found that baboons were able to learn second-order TPs, while no learning occurred on first-order TPs. In Experiment 2, this pattern of results was replicated, and a final test ruled out an alternative interpretation in terms of proximity to the reward. These results indicate that a nonhuman primate species can learn a nonlinearly separable problem such as the XOR. They also provide fine-grained empirical data to test models of statistical learning on the interaction between the learning of different orders of TPs. Recent bioinspired models of associative learning are also introduced as promising alternatives to the modeling of statistical learning mechanisms.

Brain insulin resistance triggers early onset Alzheimer disease in Down syndrome

Dysregulation of insulin signaling pathway with reduced downstream neuronal survival and plasticity mechanisms is a fundamental abnormality observed in Alzheimer's disease (AD) brain. This phenomenon, known as brain insulin resistance, is associated with poor cognitive performance and is driven by the uncoupling of insulin receptor (IR) from its direct substrate (IRS1). Considering that Down syndrome (DS) and AD neuropathology share many common features, we investigated metabolic aspects of neurodegeneration, i.e., brain insulin resistance, in DS and whether it would contribute to early onset AD in DS population. Changes of levels and activation of main brain proteins belonging to the insulin signaling pathway (i.e., IR, IRS1, PTEN, GSK3β, PKCζ, AS160, GLUT4) were evaluated. Furthermore, we analyzed whether changes of these proteins were associated with alterations of: (i) proteins regulating brain energy metabolism; (ii) APP cleavage; and (ii) regulation of synaptic plasticity mechanisms in post-mortem brain samples collected from people with DS before and after the development of AD pathology (DSAD) compared with their age-matched controls. We found that DS cases were characterized by key markers of brain insulin resistance (reduced IR and increased IRS1 inhibition) early in life. Furthermore, downstream from IRS1, an overall uncoupling among the proteins of insulin signaling was observed. Dysregulated brain insulin signaling was associated with reduced hexokinase II (HKII) levels and proteins associated with mitochondrial complexes levels as well as with reduced levels of syntaxin in DS cases. Tellingly, these alterations precede the development of AD neuropathology and clinical presentations in DS. We propose that markers of brain insulin resistance rise earlier with age in DS compared with the general population and may contribute to the cognitive impairment associated with the early development of AD in DS.

Atypical shape bias and categorization in autism: Evidence from children and computational simulations

The shape bias, a preference for mapping new word labels onto the shape rather than the color or texture of referents, has been postulated as a word-learning mechanism. Previous research has shown deficits in the shape bias in children with autism even though they acquire sizeable lexicons. While previous explanations have suggested the atypical use of color for label extension in individuals with autism, we hypothesize an atypical mapping of novel labels to novel objects, regardless of the physical properties of the objects. In Experiment 1, we demonstrate this phenomenon in some individuals with autism, but the novelty of objects only partially explains their lack of shape bias. In a second experiment, we present a computational model that provides a developmental account of the shape bias in typically developing children and in those with autism. This model is based on theories of neurological dysfunctions in autism, and it integrates theoretical and empirical findings in the literature of categorization, word learning, and the shape bias. The model replicates the pattern of results of our first experiment and shows how individuals with autism are more likely to categorize experimental objects together on the basis of their novelty. It also provides insights into possible mechanisms by which children with autism learn new words, and why their word referents may be idiosyncratic. Our model highlights a developmental approach to autism that emphasizes deficient representations of categories underlying an impaired shape bias.

Distributional Cues to Language Learning in Children With Intellectual Disabilities

Purpose

In typical development, distributional cues-patterns in input-are related to language acquisition processes. Statistical and implicit learning refer to the utilization of such cues. In children with intellectual disability, much less is known about the extent to which distributional cues are harnessed in mechanisms of language learning.

Method

This tutorial presents what is known about the process of language learning in children with language impairments associated with different sources of intellectual disability: Williams syndrome, autism spectrum disorder, Down syndrome, and fragile X syndrome.

Results

A broad view is taken on distributional cues relevant to language learning, including statistical learning (e.g., transitional probabilities) and other patterns that support lexical acquisition (e.g., sensitivities to sound patterns, cross-situational word learning) or relate to syntactic development (e.g., nonadjacent dependencies).

Conclusions

Critical gaps in the literature are highlighted. Research in this area is especially limited for Down syndrome and fragile X syndrome. Future directions for taking learning theories into account in interventions for children with intellectual disability are discussed, with a focus on the importance of language input.