The Temporal Dynamics of Regularity Extraction in Non-Human Primates

Chunking as a function of sequence length

Chunking mechanisms are central to several cognitive processes. During the acquisition of visuo-motor sequences, it is commonly reported that these sequences are segmented into chunks leading to more fluid, rapid, and accurate performances. The question of a chunk's storage capacity has been often investigated but little is known about the dynamics of chunk size evolution relative to sequence length. In two experiments, we studied the dynamics and the evolution of a sequence's chunking pattern as a function of sequence length in a non-human primate species (Guinea baboons, Papio papio). Using an operant conditioning device, baboons had to point on a touch screen to a moving target. In Experiment 1, they had to produce repeatedly the same sequence of 4 movements during 2000 trials. In Experiment 2, the sequence was composed of 5 movements and was repeated 4000 times. For both lengths, baboons initially produced small chunks that became fewer and longer with practice. Moreover, the dynamics and the evolution of the chunking pattern varied as a function of sequence length. Finally, with extended practice (i.e., more than 2000 trials), we observed that the mean chunk size reached a plateau indicating that there are fundamental limits to chunking processes that also depend on sequence length. These data therefore provide new empirical evidence for understanding the general properties of chunking mechanisms in sequence learning.

The dynamics of multiword sequence extraction

Being able to process multiword sequences is central for both language comprehension and production. Numerous studies support this claim, but less is known about the way multiword sequences are acquired, and more specifically how associations between their constituents are established over time. Here we adapted the Hebb naming task into a Hebb lexical decision task to study the dynamics of multiword sequence extraction. Participants had to read letter strings presented on a computer screen and were required to classify them as words or pseudowords. Unknown to the participants, a triplet of words or pseudowords systematically appeared in the same order and random words or pseudowords were inserted between two repetitions of the triplet. We found that response times (RTs) for the unpredictable first position in the triplet decreased over repetitions (i.e., indicating the presence of a repetition effect) but more slowly and with a different dynamic compared with items appearing at the predictable second and third positions in the repeated triplet (i.e., showing a slightly different predictability effect). Implicit and explicit learning also varied as a function of the nature of the triplet (i.e., unrelated words, pseudowords, semantically related words, or idioms). Overall, these results provide new empirical evidence about the dynamics of multiword sequence extraction, and more generally about the role of statistical learning in language acquisition.

Simple questions on simple associations: regularity extraction in non-human primates

When human and non-human animals learn sequences, they manage to implicitly extract statistical regularities through associative learning mechanisms. In two experiments conducted with a non-human primate species (Guinea baboons, Papio papio), we addressed simple questions on the learning of simple AB associations appearing in longer noisy sequences. Using a serial reaction time task, we manipulated the position of AB within the sequence, such that it could be either fixed (by appearing always at the beginning, middle, or end of a four-element sequence; Experiment 1) or variable (Experiment 2). We also tested the effect of sequence length in Experiment 2 by comparing the performance on AB when it was presented at a variable position within a sequence of four or five elements. The slope of RTs from A to B was taken for each condition as a measurement of learning rate. While all conditions differed significantly from a no-regularity baseline, we found strong evidence that the learning rate did not differ between the conditions. These results indicate that regularity extraction is not impacted by the position of the regularity within a sequence and by the length of the sequence. These data provide novel general empirical constraints for modeling associative mechanisms in sequence learning.

Chunking as a rational solution to the speed-accuracy trade-off in a serial reaction time task

When exposed to perceptual and motor sequences, people are able to gradually identify patterns within and form a compact internal description of the sequence. One proposal of how sequences can be compressed is people's ability to form chunks. We study people's chunking behavior in a serial reaction time task. We relate chunk representation with sequence statistics and task demands, and propose a rational model of chunking that rearranges and concatenates its representation to jointly optimize for accuracy and speed. Our model predicts that participants should chunk more if chunks are indeed part of the generative model underlying a task and should, on average, learn longer chunks when optimizing for speed than optimizing for accuracy. We test these predictions in two experiments. In the first experiment, participants learn sequences with underlying chunks. In the second experiment, participants were instructed to act either as fast or as accurately as possible. The results of both experiments confirmed our model's predictions. Taken together, these results shed new light on the benefits of chunking and pave the way for future studies on step-wise representation learning in structured domains.

Dynamic branching in a neural network model for probabilistic prediction of sequences

An important function of the brain is to predict which stimulus is likely to occur based on the perceived cues. The present research studied the branching behavior of a computational network model of populations of excitatory and inhibitory neurons, both analytically and through simulations. Results show how synaptic efficacy, retroactive inhibition and short-term synaptic depression determine the dynamics of selection between different branches predicting sequences of stimuli of different probabilities. Further results show that changes in the probability of the different predictions depend on variations of neuronal gain. Such variations allow the network to optimize the probability of its predictions to changing probabilities of the sequences without changing synaptic efficacy.

Detecting non-adjacent dependencies is the exception rather than the rule

Statistical learning refers to our sensitivity to the distributional properties of our environment. Humans have been shown to readily detect the dependency relationship of events that occur adjacently in a stream of stimuli but processing non-adjacent dependencies (NADs) appears more challenging. In the present study, we tested the ability of human participants to detect NADs in a new Hebb-naming task that has been proposed recently to study regularity detection in a noisy environment. In three experiments, we found that most participants did not manage to extract NADs. These results suggest that the ability to learn NADs in noise is the exception rather than the rule. They provide new information about the limits of statistical learning mechanisms.

The Evolution of Chunks in Sequence Learning

Chunking mechanisms are central to several cognitive processes and notably to the acquisition of visuo-motor sequences. Individuals segment sequences into chunks of items to perform visuo-motor tasks more fluidly, rapidly, and accurately. However, the exact dynamics of chunking processes in the case of extended practice remain unclear. Using an operant conditioning device, 18 Guinea baboons (Papio papio) produced a fixed sequence of nine movements during 1000 trials by pointing to a moving target on a touch screen. Response times analyses revealed a specific chunking pattern of the sequence for each baboon. More importantly, we found that these patterns evolved during the course of the experiment, with chunks becoming progressively fewer and longer. We identified two chunk reorganization mechanisms: the recombination of preexisting chunks and the concatenation of two distinct chunks into a single one. These results provide new evidence on chunking mechanisms in sequence learning and challenge current models of associative and statistical learning.

Learning Higher-Order Transitional Probabilities in Nonhuman Primates

The extraction of cooccurrences between two events, A and B, is a central learning mechanism shared by all species capable of associative learning. Formally, the cooccurrence of events A and B appearing in a sequence is measured by the transitional probability (TP) between these events, and it corresponds to the probability of the second stimulus given the first (i.e., p(B|A)). In the present study, nonhuman primates (Guinea baboons, Papio papio) were exposed to a serial version of the XOR (i.e., exclusive-OR), in which they had to process sequences of three stimuli: A, B, and C. In this manipulation, first-order TPs (i.e., AB and BC) were uninformative due to their transitional probabilities being equal to .5 (i.e., p(B|A) = p(C|B) = .5), while second-order TPs were fully predictive of the upcoming stimulus (i.e., p(C|AB) = 1). In Experiment 1, we found that baboons were able to learn second-order TPs, while no learning occurred on first-order TPs. In Experiment 2, this pattern of results was replicated, and a final test ruled out an alternative interpretation in terms of proximity to the reward. These results indicate that a nonhuman primate species can learn a nonlinearly separable problem such as the XOR. They also provide fine-grained empirical data to test models of statistical learning on the interaction between the learning of different orders of TPs. Recent bioinspired models of associative learning are also introduced as promising alternatives to the modeling of statistical learning mechanisms.

Working Memory for Spatial Sequences: Developmental and Evolutionary Factors in Encoding Ordinal and Relational Structures

Sequence learning is a ubiquitous facet of human and animal cognition. Here, using a common sequence reproduction task, we investigated whether and how the ordinal and relational structures linking consecutive elements are acquired by human adults, children, and macaque monkeys. While children and monkeys exhibited significantly lower precision than adults for spatial location and temporal order information, only monkeys appeared to exceedingly focus on the first item. Most importantly, only humans, regardless of age, spontaneously extracted the spatial relations between consecutive items and used a chunking strategy to compress sequences in working memory. Monkeys did not detect such relational structures, even after extensive training. Monkey behavior was captured by a conjunctive coding model, whereas a chunk-based conjunctive model explained more variance in humans. These age- and species-related differences are indicative of developmental and evolutionary mechanisms of sequence encoding and may provide novel insights into the uniquely human cognitive capacities.SIGNIFICANCE STATEMENT Sequence learning, the ability to encode the order of discrete elements and their relationships presented within a sequence, is a ubiquitous facet of cognition among humans and animals. By exploring sequence-processing abilities at different human developmental stages and in nonhuman primates, we found that only humans, regardless of age, spontaneously extracted the spatial relations between consecutive items and used an internal language to compress sequences in working memory. The findings provided insights into understanding the origins of sequence capabilities in humans and how they evolve through development to identify the unique aspects of human cognitive capacity, which includes the comprehension, learning, and production of sequences, and perhaps, above all, language processing.

Statistical learning of unbalanced exclusive-or temporal sequences in humans

A pervasive issue in statistical learning has been to determine the parameters of regularity extraction. Our hypothesis was that the extraction of transitional probabilities can prevail over frequency if the task involves prediction. Participants were exposed to four repeated sequences of three stimuli (XYZ) with each stimulus corresponding to the position of a red dot on a touch screen that participants were required to touch sequentially. The temporal and spatial structure of the positions corresponded to a serial version of the exclusive-or (XOR) that allowed testing of the respective effect of frequency and first- and second-order transitional probabilities. The XOR allowed the first-order transitional probability to vary while being not completely related to frequency and to vary while the second-order transitional probability was fixed (p(Z|X, Y) = 1). The findings show that first-order transitional probability prevails over frequency to predict the second stimulus from the first and that it also influences the prediction of the third item despite the presence of second-order transitional probability that could have offered a certain prediction of the third item. These results are particularly informative in light of statistical learning models.

Detection of regularities in a random environment

Regularity detection, or statistical learning, is regarded as a fundamental component of our cognitive system. To test the ability of human participants to detect regularity in a more ecological situation (i.e., mixed with random information), we used a simple letter-naming paradigm in which participants were instructed to name single letters presented one at a time on a computer screen. The regularity consisted of a triplet of letters that were systematically presented in that order. Participants were not told about the presence of this regularity. A variable number of random letters were presented between two repetitions of the regular triplet, making this paradigm similar to a Hebb repetition task. Hence, in this Hebb-naming task, we predicted that if any learning of the triplet occurred, naming times for the predictable letters in the triplet would decrease as the number of triplet repetitions increased. Surprisingly, across four experiments, detection of the regularity only occurred under very specific experimental conditions and was far from a trivial task. Our study provides new evidence regarding the limits of statistical learning and the critical role of contextual information in the detection (or not) of repeated patterns.

Can rhythm-induced attention improve the perceptual representation?

Temporal attention can be entrained exogenously to rhythms. Indeed, faster and more accurate responses were previously found when the target appeared in-phase with a preceding rhythm in comparison to when it was out of phase. However, the nature of this rhythm-induced attentional effect is not well understood. To better understand the processes underlying rhythm-induced attention, we employed a continuous measure of perceived orientation and a mixture-model analysis. A trial in our study started with a sequence of auditory beeps separated by a fixed inter-beeps interval in the regular (rhythmic) condition or by variable inter-beeps intervals in the irregular condition. A visual target–a line embedded in a circle–followed the sequence. The ‘critical’ interval between the last beep and the target was chosen randomly from several possible Inter-Onset Intervals (IOIs), of which only one was in-phase with the rhythm. The target was followed by a probe line, and the participants were asked to rotate it to reproduce the target’s orientation. The measure of performance for a given trial was the difference in degrees between the orientation of the target and that reproduced by the observer. We found that guessing rate was lower with regular than irregular rhythms. However, there was no effect of rhythm type (regular vs irregular) on the quality of representation (measured as the variability in reproducing the target). Furthermore, the rhythm effect was present only when rhythm type was fixed within a block, and it was found with all IOIs, not just the in-phase IOI. This lack of specificity suggests that these results reflect a general effect of rhythm on alertness.

Regularity Extraction Across Species: Associative Learning Mechanisms Shared by Human and Non-Human Primates

Extracting the regularities of our environment is a core cognitive ability in human and non-human primates. Comparative studies may provide information of strong heuristic value to constrain the elaboration of computational models of regularity learning. This study illustrates this point by testing human and non-human primates (Guinea baboons, Papio papio) with the same experimental paradigm, using a novel online learning measure. For local co-occurrence regularities, we found similar patterns of regularity extraction in baboons and humans. However, only humans extracted the more global sequence structure. It is proposed that only the first result that is common to both species should be used to constrain models of regularity learning. The second result indicates that the extraction of global regularities cannot be accounted for by mere associative learning mechanisms and suggests that humans probably benefit from their language recoding abilities for extracting these regularities. We propose to use a comparative approach to address a series of remaining theoretical questions, which will contribute to the development of a general theory of regularity learning.

Non-adjacent Dependencies Processing in Human and Non-human Primates

Human and non-human primates share the ability to extract adjacent dependencies and, under certain conditions, non-adjacent dependencies (i.e., predictive relationships between elements that are separated by one or several intervening elements in a sequence). In this study, we explore the online extraction dynamics of non-adjacent dependencies in humans and baboons using a serial reaction time task. Participants had to produce three-target sequences containing deterministic relationships between the first and last target locations. In Experiment 1, participants from the two species could extract these non-adjacent dependencies, but humans required less exposure than baboons. In Experiment 2, the data show for the first time in a non-human primate species the successful generalization of sequential non-adjacent dependencies over novel intervening items. These findings provide new evidence to further constrain current theories about the nature and the evolutionary origins of the learning mechanisms allowing the extraction of non-adjacent dependencies.

Constraints on Statistical Learning Across Species

Both human and nonhuman organisms are sensitive to statistical regularities in sensory inputs that support functions including communication, visual processing, and sequence learning. One of the issues faced by comparative research in this field is the lack of a comprehensive theory to explain the relevance of statistical learning across distinct ecological niches. In the current review we interpret cross-species research on statistical learning based on the perceptual and cognitive mechanisms that characterize the human and nonhuman models under investigation. Considering statistical learning as an essential part of the cognitive architecture of an animal will help to uncover the potential ecological functions of this powerful learning process.

Redefining "Learning" in Statistical Learning: What Does an Online Measure Reveal About the Assimilation of Visual Regularities?

From a theoretical perspective, most discussions of statistical learning (SL) have focused on the possible "statistical" properties that are the object of learning. Much less attention has been given to defining what "learning" is in the context of "statistical learning." One major difficulty is that SL research has been monitoring participants' performance in laboratory settings with a strikingly narrow set of tasks, where learning is typically assessed offline, through a set of two-alternative-forced-choice questions, which follow a brief visual or auditory familiarization stream. Is that all there is to characterizing SL abilities? Here we adopt a novel perspective for investigating the processing of regularities in the visual modality. By tracking online performance in a self-paced SL paradigm, we focus on the trajectory of learning. In a set of three experiments we show that this paradigm provides a reliable and valid signature of SL performance, and it offers important insights for understanding how statistical regularities are perceived and assimilated in the visual modality. This demonstrates the promise of integrating different operational measures to our theory of SL.

Generalizing prosodic patterns by a non-vocal learning mammal

Prosody, a salient aspect of speech that includes rhythm and intonation, has been shown to help infants acquire some aspects of syntax. Recent studies have shown that birds of two vocal learning species are able to categorize human speech stimuli based on prosody. In the current study, we found that the non-vocal learning rat could also discriminate human speech stimuli based on prosody. Not only that, but rats were able to generalize to novel stimuli they had not been trained with, which suggests that they had not simply memorized the properties of individual stimuli, but learned a prosodic rule. When tested with stimuli with either one or three out of the four prosodic cues removed, the rats did poorly, suggesting that all cues were necessary for the rats to solve the task. This result is in contrast to results with humans and budgerigars, both of which had previously been studied using the same paradigm. Humans and budgerigars both learned the task and generalized to novel items, but were also able to solve the task with some of the cues removed. In conclusion, rats appear to have some of the perceptual abilities necessary to generalize prosodic patterns, in a similar though not identical way to the vocal learning species that have been studied.

Developmental Abilities to Form Chunks in Immediate Memory and Its Non-Relationship to Span Development

Both adults and children –by the time they are 2–3 years old– have a general ability to recode information to increase memory efficiency. This paper aims to evaluate the ability of untrained children aged 6–10 years old to deploy such a recoding process in immediate memory. A large sample of 374 children were given a task of immediate serial report based on SIMON®, a classic memory game made of four colored buttons (red, green, yellow, blue) requiring players to reproduce a sequence of colors within which repetitions eventually occur. It was hypothesized that a primitive ability across all ages (since theoretically already available in toddlers) to detect redundancies allows the span to increase whenever information can be recoded on the fly. The chunkable condition prompted the formation of chunks based on the perceived structure of color repetition within to-be-recalled sequences of colors. Our result shows a similar linear improvement of memory span with age for both chunkable and non-chunkable conditions. The amount of information retained in immediate memory systematically increased for the groupable sequences across all age groups, independently of the average age-group span that was measured on sequences that contained fewer repetitions. This result shows that chunking gives young children an equal benefit as older children. We discuss the role of recoding in the expansion of capacity in immediate memory and the potential role of data compression in the formation of chunks in long-term memory.