A-learning: A new formulation of associative learning theory

A sequence bottleneck for animal intelligence and language?

We discuss recent findings suggesting that non-human animals lack memory for stimulus sequences, and therefore do not represent the order of stimuli faithfully. These observations have far-reaching consequences for animal cognition, neuroscience, and studies of the evolution of language and culture. This is because, if non-human animals do not remember or process information about order faithfully, then it is unlikely that non-human animals perform mental simulations, construct mental world models, have episodic memory, or transmit culture faithfully. If this suggested sequence bottleneck proves to be a prevalent characteristic of animal memory systems, as suggested by recent work, it would require a re-examination of some influential concepts and ideas.

Sequence representation as an early step in the evolution of language

Human language is unique in its compositional, open-ended, and sequential form, and its evolution is often solely explained by advantages of communication. However, it has proven challenging to identify an evolutionary trajectory from a world without language to a world with language, especially while at the same time explaining why such an advantageous phenomenon has not evolved in other animals. Decoding sequential information is necessary for language, making domain-general sequence representation a tentative basic requirement for the evolution of language and other uniquely human phenomena. Here, using formal evolutionary analyses of the utility of sequence representation we show that sequence representation is exceedingly costly and that current memory systems found in animals may prevent abilities necessary for language to emerge. For sequence representation to evolve, flexibility allowing for ignoring irrelevant information is necessary. Furthermore, an abundance of useful sequential information and extensive learning opportunities are required, two conditions that were likely fulfilled early in human evolution. Our results provide a novel, logically plausible trajectory for the evolution of uniquely human cognition and language, and support the hypothesis that human culture is rooted in sequential representational and processing abilities.

A test of memory for stimulus sequences in great apes

Identifying cognitive capacities underlying the human evolutionary transition is challenging, and many hypotheses exist for what makes humans capable of, for example, producing and understanding language, preparing meals, and having culture on a grand scale. Instead of describing processes whereby information is processed, recent studies have suggested that there are key differences between humans and other animals in how information is recognized and remembered. Such constraints may act as a bottleneck for subsequent information processing and behavior, proving important for understanding differences between humans and other animals. We briefly discuss different sequential aspects of cognition and behavior and the importance of distinguishing between simultaneous and sequential input, and conclude that explicit tests on non-human great apes have been lacking. Here, we test the memory for stimulus sequences-hypothesis by carrying out three tests on bonobos and one test on humans. Our results show that bonobos' general working memory decays rapidly and that they fail to learn the difference between the order of two stimuli even after more than 2,000 trials, corroborating earlier findings in other animals. However, as expected, humans solve the same sequence discrimination almost immediately. The explicit test on whether bonobos represent stimulus sequences as an unstructured collection of memory traces was not informative as no differences were found between responses to the different probe tests. However, overall, this first empirical study of sequence discrimination on non-human great apes supports the idea that non-human animals, including the closest relatives to humans, lack a memory for stimulus sequences. This may be an ability that sets humans apart from other animals and could be one reason behind the origin of human culture.

The behavioral signature of stepwise learning strategy in male rats and its neural correlate in the basal forebrain

Studies of associative learning have commonly focused on how rewarding outcomes are predicted by either sensory stimuli or animals' actions. However, in many learning scenarios, reward delivery requires the occurrence of both sensory stimuli and animals' actions in a specific order, in the form of behavioral sequences. How such behavioral sequences are learned is much less understood. Here we provide behavioral and neurophysiological evidence to show that behavioral sequences are learned using a stepwise strategy. In male rats learning a new association, learning started from the behavioral event closest to the reward and sequentially incorporated earlier events. This led to the sequential refinement of reward-seeking behaviors, which was characterized by the stepwise elimination of ineffective and non-rewarded behavioral sequences. At the neuronal level, this stepwise learning process was mirrored by the sequential emergence of basal forebrain neuronal responses toward each event, which quantitatively conveyed a reward prediction error signal and promoted reward-seeking behaviors. Together, these behavioral and neural signatures revealed how behavioral sequences were learned in discrete steps and when each learning step took place.

Models of Conditioned Reinforcement and Abnormal Behaviour in Captive Animals

Abnormal behaviours are common in captive animals, and despite a lot of research, the development, maintenance and alleviation of these behaviours are not fully understood. Here, we suggest that conditioned reinforcement can induce sequential dependencies in behaviour that are difficult to infer from direct observation. We develop this hypothesis using recent models of associative learning that include conditioned reinforcement and inborn facets of behaviour, such as predisposed responses and motivational systems. We explore three scenarios in which abnormal behaviour emerges from a combination of associative learning and a mismatch between the captive environment and inborn predispositions. The first model considers how abnormal behaviours, such as locomotor stereotypies, may arise from certain spatial locations acquiring conditioned reinforcement value. The second model shows that conditioned reinforcement can give rise to abnormal behaviour in response to stimuli that regularly precede food or other reinforcers. The third model shows that abnormal behaviour can result from motivational systems being adapted to natural environments that have different temporal structures than the captive environment. We conclude that models including conditioned reinforcement offer an important theoretical insight regarding the complex relationships between captive environments, inborn predispositions, and learning. In the future, this general framework could allow us to further understand and possibly alleviate abnormal behaviours.

Simultaneous learning of directional and non-directional stimulus relations in baboons (Papio papio)

While humans exposed to a sequential stimulus pairing A-B are commonly assumed to form a bidirectional mental relation between A and B, evidence that non-human animals can do so is limited. Careful examination of the animal literature suggests possible improvements in the test procedures used to probe such effects, notably measuring transfer effects on the learning of B-A pairings, rather than direct recall of A upon cuing with B. We developed such an experimental design and tested 20 Guinea baboons (Papio papio). Two pairings of visual shapes were trained (A1-B1, A2-B2) and testing was conducted in a reversed order, either with conserved pairings (B1-A1, B2-A2) or broken ones (B1-A2, B2-A1). We found baboons’ immediate test performance to be above chance level for conserved pairings and below chance level for broken ones. Moreover, baboons needed less trials to learn conserved pairings compared to broken ones. These effects were apparent for both pairings on average, and separately for the best learned pairing. Baboons’ responding on B-A trials was thus influenced by their previous A-B training. Performance level at the onset of testing, however, suggests that baboons did not respond in full accordance with the hypothesis of bidirectionality. To account for these data, we suggest that two competing types of relations were concomitantly encoded: a directional relation between A and B, which retains the sequential order experienced, and a non-directional relation, which retains only the co-occurrence of events, not their temporal order.