Coyotes (Canis latrans) and the matching law

Thoughts from the forest floor: a review of cognition in the slime mould Physarum polycephalum

Sensing, communication, navigation, decision-making, memory and learning are key components in a standard cognitive tool-kit that enhance an animal's ability to successfully survive and reproduce. However, these tools are not only useful for, or accessible to, animals-they evolved long ago in simpler organisms using mechanisms which may be either unique or widely conserved across diverse taxa. In this article, I review the recent research that demonstrates these key cognitive abilities in the plasmodial slime mould Physarum polycephalum, which has emerged as a model for non-animal cognition. I discuss the benefits and limitations of comparisons drawn between neural and non-neural systems, and the implications of common mechanisms across wide taxonomic divisions. I conclude by discussing future avenues of research that will draw the most benefit from a closer integration of Physarum and animal cognition research.

Overconsumption as a function of how individuals make choices: A paper in honor of Howard Rachlin's contributions to psychology

Howard Rachlin's widely influential behavioral economic approach to self-control and related issues provides the model for this submission. The topic is overconsumption. Current human consumption levels are unsustainable. Explanations typically focus on societal factors, such as the seductive power of advertising and/or misguided tax policies. However, the effectiveness of these factors depends on the degree to which individuals are susceptible to the message: "consume more." Humans are not blank slates. This paper argues that how individuals frame their choices establishes the susceptibility to overconsume. According to economic theory, consumers frame their options as bundles, composed of different combinations of the available items and activities. This leads to maximizing. In experiments, participants tend to frame their options as "either-or" choices. This leads to the matching law. Mathematical models of concurrent schedule choice procedures show that (1) the matching law implies overconsumption of the most preferred option and (2) that individuals will persist in preferring their favorite option even when doing so reduces overall reward rates. Given that the matching law better describes how individuals choose than does maximizing, the mathematical models of widely used choice procedures help explain why efforts to increase consumption have been more influential than efforts to control consumption.

Matching Behaviours and Rewards

Matching describes how behaviour is related to rewards. The matching law holds when the ratio of an individual's behaviours equals the ratio of the rewards obtained. From its origins in the study of pigeons working for food in the laboratory, the law has been applied to a range of species, both in the laboratory and outside it (e.g., human sporting decisions). Probability matching occurs when the probability of a behaviour equals the probability of being rewarded. Input matching predicts the distribution of individuals across habitats. We evaluate the rationality of the matching law and probability matching, expose the logic of matching in real-world cases, review how recent neuroscience findings relate to matching, and suggest future research directions.

Variation in reversal learning by three generalist mesocarnivores

Urbanization imposes novel challenges for wildlife, but also provides new opportunities for exploitation. Generalist species are commonly found in urban habitats, but the cognitive mechanisms facilitating their successful behavioral adaptations and exploitations are largely under-investigated. Cognitive flexibility is thought to enable generalists to be more plastic in their behavior, thereby increasing their adaptability to a variety of environments, including urban habitats. Yet direct measures of cognitive flexibility across urban wildlife are lacking. We used a classic reversal-learning paradigm to investigate the cognitive flexibility of three generalist mesocarnivores commonly found in urban habitats: striped skunks (Mephitis mephitis), raccoons (Procyon lotor), and coyotes (Canis latrans). We developed an automated device and testing protocol that allowed us to administer tests of reversal learning in captivity without extensive training or experimenter involvement. Although most subjects were able to rapidly form and reverse learned associations, we found moderate variation in performance and behavior during trials. Most notably, we observed heightened neophobia and a lack of habituation expressed by coyotes. We discuss the implications of such differences among generalists with regard to urban adaptation and we identify goals for future research. This study is an important step in investigating the relationships between cognition, generalism, and urban adaptation.

How individuals make choices explains addiction's distinctive, non-eliminable features

In keeping with the goals of this Special Issue, this paper poses the following questions: What are addiction's non-eliminable features and can they be explained by one or more general principles? I have added the qualifier "distinctive" to these goals, as in "distinctive non-eliminable features." The result is a highly heterogeneous list, which includes features of addiction's natural history, such as its high remission rates, its unique idioms (e.g., "kicking the habit"), and its patented interventions, such as Alcoholics Anonymous. I show that each of these distinctive features reflects how individuals make choices. In particular, they reflect the competing claims of two basic choice processes: global maximizing of the sort assumed in introductory economics textbooks and Herrnstein's matching law, which has empirical rather than theoretical roots. These are basic choice processes, which apply to all decision making, not just drugs and not just addicts. Nevertheless, they can result in addiction when one of the options has the capacity to undermine the value of competing interests and undermine global maximizing. Conversely, the analyses also show that the two basic choice processes combine so as to predict that addiction is a semi-stable state that is biased to resolve in favor of remission. These predictions are supported by the high rates of addiction, by the high rates of remission from addiction, and by the fact that remission is often unassisted or "spontaneous." The analyses fail to support the idea that pathological psychological processes lead to addiction. Rather they show that addiction emerges from the interactions of normal choice processes and the behaviorally toxic effects of drugs.

Behavioral flexibility: A review, a model, and some exploratory tests

This paper aimed to explore and clarify the concept of behavioral flexibility. A selective literature review explored how the concept of behavioral flexibility has been used in ways that range from acknowledging the fact that animals’ behavior is not always bounded by instinctual constraints, to describing the variation between species in their capacity for innovative foraging, a capacity that has repeatedly been linked to having a brain larger than would be predicted from body size. This wide range of usages of a single term has led to some conceptual confusion. We sought to find a more precise meaning for behavioral flexibility by representing it within a simple formal model of problem solving. The key to our model is to distinguish between an animal’s state of knowledge about the world and its observable behavior, using a construct of response strength to represent that underlying knowledge. We modelled behavioral flexibility as a parameter in the function that transforms response strengths into observable response probabilities. We tested this model in simulations based on some recent experimental work on animal problem solving. Initial results showed that parametric manipulation can mimic some of the behavioral effects that have been attributed to flexibility.

A Computational Model of Dual Competition between the Basal Ganglia and the Cortex

We propose a model that includes interactions between the cortex, the basal ganglia (BG), and the thalamus based on a dual competition. We hypothesize that the striatum, the subthalamic nucleus (STN), the internal globus pallidus (GPi), the thalamus, and the cortex are involved in closed feedback loops through the hyperdirect and direct pathways. These loops support a competition process that results in the ability of BG to make a cognitive decision followed by a motor one. Considering lateral cortical interactions, another competition takes place inside the cortex allowing the latter to make a cognitive and a motor decision. We show how this dual competition endows the model with two regimes. One is driven by reinforcement learning and the other by Hebbian learning. The final decision is made according to a combination of these two mechanisms with a gradual transfer from the former to the latter. We confirmed these theoretical results on primates (Macaca mulatta) using a novel paradigm predicted by the model.

A natural history of skills

The dorsal pallium (a.k.a. cortex in mammals) makes a loop circuit with the basal ganglia and the thalamus known to control and adapt behavior but the who's who of the functional roles of these structures is still debated. Influenced by the Triune brain theory that was proposed in the early sixties, many current theories propose a hierarchical organization on the top of which stands the cortex to which the subcortical structures are subordinated. In particular, habits formation has been proposed to reflect a switch from conscious on-line control of behavior by the cortex, to a fully automated subcortical control. In this review, we propose to revalue the function of the network in light of the current experimental evidence concerning the anatomy and physiology of the basal ganglia-cortical circuits in vertebrates. We briefly review the current theories and show that they could be encompassed in a broader framework of skill learning and performance. Then, after reminding the state of the art concerning the anatomical architecture of the network and the underlying dynamic processes, we summarize the evolution of the anatomical and physiological substrate of skill learning and performance among vertebrates. We then review experimental evidence supporting for the hypothesis that the development of automatized skills relies on the BG teaching cortical circuits and is actually a late feature linked with the development of a specialized cortex or pallium that evolved in parallel in different taxa. We finally propose a minimal computational framework where this hypothesis can be explicitly implemented and tested.

The globus pallidus pars interna in goal-oriented and routine behaviors: Resolving a long-standing paradox

BACKGROUND

There is an apparent contradiction between experimental data showing that the basal ganglia are involved in goal-oriented and routine behaviors and clinical observations. Lesion or disruption by deep brain stimulation of the globus pallidus interna has been used for various therapeutic purposes ranging from the improvement of dystonia to the treatment of Tourette's syndrome. None of these approaches has reported any severe impairment in goal-oriented or automatic movement.

METHOD

To solve this conundrum, we trained 2 monkeys to perform a variant of a 2-armed bandit-task (with different reward contingencies). In the latter we alternated blocks of trials with choices between familiar rewarded targets that elicit routine behavior and blocks with novel pairs of targets that require an intentional learning process.

RESULTS

Bilateral inactivation of the globus pallidus interna, by injection of muscimol, prevents animals from learning new contingencies while performance remains intact, although slower for the familiar stimuli. We replicate in silico these data by adding lateral competition and Hebbian learning in the cortical layer of the theoretical model of the cortex-basal ganglia loop that provided the framework of our experimental approach.

CONCLUSION

The basal ganglia play a critical role in the deliberative process that underlies learning but are not necessary for the expression of routine movements. Our approach predicts that after pallidotomy or during stimulation, patients should have difficulty with complex decision-making processes or learning new goal-oriented behaviors. © 2016 Movement Disorder Society.

Tracking of food quantity by coyotes (Canis latrans)

Previous studies have demonstrated that Weber's Law mediates quantitative discrimination abilities across various species. Here, we tested coyotes' (Canis latrans) ability to discriminate between various quantities of food and investigated whether this ability conforms to predictions of Weber's Law. We demonstrate herein that coyotes are capable of reliably discriminating large versus small quantities of discrete food items. As predicted by Weber's Law, coyotes' quantitative discrimination abilities are mediated by the ratio between the large and small quantities of food and exhibit scalar variability. Furthermore, in this task coyotes were not discriminating large versus small quantities based on olfactory cues alone.