Stimulus-response-outcome coding in the pigeon nidopallium caudolaterale

Working memory performance is tied to stimulus complexity

Working memory is the cognitive capability to maintain and process information over short periods. Behavioral and computational studies have shown that visual information is associated with working memory performance. However, the underlying neural correlates remain unknown. To identify how visual information affects working memory performance, we conducted behavioral experiments in pigeons (Columba livia) and single unit recordings in the avian prefrontal analog, the nidopallium caudolaterale (NCL). Complex pictures featuring luminance, spatial and color information, were associated with higher working memory performance compared to uniform gray pictures in conjunction with distinct neural coding patterns. For complex pictures, we found a multiplexed neuronal code displaying visual and value-related features that switched to a representation of the upcoming choice during a delay period. When processing gray stimuli, NCL neurons did not multiplex and exclusively represented the choice already during stimulus presentation and throughout the delay period. The prolonged representation possibly resulted in a decay of the memory trace ultimately leading to a decrease in performance. In conclusion, we found that high stimulus complexity is associated with neuronal multiplexing of the working memory representation possibly allowing a facilitated read-out of the neural code resulting in enhancement of working memory performance.

Executive Control of Sequence Behavior in Pigeons Involves Two Distinct Brain Regions

Executive functions arise from multiple regions of the brain acting in concert. To facilitate such cross-regional computations, the brain is organized into distinct executive networks, like the frontoparietal network. Despite similar cognitive abilities across many domains, little is known about such executive networks in birds. Recent advances in avian fMRI have shown a possible subset of regions, including the nidopallium caudolaterale (NCL) and the lateral part of medial intermediate nidopallium (NIML), that may contribute to complex cognition, forming an action control system of pigeons. We investigated the neuronal activity of NCL and NIML. Single-cell recordings were obtained during the execution of a complex sequential motor task that required executive control to stop executing one behavior and continue with a different one. We compared the neuronal activity of NIML to NCL and found that both regions fully processed the ongoing sequential execution of the task. Differences arose from how behavioral outcome was processed. Our results indicate that NCL takes on a role in evaluating outcome, while NIML is more tightly associated with ongoing sequential steps. Importantly, both regions seem to contribute to overall behavioral output as parts of a possible avian executive network, crucial for behavioral flexibility and decision-making.

Behavioral Training Related Neurotransmitter Receptor Expression Dynamics in the Nidopallium Caudolaterale and the Hippocampal Formation of Pigeons

Learning and memory are linked to dynamic changes at the level of synapses in brain areas that are involved in cognitive tasks. For example, changes in neurotransmitter receptors are prerequisite for tuning signals along local circuits and long-range networks. However, it is still unclear how a series of learning events promotes plasticity within the system of neurotransmitter receptors and their subunits to shape information processing at the neuronal level. Therefore, we investigated the expression of different glutamatergic NMDA (GRIN) and AMPA (GRIA) receptor subunits, the GABAergic GABARG2 subunit, dopaminergic DRD1, serotonergic 5HTR1A and noradrenergic ADRA1A receptors in the pigeon’s brain. We studied the nidopallium caudolaterale, the avian analogue of the prefrontal cortex, and the hippocampal formation, after training the birds in a rewarded stimulus-response association (SR) task and in a simultaneous-matching-to-sample (SMTS) task. The results show that receptor expression changed differentially after behavioral training compared to an untrained control group. In the nidopallium caudolaterale, GRIN2B, GRIA3, GRIA4, DRD1D, and ADRA1A receptor expression was altered after SR training and remained constantly decreased after the SMTS training protocol, while GRIA2 and DRD1A decreased only under the SR condition. In the hippocampal formation, GRIN2B decreased and GABARG2 receptor expression increased after SR training. After SMTS sessions, GRIN2B remained decreased, GABARG2 remained increased if compared to the control group. None of the investigated receptors differed directly between both conditions, although differentially altered. The changes in both regions mostly occur in favor of the stimulus response task. Thus, the present data provide evidence that neurotransmitter receptor expression dynamics play a role in the avian prefrontal cortex and the hippocampal formation for behavioral training and is uniquely, regionally and functionally associated to cognitive processes including learning and memory.

Event-related functional MRI of awake behaving pigeons at 7T

Animal-fMRI is a powerful method to understand neural mechanisms of cognition, but it remains a major challenge to scan actively participating small animals under low-stress conditions. Here, we present an event-related functional MRI platform in awake pigeons using single-shot RARE fMRI to investigate the neural fundaments for visually-guided decision making. We established a head-fixated Go/NoGo paradigm, which the animals quickly learned under low-stress conditions. The animals were motivated by water reward and behavior was assessed by logging mandibulations during the fMRI experiment with close to zero motion artifacts over hundreds of repeats. To achieve optimal results, we characterized the species-specific hemodynamic response function. As a proof-of-principle, we run a color discrimination task and discovered differential neural networks for Go-, NoGo-, and response execution-phases. Our findings open the door to visualize the neural fundaments of perceptual and cognitive functions in birds-a vertebrate class of which some clades are cognitively on par with primates.

Spatial planning with long visual range benefits escape from visual predators in complex naturalistic environments

It is uncontroversial that land animals have more elaborated cognitive abilities than their aquatic counterparts such as fish. Yet there is no apparent a-priori reason for this. A key cognitive faculty is planning. We show that in visually guided predator-prey interactions, planning provides a significant advantage, but only on land. During animal evolution, the water-to-land transition resulted in a massive increase in visual range. Simulations of behavior identify a specific type of terrestrial habitat, clustered open and closed areas (savanna-like), where the advantage of planning peaks. Our computational experiments demonstrate how this patchy terrestrial structure, in combination with enhanced visual range, can reveal and hide agents as a function of their movement and create a selective benefit for imagining, evaluating, and selecting among possible future scenarios-in short, for planning. The vertebrate invasion of land may have been an important step in their cognitive evolution.

A comparative analysis of the dopaminergic innervation of the executive caudal nidopallium in pigeon, chicken, zebra finch, and carrion crow

Despite the long, separate evolutionary history of birds and mammals, both lineages developed a rich behavioral repertoire of remarkably similar executive control generated by distinctly different brains. The seat for executive functioning in birds is the nidopallium caudolaterale (NCL) and the mammalian equivalent is known as the prefrontal cortex (PFC). Both are densely innervated by dopaminergic fibers, and are an integration center of sensory input and motor output. Whereas the variation of the PFC has been well documented in different mammalian orders, we know very little about the NCL across the avian clade. In order to investigate whether this structure adheres to species-specific variations, this study aimed to describe the trajectory of the NCL in pigeon, chicken, carrion crow and zebra finch. We employed immunohistochemistry to map dopaminergic innervation, and executed a Gallyas stain to visualize the dorsal arcopallial tract that runs between the NCL and the arcopallium. Our analysis showed that whereas the trajectory of the NCL in the chicken is highly comparable to the pigeon, the two Passeriformes show a strikingly different pattern. In both carrion crow and zebra finch, we identified four different subareas of high dopaminergic innervation that span the entire caudal forebrain. Based on their sensory input, motor output, and involvement in dopamine-related cognitive control of the delineated areas here, we propose that at least three morphologically different subareas constitute the NCL in these songbirds. Thus, our study shows that comparable to the PFC in mammals, the NCL in birds varies considerably across species.

Neurons in the pigeon nidopallium caudolaterale, but not the corticoidea dorsolateralis, display value and effort discounting activity

We recorded from single neurons in two areas of the pigeon brain while birds were required to peck a stimulus indicating either a high effort task or a low effort task would follow. Upon completion of the task the birds received the same reward. We found that activity in the nidopallium caudolaterale, an area equivalent to the mammalian prefrontal cortex, was modulated by the value of the reward that would be received based on how much effort was required to obtain it. Value coding was most prominent during the presentation of the stimulus indicating a high or low effort task, and in the delay period immediately prior to carrying out the effort task. In contrast, activity in the corticoidea dorsolateralis was not modulated by value, however, population firing patterns suggest that it may be involved in associating actions with outcomes. Our findings support the view that activity in the nidopallium caudolaterale reflects value of reward as a function of effort discounting and as such may serve functions similar to the mammalian anterior cingulate cortex.

Hippocampus-nidopallium caudolaterale interactions exist in the goal-directed behavior of pigeon

Avian hippocampus (Hp) and nidopallium caudolaterale (NCL) are believed to play key roles in goal-directed behavior. However, it is still unclear whether there are interactions between the two brain regions in the goal-directed behavior of pigeons. To investigate the interactions between the Hp and the NCL in the goal-directed behavior, we recorded local field potential (LFP) signals from the two regions simultaneously when the pigeons performed a goal-directed decision-making task. Amplitude-amplitude coupling analysis revealed that the coupling value between the LFP recorded from the Hp and that from the NCL increased significantly (P < 0.05) in slow gamma-band (40-60 Hz) during the turning area. In addition, the LFP functional network analysis demonstrated the LFP functional connections between the Hp and the NCL increased significantly (P < 0.05) in the turning area. The result of partial directed coherence (PDC) analysis showed that the predominant direction of information flow is thought to be from the Hp to the NCL. These findings suggest that there are causal functional interactions between the Hp and the NCL by which information is transmitted between the two regions relevant to goal-directed behavior.

Renewal of extinguished behavior in pigeons (Columba livia) does not require memory consolidation of acquisition or extinction in a free-operant appetitive conditioning paradigm

Extinction learning is a fundamental capacity for adaptive and flexible behavior. As extinguished conditioned responding is prone to relapse under certain conditions, the necessity of memory consolidation for recovery phenomena to occur has been highlighted recently. Several studies have demonstrated that both acquisition and extinction training need to be properly consolidated for a relapse of the original acquired memory trace to occur. Does this imply that extinguished responses cannot relapse before memory consolidation? To answer this question, we investigated the renewal effect subsequent to an immediate or a delayed (24 h) extinction in a discriminative operant conditioning paradigm. In three different experiments, we could show (1) that acquisition learning does not need to be long-term consolidated for the occurrence of renewal, (2) that the offset of extinction training is a reliable marker for extinction recall in a free-operant extinction learning paradigm where organisms undergo consecutive acquisition training, extinction training as well as testing of conditioned responding and (3), that immediate and long-term consolidated renewal do not demonstrate any qualitative difference in terms of the behavioral output. Our results indicate on the behavioral level that the inhibitory nature of extinction is already present in free-operant learning paradigms and that it does not seem to be affected by the absence of long-term memory consolidation.

Spatially Tuned Neurons in Corvid Nidopallium Caudolaterale Signal Target Position During Visual Search

The avian pallial endbrain area nidopallium caudolaterale (NCL) shows important similarities to mammalian prefrontal cortex in connectivity, dopamine neurochemistry, and function. Neuronal processing in NCL has been studied with respect to sensory, cognitive, and reward information, but little is known about its role in more direct control of motor behavior. We investigated NCL activity during the choice period of a delayed match-to-sample task, as 2 trained crows searched and selected a previously remembered visual target among an array of 4 pictures. The crows exhibited behavioral response patterns consistent with serial visual search. Many single NCL neurons were spatially tuned to specific target positions during visual search and directed motor behavior. Moreover, single NCL neurons dynamically changed their tuning properties to represent different behaviorally relevant task variables across the trial. In consecutive task periods, single neurons responded to visual stimuli, stored stimulus information in working memory, guided goal-directed behavior depending on the remembered target picture, and encoded trial outcomes. This flexible encoding of all task-relevant aspects in the executive control of goal-directed behavior represents a striking convergence to neuronal encoding in primate prefrontal cortex. These data highlight key properties of associative endbrain areas underlying flexible cognitive behavior in corvids and primates.

Decoding Pigeon Behavior Outcomes Using Functional Connections among Local Field Potentials

Recent studies indicate that the local field potential (LFP) carries information about an animal's behavior, but issues regarding whether there are any relationships between the LFP functional networks and behavior tasks as well as whether it is possible to employ LFP network features to decode the behavioral outcome in a single trial remain unresolved. In this study, we developed a network-based method to decode the behavioral outcomes in pigeons by using the functional connectivity strength values among LFPs recorded from the nidopallium caudolaterale (NCL). In our method, the functional connectivity strengths were first computed based on the synchronization likelihood. Second, the strength values were unwrapped into row vectors and their dimensions were then reduced by principal component analysis. Finally, the behavioral outcomes in single trials were decoded using leave-one-out combined with the k-nearest neighbor method. The results showed that the LFP functional network based on the gamma-band was related to the goal-directed behavior of pigeons. Moreover, the accuracy of the network features (74 ± 8%) was significantly higher than that of the power features (61 ± 12%). The proposed method provides a powerful tool for decoding animal behavior outcomes using a neural functional network.

Learning Recruits Neurons Representing Previously Established Associations in the Corvid Endbrain

Crows quickly learn arbitrary associations. As a neuronal correlate of this behavior, single neurons in the corvid endbrain area nidopallium caudolaterale (NCL) change their response properties during association learning. In crows performing a delayed association task that required them to map both familiar and novel sample pictures to the same two choice pictures, NCL neurons established a common, prospective code for associations. Here, we report that neuronal tuning changes during learning were not distributed equally in the recorded population of NCL neurons. Instead, such learning-related changes relied almost exclusively on neurons which were already encoding familiar associations. Only in such neurons did behavioral improvements during learning of novel associations coincide with increasing selectivity over the learning process. The size and direction of selectivity for familiar and newly learned associations were highly correlated. These increases in selectivity for novel associations occurred only late in the delay period. Moreover, NCL neurons discriminated correct from erroneous trial outcome based on feedback signals at the end of the trial, particularly in newly learned associations. Our results indicate that task-relevant changes during association learning are not distributed within the population of corvid NCL neurons but rather are restricted to a specific group of association-selective neurons. Such association neurons in the multimodal cognitive integration area NCL likely play an important role during highly flexible behavior in corvids.

Integration of contextual cues into memory depends on "prefrontal" N-methyl-D-aspartate receptors

Every learning event is embedded in a context, but not always does the context become an integral part of the memory; however, for extinction learning it usually does, resulting in context-specific conditioned responding. The neuronal mechanisms underlying contextual control have been mainly investigated for Pavlovian fear extinction with a focus on hippocampal structures. However, the initial acquisition of novel responses can be subject to contextual control as well, although the neuronal mechanisms are mostly unknown. Here, we tested the hypothesis that contextual control of acquisition depends on glutamatergic transmission underlying executive functions in forebrain areas, e.g. by shifting attention to critical cues. Thus, we antagonized N-methyl-D-aspartate (NMDA) receptors with 2-amino-5-phosphonovaleric acid (AP5) in the pigeon nidopallium caudolaterale, the functional analogue of mammalian prefrontal cortex, during the concomitant acquisition and extinction of conditioned responding to two different stimuli. This paradigm has previously been shown to lead to contextual control over extinguished as well as non-extinguished responding. NMDA receptor blockade resulted in an impairment of extinction learning, but left the acquisition of responses to a novel stimulus unaffected. Critically, when responses were tested in a different context in the retrieval phase, we observed that NMDA receptor blockade led to the abolishment of contextual control over acquisition performance. This result is predicted by a model describing response inclination as the product of associative strength and contextual gain. In this model, learning under AP5 leads to a change in the contextual gain on the learned association, possibly via the modulation of attentional mechanisms.

Neurons in the pigeon caudolateral nidopallium differentiate Pavlovian conditioned stimuli but not their associated reward value in a sign-tracking paradigm

Animals exploit visual information to identify objects, form stimulus-reward associations, and prepare appropriate behavioral responses. The nidopallium caudolaterale (NCL), an associative region of the avian endbrain, contains neurons exhibiting prominent response modulation during presentation of reward-predicting visual stimuli, but it is unclear whether neural activity represents valuation signals, stimulus properties, or sensorimotor contingencies. To test the hypothesis that NCL neurons represent stimulus value, we subjected pigeons to a Pavlovian sign-tracking paradigm in which visual cues predicted rewards differing in magnitude (large vs. small) and delay to presentation (short vs. long). Subjects' strength of conditioned responding to visual cues reliably differentiated between predicted reward types and thus indexed valuation. The majority of NCL neurons discriminated between visual cues, with discriminability peaking shortly after stimulus onset and being maintained at lower levels throughout the stimulus presentation period. However, while some cells' firing rates correlated with reward value, such neurons were not more frequent than expected by chance. Instead, neurons formed discernible clusters which differed in their preferred visual cue. We propose that this activity pattern constitutes a prerequisite for using visual information in more complex situations e.g. requiring value-based choices.

Context specificity of both acquisition and extinction of a Pavlovian conditioned response

It is widely held that the extinction of a conditioned response is more context specific than its initial acquisition. One proposed explanation is that context serves to disambiguate the meaning of a stimulus. Using a procedure that equated the learning histories of the contexts, we show that the memory of an appetitive Pavlovian association can be highly context specific despite being unambiguous. This result is inconsistent with predictions of the Rescorla–Wagner model of learning but in line with configural accounts of contextual control of behavior. We propose an explanatory model in which context serves to modulate the gain of associative strength and which expands upon the configural idea of unitary representations of context and conditioned stimuli.

Blocking NMDA-receptors in the pigeon's "prefrontal" caudal nidopallium impairs appetitive extinction learning in a sign-tracking paradigm

Extinction learning provides the ability to flexibly adapt to new contingencies by learning to inhibit previously acquired associations in a context-dependent manner. The neural networks underlying extinction learning were mostly studied in rodents using fear extinction paradigms. To uncover invariant properties of the neural basis of extinction learning, we employ pigeons as a model system. Since the prefrontal cortex (PFC) of mammals is a key structure for extinction learning, we assessed the role of N-methyl-D-aspartate receptors (NMDARs) in the nidopallium caudolaterale (NCL), the avian functional equivalent of mammalian PFC. Since NMDARs in PFC have been shown to be relevant for extinction learning, we locally antagonized NMDARs through 2-Amino-5-phosphonovalerianacid (APV) during extinction learning in a within-subject sign-tracking ABA-renewal paradigm. APV-injection slowed down extinction learning and in addition also caused a disinhibition of responding to a continuously reinforced control stimulus. In subsequent retrieval sessions, spontaneous recovery was increased while ABA renewal was unaffected. The effect of APV resembles that observed in studies of fear extinction with rodents, suggesting common neural substrates of extinction under both appetitive and aversive conditions and highlighting the similarity of mammalian PFC and the avian caudal nidopallium despite 300 million years of independent evolution.

Neurons in the pigeon nidopallium caudolaterale signal the selection and execution of perceptual decisions

Sensory systems provide organisms with information on the current status of the environment, thus enabling adaptive behavior. The neural mechanisms by which sensory information is exploited for action selection are typically studied with mammalian subjects performing perceptual decision-making tasks, and most of what is known about these mechanisms at the single-neuron level is derived from cortical recordings in behaving monkeys. To explore the generality of neural mechanisms underlying perceptual decision making across species, we recorded single-neuron activity in the pigeon nidopallium caudolaterale (NCL), a non-laminated associative forebrain structure thought to be functionally equivalent to mammalian prefrontal cortex, while subjects performed a visual categorisation task. We found that, whereas the majority of NCL neurons unspecifically upregulated or downregulated activity during stimulus presentation, ~20% of neurons exhibited differential activity for the sample stimuli and predicted upcoming choices. Moreover, neural activity in these neurons was ramping up during stimulus presentation and remained elevated until a choice was initiated, a response pattern similar to that found in monkey prefrontal and parietal cortices in saccadic choice tasks. In addition, many NCL neurons coded for movement direction during choice execution and differentiated between choice outcomes (reward and punishment). Taken together, our results implicate the NCL in the selection and execution of operant responses, an interpretation resonating well with the results of previous lesion studies. The resemblance of the response patterns of NCL neurons to those observed in mammalian cortex suggests that, despite differing neural architectures, mechanisms for perceptual decision making are similar across classes of vertebrates.

A role for descending auditory cortical projections in songbird vocal learning

Many learned motor behaviors are acquired by comparing ongoing behavior with an internal representation of correct performance, rather than using an explicit external reward. For example, juvenile songbirds learn to sing by comparing their song with the memory of a tutor song. At present, the brain regions subserving song evaluation are not known. In this study, we report several findings suggesting that song evaluation involves an avian 'cortical' area previously shown to project to the dopaminergic midbrain and other downstream targets. We find that this ventral portion of the intermediate arcopallium (AIV) receives inputs from auditory cortical areas, and that lesions of AIV result in significant deficits in vocal learning. Additionally, AIV neurons exhibit fast responses to disruptive auditory feedback presented during singing, but not during nonsinging periods. Our findings suggest that auditory cortical areas may guide learning by transmitting song evaluation signals to the dopaminergic midbrain and/or other subcortical targets.

Recording single neurons' action potentials from freely moving pigeons across three stages of learning

While the subject of learning has attracted immense interest from both behavioral and neural scientists, only relatively few investigators have observed single-neuron activity while animals are acquiring an operantly conditioned response, or when that response is extinguished. But even in these cases, observation periods usually encompass only a single stage of learning, i.e. acquisition or extinction, but not both (exceptions include protocols employing reversal learning; see Bingman et al.(1) for an example). However, acquisition and extinction entail different learning mechanisms and are therefore expected to be accompanied by different types and/or loci of neural plasticity. Accordingly, we developed a behavioral paradigm which institutes three stages of learning in a single behavioral session and which is well suited for the simultaneous recording of single neurons' action potentials. Animals are trained on a single-interval forced choice task which requires mapping each of two possible choice responses to the presentation of different novel visual stimuli (acquisition). After having reached a predefined performance criterion, one of the two choice responses is no longer reinforced (extinction). Following a certain decrement in performance level, correct responses are reinforced again (reacquisition). By using a new set of stimuli in every session, animals can undergo the acquisition-extinction-reacquisition process repeatedly. Because all three stages of learning occur in a single behavioral session, the paradigm is ideal for the simultaneous observation of the spiking output of multiple single neurons. We use pigeons as model systems, but the task can easily be adapted to any other species capable of conditioned discrimination learning.

Transient inactivation of the pigeon hippocampus or the nidopallium caudolaterale during extinction learning impairs extinction retrieval in an appetitive conditioning paradigm

The majority of experiments exploring context-dependent extinction learning employ Pavlovian fear conditioning in rodents. Since mechanisms of appetitive and aversive learning are known to differ at the neuronal level, we sought to investigate extinction learning in an appetitive setting. Working with pigeons, we established a within-subject ABA renewal paradigm based on Rescorla (Q J Exp Psychol 61:1793) and combined it with pharmacological interventions during extinction. From the fear conditioning literature, it is known that both prefrontal cortex and the hippocampus are core structures for context-specific extinction learning. Accordingly, we transiently inactivated the nidopallium caudolaterale (NCL, a functional analogue of mammalian prefrontal cortex) and the hippocampus in separate experiments by intracranial infusion of the sodium-channel blocker tetrodotoxin immediately before extinction training. We find that TTX in both structures non-specifically suppresses conditioned responding, as revealed by a reduction of response rate to both the extinguished conditioned stimulus and a control stimulus which remained reinforced throughout the experiment. Furthermore, TTX during extinction training impaired later extinction retrieval assessed under drug-free conditions. This was true when responding to the extinguished stimulus was assessed in the context of extinction but not when tested in the context of acquisition, although both contexts were matched with respect to their history of conditioning. These results indicate that both NCL and hippocampus are involved in extinction learning under appetitive conditions or, more specifically, in the consolidation of extinction memory, and that their contribution to extinction is context-specific.

Magnetic tracking of eye position in freely behaving chickens

Research on the visual system of non-primates, such as birds and rodents, is increasing. Evidence that neural responses can differ dramatically between head-immobilized and freely behaving animals underlines the importance of studying visual processing in ethologically relevant contexts. In order to systematically study visual responses in freely behaving animals, an unobtrusive system for monitoring eye-in-orbit position in real time is essential. We describe a novel system for monitoring eye position that utilizes a head-mounted magnetic displacement sensor coupled with an eye-implanted magnet. This system is small, lightweight, and offers high temporal and spatial resolution in real time. We use the system to demonstrate the stability of the eye and the stereotypy of eye position during two different behavioral tasks in chickens. This approach offers a viable alternative to search coil and optical eye tracking techniques for high resolution tracking of eye-in-orbit position in behaving animals.

Suboptimal criterion setting in a perceptual choice task with asymmetric reinforcement

Performance on psychophysical tasks is influenced by a variety of non-sensory factors, most notably the magnitude or probability of reinforcement following correct responses. When reinforcement probability is unequal for hits and correct rejections, signal detection theory specifies an optimal decision criterion which maximizes the number of reinforcers. We subjected pigeons to a task in which six different stimuli (shades of gray) had to be assigned to one of two categories. Animals were confronted with asymmetric reinforcement schedules in which correct responses to five of the stimuli were reinforced with a probability of 0.5, while correct responses to the remaining stimulus were extinguished. The subjects' resultant choice probabilities clearly deviated from those predicted by a maximization account. More specifically, the magnitude of the choice bias increased with the distance of the to-be-extinguished stimulus to the category boundary, a pattern opposite to that posited by maximization. The present and a previous set of results in which animals performed optimally can be explained by a simple choice mechanism in which a variable decision criterion is constantly updated according to a leaky integration of incomes attained from both response options.