When animals misbehave: analogs of human biases and suboptimal choice

Time, uncertainty, and suboptimal choice

Under certain conditions, pigeons prefer information about whether food will be forthcoming at the end of an interval to a higher chance of obtaining the food. In the typical protocol, choosing one option (Informative) is followed by one of two 10-s long terminal-link stimuli: SG always ending in food or SR never ending in food, with SG occurring only 20% of the trials. The other option (Non-informative) is also followed by one of two 10-s long terminal-link stimuli: SB or SY, both ending in food 50% of the trials. Although the Informative option yields food with a lower probability than the Non-informative (0.2 vs. 0.5), pigeons prefer it. To determine whether such preference occurs because SG and SR disambiguate the trial outcome immediately upon choice, we delayed the moment the disambiguation took place in two experiments. In Experiment 1, when the Informative option was chosen, SG always ensued for t seconds of the terminal-link, and then the standard contingencies followed. Experiment 2 was similar, except that SR always ensued for t seconds. Across conditions, t varied from 0 to 10 s. In both experiments, preference for the Informative option decreased with t, but the effect was stronger in Experiment 1. We discuss the implication of these findings for functional and mechanistic models of suboptimal choice.

Rapid learning of predictive maps with STDP and theta phase precession

The predictive map hypothesis is a promising candidate principle for hippocampal function. A favoured formalisation of this hypothesis, called the successor representation, proposes that each place cell encodes the expected state occupancy of its target location in the near future. This predictive framework is supported by behavioural as well as electrophysiological evidence and has desirable consequences for both the generalisability and efficiency of reinforcement learning algorithms. However, it is unclear how the successor representation might be learnt in the brain. Error-driven temporal difference learning, commonly used to learn successor representations in artificial agents, is not known to be implemented in hippocampal networks. Instead, we demonstrate that spike-timing dependent plasticity (STDP), a form of Hebbian learning, acting on temporally compressed trajectories known as 'theta sweeps', is sufficient to rapidly learn a close approximation to the successor representation. The model is biologically plausible - it uses spiking neurons modulated by theta-band oscillations, diffuse and overlapping place cell-like state representations, and experimentally matched parameters. We show how this model maps onto known aspects of hippocampal circuitry and explains substantial variance in the temporal difference successor matrix, consequently giving rise to place cells that demonstrate experimentally observed successor representation-related phenomena including backwards expansion on a 1D track and elongation near walls in 2D. Finally, our model provides insight into the observed topographical ordering of place field sizes along the dorsal-ventral axis by showing this is necessary to prevent the detrimental mixing of larger place fields, which encode longer timescale successor representations, with more fine-grained predictions of spatial location.

Bundling and segregation affect pheromone deposition, but not choice, in an ant

Behavioural economists have identified many psychological manipulations which affect perceived value. A prominent example of this is bundling, in which several small gains (or costs) are experienced as more valuable (or costly) than if the same total amount is presented together. While extensively demonstrated in humans, to our knowledge this effect has never been investigated in an animal, let alone an invertebrate. We trained individual Lasius niger workers to two of three conditions in which either costs (travel distance), gains (sucrose reward), or both were either bundled or segregated: (1) both costs and gains bundled, (2) both segregated, and (3) only gains segregated. We recorded pheromone deposition on the ants' return trips to the nest as measure of perceived value. After training, we offer the ants a binary choice between odours associated with the treatments. While bundling treatment did not affect binary choice, it strongly influenced pheromone deposition. Ants deposited c. 80% more pheromone when rewards were segregated but costs bundled as compared with both costs and rewards being bundled. This pattern is further complicated by the pairwise experience each animal made, and which of the treatments it experiences first during training. This demonstrates that even insects are influenced by bundling effects. We propose that the deviation between binary choice and pheromone deposition in this case may be due to a possible linearity in distance perception in ants, while almost all other sensory perception in animals is logarithmic.

A description-experience gap in statistical intuitions: Of smart babies, risk-savvy chimps, intuitive statisticians, and stupid grown-ups

Comparison of different lines of research on statistical intuitions and probabilistic reasoning reveals several puzzling contradictions. Whereas babies seem to be intuitive statisticians, surprisingly capable of statistical learning and inference, adults' statistical inferences have been found to be inconsistent with the rules of probability theory and statistics. Whereas researchers in the 1960s concluded that people's probability updating is "conservatively" proportional to normative predictions, probability updating research in the 1970s suggested that people are incapable of following Bayes's rule. And whereas animals appear to be strikingly risk savvy, humans often seem "irrational" when dealing with probabilistic information. Drawing on research on the description-experience gap in risky choice, we integrate and systematize these findings from disparate fields of inquiry that have, to date, operated largely in parallel. Our synthesis shows that a key factor in understanding inconsistencies in statistical intuitions research is whether probabilistic inferences are based on symbolic, abstract descriptions or on the direct experience of statistical information. We delineate this view from other conceptual accounts, consider potential mechanisms by which attributes of first-hand experience can facilitate appropriate statistical inference, and identify conditions under which they improve or impair probabilistic reasoning. To capture the full scope of human statistical intuition, we conclude, research on probabilistic reasoning across the lifespan, across species, and across research traditions must bear in mind that experience and symbolic description of the world may engage systematically distinct cognitive processes.

The essential value of the alternatives of the suboptimal choice procedure is different for pigeons and rats

Suboptimal choice is the preference for a discriminative alternative with low probability of reinforcement, over a non-discriminative alternative with higher probability of reinforcement. Pigeons consistently prefer the discriminative alternative, whereas rats prefer the non-discriminative; the variables accounting for this difference are not yet clear. The economic concepts related to demand curves have been used to calculate the essential value of different types of reinforcers, so they may be useful to compare the value of the alternatives in the suboptimal choice procedure. The goal of this study was to calculate the essential value of each of the alternatives presented in the suboptimal choice procedure to assess if pigeons (Experiment 1) and rats (Experiment 2) value them differently. In both experiments, the fixed ratio requirement in the initial link was increased throughout sessions in order to obtain the demand curve and calculate the essential value by fitting the exponential-demand model. A Bayesian Linear Mixed-Effects Model indicated that pigeons had higher essential values for the discriminative alternative, whereas rats obtained higher essential values for the non-discriminative alternative. These results suggest that preferences in the suboptimal choice procedure are indeed based on the essential value of the alternatives, and provide a new paradigm to study the variables affecting this phenomenon.

Claw-in-the-door: pigeons, like humans, display the foot-in-the-door effect

People are more likely to comply with a large request when it is preceded by another, smaller request, and this is known as the "foot-in-the-door" (FITD). The FITD has been widely studied in social psychology and is thought to arise from mutually conflicting beliefs about past and present behavior (cognitive dissonance) or changes in self-perception. Across two experiments, we found that pigeons' latency to respond to an effortful second stimulus in a pair scales with how much effort they had exerted on the first stimulus. As such, pigeons also display a FITD-like effect. We argue that the FITD may not be caused by conflicting beliefs or changes in self-perception but may instead be the product of behavioral contrast.

The Δ-∑ hypothesis: How contrast and reinforcement rate combine to generate suboptimal choice

When given a choice between two alternatives, each offering food after the same delay with different but signaled probabilities, pigeons often prefer the low probability alternative. This preference is surprising because pigeons fail to maximize the rate of food intake; they exhibit a suboptimal preference. We advance a new explanation, the Δ-∑ hypothesis, in which the difference in probability of reinforcement within terminal links (Δ) and the overall reinforcement probability rate of each alternative (∑) are the key variables responsible for such suboptimal preference. We tested the Δ-∑ hypothesis in two experiments. In Experiment 1, we manipulated the Δs while maintaining constant all other parameters of the task, in particular the ∑s. We predicted a preference for the alternative with the larger Δ. In Experiment 2, we examined the effect of the overall reinforcement probabilities, the ∑s, while maintaining constant all other parameters of the task, in particular the Δs. We predicted a preference for the larger ∑. The results of both experiments support the Δ-∑ hypothesis.

Anabolic-androgenic steroids and cognitive effort discounting in male rats

Anabolic-androgenic steroids (AAS) are drugs of abuse that impair behavior and cognition. In a rodent model of AAS abuse, testosterone-treated male rats expend more physical effort, by repeatedly pressing a lever for a large reward in an operant discounting task. However, since modern society prioritizes cognitive over physical effort, it is important to determine if AAS limit cognitive effort. Here we tested the effects of AAS on a novel cognitive-effort discounting task. Each operant chamber had 3 nose-pokes, opposite 2 levers and a pellet dispenser. Rats pressed a lever to illuminate 1 nose-poke; they responded in the illuminated nose-poke to receive sugar pellets. For the 'easy' lever, the light remained on for 1 s, and a correct response earned 1 pellet. For the 'hard' lever, the light duration decreased from 1 s to 0.1 s across 5 blocks of trials, and a correct response earned 4 pellets. As the duration of the nose-poke light decreased, all rats decreased their choice of the hard lever in a modest discounting curve. Task accuracy also decreased significantly across the 5 blocks of trials. However, there was no effect of testosterone on choice of the hard lever or task accuracy. Antagonism of dopamine D1 or D2 receptors had no effect on lever choice or task accuracy. However, serotonin depletion significantly decreased preference for the hard lever, and impaired task accuracy. Thus, physical effort discounting depends on dopamine activity, while cognitive effort discounting task is sensitive to serotonin. AAS impair physical effort discounting, but not cognitive effort discounting.

More evidence that less is better: Sub-optimal choice in dogs

The less-is-better effect is a preference for the lesser of two alternatives sometimes observed when they are evaluated separately. For example, a dinner service of 24 intact pieces might be judged to be more valuable than a 40-piece dinner service containing nine broken pieces. Pattison and Zentall (Animal Cognition, 17: 1019-1022, 2014) reported similar sub-optimal choice behavior in dogs using a simultaneous choice procedure. Given a choice between a single high-value food item (cheese) or an equivalent high-value item plus a lower-value food item (carrot), their dogs chose the individual item. In a subsequent test, the dogs preferred two high-value items to a single high-value item, suggesting that avoidance of multiple items did not cause the sub-optimal choice behavior. In two experiments, we replicated Pattison and Zentall's procedure while including additional controls. In Experiment 1, habituation of neophobia for multiple items was controlled for by intermixing the two types of test trial within a single experimental session. In Experiment 2, we controlled for avoidance of heterogeneous rewards by including test trials in which a choice was offered between the combination of items and a single low-value item. In both experiments we observed sub-optimal choice behavior which could not be explained by either of these putative mechanisms. Our results, as well as those of Pattison and Zentall, are consistent with the suggestion that dogs' assessment of the total value of multiple items is based, at least partly, on their average quality.

Suboptimal choice in rats: Incentive salience attribution promotes maladaptive decision-making

Stimuli that are more predictive of subsequent reward also function as better conditioned reinforcers. Moreover, stimuli attributed with incentive salience function as more robust conditioned reinforcers. Some theories have suggested that conditioned reinforcement plays an important role in promoting suboptimal choice behavior, like gambling. The present experiments examined how different stimuli, those attributed with incentive salience versus those without, can function in tandem with stimulus-reward predictive utility to promote maladaptive decision-making in rats. One group of rats had lights associated with goal-tracking as the reward-predictive stimuli and another had levers associated with sign-tracking as the reward-predictive stimuli. All rats were first trained on a choice procedure in which the expected value across both alternatives was equivalent but differed in their stimulus-reward predictive utility. Next, the expected value across both alternatives was systematically changed so that the alternative with greater stimulus-reward predictive utility was suboptimal in regard to primary reinforcement. The results demonstrate that in order to obtain suboptimal choice behavior, incentive salience alongside strong stimulus-reward predictive utility may be necessary; thus, maladaptive decision-making can be driven more by the value attributed to stimuli imbued with incentive salience that reliably predict a reward rather than the reward itself.

When good news leads to bad choices

Pigeons and other animals sometimes deviate from optimal choice behavior when given informative signals for delayed outcomes. For example, when pigeons are given a choice between an alternative that always leads to food after a delay and an alternative that leads to food only half of the time after a delay, preference changes dramatically depending on whether the stimuli during the delays are correlated with (signal) the outcomes or not. With signaled outcomes, pigeons show a much greater preference for the suboptimal alternative than with unsignaled outcomes. Key variables and research findings related to this phenomenon are reviewed, including the effects of durations of the choice and delay periods, probability of reinforcement, and gaps in the signal. We interpret the available evidence as reflecting a preference induced by signals for good news in a context of uncertainty. Other explanations are briefly summarized and compared.

When good pigeons make bad decisions: Choice with probabilistic delays and outcomes

Pigeons chose between an (optimal) alternative that sometimes provided food after a 10-s delay and other times after a 40-s delay and another (suboptimal) alternative that sometimes provided food after 10 s but other times no food after 40 s. When outcomes were not signaled during the delays, pigeons strongly preferred the optimal alternative. When outcomes were signaled, choices of the suboptimal alternative increased and most pigeons preferred the alternative that provided no food after the long delay despite the cost in terms of obtained food. The pattern of results was similar whether the short delays occurred on 25% or 50% of the trials. Shortening the 40-s delay to food sharply reduced suboptimal choices, but shortening the delay to no food had little effect. The results suggest that a signaled delay to no food does not punish responding in probabilistic choice procedures. The findings are discussed in terms of conditioned reinforcement by signals for good news.

A conceptual approach to practitioners’ health information literacy

Purpose

The purpose of this paper is to examine healthcare professionals’ own health literacy through the lenses of information behavior and evidence-based practice. These practitioners’ health information literacy is critical to client care.

Design/methodology/approach

This conceptual paper applies general and professional-specific models of information behavior and issues of bias to methods in which healthcare practitioners seek, evaluate and use research information within professional practice.

Findings

Case examples from library, medical and the broader healthcare literature are used to explore ways in which care professionals’ information behaviors align with or deviate from information behavior models and the role of different types of bias in their information behavior. Adaption of evidence-based practice precepts, already familiar to healthcare professionals, is proposed as a method to improve practitioners’ health information literacy.

Originality/value

Explorations of “health literacy” have primarily focused on healthcare consumers’ interactions with basic health information and services. The health literacy (and health information literacy) of care practitioners has received much less attention. By gaining a greater understanding of how information behaviors intersect with healthcare practitioners’ own health literacy, the librarians and educators who serve future and current care professionals can offer more informed information literacy instruction, enabling practitioners to provide improved patient care.

A test of stress, cues, and re-exposure to large wins as potential reinstaters of suboptimal decision making in rats

The present experiment investigated potential reinstaters of suboptimal economic decision making in rats. Rats were first trained on a version of the rat Gambling Task under conditions designed to promote choice of a suboptimal option that occasionally resulted in large “wins” (four sucrose pellets). In a second phase, preference for this economically suboptimal option was reduced by substantially increasing the probability of punishment when this option was chosen. Then, three events were tested for their ability to reinstate choice of the suboptimal option. A brief period of re-exposure to a high frequency of large wins significantly increased choice of the suboptimal option. The pharmacological stressor yohimbine did not reinstate suboptimal choice, but did increase impulsive action as indexed by premature responding. Presentation of cues previously associated with large wins did not alter behavior. Results suggest reinstaters of suboptimal choice may differ from reinstaters of extinguished drug- and food-seeking behavior.

The sunk cost effect in pigeons and people: a case of within-trials contrast?

Pigeons show the sunk cost effect in procedures in which their choice between two outcomes is biased by a prior investment. We review recent studies of the sunk cost effect in pigeons, in which choice procedures are analogous to studies with humans using hypothetical scenarios to make explicit a prior investment and the later choice. Zentall's (2010) theory of within-trial contrast can account for the sunk cost effect - an effortful prior investment contrasts with choice outcomes to increase the value of the outcome in which the prior investment was made. The account correctly predicts that in both pigeons and humans, increased prior investment increases the sunk cost effect. We present data from a study with humans using hypothetical scenarios in which delay was varied between the time of the prior investment and later choice. Extending the delay reduced the sunk cost effect, suggesting the need for a second process by which value is depreciated, in addition to the value-enhancing effect of contrast. This article is part of a Special Issue entitled: Tribute to Tom Zentall.