Reward currency modulates human risk preferences

Flexible information-seeking in chimpanzees

Humans can flexibly use metacognition to monitor their own knowledge and strategically acquire new information when needed. While humans can deploy these skills across a variety of contexts, most evidence for metacognition in animals has focused on simple situations, such as seeking out information about the location of food. Here, we examine the flexibility, breadth, and limits of this skill in chimpanzees. We tested semi-free-ranging chimpanzees on a novel task where they could seek information by standing up to peer into different containers. In Study 1, we tested n = 47 chimpanzees to assess if chimpanzees would spontaneously engage in information-seeking without prior experience, as well as to characterize individual variation in this propensity. We found that many chimpanzees engaged in information-seeking with minimal experience, and that younger chimpanzees and females were more likely to do so. In two subsequent studies, we then further tested chimpanzees who initially showed robust information-seeking on new variations of this task, to disentangle the cognitive processing shaping their behaviors. In Study 2, we examined how a subset of n = 12 chimpanzees applied these skills to seek information about the location versus the identity of rewards, and found that chimpanzees were equally adept at seeking out location and identity information. In Study 3, we examined whether a subset of n = 6 chimpanzees could apply these skills to make more efficacious decisions when faced with uncertainty about reward payoffs. Chimpanzees were able to use information-seeking to resolve risk and choose more optimally when faced with uncertain payoffs, although they often also engaged in information-seeking when it was not strictly necessary. These results identify core features of flexible metacognition that chimpanzees share with humans, as well as constraints that may represent key evolutionary shifts in human cognition.

A critical review of risk-sensitive foraging

Foraging is risk sensitive if choices depend on the variability of returns from the options as well as their mean return. Risk-sensitive foraging is important in behavioural ecology, psychology and neurophysiology. It has been explained both in terms of mechanisms and in terms of evolutionary advantage. We provide a critical review, evaluating both mechanistic and evolutionary accounts. Some derivations of risk sensitivity from mechanistic models based on psychophysics are not convincing because they depend on an inappropriate use of Jensen's inequality. Attempts have been made to link risk sensitivity to the ecology of a species, but again these are not convincing. The field of risk-sensitive foraging has provided a focus for theoretical and empirical work and has yielded important insights, but we lack a simple and empirically defendable general account of it in either mechanistic or evolutionary terms. However, empirical analysis of choice sequences under theoretically motivated experimental designs and environmental settings appears a promising avenue for mapping the scope and relative merits of existing theories. Simply put, the devil is in the sequence.

Chimpanzee and Human Risk Preferences Show Key Similarities

Risk preference impacts how people make key life decisions related to health, wealth, and well-being. Systematic variations in risk-taking behavior can be the result of differences in fitness expectations, as predicted by life-history theory. Yet the evolutionary roots of human risk-taking behavior remain poorly understood. Here, we studied risk preferences of chimpanzees (86 Pan troglodytes; 47 females; age = 2-40 years) using a multimethod approach that combined observer ratings with behavioral choice experiments. We found that chimpanzees' willingness to take risks shared structural similarities with that of humans. First, chimpanzees' risk preference manifested as a traitlike preference that was consistent across domains and measurements. Second, chimpanzees were ambiguity averse. Third, males were more risk prone than females. Fourth, the appetite for risk showed an inverted-U-shaped relation to age and peaked in young adulthood. Our findings suggest that key dimensions of risk preference appear to emerge independently of the influence of human cultural evolution.

Rationality and cognitive bias in captive gorillas' and orang-utans' economic decision-making

Human economic decision-making sometimes appears to be irrational. Partly, this is due to cognitive biases that can lead to suboptimal economic choices and context-dependent risk-preferences. A pertinent question is whether such biases are part of our evolutionary heritage or whether they are culturally acquired. To address this, we tested gorillas (Gorilla gorilla gorilla) and orang-utans (Pongo abelii) with two risk-assessment experiments that differed in how risk was presented. For both experiments, we found that subjects increased their preferences for the risky options as their expected gains increased, showing basic understanding of reward contingencies and rational decision-making. However, we also found consistent differences in risk proneness between the two experiments, as subjects were risk-neutral in one experiment and risk-prone in the other. We concluded that gorillas and orang-utans are economically rational but that their decisions can interact with pre-existing cognitive biases which modulates their risk-preference in context-dependent ways, explaining the variability of their risk-preference in previous literature.

Reward type influences adults’ rejections of inequality in a task designed for children

In the context of economic games, adults sacrifice money to avoid unequal outcomes, showing so-called inequity aversion. Child-friendly adaptations of these games have shown that children, too, show inequity aversion. Moreover, inequity aversion shows a clear developmental trajectory, with young children rejecting only disadvantageously unequal distributions and older children rejecting both disadvantageously and advantageously unequal distributions. However, based on existing work, it is difficult to compare adult and child responses to inequity because (1) adapting economic games to make them child-friendly may importantly alter the dynamics of the fairness interaction and (2) adult work typically uses abstract rewards such as money while work with children typically uses more concrete rewards like candy, stickers or toys. Here we adapted the Inequity Game—a paradigm designed to study children’s responses to inequality in isolation from other concerns—to test inequity aversion in adults (N = 104 pairs). We manipulated whether participants made decisions about concrete rewards (candy) or abstract rewards (tokens that could be traded in for money). We found that, like children, adults rejected unequal payoffs in this task. Additionally, we found that reward type mattered: adults rejected disadvantageous—but not advantageous—monetary distributions, yet rejected both disadvantageous and advantageous candy distributions. These findings allow us to draw clearer comparisons across child and adult responses to unfairness and help paint a fuller picture of inequity aversion in humans.

Discounting for Money, Food, and Sex, over the Menstrual Cycle

Sexual desire, physical activity, economic choices and other behaviours fluctuate over the menstrual cycle. However, we have an incomplete understanding of how preferences for smaller sooner or larger later rewards (known as delay discounting) change over the menstrual cycle. In this pre-registered, cross-sectional study, Bayesian linear and quadratic binomial regression analyses provide compelling evidence that delay discounting does change over the menstrual cycle. Data from 203 naturally cycling women show increased discounting (preference for more immediate rewards) mid-cycle, which is at least partially driven by changes in fertility. This study provides evidence for a robust and broad-spectrum increase in delay discounting (Cohen’s h ranging from 0.1 to 0.4) around the fertile point in the menstrual cycle across multiple commodities (money, food, and sex). We also show, for the first time, that discounting changes over the menstrual cycle in a pseudo-control group of 99 women on hormonal contraception. Interestingly, such women increase their discounting of sex toward the end of the menstrual phase — possibly reflecting a prioritisation of bonding-related sexual activity before menstrual onset.

Dopaminergic modulation of reward discounting in healthy rats: a systematic review and meta-analysis

RATIONALE

Although numerous studies have suggested that pharmacological alteration of the dopamine (DA) system modulates reward discounting, these studies have produced inconsistent findings.

OBJECTIVES

Here, we conducted a systematic review and pre-registered meta-analysis to evaluate DA drug-mediated effects on reward discounting of time, probability, and effort costs in studies of healthy rats. This produced a total of 1343 articles to screen for inclusion/exclusion. From the literature, we identified 117 effects from approximately 1549 individual rats.

METHODS

Using random effects with maximum-likelihood estimation, we meta-analyzed placebo-controlled drug effects for (1) DA D1-like receptor agonists and (2) antagonists, (3) D2-like agonists and (4) antagonists, and (5) DA transporter-modulating drugs.

RESULTS

Meta-analytic effects showed that DAT-modulating drugs decreased reward discounting. While D1-like and D2-like antagonists both increased discounting, agonist drugs for those receptors had no significant effect on discounting behavior. A number of these effects appear contingent on study design features like cost type, rat strain, and microinfusion location.

CONCLUSIONS

These findings suggest a nuanced relationship between DA and discounting behavior and urge caution when drawing generalizations about the effects of pharmacologically manipulating dopamine on reward-based decision-making.

Variation in primate decision-making under uncertainty and the roots of human economic behaviour

Uncertainty is a ubiquitous component of human economic behaviour, yet people can vary in their preferences for risk across populations, individuals and different points in time. As uncertainty also characterizes many aspects of animal decision-making, comparative research can help evaluate different potential mechanisms that generate this variation, including the role of biological differences or maturational change versus cultural learning, as well as identify human-unique components of economic decision-making. Here, we examine decision-making under risk across non-human primates, our closest relatives. We first review theoretical approaches and current methods for understanding decision-making in animals. We then assess the current evidence for variation in animal preferences between species and populations, between individuals based on personality, sex and age, and finally, between different contexts and individual states. We then use these primate data to evaluate the processes that can shape human decision-making strategies and identify the primate foundations of human economic behaviour. This article is part of the theme issue 'Existence and prevalence of economic behaviours among non-human primates'.

Contextual factors modulate risk preferences in adult humans

Humans have generally been considered risk averse for gains. Yet, growing evidence shows that risk preferences may change across reward currencies and depend on the type of tasks used to measure them. Here, we examined how context affects human risk preferences to shed light on the psychological mechanisms underlying human decision-making under risk. Participants were presented with a descriptive risky choice task involving repeated choices between real options and they were provided with trial-by-trial feedback. We manipulated the type of reward and, for the first time, the format of the choice stimuli. Options were either 2D computer-based images or concrete 3D objects, and participants received food or money as reward. First, we found that participants were more risk-seeking for food compared to money, suggesting that people treat money differently from consumable rewards. Second, we found that people were more risk-seeking when they made choices between concrete 3D objects than between 2D computer-based images. Our results strengthened the evidence that human choice patterns may change depending on the context and, for the first time, showed that the format of the choice stimuli does affect risk preferences, an important consideration for future research.

Motivated Cognition: Effects of Reward, Emotion, and Other Motivational Factors Across a Variety of Cognitive Domains

A growing body of literature has demonstrated that motivation influences cognitive processing. The breadth of these effects is extensive and span influences of reward, emotion, and other motivational processes across all cognitive domains. As examples, this scope includes studies of emotional memory, value-based attentional capture, emotion effects on semantic processing, reward-related biases in decision making, and the role of approach/avoidance motivation on cognitive scope. Additionally, other less common forms of motivation–cognition interactions, such as self-referential and motoric processing can also be considered instances of motivated cognition. Here I outline some of the evidence indicating the generality and pervasiveness of these motivation influences on cognition, and introduce the associated ‘research nexus’ at Collabra: Psychology.