Choosing fast and simply: Construction of preferences by starlings through parallel option valuation

On the value of advanced information about delayed rewards

In a variety of laboratory preparations, several animal species prefer signaled over unsignaled outcomes. Here we examine whether pigeons prefer options that signal the delay to reward over options that do not and how this preference changes with the ratio of the delays. We offered pigeons repeated choices between two alternatives leading to a short or a long delay to reward. For one alternative (informative), the short and long delays were reliably signaled by different stimuli (e.g., SS for short delays, SL for long delays). For the other (non-informative), the delays were not reliably signaled by the stimuli presented (S1 and S2). Across conditions, we varied the durations of the short and long delays, hence their ratio, while keeping the average delay to reward constant. Pigeons preferred the informative over the non-informative option and this preference became stronger as the ratio of the long to the short delay increased. A modified version of the Δ-Σ hypothesis (González et al., J Exp Anal Behav 113(3):591-608. https://doi.org/10.1002/jeab.595 , 2020a) incorporating a contrast-like process between the immediacies to reward signaled by each stimulus accounted well for our findings. Functionally, we argue that a preference for signaled delays hinges on the potential instrumental advantage typically conveyed by information.

GoFish: A low-cost, open-source platform for closed-loop behavioural experiments on fish

Fish are the most species-rich vertebrate group, displaying vast ecological, anatomical and behavioural diversity, and therefore are of major interest for the study of behaviour and its evolution. However, with respect to other vertebrates, fish are relatively underrepresented in psychological and cognitive research. A greater availability of easily accessible, flexible, open-source experimental platforms that facilitate the automation of task control and data acquisition may help to reduce this bias and improve the scalability and refinement of behavioural experiments in a range of different fish species. Here we present GoFish, a fully automated platform for behavioural experiments in aquatic species. GoFish includes real-time video tracking of subjects, presentation of stimuli in a computer screen, an automatic feeder device, and closed-loop control of task contingencies and data acquisition. The design and software components of the platform are freely available, while the hardware is open-source and relatively inexpensive. The control software, Bonsai, is designed to facilitate rapid development of task workflows and is supported by a growing community of users. As an illustration and test of its use, we present the results of two experiments on discrimination learning, reversal, and choice in goldfish (Carassius auratus). GoFish facilitates the automation of high-throughput protocols and the acquisition of rich behavioural data. Our platform has the potential to become a widely used tool that facilitates complex behavioural experiments in aquatic species.

Paradoxical choice and the reinforcing value of information

Signals that reduce uncertainty can be valuable because well-informed decision-makers can better align their preferences to opportunities. However, some birds and mammals display an appetite for informative signals that cannot be used to increase returns. We explore the role that reward-predictive stimuli have in fostering such preferences, aiming at distinguishing between two putative underlying mechanisms. The 'information hypothesis' proposes that reducing uncertainty is reinforcing per se, somewhat consistently with the concept of curiosity: a motivation to know in the absence of tractable extrinsic benefits. In contrast, the 'conditioned reinforcement hypothesis', an associative account, proposes asymmetries in secondarily acquired reinforcement: post-choice stimuli announcing forthcoming rewards (S⁺) reinforce responses more than stimuli signalling no rewards (S^-) inhibit responses. In three treatments, rats faced two equally profitable options delivering food probabilistically after a fixed delay. In the informative option (Info), food or no food was signalled immediately after choice, whereas in the non-informative option (NoInfo) outcomes were uncertain until the delay lapsed. Subjects preferred Info when (1) both outcomes were explicitly signalled by salient auditory cues, (2) only forthcoming food delivery was explicitly signalled, and (3) only the absence of forthcoming reward was explicitly signalled. Acquisition was slower in (3), when food was not explicitly signalled, showing that signals for positive outcomes have a greater influence on the development of preference than signals for negative ones. Our results are consistent with an elaborated conditioned reinforcement account, and with the conjecture that both uncertainty reduction and conditioned reinforcement jointly act to generate preference.

Testing cognitive models of decision-making: selected studies with starlings

The behavioural sciences are home to controversies that have survived for centuries, notably about the relation between observable behaviour and theoretical constructs addressing out-of-sight processes in the agents' brains. There is no shared definition for cognition, but the very existence of a thriving journal called Animal Cognition proves that such controversies are still live and help to (a) promote research on the complexity of processes leading to action, and (b) nudge scholars to restrict their cognitive models to those that can be falsified experimentally. Here, we illustrate some of these issues in a limited arena, focusing on the construction and expression of subjective value and choice. Using mainly work from our own laboratory, we show that valuation of alternatives is sensitive to options' properties, to subject's state, and to background alternatives. These factors exert their influence at the time the subject learns about individual options, rather than at choice time. We also show that valuation can be experimentally dissociated from the cognitive representation of options' metrics and argue that experimental animals process options independently at the time of choice, without elaborated comparisons along different dimensions. The findings we report are not consistent with the hypothesis that preference is constructed at the time of choice, a prevalent view in human decision-making research. We argue that animal cognition, viewed as a research program at the crossroads of different behavioural sciences rather than as a debate about properties of mental life, is inspiring and solid, and a progressive and progressing paradigm.

Probing the decision-making mechanisms underlying choice between drug and nondrug rewards in rats

Delineating the decision-making mechanisms underlying choice between drug and nondrug rewards remains a challenge. This study adopts an original approach to probe these mechanisms by comparing response latencies during sampling versus choice trials. While lengthening of latencies during choice is predicted in a deliberative choice model (DCM), the race-like response competition mechanism postulated by the Sequential choice model (SCM) predicts a shortening of latencies during choice compared to sampling. Here, we tested these predictions by conducting a retrospective analysis of cocaine-versus-saccharin choice experiments conducted in our laboratory. We found that rats engage deliberative decision-making mechanisms after limited training, but adopt a SCM-like response selection mechanism after more extended training, while their behavior is presumably habitual. Thus, the DCM and SCM may not be general models of choice, as initially formulated, but could be dynamically engaged to control choice behavior across early and extended training.