Visual fixations and the computation and comparison of value in simple choice

Orbitofrontal Cortex: A Neural Circuit for Economic Decisions

Economic choice behavior entails the computation and comparison of subjective values. A central contribution of neuroeconomics has been to show that subjective values are represented explicitly at the neuronal level. With this result at hand, the field has increasingly focused on the difficult question of where in the brain and how exactly subjective values are compared to make a decision. Here, we review a broad range of experimental and theoretical results suggesting that good-based decisions are generated in a neural circuit within the orbitofrontal cortex (OFC). The main lines of evidence supporting this proposal include the fact that goal-directed behavior is specifically disrupted by OFC lesions, the fact that different groups of neurons in this area encode the input and the output of the decision process, the fact that activity fluctuations in each of these cell groups correlate with choice variability, and the fact that these groups of neurons are computationally sufficient to generate decisions. Results from other brain regions are consistent with the idea that good-based decisions take place in OFC and indicate that value signals inform a variety of mental functions. We also contrast the present proposal with other leading models for the neural mechanisms of economic decisions. Finally, we indicate open questions and suggest possible directions for future research.

Why Do Irrelevant Alternatives Matter? An fMRI-TMS Study of Context-Dependent Preferences

Both humans and animals are known to exhibit a violation of rationality known as "decoy effect": introducing an irrelevant option (a decoy) can influence choices among other (relevant) options. Exactly how and why decoys trigger this effect is not known. It may be an example of fast heuristic decision-making, which is adaptive in natural environments, but may lead to biased choices in certain markets or experiments. We used fMRI and transcranial magnetic stimulation to investigate the neural underpinning of the decoy effect of both sexes. The left ventral striatum was more active when the chosen option dominated the decoy. This is consistent with the hypothesis that the presence of a decoy option influences the valuation of other options, making valuation context-dependent even when choices appear fully rational. Consistent with the idea that control is recruited to prevent heuristics from producing biased choices, the right inferior frontal gyrus, often implicated in inhibiting prepotent responses, connected more strongly with the striatum when subjects successfully overrode the decoy effect and made unbiased choices. This is further supported by our transcranial magnetic stimulation experiment: subjects whose right inferior frontal gyrus was temporarily disrupted made biased choices more often than a control group. Our results suggest that the neural basis of the decoy effect could be the context-dependent activation of the valuation area. But the differential connectivity from the frontal area may indicate how deliberate control monitors and corrects errors and biases in decision-making.SIGNIFICANCE STATEMENT Standard theories of rational decision-making assume context-independent valuations of available options. Motivated by the importance of this basic assumption, we used fMRI to study how the human brain assigns values to available options. We found activity in the valuation area to be consistent with the hypothesis that values depend on irrelevant aspects of the environment, even for subjects whose choices appear fully rational. Such context-dependent valuations may lead to biased decision-making. We further found differential connectivity from the frontal area to the valuation area depending on whether biases were successfully overcome. This suggests a mechanism for making rational choices despite the potential bias. Further support was obtained by a transcranial magnetic stimulation experiment, where subjects whose frontal control was temporarily disrupted made biased choices more often than a control group.

A novel approach to studying strategic decisions with eye-tracking and machine learning

We propose a novel method of using eye-tracking to study strategic decisions. The conventional approach is to hypothesize what eye-patterns should be observed if a given model of decision-making was accurate, and then proceed to verify if this occurs. When such hypothesis specification is difficult a priori, we propose instead to expose subjects to a variant of the original strategic task that should induce processing it in a way consistent with the postulated model. It is then possible to use machine learning pattern recognition techniques to check if the associated eye-patterns are similar to those recorded during the original task. We illustrate the method using simple examples of 2x2 matching-pennies and coordination games with or without feedback about the counterparts’ past moves. We discuss the strengths and limitations of the method in this context.

Optimal coding and neuronal adaptation in economic decisions

During economic decisions, offer value cells in orbitofrontal cortex (OFC) encode the values of offered goods. Furthermore, their tuning functions adapt to the range of values available in any given context. A fundamental and open question is whether range adaptation is behaviorally advantageous. Here we present a theory of optimal coding for economic decisions. We propose that the representation of offer values is optimal if it ensures maximal expected payoff. In this framework, we examine offer value cells in non-human primates. We show that their responses are quasi-linear even when optimal tuning functions are highly non-linear. Most importantly, we demonstrate that for linear tuning functions range adaptation maximizes the expected payoff. Thus value coding in OFC is functionally rigid (linear tuning) but parametrically plastic (range adaptation with optimal gain). Importantly, the benefit of range adaptation outweighs the cost of functional rigidity. While generally suboptimal, linear tuning may facilitate transitive choices.

Process-Tracing Methods in Decision Making: On Growing Up in the 70s

Decision research has experienced a shift from simple algebraic theories of choice to an appreciation of mental processes underlying choice. A variety of process-tracing methods has helped researchers test these process explanations. Here, we provide a survey of these methods, including specific examples for subject reports, movement-based measures, peripheral psychophysiology, and neural techniques. We show how these methods can inform phenomena as varied as attention, emotion, strategy use, and understanding neural correlates. Two important future developments are identified: broadening the number of explicit tests of proposed processes through formal modeling and determining standards and best practices for data collection.

Value-based decision making via sequential sampling with hierarchical competition and attentional modulation

In principle, formal dynamical models of decision making hold the potential to represent fundamental computations underpinning value-based (i.e., preferential) decisions in addition to perceptual decisions. Sequential-sampling models such as the race model and the drift-diffusion model that are grounded in simplicity, analytical tractability, and optimality remain popular, but some of their more recent counterparts have instead been designed with an aim for more feasibility as architectures to be implemented by actual neural systems. Connectionist models are proposed herein at an intermediate level of analysis that bridges mental phenomena and underlying neurophysiological mechanisms. Several such models drawing elements from the established race, drift-diffusion, feedforward-inhibition, divisive-normalization, and competing-accumulator models were tested with respect to fitting empirical data from human participants making choices between foods on the basis of hedonic value rather than a traditional perceptual attribute. Even when considering performance at emulating behavior alone, more neurally plausible models were set apart from more normative race or drift-diffusion models both quantitatively and qualitatively despite remaining parsimonious. To best capture the paradigm, a novel six-parameter computational model was formulated with features including hierarchical levels of competition via mutual inhibition as well as a static approximation of attentional modulation, which promotes "winner-take-all" processing. Moreover, a meta-analysis encompassing several related experiments validated the robustness of model-predicted trends in humans' value-based choices and concomitant reaction times. These findings have yet further implications for analysis of neurophysiological data in accordance with computational modeling, which is also discussed in this new light.

A Spotlight on Reward

Research published in this issue of Neuron from McGinty et al. (2016) suggests that attention may help bind information about value to specific options in economic choice. Responses of orbitofrontal neurons are strongly modulated by the distance from gaze to the position of a reward-predicting target.

Search predicts and changes patience in intertemporal choice

People often make decisions with consequences that unfold over time. When facing such intertemporal choices, people use different search strategies. We examine how these search strategies differ and how they relate to patience in intertemporal choice. We demonstrate that search varies substantially across individuals and identify two main search strategies—comparative or integrative search. Importantly, comparative search correlates with greater patience and higher susceptibility to contextual influences on choice. We manipulated search using an unobtrusive technique, revealing a causal relationship between strategy and choice. Comparative searchers make more patient choices and exhibit larger framing effects than integrative searchers. An understanding of how differences in psychological processes change discounting can inform the design of behavioral interventions to improve consumer welfare.

Intertemporal choice impacts many important outcomes, such as decisions about health, education, wealth, and the environment. However, the psychological processes underlying decisions involving outcomes at different points in time remain unclear, limiting opportunities to intervene and improve people’s patience. This research examines information-search strategies used during intertemporal choice and their impact on decisions. In experiment 1, we demonstrate that search strategies vary substantially across individuals. We subsequently identify two distinct search strategies across individuals. Comparative searchers, who compare features across options, discount future options less and are more susceptible to acceleration versus delay framing than integrative searchers, who integrate the features of an option. Experiment 2 manipulates search using an unobtrusive method to establish a causal relationship between strategy and choice, randomly assigning participants to conditions promoting either comparative or integrative search. Again, comparative search promotes greater patience than integrative search. Additionally, when participants adopt a comparative search strategy, they also exhibit greater effects of acceleration versus delay framing. Although most participants reported that the manipulation did not change their behavior, promoting comparative search decreased discounting of future rewards substantially and speeded patient choices. These findings highlight the central role that heterogeneity in psychological processes plays in shaping intertemporal choice. Importantly, these results indicate that theories that ignore variability in search strategies may be inadvertently aggregating over different subpopulations that use very different processes. The findings also inform interventions in choice architecture to increase patience and improve consumer welfare.

Individual differences in responsivity to social rewards: Insights from two eye-tracking tasks

Humans generally prefer social over nonsocial stimuli from an early age. Reduced preference for social rewards has been observed in individuals with autism spectrum conditions (ASC). This preference has typically been noted in separate tasks that measure orienting toward and engaging with social stimuli. In this experiment, we used two eye-tracking tasks to index both of these aspects of social preference in in 77 typical adults. We used two measures, global effect and preferential looking time. The global effect task measures saccadic deviation toward a social stimulus (related to ‘orienting’), while the preferential looking task records gaze duration bias toward social stimuli (relating to ‘engaging’). Social rewards were found to elicit greater saccadic deviation and greater gaze duration bias, suggesting that they have both greater salience and higher value compared to nonsocial rewards. Trait empathy was positively correlated with the measure of relative value of social rewards, but not with their salience. This study thus elucidates the relationship of empathy with social reward processing.

Effects of acute alcohol ingestion on eye movements and cognition: A double-blind, placebo-controlled study

Alcohol is one of the most consumed psychoactive substances in the world, and the negative impact related to alcohol use has become a worldwide public health issue. Alcohol is able to affect diffusely several areas of the Central Nervous System, which could impair visual functions, including eye movements, and cognitive processes. The objective of the present study was to investigate the effects of moderate alcohol intake in eyes movements, as an indicator of cognitive processing underlying the visual search in a the Maze task. We investigated the concentration of 0.08% blood alcohol concentration (BAC), using an intra-subject, double-blind, and placebo-controlled experimental design with a sample size of 20 young adults (11 men and nine women). All volunteers participated in both conditions, i.e., alcohol (0.08%) and placebo (0.00%), in a counterbalanced order. We use the Tobii TX300 eye tracker to evaluate eye movements during completion of Visual Maze Test. The results showed significant differences in the following eye movement patterns: the first fixation latency, number and duration of fixations (mean and total), the number and duration of saccades (mean and total), and the total execution time in the test. In addition, we investigate the areas of interest (AOI), decision points in which the participant must decide which course to follow. We verified that the participants in the alcohol condition had a significantly greater number of fixations in both AOI, in comparison to the placebo condition. Overall, our findings confirm that moderate doses of alcohol can change the eye movements of young adults. These alterations may evidence the influence of alcohol in cognitive processes, such as flexibility, attention, and planning, which are required during resolution of Maze Task.

Loss Aversion Reflects Information Accumulation, Not Bias: A Drift-Diffusion Model Study

Defined as increased sensitivity to losses, loss aversion is often conceptualized as a cognitive bias. However, findings that loss aversion has an attentional or emotional regulation component suggest that it may instead reflect differences in information processing. To distinguish these alternatives, we applied the drift-diffusion model (DDM) to choice and response time (RT) data in a card gambling task with unknown risk distributions. Loss aversion was measured separately for each participant. Dividing the participants into terciles based on loss aversion estimates, we found that the most loss-averse group showed a significantly lower drift rate than the other two groups, indicating overall slower uptake of information. In contrast, neither the starting bias nor the threshold separation (barrier) varied by group, suggesting that decision thresholds are not affected by loss aversion. These results shed new light on the cognitive mechanisms underlying loss aversion, consistent with an account based on information accumulation.

Self-Control as Value-Based Choice

Self-control is often conceived as a battle between "hot" impulsive processes and "cold" deliberative ones. Heeding the angel on one shoulder leads to success; following the demon on the other leads to failure. Self-control feels like a duality. What if that sensation is misleading, and, despite how they feel, self-control decisions are just like any other choice? We argue that self-control is a form of value-based choice wherein options are assigned a subjective value and a decision is made through a dynamic integration process. We articulate how a value-based choice model of self-control can capture its phenomenology and account for relevant behavioral and neuroscientific data. This conceptualization of self-control links divergent scientific approaches, allows for more robust and precise hypothesis testing, and suggests novel pathways to improve self-control.

Continuous track paths reveal additive evidence integration in multistep decision making

Multistep decision making pervades daily life, but its underlying mechanisms remain obscure. We distinguish four prominent models of multistep decision making, namely serial stage, hierarchical evidence integration, hierarchical leaky competing accumulation (HLCA), and probabilistic evidence integration (PEI). To empirically disentangle these models, we design a two-step reward-based decision paradigm and implement it in a reaching task experiment. In a first step, participants choose between two potential upcoming choices, each associated with two rewards. In a second step, participants choose between the two rewards selected in the first step. Strikingly, as predicted by the HLCA and PEI models, the first-step decision dynamics were initially biased toward the choice representing the highest sum/mean before being redirected toward the choice representing the maximal reward (i.e., initial dip). Only HLCA and PEI predicted this initial dip, suggesting that first-step decision dynamics depend on additive integration of competing second-step choices. Our data suggest that potential future outcomes are progressively unraveled during multistep decision making.

Noisy preferences in risky choice: A cautionary note

We examine the effects of multiple sources of noise in risky decision making. Noise in the parameters that characterize an individual's preferences can combine with noise in the response process to distort observed choice proportions. Thus, underlying preferences that conform to expected value maximization can appear to show systematic risk aversion or risk seeking. Similarly, core preferences that are consistent with expected utility theory, when perturbed by such noise, can appear to display nonlinear probability weighting. For this reason, modal choices cannot be used simplistically to infer underlying preferences. Quantitative model fits that do not allow for both sorts of noise can lead to wrong conclusions. (PsycINFO Database Record

Final Sampling Bias in Haptic Judgments: How Final Touch Affects Decision-Making

When people make a choice between multiple items, they usually evaluate each item one after the other repeatedly. The effect of the order and number of evaluating items on one’s choices is essential to understanding the decision-making process. Previous studies have shown that when people choose a favorable item from two items, they tend to choose the item that they evaluated last. This tendency has been observed regardless of sensory modalities. This study investigated the origin of this bias by using three experiments involving two-alternative forced-choice tasks using handkerchiefs. First, the bias appeared in a smoothness discrimination task, which indicates that the bias was not based on judgments of preference. Second, the handkerchief that was touched more often tended to be chosen more frequently in the preference task, but not in the smoothness discrimination task, indicating that a mere exposure effect enhanced the bias. Third, in the condition where the number of touches did not differ between handkerchiefs, the bias appeared when people touched a handkerchief they wanted to touch last, but not when people touched the handkerchief that was predetermined. This finding suggests a direct coupling between final voluntary touching and judgment.

Nutrition labeling reduces valuations of food through multiple health and taste channels

One popularized technique to promote healthy dietary choice involves posting calorie or other nutritional information at the time individuals make a consumption decision. While the evidence on the effectiveness of such interventions is mixed, relatively little work has focused on the underlying mechanisms of how such labels alter behavior. In the research reported here, we asked 87 hungry laboratory subjects to make bids over foods with or without nutrition labels present. We found that the presence of a nutrition label reduced bids by an average of 25 cents. Furthermore, we found this reduction was driven by differences in perceptions and the importance individuals placed on health features of the foods, but also by differences in the importance individuals placed on more visceral taste features. These results help explain the various methods in which nutritional information postings or other policy tools can nudge individuals to consume healthier options.

The Attentional Drift Diffusion Model of Simple Perceptual Decision-Making

Perceptual decisions requiring the comparison of spatially distributed stimuli that are fixated sequentially might be influenced by fluctuations in visual attention. We used two psychophysical tasks with human subjects to investigate the extent to which visual attention influences simple perceptual choices, and to test the extent to which the attentional Drift Diffusion Model (aDDM) provides a good computational description of how attention affects the underlying decision processes. We find evidence for sizable attentional choice biases and that the aDDM provides a reasonable quantitative description of the relationship between fluctuations in visual attention, choices and reaction times. We also find that exogenous manipulations of attention induce choice biases consistent with the predictions of the model.

Multi-attribute, multi-alternative models of choice: Choice, reaction time, and process tracing

The first aim of this research is to compare computational models of multi-alternative, multi-attribute choice when attribute values are explicit. The choice predictions of utility (standard random utility & weighted valuation), heuristic (elimination-by-aspects, lexicographic, & maximum attribute value), and dynamic (multi-alternative decision field theory, MDFT, & a version of the multi-attribute linear ballistic accumulator, MLBA) models are contrasted on both preferential and risky choice data. Using both maximum likelihood and cross-validation fit measures on choice data, the utility and dynamic models are preferred over the heuristic models for risky choice, with a slight overall advantage for the MLBA for preferential choice. The response time predictions of these models (except the MDFT) are then tested. Although the MLBA accurately predicts response time distributions, it only weakly accounts for stimulus-level differences. The other models completely fail to account for stimulus-level differences. Process tracing measures, i.e., eye and mouse tracking, were also collected. None of the qualitative predictions of the models are completely supported by that data. These results suggest that the models may not appropriately represent the interaction of attention and preference formation. To overcome this potential shortcoming, the second aim of this research is to test preference-formation assumptions, independently of attention, by developing the models of attentional sampling (MAS) model family which incorporates the empirical gaze patterns into a sequential sampling framework. An MAS variant that includes attribute values, but only updates the currently viewed alternative and does not contrast values across alternatives, performs well in both experiments. Overall, the results support the dynamic models, but point to the need to incorporate a framework that more accurately reflects the relationship between attention and the preference-formation process.

Finding the "self" in self-regulation: The identity-value model

Many psychological theories suggest a link between self-regulation and identity, but until now a mechanistic account that suggests ways to improve self-regulation has not been put forth. The identity-value model (IVM) connects the idea from social psychology, that aspects of identity such as core values and group affiliations hold positive subjective value, to the process-focused account from decision-making and behavioral economics, that self-regulation is driven by a dynamic value integration across a range of choice attributes. Together, these ideas imply that goal-directed behaviors that are identity-relevant are more likely to be enacted because they have greater subjective value than identity-irrelevant behaviors. A central hypothesis, therefore, is that interventions that increase the degree to which a target behavior is perceived as self-relevant will improve self-regulation. Additionally, identity-based changes in self-regulation are expected to be mediated by changes in subjective value and its underlying neural systems. In this paper, we define the key constructs relevant to the IVM, explicate the model and delineate its boundary conditions, and describe how it fits with related theories. We also review disparate results in the research literature that might share identity-related value as a common underlying mechanism of action. We close by discussing questions about the model whose answers could advance the study of self-regulation.

Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments

Little is known about the relationship between attention and learning during decision making. Using eye tracking and multivariate pattern analysis of fMRI data, we measured participants' dimensional attention as they performed a trial-and-error learning task in which only one of three stimulus dimensions was relevant for reward at any given time. Analysis of participants' choices revealed that attention biased both value computation during choice and value update during learning. Value signals in the ventromedial prefrontal cortex and prediction errors in the striatum were similarly biased by attention. In turn, participants' focus of attention was dynamically modulated by ongoing learning. Attentional switches across dimensions correlated with activity in a frontoparietal attention network, which showed enhanced connectivity with the ventromedial prefrontal cortex between switches. Our results suggest a bidirectional interaction between attention and learning: attention constrains learning to relevant dimensions of the environment, while we learn what to attend to via trial and error.

Metacognitive impairments extend perceptual decision making weaknesses in compulsivity

Awareness of one's own abilities is of paramount importance in adaptive decision making. Psychotherapeutic theories assume such metacognitive insight is impaired in compulsivity, though this is supported by scant empirical evidence. In this study, we investigate metacognitive abilities in compulsive participants using computational models, where these enable a segregation between metacognitive and perceptual decision making impairments. We examined twenty low-compulsive and twenty high-compulsive participants, recruited from a large population-based sample, and matched for other psychiatric and cognitive dimensions. Hierarchical computational modelling of the participants' metacognitive abilities on a visual global motion detection paradigm revealed that high-compulsive participants had a reduced metacognitive ability. This impairment was accompanied by a perceptual decision making deficit whereby motion-related evidence was accumulated more slowly in high compulsive participants. Our study shows that the compulsivity spectrum is associated with a reduced ability to monitor one's own performance, over and above any perceptual decision making difficulties.

A Two-Stage Process Model of Sensory Discrimination: An Alternative to Drift-Diffusion

Discrimination of the direction of motion of a noisy stimulus is an example of sensory discrimination under uncertainty. For stimuli that are extended in time, reaction time is quicker for larger signal values (e.g., discrimination of opposite directions of motion compared with neighboring orientations) and larger signal strength (e.g., stimuli with higher contrast or motion coherence, that is, lower noise). The standard model of neural responses (e.g., in lateral intraparietal cortex) and reaction time for discrimination is drift-diffusion. This model makes two clear predictions. (1) The effects of signal strength and value on reaction time should interact multiplicatively because the diffusion process depends on the signal-to-noise ratio. (2) If the diffusion process is interrupted, as in a cued-response task, the time to decision after the cue should be independent of the strength of accumulated sensory evidence. In two experiments with human participants, we show that neither prediction holds. A simple alternative model is developed that is consistent with the results. In this estimate-then-decide model, evidence is accumulated until estimation precision reaches a threshold value. Then, a decision is made with duration that depends on the signal-to-noise ratio achieved by the first stage.

SIGNIFICANCE STATEMENT

Sensory decision-making under uncertainty is usually modeled as the slow accumulation of noisy sensory evidence until a threshold amount of evidence supporting one of the possible decision outcomes is reached. Furthermore, it has been suggested that this accumulation process is reflected in neural responses, e.g., in lateral intraparietal cortex. We derive two behavioral predictions of this model and show that neither prediction holds. We introduce a simple alternative model in which evidence is accumulated until a sufficiently precise estimate of the stimulus is achieved, and then that estimate is used to guide the discrimination decision. This model is consistent with the behavioral data.

Choice Rules and Accumulator Networks

This article presents a preference accumulation model that can be used to implement a number of different multi-attribute heuristic choice rules, including the lexicographic rule, the majority of confirming dimensions (tallying) rule and the equal weights rule. The proposed model differs from existing accumulators in terms of attribute representation: Leakage and competition, typically applied only to preference accumulation, are also assumed to be involved in processing attribute values. This allows the model to perform a range of sophisticated attribute-wise comparisons, including comparisons that compute relative rank. The ability of a preference accumulation model composed of leaky competitive networks to mimic symbolic models of heuristic choice suggests that these 2 approaches are not incompatible, and that a unitary cognitive model of preferential choice, based on insights from both these approaches, may be feasible.

Decision Making and Sequential Sampling from Memory

Decisions take time, and as a rule more difficult decisions take more time. But this only raises the question of what consumes the time. For decisions informed by a sequence of samples of evidence, the answer is straightforward: more samples are available with more time. Indeed, the speed and accuracy of such decisions are explained by the accumulation of evidence to a threshold or bound. However, the same framework seems to apply to decisions that are not obviously informed by sequences of evidence samples. Here, we proffer the hypothesis that the sequential character of such tasks involves retrieval of evidence from memory. We explore this hypothesis by focusing on value-based decisions and argue that mnemonic processes can account for regularities in choice and decision time. We speculate on the neural mechanisms that link sampling of evidence from memory to circuits that represent the accumulated evidence bearing on a choice. We propose that memory processes may contribute to a wider class of decisions that conform to the regularities of choice-reaction time predicted by the sequential sampling framework.

Demotivating incentives and motivation crowding out in charitable giving

Research has shown that extrinsic incentives can crowd out intrinsic motivation in many contexts. Despite this, many nonprofits offer conditional thank-you gifts, such as mugs or tote bags, in exchange for donations. In collaboration with a nonprofit, this study implements a direct mail field experiment and demonstrates that thank-you gifts reduced donation rates in a fundraising campaign. Attention-based multiattribute choice models suggest that this is because prospective donors shift attention to the salient gift offer, causing them to underweight less salient intrinsic motives. Attention to the gift may also cause individuals to adopt a more cost-benefit mindset, further de-emphasizing intrinsic motives. Consistent with these hypotheses, crowding out was driven by those who donated higher amounts in the previous year (i.e., those who likely had higher intrinsic motivation). In a complementary online experiment, thank-you gifts also reduced donation rates but only when the gift was visually salient. This corroborates the mediating role of attention in crowding out. Taken together, the laboratory and field results demonstrate that this fundraising technique can be demotivating in some contexts and that this may occur through an attention-based mechanism.

Reminders of past choices bias decisions for reward in humans

We provide evidence that decisions are made by consulting memories for individual past experiences, and that this process can be biased in favour of past choices using incidental reminders. First, in a standard rewarded choice task, we show that a model that estimates value at decision-time using individual samples of past outcomes fits choices and decision-related neural activity better than a canonical incremental learning model. In a second experiment, we bias this sampling process by incidentally reminding participants of individual past decisions. The next decision after a reminder shows a strong influence of the action taken and value received on the reminded trial. These results provide new empirical support for a decision architecture that relies on samples of individual past choice episodes rather than incrementally averaged rewards in evaluating options and has suggestive implications for the underlying cognitive and neural mechanisms.

From faces to prosocial behavior: cues, tools, and mechanisms

In this review we ask how looking at people's faces can influence prosocial behaviors towards them. Components of this process have often been studied by disparate literatures: one focused on perception and judgment of faces, using both psychological and neuroscience approaches; and a second focused on actual social behaviors, as studied in behavioral economics and decision science. Bridging these disciplines requires a more mechanistic account of how processing of particular face attributes or features influences social judgments and behaviors. Here we review these two lines of research, and suggest that combining some of their methodological tools can provide the bridging mechanistic explanations.

Neural correlates of evidence accumulation during value-based decisions revealed via simultaneous EEG-fMRI

Current computational accounts posit that, in simple binary choices, humans accumulate evidence in favour of the different alternatives before committing to a decision. Neural correlates of this accumulating activity have been found during perceptual decisions in parietal and prefrontal cortex; however the source of such activity in value-based choices remains unknown. Here we use simultaneous EEG–fMRI and computational modelling to identify EEG signals reflecting an accumulation process and demonstrate that the within- and across-trial variability in these signals explains fMRI responses in posterior-medial frontal cortex. Consistent with its role in integrating the evidence prior to reaching a decision, this region also exhibits task-dependent coupling with the ventromedial prefrontal cortex and the striatum, brain areas known to encode the subjective value of the decision alternatives. These results further endorse the proposition of an evidence accumulation process during value-based decisions in humans and implicate the posterior-medial frontal cortex in this process.

Parietal and prefrontal cortices gather information to make perceptual decisions, but it is not known if the same is true for value-based choices. Here, authors use simultaneous EEG-fMRI and modelling to show that during value- and reward-based decisions this evidence is accumulated in the posterior medial frontal cortex.

The BCD of response time analysis in experimental economics

For decisions in the wild, time is of the essence. Available decision time is often cut short through natural or artificial constraints, or is impinged upon by the opportunity cost of time. Experimental economists have only recently begun to conduct experiments with time constraints and to analyze response time (RT) data, in contrast to experimental psychologists. RT analysis has proven valuable for the identification of individual and strategic decision processes including identification of social preferences in the latter case, model comparison/selection, and the investigation of heuristics that combine speed and performance by exploiting environmental regularities. Here we focus on the benefits, challenges, and desiderata of RT analysis in strategic decision making. We argue that unlocking the potential of RT analysis requires the adoption of process-based models instead of outcome-based models, and discuss how RT in the wild can be captured by time-constrained experiments in the lab. We conclude that RT analysis holds considerable potential for experimental economics, deserves greater attention as a methodological tool, and promises important insights on strategic decision making in naturally occurring environments.

Advancing Research on Cognitive Processes in Social and Personality Psychology

We provide a primer on a hierarchical extension of the drift diffusion model (DDM). This formal model of decisions is frequently used in the cognitive sciences but infrequently used in social and personality research. Recent advances in model estimation have overcome issues that previously made the hierarchical DDM impractical to implement. Using examples from two paradigms, the first-person shooter task and the flash gambling task, we demonstrate that the hierarchical DDM can provide novel insights into cognitive processes underlying decisions. Finally, we compare the DDM to dual-process models of decision-making. We hope this primer will provide researchers a new tool for investigating psychological processes.

Computational modeling of epiphany learning

Models of reinforcement learning (RL) are prevalent in the decision-making literature, but not all behavior seems to conform to the gradual convergence that is a central feature of RL. In some cases learning seems to happen all at once. Limited prior research on these "epiphanies" has shown evidence of sudden changes in behavior, but it remains unclear how such epiphanies occur. We propose a sequential-sampling model of epiphany learning (EL) and test it using an eye-tracking experiment. In the experiment, subjects repeatedly play a strategic game that has an optimal strategy. Subjects can learn over time from feedback but are also allowed to commit to a strategy at any time, eliminating all other options and opportunities to learn. We find that the EL model is consistent with the choices, eye movements, and pupillary responses of subjects who commit to the optimal strategy (correct epiphany) but not always of those who commit to a suboptimal strategy or who do not commit at all. Our findings suggest that EL is driven by a latent evidence accumulation process that can be revealed with eye-tracking data.

The socialization effect on decision making in the Prisoner's Dilemma game: An eye-tracking study

We used a mobile eye-tracking system (in the form of glasses) to study the characteristics of visual perception in decision making in the Prisoner's Dilemma game. In each experiment, one of the 12 participants was equipped with eye-tracking glasses. The experiment was conducted in three stages: an anonymous Individual Game stage against a randomly chosen partner (one of the 12 other participants of the experiment); a Socialization stage, in which the participants were divided into two groups; and a Group Game stage, in which the participants played with partners in the groups. After each round, the respondent received information about his or her personal score in the last round and the overall winner of the game at the moment. The study proves that eye-tracking systems can be used for studying the process of decision making and forecasting. The total viewing time and the time of fixation on areas corresponding to noncooperative decisions is related to the participants’ overall level of cooperation. The increase in the total viewing time and the time of fixation on the areas of noncooperative choice is due to a preference for noncooperative decisions and a decrease in the overall level of cooperation. The number of fixations on the group attributes is associated with group identity, but does not necessarily lead to cooperative behavior.

A martingale analysis of first passage times of time-dependent Wiener diffusion models

Research in psychology and neuroscience has successfully modeled decision making as a process of noisy evidence accumulation to a decision bound. While there are several variants and implementations of this idea, the majority of these models make use of a noisy accumulation between two absorbing boundaries. A common assumption of these models is that decision parameters, e.g., the rate of accumulation (drift rate), remain fixed over the course of a decision, allowing the derivation of analytic formulas for the probabilities of hitting the upper or lower decision threshold, and the mean decision time. There is reason to believe, however, that many types of behavior would be better described by a model in which the parameters were allowed to vary over the course of the decision process. In this paper, we use martingale theory to derive formulas for the mean decision time, hitting probabilities, and first passage time (FPT) densities of a Wiener process with time-varying drift between two time-varying absorbing boundaries. This model was first studied by Ratcliff (1980) in the two-stage form, and here we consider the same model for an arbitrary number of stages (i.e. intervals of time during which parameters are constant). Our calculations enable direct computation of mean decision times and hitting probabilities for the associated multistage process. We also provide a review of how martingale theory may be used to analyze similar models employing Wiener processes by re-deriving some classical results. In concert with a variety of numerical tools already available, the current derivations should encourage mathematical analysis of more complex models of decision making with time-varying evidence.

A Quantitative Relationship between Signal Detection in Attention and Approach/Avoidance Behavior

This study examines how the domains of reward and attention, which are often studied as independent processes, in fact interact at a systems level. We operationalize divided attention with a continuous performance task and variables from signal detection theory (SDT), and reward/aversion with a keypress task measuring approach/avoidance in the framework of relative preference theory (RPT). Independent experiments with the same subjects showed a significant association between one SDT and two RPT variables, visualized as a three-dimensional structure. Holding one of these three variables constant, further showed a significant relationship between a loss aversion-like metric from the approach/avoidance task, and the response bias observed during the divided attention task. These results indicate that a more liberal response bias under signal detection (i.e., a higher tolerance for noise, resulting in a greater proportion of false alarms) is associated with higher "loss aversion." Furthermore, our functional model suggests a mechanism for processing constraints with divided attention and reward/aversion. Together, our results argue for a systematic relationship between divided attention and reward/aversion processing in humans.

Deliberation period during easy and difficult decisions: re-examining Libet's "veto" window in a more ecologically valid framework

Whether consciousness plays a causal role in cognitive processing remains debated. According to Benjamin Libet, consciousness is needed to deliberate and veto an action that is initiated unconsciously. Libet offered that the deliberation window takes place between the time of conscious intent (W) and action (MR). We further examined this deliberation-veto hypothesis by measuring the length of the temporal window (W-MR) when making easy and difficult choices. If Libet were correct that the W-MR is intended for evaluation and cancelation, we should expect a shorter W-MR for an easy decision since less deliberation is presumably needed. Instead, we observed a less intuitive effect: The W-MR window in the easy trials was longer than the W-MR window in the difficult ones. Our results suggest several interpretations including the idea that consciousness may play a causal role in decision making but not in a straightforward manner as assumed by Libet's veto hypothesis.

What to Choose Next? A Paradigm for Testing Human Sequential Decision Making

Many of the decisions we make in our everyday lives are sequential and entail sparse rewards. While sequential decision-making has been extensively investigated in theory (e.g., by reinforcement learning models) there is no systematic experimental paradigm to test it. Here, we developed such a paradigm and investigated key components of reinforcement learning models: the eligibility trace (i.e., the memory trace of previous decision steps), the external reward, and the ability to exploit the statistics of the environment's structure (model-free vs. model-based mechanisms). We show that the eligibility trace decays not with sheer time, but rather with the number of discrete decision steps made by the participants. We further show that, unexpectedly, neither monetary rewards nor the environment's spatial regularity significantly modulate behavioral performance. Finally, we found that model-free learning algorithms describe human performance better than model-based algorithms.

What Is Trained During Food Go/No-Go Training? A Review Focusing on Mechanisms and a Research Agenda

Purpose of Review

During food go/no-go training, people consistently withhold responses toward no-go food items. We discuss how food go/no-go training may change people’s behavior toward no-go food items by comparing three accounts: (a) the training strengthens ‘top-down’ inhibitory control over food-related responses, (b) the training creates automatic ‘bottom-up’ associations between no-go food items and stopping responses, and (c) the training leads to devaluation of no-go food items.

Recent Findings

Go/no-go training can reduce intake of food and choices for food and facilitate short-term weight loss. It appears unlikely that food go/no-go training strengthens top-down inhibitory control. There is some evidence suggesting the training could create automatic stop associations. There is strong evidence suggesting go/no-go training reduces evaluations of no-go food items.

Summary

Food go/no-go training can change behavior toward food and evaluation of food items. To advance knowledge, more research is needed on the underlying mechanisms of the training, the role of attention during go/no-go training, and on when effects generalize to untrained food items.

Robust sampling of decision information during perceptual choice

Humans move their eyes to gather information about the visual world. However, saccadic sampling has largely been explored in paradigms that involve searching for a lone target in a cluttered array or natural scene. Here, we investigated the policy that humans use to overtly sample information in a perceptual decision task that required information from across multiple spatial locations to be combined. Participants viewed a spatial array of numbers and judged whether the average was greater or smaller than a reference value. Participants preferentially sampled items that were less diagnostic of the correct answer ("inlying" elements; that is, elements closer to the reference value). This preference to sample inlying items was linked to decisions, enhancing the tendency to give more weight to inlying elements in the final choice ("robust averaging"). These findings contrast with a large body of evidence indicating that gaze is directed preferentially to deviant information during natural scene viewing and visual search, and suggest that humans may sample information "robustly" with their eyes during perceptual decision-making.

A distributed, hierarchical and recurrent framework for reward-based choice

Many accounts of reward-based choice argue for distinct component processes that are serial and functionally localized. In this Opinion article, we argue for an alternative viewpoint, in which choices emerge from repeated computations that are distributed across many brain regions. We emphasize how several features of neuroanatomy may support the implementation of choice, including mutual inhibition in recurrent neural networks and the hierarchical organization of timescales for information processing across the cortex. This account also suggests that certain correlates of value are emergent rather than represented explicitly in the brain.

Information foraging for perceptual decisions

We tested an information foraging framework to characterize the mechanisms that drive active (visual) sampling behavior in decision problems that involve multiple sources of information. Experiments 1 through 3 involved participants making an absolute judgment about the direction of motion of a single random dot motion pattern. In Experiment 4, participants made a relative comparison between 2 motion patterns that could only be sampled sequentially. Our results show that: (a) Information (about noisy motion information) grows to an asymptotic level that depends on the quality of the information source; (b) The limited growth is attributable to unequal weighting of the incoming sensory evidence, with early samples being weighted more heavily; (c) Little information is lost once a new source of information is being sampled; and (d) The point at which the observer switches from 1 source to another is governed by online monitoring of his or her degree of (un)certainty about the sampled source. These findings demonstrate that the sampling strategy in perceptual decision-making is under some direct control by ongoing cognitive processing. More specifically, participants are able to track a measure of (un)certainty and use this information to guide their sampling behavior. (PsycINFO Database Record

Modeling Trait Anxiety: From Computational Processes to Personality

Computational methods are increasingly being applied to the study of psychiatric disorders. Often, this involves fitting models to the behavior of individuals with subclinical character traits that are known vulnerability factors for the development of psychiatric conditions. Anxiety disorders can be examined with reference to the behavior of individuals high in "trait" anxiety, which is a known vulnerability factor for the development of anxiety and mood disorders. However, it is not clear how this self-report measure relates to neural and behavioral processes captured by computational models. This paper reviews emerging computational approaches to the study of trait anxiety, specifying how interacting processes susceptible to analysis using computational models could drive a tendency to experience frequent anxious states and promote vulnerability to the development of clinical disorders. Existing computational studies are described in the light of this perspective and appropriate targets for future studies are discussed.

Innovative Techniques for Evaluating Behavioral Nutrition Interventions

Assessing outcomes and the impact from behavioral nutrition interventions has remained challenging because of the lack of methods available beyond traditional nutrition assessment tools and techniques. With the current high global obesity and related chronic disease rates, novel methods to evaluate the impact of behavioral nutrition-based interventions are much needed. The objective of this narrative review is to describe and review the current status of knowledge as it relates to 4 different innovative methods or tools to assess behavioral nutrition interventions. Methods reviewed include 1) the assessment of stress and stress responsiveness to enhance the evaluation of nutrition interventions, 2) eye-tracking technology in nutritional interventions, 3) smartphone biosensors to assess nutrition and health-related outcomes, and 4) skin carotenoid measurements to assess fruit and vegetable intake. Specifically, the novel use of functional magnetic resonance imaging, by characterizing the brain's responsiveness to an intervention, can help researchers develop programs with greater efficacy. Similarly, if eye-tracking technology can enable researchers to get a better sense as to how participants view materials, the materials may be better tailored to create an optimal impact. The latter 2 techniques reviewed, smartphone biosensors and methods to detect skin carotenoids, can provide the research community with portable, effective, nonbiased ways to assess dietary intake and quality and more in the field. The information gained from using these types of methodologies can improve the efficacy and assessment of behavior-based nutrition interventions.

Psychopathic individuals exhibit but do not avoid regret during counterfactual decision making

Psychopathy is associated with persistent antisocial behavior and a striking lack of regret for the consequences of that behavior. Although explanatory models for psychopathy have largely focused on deficits in affective responsiveness, recent work indicates that aberrant value-based decision making may also play a role. On that basis, some have suggested that psychopathic individuals may be unable to effectively use prospective simulations to update action value estimates during cost-benefit decision making. However, the specific mechanisms linking valuation, affective deficits, and maladaptive decision making in psychopathy remain unclear. Using a counterfactual decision-making paradigm, we found that individuals who scored high on a measure of psychopathy were as or more likely than individuals low on psychopathy to report negative affect in response to regret-inducing counterfactual outcomes. However, despite exhibiting intact affective regret sensitivity, they did not use prospective regret signals to guide choice behavior. In turn, diminished behavioral regret sensitivity predicted a higher number of prior incarcerations, and moderated the relationship between psychopathy and incarceration history. These findings raise the possibility that maladaptive decision making in psychopathic individuals is not a consequence of their inability to generate or experience negative emotions. Rather, antisocial behavior in psychopathy may be driven by a deficit in the generation of forward models that integrate information about rules, costs, and goals with stimulus value representations to promote adaptive behavior.