Decision making

Eye Movements as a Window into Decision-Making

For over 100 years, eye movements have been studied and used as indicators of human sensory and cognitive functions. This review evaluates how eye movements contribute to our understanding of the processes that underlie decision-making. Eye movement metrics signify the visual and task contexts in which information is accumulated and weighed. They indicate the efficiency with which we evaluate the instructions for decision tasks, the timing and duration of decision formation, the expected reward associated with a decision, the accuracy of the decision outcome, and our ability to predict and feel confident about a decision. Because of their continuous nature, eye movements provide an exciting opportunity to probe decision processes noninvasively in real time. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

From Biological Synapses to “Intelligent” Robots

This selective review explores biologically inspired learning as a model for intelligent robot control and sensing technology on the basis of specific examples. Hebbian synaptic learning is discussed as a functionally relevant model for machine learning and intelligence, as explained on the basis of examples from the highly plastic biological neural networks of invertebrates and vertebrates. Its potential for adaptive learning and control without supervision, the generation of functional complexity, and control architectures based on self-organization is brought forward. Learning without prior knowledge based on excitatory and inhibitory neural mechanisms accounts for the process through which survival-relevant or task-relevant representations are either reinforced or suppressed. The basic mechanisms of unsupervised biological learning drive synaptic plasticity and adaptation for behavioral success in living brains with different levels of complexity. The insights collected here point toward the Hebbian model as a choice solution for “intelligent” robotics and sensor systems.

Decision Science: A New Hope

Decision science is an area of enquiry that crosses many disciplines, from psychology to economics, each with their own perspective of decision-making. Traditionally, mathematicians have envisaged decision-making as a purely rational endeavor, whereas psychologists and behavioral economists have critiqued this narrative and suggested that cognitive short cuts are the real mechanisms behind how decisions are made. However, contemporary dual process theorists argue that two systems of the mind exist: system 1 (intuitive decision-making) and system 2 (rational decision-making). The current review will present a relatively new metaphor for decision-making: the unified threshold model. This model is a global approach to decision-making which allows both intuitive and rational decision-making processes to be explained in a more flexible manner than the dual process model. This review will introduce the reader to different types of threshold models (counter and diffusion), their assumptions, and their ability to explain decision-making behavior. Implications and future research will also be discussed. In summary, the aim of this review is to highlight that a rather than the unified threshold model of decision-making may give a more adequate explanation of decision-making data in comparison to previous models and theories.

Not moving: the fundamental but neglected motor function

The function of the motor system in preventing rather than initiating movement is often overlooked. Not only are its highest levels predominantly, and tonically, inhibitory, but in general behaviour it is often intermittent, characterized by relatively short periods of activity separated by longer periods of stillness: for most of the time we are not moving, but stationary. Furthermore, these periods of immobility are not a matter of inhibition and relaxation, but require us to expend almost as much energy as when we move, and they make just as many demands on the central nervous system in controlling their performance. The mechanisms that stop movement and maintain immobility have been a greatly neglected area of the study of the brain. This paper introduces the topics to be examined in this special issue of Philosophical Transactions, discussing the various types of stopping and stillness, the problems that they impose on the motor system, the kinds of neural mechanism that underlie them and how they can go wrong.This article is part of the themed issue 'Movement suppression: brain mechanisms for stopping and stillness'.

Tobacco Use Among Healthcare Workers: Impact of a Worksite Policy Change at a US Military Community Hospital

Introductions:Healthcare workers use less tobacco than other working populations. In contrast, US military members use more tobacco than civilians. Military healthcare workers, therefore, represent a unique group with regard to occupational factors that may influence tobacco use.

Aims/Methods:Records of workers at a military community hospital were reviewed to describe tobacco use. An anonymous survey assessed impressions of a worksite policy change that prohibited tobacco use anywhere on hospital grounds.

Results:Hospital staff included 2,074 professionals. Tobacco use was significantly associated with male sex and being a military enlisted worker. In fact, 37% of male enlisted members used tobacco; fewer than 10% of all other workers used tobacco. Among 232 survey respondents, 61% agreed with tobacco-restrictive worksite policies, but only 33% thought policies were effective. Nearly one-third of tobacco users reported decreasing use in the past year. In multivariable modelling, changing habits in response to worksite policy was the only factor significantly associated with decreased tobacco use.

Conclusions:Tobacco use among US military healthcare workers varies markedly by demographic characteristics. Male, military enlisted workers use tobacco at very high rates, paralleling the troops they serve. Implementation of tobacco-restrictive worksite policies is associated with decreased tobacco use in this population.

Evolution of posterior parietal cortex and parietal-frontal networks for specific actions in primates

Posterior parietal cortex (PPC) is an extensive region of the human brain that develops relatively late and is proportionally large compared with that of monkeys and prosimian primates. Our ongoing comparative studies have led to several conclusions about the evolution of this posterior parietal region. In early placental mammals, PPC likely was a small multisensory region much like PPC of extant rodents and tree shrews. In early primates, PPC likely resembled that of prosimian galagos, in which caudal PPC (PPCc) is visual and rostral PPC (PPCr) has eight or more multisensory domains where electrical stimulation evokes different complex motor behaviors, including reaching, hand-to-mouth, looking, protecting the face or body, and grasping. These evoked behaviors depend on connections with functionally matched domains in premotor cortex (PMC) and motor cortex (M1). Domains in each region compete with each other, and a serial arrangement of domains allows different factors to influence motor outcomes successively. Similar arrangements of domains have been retained in New and Old World monkeys, and humans appear to have at least some of these domains. The great expansion and prolonged development of PPC in humans suggest the addition of functionally distinct territories. We propose that, across primates, PMC and M1 domains are second and third levels in a number of parallel, interacting networks for mediating and selecting one type of action over others.

Using saccades to diagnose covert hepatic encephalopathy

Covert Hepatic Encephalopathy (CHE), previously known as Minimal Hepatic Encephalopathy, is a subtle cognitive defect found in 30-70 % of cirrhosis patients. It has been linked to poor quality of life, impaired fitness to drive, and increased mortality: treatment is possible. Despite its clinical significance, diagnosis relies on psychometric tests that have proved unsuitable for use in a clinical setting. We investigated whether measurement of saccadic latency distributions might be a viable alternative. We collected data on 35 cirrhosis patients at Addenbrooke's Hospital, Cambridge, with no evidence of clinically overt encephalopathy, and 36 age-matched healthy controls. Performance on standard psychometric tests was evaluated to determine those patients with CHE as defined by the World Congress of Gastroenterology. We then compared visually-evoked saccades between those with CHE and those without, as well as reviewing blood test results and correlating saccadic latencies with biochemical parameters and prognostic scores. Cirrhosis patients have significantly longer median saccadic latencies than healthy controls. Those with CHE had significantly prolonged saccadic latencies when compared with those without CHE. Analysis of a cirrhosis patient's saccades can diagnose CHE with a sensitivity of 75 % and a specificity of 75 %. We concluded that analysis of a cirrhosis patient's saccadic latency distributions is a fast and objective measure that can be used as a diagnostic tool for CHE. This improved early diagnosis could direct avoidance of high-risk activities such as driving, and better inform treatment strategies.

Stimulus value signals in ventromedial PFC reflect the integration of attribute value signals computed in fusiform gyrus and posterior superior temporal gyrus

We often have to make choices among multiattribute stimuli (e.g., a food that differs on its taste and health). Behavioral data suggest that choices are made by computing the value of the different attributes and then integrating them into an overall stimulus value signal. However, it is not known whether this theory describes the way the brain computes the stimulus value signals, or how the underlying computations might be implemented. We investigated these questions using a human fMRI task in which individuals had to evaluate T-shirts that varied in their visual esthetic (e.g., color) and semantic (e.g., meaning of logo printed in T-shirt) components. We found that activity in the fusiform gyrus, an area associated with the processing of visual features, correlated with the value of the visual esthetic attributes, but not with the value of the semantic attributes. In contrast, activity in posterior superior temporal gyrus, an area associated with the processing of semantic meaning, exhibited the opposite pattern. Furthermore, both areas exhibited functional connectivity with an area of ventromedial prefrontal cortex that reflects the computation of overall stimulus values at the time of decision. The results provide supporting evidence for the hypothesis that some attribute values are computed in cortical areas specialized in the processing of such features, and that those attribute-specific values are then passed to the vmPFC to be integrated into an overall stimulus value signal to guide the decision.

Macrocircuits: decision networks

Decision-making requires stimulus categorization and localization to guide accurate responses that can be produced through multiple effectors. The success of actions is monitored so that performance can be adjusted to achieve goals. This review will survey recent empirical and theoretical developments very selectively with an emphasis on neurophysiological data from nonhuman primates that provide the clearest information about neural mechanisms.

Functional organization and adaptability of a decision-making network in aplysia

Whereas major insights into the neuronal basis of adaptive behavior have been gained from the study of automatic behaviors, including reflexive and rhythmic motor acts, the neural substrates for goal-directed behaviors in which decision-making about action selection and initiation are crucial, remain poorly understood. However, the mollusk Aplysia is proving to be increasingly relevant to redressing this issue. The functional properties of the central circuits that govern this animal’s goal-directed feeding behavior and particularly the neural processes underlying the selection and initiation of specific feeding actions are becoming understood. In addition to relying on the intrinsic operation of central networks, goal-directed behaviors depend on external sensory inputs that through associative learning are able to shape decision-making strategies. Here, we will review recent findings on the functional design of the central network that generates Aplysia’s feeding-related movements and the sensory-derived plasticity that through learning can modify the selection and initiation of appropriate action. The animal’s feeding behavior and the implications of decision-making will be briefly described. The functional design of the underlying buccal network will then be used to illustrate how cellular diversity and the coordination of neuronal burst activity provide substrates for decision-making. The contribution of specific synaptic and neuronal membrane properties within the buccal circuit will also be discussed in terms of their role in motor pattern selection and initiation. The ability of learning to “rigidify” these synaptic and cellular properties so as to regularize network operation and lead to the expression of stereotyped rhythmic behavior will then be described. Finally, these aspects will be drawn into a conceptual framework of how Aplysia’s goal-directed circuitry compares to the central pattern generating networks for invertebrate rhythmic behaviors.

The perception of attractiveness and trustworthiness in male faces affects hypothetical voting decisions differently in wartime and peacetime scenarios

Facial appearance of candidates has been linked to real election outcomes. Here we extend these findings by examining the contributions of attractiveness and trustworthiness in male faces to perceived votability. We first use real faces to show that attractiveness and trustworthiness are positively and independently related to perceptions of good leadership (rating study). We then show that computer graphic manipulations of attractiveness and trustworthiness influence choice of leader (experiments 1 and 2). Finally, we show that changing context from wartime to peacetime can affect which face receives the most votes. Attractive faces were relatively more valued for wartime and trustworthy faces relatively more valued for peacetime (experiments 1 and 2). This pattern suggests that attractiveness, which may indicate health and fitness, is perceived to be a useful attribute in wartime leaders, whereas trustworthiness, which may indicate prosocial traits, is perceived to be more important during peacetime. Our studies highlight the possible role of facial appearance in voting behaviour and the role of attributions of attractiveness and trust. We also show that there may be no general characteristics of faces that make them perceived as the best choice of leader; leaders may be chosen because of characteristics that are perceived as the best for leaders to possess in particular situations.

Midbrain contributions to sensorimotor decision making

Making decisions about future actions is a fundamental function of the nervous system. Classical theories hold that separate sets of brain regions are responsible for selecting and implementing an action. Traditionally, action selection has been considered the domain of high-level regions, such as the prefrontal cortex, whereas action generation is thought to be carried out by dedicated cortical and subcortical motor regions. However, increasing evidence suggests that the activity of individual neurons in cortical motor structures reflects abstract properties of "decision variables" rather than conveying simple motor commands. Less is known, though, about the role of subcortical structures in decision making. In particular, the superior colliculus (SC) is critical for planning and initiating visually guided, gaze-displacing movements and selecting visual targets, but whether and how it contributes more generally to sensorimotor decisions are unclear. Here, we show that the SC is intimately involved in orienting decisions based on odor cues, even though the SC does not explicitly process olfactory stimuli. Neurons were recorded from the intermediate and deep SC layers in rats trained to perform a delayed-response, odor-cued spatial choice task. SC neurons commonly fired well in advance of movement initiation, predicting the chosen direction nearly 1 s before movement. Moreover, under conditions of sensory uncertainty, SC activity varied with task difficulty and reward outcome, reflecting the influence of decision variables on the intercollicular competition thought to underlie orienting movements. These results indicate that the SC plays a more general role in decisions than previously appreciated, extending beyond visuomotor functions.

The organization and evolution of dorsal stream multisensory motor pathways in primates

In Prosimian primates, New World monkeys, and Old World monkeys microstimulation with half second trains of electrical pulses identifies separate zones in posterior parietal cortex (PPC) where reaching, defensive, grasping, and other complex movements can be evoked. Each functional zone receives a different pattern of visual and somatosensory inputs, and projects preferentially to functionally matched parts of motor and premotor cortex. As PPC is a relatively small portion of cortex in most mammals, including the close relatives of primates, we suggest that a larger, more significant PPC emerged with the first primates as a region where several ethologically relevant behaviors could be initiated by sensory and intrinsic signals, and mediated via connections with premotor and motor cortex. While several classes of PPC modules appear to be retained by all primates, elaboration and differentiation of these modules likely occurred in some primates, especially humans.

Neural mechanisms of operant conditioning and learning-induced behavioral plasticity in Aplysia

Associative learning in goal-directed behaviors, in contrast to reflexive behaviors, can alter processes of decision-making in the selection of appropriate action and its initiation, thereby enabling animals, including humans, to gain a predictive understanding of their external environment. In the mollusc Aplysia, recent studies on appetitive operant conditioning in which the animal learns about the positive consequences of its behavior have provided insights into this form of associative learning which, although ubiquitous, remains mechanistically poorly understood. The findings support increasing evidence that central circuit- and cell-wide sites other than chemical synaptic connections, including electrical coupling and membrane conductances controlling intrinsic neuronal excitability and underlying voltage-dependent plateauing or oscillatory mechanisms, may serve as the neural substrates for behavioral plasticity resulting from operant conditioning. Aplysia therefore continues to provide a model system for understanding learning and memory formation that enables establishing the neurobiological links between behavioral, network, and cellular levels of analysis.

The real-time link between person perception and action: brain potential evidence for dynamic continuity

Using event-related potentials, we investigated how the brain extracts information from another's face and translates it into relevant action in real time. In Study 1, participants made between-hand sex categorizations of sex-typical and sex-atypical faces. Sex-atypical faces evoked negativity between 250 and 550 ms (N300/N400 effects), reflecting the integration of accumulating sex-category knowledge into a coherent sex-category interpretation. Additionally, the lateralized readiness potential revealed that the motor cortex began preparing for a correct hand response while social category knowledge was still gradually evolving in parallel. In Study 2, participants made between-hand eye-color categorizations as part of go/no-go trials that were contingent on a target's sex. On no-go trials, although the hand did not actually move, information about eye color partially prepared the motor cortex to move the hand before perception of sex had finalized. Together, these findings demonstrate the dynamic continuity between person perception and action, such that ongoing results from face processing are immediately and continuously cascaded into the motor system over time. The preparation of action begins based on tentative perceptions of another's face before perceivers have finished interpreting what they just saw.

Reward networks in the brain as captured by connectivity measures

An assortment of human behaviors is thought to be driven by rewards including reinforcement learning, novelty processing, learning, decision making, economic choice, incentive motivation, and addiction. In each case the ventral tegmental area/ventral striatum (nucleus accumbens) (VTA–VS) system has been implicated as a key structure by functional imaging studies, mostly on the basis of standard, univariate analyses. Here we propose that standard functional magnetic resonance imaging analysis needs to be complemented by methods that take into account the differential connectivity of the VTA–VS system in the different behavioral contexts in order to describe reward based processes more appropriately. We first consider the wider network for reward processing as it emerged from animal experimentation. Subsequently, an example for a method to assess functional connectivity is given. Finally, we illustrate the usefulness of such analyses by examples regarding reward valuation, reward expectation and the role of reward in addiction.

Neurocomputational mechanisms of reinforcement-guided learning in humans: a review

Adapting decision making according to dynamic and probabilistic changes in action-reward contingencies is critical for survival in a competitive and resource-limited world. Much research has focused on elucidating the neural systems and computations that underlie how the brain identifies whether the consequences of actions are relatively good or bad. In contrast, less empirical research has focused on the mechanisms by which reinforcements might be used to guide decision making. Here, I review recent studies in which an attempt to bridge this gap has been made by characterizing how humans use reward information to guide and optimize decision making. Regions that have been implicated in reinforcement processing, including the striatum, orbitofrontal cortex, and anterior cingulate, also seem to mediate how reinforcements are used to adjust subsequent decision making. This research provides insights into why the brain devotes resources to evaluating reinforcements and suggests a direction for future research, from studying the mechanisms of reinforcement processing to studying the mechanisms of reinforcement learning.

Currents contributing to decision making in neurons B31/B32 of Aplysia

Biophysical properties of neurons contributing to the ability of an animal to decide whether or not to respond were examined. B31/B32, two pairs of bilaterally symmetrical Aplysia neurons, are major participants in deciding to initiate a buccal motor program, the neural correlate of a consummatory feeding response. B31/B32 respond to an adequate stimulus after a delay, during which time additional stimuli influence the decision to respond. B31/B32 then respond with a ramp depolarization followed by a sustained soma depolarization and axon spiking that is the expression of a commitment to respond to food. Four currents contributing to decision making in B31/B32 were characterized, and their functional effects were determined, in current- and voltage-clamp experiments and with simulations. Inward currents arising from slow muscarinic transmission were characterized. These currents contribute to the B31/B32 depolarization. Their slow activation kinetics contribute to the delay preceding B31/B32 activity. After the delay, inward currents affect B31/B32 in the context of two endogenous inactivating outward currents: a delayed rectifier K+ current (I(K-V)) and an A-type K+ current (I(K-A)), as well as a high-threshold noninactivating outward current (I(maintained)). Hodgkin-Huxley kinetic analyses were performed on the outward currents. Simulations using equations from these analyses showed that I(K-V) and I(K-A) slow the ramp depolarization preceding the sustained depolarization. The three outward currents contribute to braking the B31/B32 depolarization and keeping the sustained depolarization at a constant voltage. The currents identified are sufficient to explain the properties of B31/B32 that play a role in generating the decision to feed.

Reinforcement learning signals predict future decisions

Optimal behavior in a competitive world requires the flexibility to adapt decision strategies based on recent outcomes. In the present study, we tested the hypothesis that this flexibility emerges through a reinforcement learning process, in which reward prediction errors are used dynamically to adjust representations of decision options. We recorded event-related brain potentials (ERPs) while subjects played a strategic economic game against a computer opponent to evaluate how neural responses to outcomes related to subsequent decision-making. Analyses of ERP data focused on the feedback-related negativity (FRN), an outcome-locked potential thought to reflect a neural prediction error signal. Consistent with predictions of a computational reinforcement learning model, we found that the magnitude of ERPs after losing to the computer opponent predicted whether subjects would change decision behavior on the subsequent trial. Furthermore, FRNs to decision outcomes were disproportionately larger over the motor cortex contralateral to the response hand that was used to make the decision. These findings provide novel evidence that humans engage a reinforcement learning process to adjust representations of competing decision options.

Neural activity in macaque parietal cortex reflects temporal integration of visual motion signals during perceptual decision making

Decision-making often requires the accumulation and maintenance of evidence over time. Although the neural signals underlying sensory processing have been studied extensively, little is known about how the brain accrues and holds these sensory signals to guide later actions. Previous work has suggested that neural activity in the lateral intraparietal area (LIP) of the monkey brain reflects the formation of perceptual decisions in a random dot direction-discrimination task in which monkeys communicate their decisions with eye-movement responses. We tested the hypothesis that decision-related neural activity in LIP represents the time integral of the momentary motion "evidence." By briefly perturbing the strength of the visual motion stimulus during the formation of perceptual decisions, we tested whether this LIP activity reflected a persistent, integrated "memory" of these brief sensory events. We found that the responses of LIP neurons reflected substantial temporal integration. Brief pulses had persistent effects on both the monkeys' choices and the responses of neurons in LIP, lasting up to 800 ms after appearance. These results demonstrate that LIP is involved in neural time integration underlying the accumulation of evidence in this task. Additional analyses suggest that decision-related LIP responses, as well as behavioral choices and reaction times, can be explained by near-perfect time integration that stops when a criterion amount of evidence has been accumulated. Temporal integration may be a fundamental computation underlying higher cognitive functions that are dissociated from immediate sensory inputs or motor outputs.