Perceptual Decision-Making: Biases in Post-Error Reaction Times Explained by Attractor Network Dynamics

Attractor dynamics reflect decision confidence in macaque prefrontal cortex

Decisions are made with different degrees of consistency, and this consistency can be linked to the confidence that the best choice has been made. Theoretical work suggests that attractor dynamics in networks can account for choice consistency, but how this is implemented in the brain remains unclear. Here we provide evidence that the energy landscape around attractor basins in population neural activity in the prefrontal cortex reflects choice consistency. We trained two rhesus monkeys to make accept/reject decisions based on pretrained visual cues that signaled reward offers with different magnitudes and delays to reward. Monkeys made consistent decisions for very good and very bad offers, but decisions were less consistent for intermediate offers. Analysis of neural data showed that the attractor basins around patterns of activity reflecting decisions had steeper landscapes for offers that led to consistent decisions. Therefore, we provide neural evidence that energy landscapes predict decision consistency, which reflects decision confidence.

Modelling decision-making biases

Biases are a fundamental aspect of everyday life decision-making. A variety of modelling approaches have been suggested to capture decision-making biases. Statistical models are a means to describe the data, but the results are usually interpreted according to a verbal theory. This can lead to an ambiguous interpretation of the data. Mathematical cognitive models of decision-making outline the structure of the decision process with formal assumptions, providing advantages in terms of prediction, simulation, and interpretability compared to statistical models. We compare studies that used both signal detection theory and evidence accumulation models as models of decision-making biases, concluding that the latter provides a more comprehensive account of the decision-making phenomena by including response time behavior. We conclude by reviewing recent studies investigating attention and expectation biases with evidence accumulation models. Previous findings, reporting an exclusive influence of attention on the speed of evidence accumulation and prior probability on starting point, are challenged by novel results suggesting an additional effect of attention on non-decision time and prior probability on drift rate.

Attractor dynamics reflect decision confidence in macaque prefrontal cortex

Decisions are made with different degrees of consistency, and this consistency can be linked to the confidence that the best choice has been made. Theoretical work suggests that attractor dynamics in networks can account for choice consistency, but how this is implemented in the brain remains unclear. Here, we provide evidence that the energy landscape around attractor basins in population neural activity in prefrontal cortex reflects choice consistency. We trained two rhesus monkeys to make accept/reject decisions based on pretrained visual cues that signaled reward offers with different magnitudes and delays-to-reward. Monkeys made consistent decisions for very good and very bad offers, but decisions were less consistent for intermediate offers. Analysis of neural data showed that the attractor basins around patterns of activity reflecting decisions had steeper landscapes for offers that led to consistent decisions. Therefore, we provide neural evidence that energy landscapes predict decision consistency, which reflects decision confidence.

Probabilistic integration of preceding responses explains response bias in perceptual decision making

Expectations of sensory information change not only how well but also what we perceive. Even in an unpredictable environment, the brain is by default constantly engaged in computing probabilities between sensory events. These estimates are used to generate predictions about future sensory events. Here, we investigated the predictability of behavioral responses using three different learning models in three different one-interval two-alternative forced choice experiments with either auditory, vestibular, or visual stimuli. Results indicate that recent decisions, instead of the sequence of generative stimuli, cause serial dependence. By bridging the gap between sequence learning and perceptual decision making, we provide a novel perspective on sequential choice effects. We propose that serial biases reflect the tracking of statistical regularities of the decision variable, offering a broader understanding of this phenomenon.

Kinematic Studies of the Go/No-Go Task as a Dynamic Sensorimotor Inhibition Task for Assessment of Motor and Executive Function in Stroke Patients: An Exploratory Study in a Neurotypical Sample

Inhibition of reaching and grasping actions as an element of cognitive control and executive function is a vital component of sensorimotor behaviour that is often impaired in patients who have lost sensorimotor function following a stroke. To date, there are few kinematic studies detailing the fine spatial and temporal upper limb movements associated with the millisecond temporal trajectory of correct and incorrect responses to visually driven Go/No-Go reaching and grasping tasks. Therefore, we aimed to refine the behavioural measurement of correct and incorrect inhibitory motor responses in a Go/No-Go task for future quantification and personalized rehabilitation in older populations and those with acquired motor disorders, such as stroke. An exploratory study mapping the kinematic profiles of hand movements in neurotypical participants utilizing such a task was conducted using high-speed biological motion capture cameras, revealing both within and between subject differences in a sample of healthy participants. These kinematic profiles and differences are discussed in the context of better assessment of sensorimotor function impairment in stroke survivors.

From single decisions to sequential choice patterns: Extending the dynamics of value-based decision-making

Every day, we make many value-based decisions where we weigh the value of options with other properties, e.g. their time of delivery. In the laboratory, such value-based decision-making is usually studied on a trial by trial basis and each decision is assumed to represent an isolated choice process. Real-life decisions however are usually embedded in a rich context of previous choices at different time scales. A fundamental question is therefore how the dynamics of value-based decision processes unfold on a time scale across several decisions. Indeed, findings from perceptual decision making suggest that sequential decisions patterns might also be present for vale-based decision making. Here, we use a neural-inspired attractor model as an instance of dynamic models from perceptual decision making, as such models incorporate inherent activation dynamics across decisions. We use the model to predict sequential patterns, namely oscillatory switching, perseveration and dependence of perseveration on the delay between decisions. Furthermore, we predict RT effects for specific sequences of trials. We validate the predictions in two new studies and a reanalysis of existing data from a novel decision game in which participants have to perform delay discounting decisions. Applying the validated reasoning to a well-established choice questionnaire, we illustrate and discuss that taking sequential choice patterns into account may be necessary to accurately analyse and model value-based decision processes, especially when considering differences between individuals.

Confidence-Controlled Hebbian Learning Efficiently Extracts Category Membership From Stimuli Encoded in View of a Categorization Task

In experiments on perceptual decision making, individuals learn a categorization task through trial-and-error protocols. We explore the capacity of a decision-making attractor network to learn a categorization task through reward-based, Hebbian-type modifications of the weights incoming from the stimulus encoding layer. For the latter, we assume a standard layer of a large number of stimulus-specific neurons. Within the general framework of Hebbian learning, we have hypothesized that the learning rate is modulated by the reward at each trial. Surprisingly, we find that when the coding layer has been optimized in view of the categorization task, such reward-modulated Hebbian learning (RMHL) fails to extract efficiently the category membership. In previous work, we showed that the attractor neural networks' nonlinear dynamics accounts for behavioral confidence in sequences of decision trials. Taking advantage of these findings, we propose that learning is controlled by confidence, as computed from the neural activity of the decision-making attractor network. Here we show that this confidence-controlled, reward-based Hebbian learning efficiently extracts categorical information from the optimized coding layer. The proposed learning rule is local and, in contrast to RMHL, does not require storing the average rewards obtained on previous trials. In addition, we find that the confidence-controlled learning rule achieves near-optimal performance. In accordance with this result, we show that the learning rule approximates a gradient descent method on a maximizing reward cost function.

Is value-based choice repetition susceptible to medial frontal transcranial direct current stimulation (tDCS)? A preregistered study

In value-based decision making, people have to weigh different options based on their subjective value. This process, however, also is influenced by choice biases, such as choice repetition: in a series of choices, people are more likely to repeat their decision than to switch to a different choice. Previously, it was shown that transcranial direct current stimulation (tDCS) can affect such choice biases. We applied tDCS over the medial prefrontal cortex to investigate whether tDCS can alter choice repetition in value-based decision making. In a preregistered study, we applied anodal, cathodal, and sham tDCS stimulation to 52 participants. While we found robust choice repetition effects, we did not find support for an effect of tDCS stimulation. We discuss these findings within the larger scope of the tDCS literature and highlight the potential roles of interindividual variability and current density strength.

Perceptual decisions are biased toward relevant prior choices

Perceptual decisions are biased by recent perceptual history-a phenomenon termed 'serial dependence.' Here, we investigated what aspects of perceptual decisions lead to serial dependence, and disambiguated the influences of low-level sensory information, prior choices and motor actions. Participants discriminated whether a brief visual stimulus lay to left/right of the screen center. Following a series of biased 'prior' location discriminations, subsequent 'test' location discriminations were biased toward the prior choices, even when these were reported via different motor actions (using different keys), and when the prior and test stimuli differed in color. By contrast, prior discriminations about an irrelevant stimulus feature (color) did not substantially influence subsequent location discriminations, even though these were reported via the same motor actions. Additionally, when color (not location) was discriminated, a bias in prior stimulus locations no longer influenced subsequent location discriminations. Although low-level stimuli and motor actions did not trigger serial-dependence on their own, similarity of these features across discriminations boosted the effect. These findings suggest that relevance across perceptual decisions is a key factor for serial dependence. Accordingly, serial dependence likely reflects a high-level mechanism by which the brain predicts and interprets new incoming sensory information in accordance with relevant prior choices.

Nonlinear neural network dynamics accounts for human confidence in a sequence of perceptual decisions

Electrophysiological recordings during perceptual decision tasks in monkeys suggest that the degree of confidence in a decision is based on a simple neural signal produced by the neural decision process. Attractor neural networks provide an appropriate biophysical modeling framework, and account for the experimental results very well. However, it remains unclear whether attractor neural networks can account for confidence reports in humans. We present the results from an experiment in which participants are asked to perform an orientation discrimination task, followed by a confidence judgment. Here we show that an attractor neural network model quantitatively reproduces, for each participant, the relations between accuracy, response times and confidence. We show that the attractor neural network also accounts for confidence-specific sequential effects observed in the experiment (participants are faster on trials following high confidence trials). Remarkably, this is obtained as an inevitable outcome of the network dynamics, without any feedback specific to the previous decision (that would result in, e.g., a change in the model parameters before the onset of the next trial). Our results thus suggest that a metacognitive process such as confidence in one's decision is linked to the intrinsically nonlinear dynamics of the decision-making neural network.

Choice perseveration in value-based decision making: The impact of inter-trial interval and mood

In a series of decisions, people tend to show choice perseveration, that is, they repeat their choices. This choice perseveration is assumed to emerge due to residual activity from the previous decision. Here, we use a computational model with attractor dynamics to describe this process and to predict how choice perseveration can be modulated. We derive two qualitative predictions: Choice perseveration should decrease under longer (vs. shorter) inter-trial intervals and positive (vs. negative) mood. We test these predictions in a dynamic decision task where we modulate decisions across trials via sequentially manipulated reward options. Our findings replicate our previous study in showing choice perseveration in value-based decision making. Furthermore, choice perseveration decreased with increasing inter-trial interval as predicted by the model. However, we did not find clear evidence supporting mood effects on choice perseveration. We discuss how integrating decision process dynamics by the means of applying the neural attractor model can increase our understanding of the evolution of decision outcomes and therefore complement the psychophysical perspective on decision making.

Laws of concatenated perception: Vision goes for novelty, decisions for perseverance

Every instant of perception depends on a cascade of brain processes calibrated to the history of sensory and decisional events. In the present work, we show that human visual perception is constantly shaped by two contrasting forces exerted by sensory adaptation and past decisions. In a series of experiments, we used multilevel modeling and cross-validation approaches to investigate the impact of previous stimuli and decisions on behavioral reports during adjustment and forced-choice tasks. Our results revealed that each perceptual report is permeated by opposite biases from a hierarchy of serially dependent processes: Low-level adaptation repels perception away from previous stimuli, whereas decisional traces attract perceptual reports toward the recent past. In this hierarchy of serial dependence, "continuity fields" arise from the inertia of decisional templates and not from low-level sensory processes. This finding is consistent with a Two-process model of serial dependence in which the persistence of readout weights in a decision unit compensates for sensory adaptation, leading to attractive biases in sequential perception. We propose a unified account of serial dependence in which functionally distinct mechanisms, operating at different stages, promote the differentiation and integration of visual information over time.