Dynamic excitatory and inhibitory gain modulation can produce flexible, robust and optimal decision-making

Of Rodents and Primates: Time-Variant Gain in Drift-Diffusion Decision Models

Sequential sampling models of decision-making involve evidence accumulation over time and have been successful in capturing choice behaviour. A popular model is the drift-diffusion model (DDM). To capture the finer aspects of choice reaction times (RTs), time-variant gain features representing urgency signals have been implemented in DDM that can exhibit slower error RTs than correct RTs. However, time-variant gain is often implemented on both DDM's signal and noise features, with the assumption that increasing gain on the drift rate (due to urgency) is similar to DDM with collapsing decision bounds. Hence, it is unclear whether gain effects on just the signal or noise feature can lead to a different choice behaviour. This work presents an alternative DDM variant, focusing on the implications of time-variant gain mechanisms, constrained by model parsimony. Specifically, using computational modelling of choice behaviour of rats, monkeys, and humans, we systematically showed that time-variant gain only on the DDM's noise was sufficient to produce slower error RTs, as in monkeys, while time-variant gain only on drift rate leads to faster error RTs, as in rodents. We also found minimal effects of time-variant gain in humans. By highlighting these patterns, this study underscores the utility of group-level modelling in capturing general trends and effects consistent across species. Thus, time-variant gain on DDM's different components can lead to different choice behaviours, shed light on the underlying time-variant gain mechanisms for different species, and can be used for systematic data fitting.

Supplementary Information

The online version contains supplementary material available at 10.1007/s42113-023-00194-1.

Explaining Integration of Evidence Separated by Temporal Gaps with Frontoparietal Circuit Models

Perceptual decisions rely on accumulating sensory evidence over time. However, the accumulation process is complicated in real life when evidence resulted from separated cues over time. Previous studies demonstrate that participants are able to integrate information from two separated cues to improve their performance invariant to an interval between the cues. However, there is no neural model that can account for accuracy and confidence in decisions when there is a time interval in evidence. We used behavioral and EEG datasets from a visual choice task -Random dot motion- with separated evidence to investigate three candid distributed neural networks. We showed that decisions based on evidence accumulation by separated cues over time are best explained by the interplay of recurrent cortical dynamics of centro-parietal and frontal brain areas while an uncertainty-monitoring module included in the model.

Choice selective inhibition drives stability and competition in decision circuits

During perceptual decision-making, the firing rates of cortical neurons reflect upcoming choices. Recent work showed that excitatory and inhibitory neurons are equally selective for choice. However, the functional consequences of inhibitory choice selectivity in decision-making circuits are unknown. We developed a circuit model of decision-making which accounts for the specificity of inputs to and outputs from inhibitory neurons. We found that selective inhibition expands the space of circuits supporting decision-making, allowing for weaker or stronger recurrent excitation when connected in a competitive or feedback motif. The specificity of inhibitory outputs sets the trade-off between speed and accuracy of decisions by either stabilizing or destabilizing the saddle-point dynamics underlying decisions in the circuit. Recurrent neural networks trained to make decisions display the same dependence on inhibitory specificity and the strength of recurrent excitation. Our results reveal two concurrent roles for selective inhibition in decision-making circuits: stabilizing strongly connected excitatory populations and maximizing competition between oppositely selective populations.

Bidirectional influences of information sampling and concept learning

Contemporary models of categorization typically tend to sidestep the problem of how information is initially encoded during decision making. Instead, a focus of this work has been to investigate how, through selective attention, stimulus representations are "contorted" such that behaviorally relevant dimensions are accentuated (or "stretched"), and the representations of irrelevant dimensions are ignored (or "compressed"). In high-dimensional real-world environments, it is computationally infeasible to sample all available information, and human decision makers selectively sample information from sources expected to provide relevant information. To address these and other shortcomings, we develop an active sampling model, Sampling Emergent Attention (SEA), which sequentially and strategically samples information sources until the expected cost of information exceeds the expected benefit. The model specifies the interplay of two components, one involved in determining the expected utility of different information sources and the other in representing knowledge and beliefs about the environment. These two components interact such that knowledge of the world guides information sampling, and what is sampled updates knowledge. Like human decision makers, the model displays strategic sampling behavior, such as terminating information search when sufficient information has been sampled and adaptively adjusting the search path in response to previously sampled information. The model also shows human-like failure modes. For example, when information exploitation is prioritized over exploration, the bidirectional influences between information sampling and learning can lead to the development of beliefs that systematically differ from reality. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Explaining distortions in metacognition with an attractor network model of decision uncertainty

Metacognition is the ability to reflect on, and evaluate, our cognition and behaviour. Distortions in metacognition are common in mental health disorders, though the neural underpinnings of such dysfunction are unknown. One reason for this is that models of key components of metacognition, such as decision confidence, are generally specified at an algorithmic or process level. While such models can be used to relate brain function to psychopathology, they are difficult to map to a neurobiological mechanism. Here, we develop a biologically-plausible model of decision uncertainty in an attempt to bridge this gap. We first relate the model's uncertainty in perceptual decisions to standard metrics of metacognition, namely mean confidence level (bias) and the accuracy of metacognitive judgments (sensitivity). We show that dissociable shifts in metacognition are associated with isolated disturbances at higher-order levels of a circuit associated with self-monitoring, akin to neuropsychological findings that highlight the detrimental effect of prefrontal brain lesions on metacognitive performance. Notably, we are able to account for empirical confidence judgements by fitting the parameters of our biophysical model to first-order performance data, specifically choice and response times. Lastly, in a reanalysis of existing data we show that self-reported mental health symptoms relate to disturbances in an uncertainty-monitoring component of the network. By bridging a gap between a biologically-plausible model of confidence formation and observed disturbances of metacognition in mental health disorders we provide a first step towards mapping theoretical constructs of metacognition onto dynamical models of decision uncertainty. In doing so, we provide a computational framework for modelling metacognitive performance in settings where access to explicit confidence reports is not possible.

Neurophysiology of Human Perceptual Decision-Making

The discovery of neural signals that reflect the dynamics of perceptual decision formation has had a considerable impact. Not only do such signals enable detailed investigations of the neural implementation of the decision-making process but they also can expose key elements of the brain's decision algorithms. For a long time, such signals were only accessible through direct animal brain recordings, and progress in human neuroscience was hampered by the limitations of noninvasive recording techniques. However, recent methodological advances are increasingly enabling the study of human brain signals that finely trace the dynamics of the unfolding decision process. In this review, we highlight how human neurophysiological data are now being leveraged to furnish new insights into the multiple processing levels involved in forming decisions, to inform the construction and evaluation of mathematical models that can explain intra- and interindividual differences, and to examine how key ancillary processes interact with core decision circuits.

Choices change the temporal weighting of decision evidence

Many decisions result from the accumulation of decision-relevant information (evidence) over time. Even when maximizing decision accuracy requires weighting all the evidence equally, decision-makers often give stronger weight to evidence occurring early or late in the evidence stream. Here, we show changes in such temporal biases within participants as a function of intermittent judgments about parts of the evidence stream. Human participants performed a decision task that required a continuous estimation of the mean evidence at the end of the stream. The evidence was either perceptual (noisy random dot motion) or symbolic (variable sequences of numbers). Participants also reported a categorical judgment of the preceding evidence half-way through the stream in one condition or executed an evidence-independent motor response in another condition. The relative impact of early versus late evidence on the final estimation flipped between these two conditions. In particular, participants' sensitivity to late evidence after the intermittent judgment, but not the simple motor response, was decreased. Both the intermittent response as well as the final estimation reports were accompanied by nonluminance-mediated increases of pupil diameter. These pupil dilations were bigger during intermittent judgments than simple motor responses and bigger during estimation when the late evidence was consistent than inconsistent with the initial judgment. In sum, decisions activate pupil-linked arousal systems and alter the temporal weighting of decision evidence. Our results are consistent with the idea that categorical choices in the face of uncertainty induce a change in the state of the neural circuits underlying decision-making.NEW & NOTEWORTHY The psychology and neuroscience of decision-making have extensively studied the accumulation of decision-relevant information toward a categorical choice. Much fewer studies have assessed the impact of a choice on the processing of subsequent information. Here, we show that intermittent choices during a protracted stream of input reduce the sensitivity to subsequent decision information and transiently boost arousal. Choices might trigger a state change in the neural machinery for decision-making.

Neurocomputational mechanisms of prior-informed perceptual decision-making in humans

To interact successfully with diverse sensory environments, we must adapt our decision processes to account for time constraints and prior probabilities. The full set of decision-process parameters that undergo such flexible adaptation has proven to be difficult to establish using simplified models that are based on behaviour alone. Here, we utilize well-characterized human neurophysiological signatures of decision formation to construct and constrain a build-to-threshold decision model with multiple build-up (evidence accumulation and urgency) and delay components (pre- and post-decisional). The model indicates that all of these components were adapted in distinct ways and, in several instances, fundamentally differ from the conclusions of conventional diffusion modelling. The neurally informed model outcomes were corroborated by independent neural decision signal observations that were not used in the model's construction. These findings highlight the breadth of decision-process parameters that are amenable to strategic adjustment and the value in leveraging neurophysiological measurements to quantify these adjustments.

A circuit mechanism for decision-making biases and NMDA receptor hypofunction

Decision-making biases can be features of normal behaviour, or deficits underlying neuropsychiatric symptoms. We used behavioural psychophysics, spiking-circuit modelling and pharmacological manipulations to explore decision-making biases during evidence integration. Monkeys showed a pro-variance bias (PVB): a preference to choose options with more variable evidence. The PVB was also present in a spiking circuit model, revealing a potential neural mechanism for this behaviour. To model possible effects of NMDA receptor (NMDA-R) antagonism on this behaviour, we simulated the effects of NMDA-R hypofunction onto either excitatory or inhibitory neurons in the model. These were then tested experimentally using the NMDA-R antagonist ketamine, a pharmacological model of schizophrenia. Ketamine yielded an increase in subjects' PVB, consistent with lowered cortical excitation/inhibition balance from NMDA-R hypofunction predominantly onto excitatory neurons. These results provide a circuit-level mechanism that bridges across explanatory scales, from the synaptic to the behavioural, in neuropsychiatric disorders where decision-making biases are prominent.

Optimality and Limitations of Audio-Visual Integration for Cognitive Systems

Multimodal integration is an important process in perceptual decision-making. In humans, this process has often been shown to be statistically optimal, or near optimal: sensory information is combined in a fashion that minimizes the average error in perceptual representation of stimuli. However, sometimes there are costs that come with the optimization, manifesting as illusory percepts. We review audio-visual facilitations and illusions that are products of multisensory integration, and the computational models that account for these phenomena. In particular, the same optimal computational model can lead to illusory percepts, and we suggest that more studies should be needed to detect and mitigate these illusions, as artifacts in artificial cognitive systems. We provide cautionary considerations when designing artificial cognitive systems with the view of avoiding such artifacts. Finally, we suggest avenues of research toward solutions to potential pitfalls in system design. We conclude that detailed understanding of multisensory integration and the mechanisms behind audio-visual illusions can benefit the design of artificial cognitive systems.

Mechanisms underlying gain modulation in the cortex

Cortical gain regulation allows neurons to respond adaptively to changing inputs. Neural gain is modulated by internal and external influences, including attentional and arousal states, motor activity and neuromodulatory input. These influences converge to a common set of mechanisms for gain modulation, including GABAergic inhibition, synaptically driven fluctuations in membrane potential, changes in cellular conductance and changes in other biophysical neural properties. Recent work has identified GABAergic interneurons as targets of neuromodulatory input and mediators of state-dependent gain modulation. Here, we review the engagement and effects of gain modulation in the cortex. We highlight key recent findings that link phenomenological observations of gain modulation to underlying cellular and circuit-level mechanisms. Finally, we place these cellular and circuit interactions in the larger context of their impact on perception and cognition.

Pupillometric investigation into the speed-accuracy trade-off in a visuo-motor aiming task

Convergent lines of evidence suggest that fluctuations in the size of the pupil may be associated with the trade‐off between the speed (adrenergic, sympathetic) and accuracy (cholinergic, parasympathetic) of behavior across a variety of task contexts. Here, we explored whether pupil size was related to this trade‐off during a visuospatial motor aiming task. Participants were shown visual targets at random locations on a screen and were instructed and incentivized to move a computer mouse‐controlled cursor to the center of the targets, either as fast as possible, as accurately as possible, or to strike a balance between the two. Behavioral results showed that these instructions led to typical speed‐accuracy trade‐off effects on movement reaction times and hit distances to target centers. Pupillometric analyses revealed that movements were faster and less accurate when participants had relatively large baseline pupil sizes, as measured before target onset. Furthermore, trial‐evoked pupil dilation was related specifically to a bias toward speed in the trade‐off and the speed of the ballistic and error‐correction phases of the motor responses such that larger pupils predicted shorter latencies and higher movement speeds. Pupil responses were also associated with performance in a manner that may reflect the combined influence of a number of factors, including the generation of dynamic urgency and an arousal response to negative feedback. Our results generally support a role for pupil‐linked arousal in regulating the trade‐off between speed and accuracy, while also highlighting how the trial‐related pupil response can exhibit multifaceted, temporally discrete associations with behavior.

The eye’s pupil has been considered a “window into the soul” as its dynamics are related to a wide variety of cognitive processes. Here, we present convergent evidence that both slow, prestimulus fluctuations and fast, event‐related changes in pupil diameter are sensitive to a fundamental trade‐off between the speed and accuracy of visuo‐motor actions—an association that holds for both instructed and endogenous variation in this trade‐off. This finding complements a growing literature linking pupil size to adaptive, contextually appropriate changes in behavior.

A neural circuit model of decision uncertainty and change-of-mind

Decision-making is often accompanied by a degree of confidence on whether a choice is correct. Decision uncertainty, or lack in confidence, may lead to change-of-mind. Studies have identified the behavioural characteristics associated with decision confidence or change-of-mind, and their neural correlates. Although several theoretical accounts have been proposed, there is no neural model that can compute decision uncertainty and explain its effects on change-of-mind. We propose a neuronal circuit model that computes decision uncertainty while accounting for a variety of behavioural and neural data of decision confidence and change-of-mind, including testable model predictions. Our theoretical analysis suggests that change-of-mind occurs due to the presence of a transient uncertainty-induced choice-neutral stable steady state and noisy fluctuation within the neuronal network. Our distributed network model indicates that the neural basis of change-of-mind is more distinctively identified in motor-based neurons. Overall, our model provides a framework that unifies decision confidence and change-of-mind.

We make decisions with varying degrees of confidence and, if our confidence in a decision falls, we may change our mind. Here, the authors present a neuronal circuit model to account for how change of mind occurs under particular low-confidence conditions.

Inhibition and Excitation Shape Activity Selection: Effect of Oscillations in a Decision-Making Circuit

Decision making is a complex task, and its underlying mechanisms that regulate behavior, such as the implementation of the coupling between physiological states and neural networks, are hard to decipher. To gain more insight into neural computations underlying ongoing binary decision-making tasks, we consider a neural circuit that guides the feeding behavior of a hypothetical animal making dietary choices. We adopt an inhibition motif from neural network theory and propose a dynamical system characterized by nonlinear feedback, which links mechanism (the implementation of the neural circuit and its coupling to the animal's nutritional state) and function (improving behavioral performance). A central inhibitory unit influences evidence-integrating excitatory units, which in our terms correspond to motivations competing for selection. We determine the parameter regime where the animal exhibits improved decision-making behavior and explain different behavioral outcomes by making the link between accessible states of the nonlinear neural circuit model and decision-making performance. We find that for given deficits in nutritional items, the variation of inhibition strength and ratio of excitation and inhibition strengths in the decision circuit allows the animal to enter an oscillatory phase that describes its internal motivational state. Our findings indicate that this oscillatory phase may improve the overall performance of the animal in an ongoing foraging task and underpin the importance of an integrated functional and mechanistic study of animal activity selection.

Perceptual Decision-Making: Biases in Post-Error Reaction Times Explained by Attractor Network Dynamics

Perceptual decision-making is the subject of many experimental and theoretical studies. Most modeling analyses are based on statistical processes of accumulation of evidence. In contrast, very few works confront attractor network models' predictions with empirical data from continuous sequences of trials. Recently however, numerical simulations of a biophysical competitive attractor network model have shown that such a network can describe sequences of decision trials and reproduce repetition biases observed in perceptual decision experiments. Here we get more insights into such effects by considering an extension of the reduced attractor network model of Wong and Wang (2006), taking into account an inhibitory current delivered to the network once a decision has been made. We make explicit the conditions on this inhibitory input for which the network can perform a succession of trials, without being either trapped in the first reached attractor, or losing all memory of the past dynamics. We study in detail how, during a sequence of decision trials, reaction times and performance depend on nonlinear dynamics of the network, and we confront the model behavior with empirical findings on sequential effects. Here we show that, quite remarkably, the network exhibits, qualitatively and with the correct order of magnitude, post-error slowing and post-error improvement in accuracy, two subtle effects reported in behavioral experiments in the absence of any feedback about the correctness of the decision. Our work thus provides evidence that such effects result from intrinsic properties of the nonlinear neural dynamics.SIGNIFICANCE STATEMENT Much experimental and theoretical work is being devoted to the understanding of the neural correlates of perceptual decision-making. In a typical behavioral experiment, animals or humans perform a continuous series of binary discrimination tasks. To model such experiments, we consider a biophysical decision-making attractor neural network, taking into account an inhibitory current delivered to the network once a decision is made. Here we provide evidence that the same intrinsic properties of the nonlinear network dynamics underpins various sequential effects reported in experiments. Quite remarkably, in the absence of feedback on the correctness of the decisions, the network exhibits post-error slowing (longer reaction times after error trials) and post-error improvement in accuracy (smaller error rates after error trials).

Bridging Neural and Computational Viewpoints on Perceptual Decision-Making

Sequential sampling models have provided a dominant theoretical framework guiding computational and neurophysiological investigations of perceptual decision-making. While these models share the basic principle that decisions are formed by accumulating sensory evidence to a bound, they come in many forms that can make similar predictions of choice behaviour despite invoking fundamentally different mechanisms. The identification of neural signals that reflect some of the core computations underpinning decision formation offers new avenues for empirically testing and refining key model assumptions. Here, we highlight recent efforts to explore these avenues and, in so doing, consider the conceptual and methodological challenges that arise when seeking to infer decision computations from complex neural data.

Tune it in: mechanisms and computational significance of neuron-autonomous plasticity

The activity of a neural network is a result of synaptic signals that convey the communication between neurons and neuron-based intrinsic currents that determine the neuron’s input-output transfer function. Ample studies have demonstrated that cell-based excitability, and in particular intrinsic excitability, is modulated by learning and that these modifications play a key role in learning-related behavioral changes. The field of cell-based plasticity is largely growing, and it entails numerous experimental findings that demonstrate a large diversity of currents that are affected by learning. The diverse effect of learning on the neuron’s excitability emphasizes the need for a framework under which cell-based plasticity can be categorized to enable the assessment of the computational roles of the intrinsic modifications. We divide the domain of cell-based plasticity into three main categories, where the first category entails the currents that mediate the passive properties and single-spike generation, the second category entails the currents that mediate spike frequency adaptation, and the third category entails a novel learning-induced mechanism where all excitatory and inhibitory synapses double their strength. Curiously, this elementary division enables a natural categorization of the computational roles of these learning-induced plasticities. The computational roles are diverse and include modification of the neuronal mode of action, such as bursting, prolonged, and fast responsive; attention-like effect where the signal detection is improved; transfer of the network into an active state; biasing the competition for memory allocation; and transforming an environmental cue into a dominant cue and enabling a quicker formation of new memories.

Decisions are expedited through multiple neural adjustments spanning the sensorimotor hierarchy

When decisions are made under speed pressure, "urgency" signals elevate neural activity toward action-triggering thresholds independent of the sensory evidence, thus incurring a cost to choice accuracy. While urgency signals have been observed in brain circuits involved in preparing actions, their influence at other levels of the sensorimotor pathway remains unknown. We used a novel contrast-comparison paradigm to simultaneously trace the dynamics of sensory evidence encoding, evidence accumulation, motor preparation, and muscle activation in humans. Results indicate speed pressure impacts multiple sensorimotor levels but in crucially distinct ways. Evidence-independent urgency was applied to cortical action-preparation signals and downstream muscle activation, but not directly to upstream levels. Instead, differential sensory evidence encoding was enhanced in a way that partially countered the negative impact of motor-level urgency on accuracy, and these opposing sensory-boost and motor-urgency effects had knock-on effects on the buildup and pre-response amplitude of a motor-independent representation of cumulative evidence.

The system-neurophysiological basis for how methylphenidate modulates perceptual-attentional conflicts during auditory processing

The ability to selectively perceive and flexibly attend to relevant sensory signals in the environment is essential for action control. Whereas neuromodulation of sensory or attentional processing is often investigated, neuromodulation of interactive effects between perception and attention, that is, high attentional control demand when the relevant sensory information is perceptually less salient than the irrelevant one, is not well understood. To fill this gap, this pharmacological-electroencephalogram (EEG) study applied an intensity-modulated, focused-attention dichotic listening paradigm together with temporal EEG signal decomposition and source localization analyses. We used a double-blind MPH/placebo crossover design to delineate the effects of methylphenidate (MPH)-a dopamine/norepinephrine transporter blocker-on the resolution of perceptual-attentional conflicts, when perceptual saliency and attentional focus favor opposing ears, in healthy young adults. We show that MPH increased behavioral performance specifically in the condition with the most pronounced conflict between perceptual saliency and attentional focus. On the neurophysiological level, MPH effects in line with the behavioral data were observed after accounting for intraindividual variability in the signal. More specifically, MPH did not show an effect on stimulus-related processes but modulated the onset latency of processes between stimulus evaluation and responding. These modulations were further shown to be associated with activation differences in the temporoparietal junction (BA40) and the superior parietal cortex (BA7) and may reflect neuronal gain modulation principles. The findings provide mechanistic insights into the role of modulated dopamine/norepinephrine transmitter systems for the interactions between perception and attention.

Of monkeys and men: Impatience in perceptual decision-making

For decades sequential sampling models have successfully accounted for human and monkey decision-making, relying on the standard assumption that decision makers maintain a pre-set decision standard throughout the decision process. Based on the theoretical argument of reward rate maximization, some authors have recently suggested that decision makers become increasingly impatient as time passes and therefore lower their decision standard. Indeed, a number of studies show that computational models with an impatience component provide a good fit to human and monkey decision behavior. However, many of these studies lack quantitative model comparisons and systematic manipulations of rewards. Moreover, the often-cited evidence from single-cell recordings is not unequivocal and complimentary data from human subjects is largely missing. We conclude that, despite some enthusiastic calls for the abandonment of the standard model, the idea of an impatience component has yet to be fully established; we suggest a number of recently developed tools that will help bring the debate to a conclusive settlement.

Real Time Multiplicative Memory Amplification Mediated by Whole-Cell Scaling of Synaptic Response in Key Neurons

Intense spiking response of a memory-pattern is believed to play a crucial role both in normal learning and pathology, where it can create biased behavior. We recently proposed a novel model for memory amplification where the simultaneous two-fold increase of all excitatory (AMPAR-mediated) and inhibitory (GABA_AR-mediated) synapses in a sub-group of cells that constitutes a memory-pattern selectively amplifies this memory. Here we confirm the cellular basis of this model by validating its major predictions in four sets of experiments, and demonstrate its induction via a whole-cell transduction mechanism. Subsequently, using theory and simulations, we show that this whole-cell two-fold increase of all inhibitory and excitatory synapses functions as an instantaneous and multiplicative amplifier of the neurons’ spiking. The amplification mechanism acts through multiplication of the net synaptic current, where it scales both the average and the standard deviation of the current. In the excitation-inhibition balance regime, this scaling creates a linear multiplicative amplifier of the cell’s spiking response. Moreover, the direct scaling of the synaptic input enables the amplification of the spiking response to be synchronized with rapid changes in synaptic input, and to be independent of previous spiking activity. These traits enable instantaneous real-time amplification during brief elevations of excitatory synaptic input. Furthermore, the multiplicative nature of the amplifier ensures that the net effect of the amplification is large mainly when the synaptic input is mostly excitatory. When induced on all cells that comprise a memory-pattern, these whole-cell modifications enable a substantial instantaneous amplification of the memory-pattern when the memory is activated. The amplification mechanism is induced by CaMKII dependent phosphorylation that doubles the conductance of all GABA_A and AMPA receptors in a subset of neurons. This whole-cell transduction mechanism enables both long-term induction of memory amplification when necessary and extinction when not further required.

Amplifying the strength of a neuronal assembly that underlies a behavioral choice can lead to a particularly long lasting dominant memory. We report experimental and theoretical evidence for a long-term mechanism that amplifies the response of a neuronal assembly which we termed “memory amplification mechanism”. The amplification mechanism is mediated by doubling the strength of all inhibitory and all excitatory synapses in the cell and is induced by whole-cell phosphorylation of all inhibitory and excitatory synaptic receptors in a subset of cells, via a process that is distinct from memory formation. Computationally, the inherent scaling of both excitation and inhibition yields a robust and stable amplifier of the neuron’s response. When such an amplifier is induced in a set of cells that compose a memory-pattern, it can selectively amplify the response of this memory. The memory amplification mechanism is independent from associative learning. Thus, while associative learning forms a memory that encodes new associations, the amplification mechanism can promote an already formed memory to a dominant memory.

Global gain modulation generates time-dependent urgency during perceptual choice in humans

Decision-makers must often balance the desire to accumulate information with the costs of protracted deliberation. Optimal, reward-maximizing decision-making can require dynamic adjustment of this speed/accuracy trade-off over the course of a single decision. However, it is unclear whether humans are capable of such time-dependent adjustments. Here, we identify several signatures of time-dependency in human perceptual decision-making and highlight their possible neural source. Behavioural and model-based analyses reveal that subjects respond to deadline-induced speed pressure by lowering their criterion on accumulated perceptual evidence as the deadline approaches. In the brain, this effect is reflected in evidence-independent urgency that pushes decision-related motor preparation signals closer to a fixed threshold. Moreover, we show that global modulation of neural gain, as indexed by task-related fluctuations in pupil diameter, is a plausible biophysical mechanism for the generation of this urgency. These findings establish context-sensitive time-dependency as a critical feature of human decision-making.

Decision-making balances the benefits of additional information with the cost of time, but it is unclear whether humans adjust this balance within individual decisions. Here, authors show that we do make such adjustments to suit contextual demands and suggest that these are driven by modulation of neural gain.

Temporal Information of Directed Causal Connectivity in Multi-Trial ERP Data using Partial Granger Causality

Partial Granger causality (PGC) has been applied to analyse causal functional neural connectivity after effectively mitigating confounding influences caused by endogenous latent variables and exogenous environmental inputs. However, it is not known how this connectivity obtained from PGC evolves over time. Furthermore, PGC has yet to be tested on realistic nonlinear neural circuit models and multi-trial event-related potentials (ERPs) data. In this work, we first applied a time-domain PGC technique to evaluate simulated neural circuit models, and demonstrated that the PGC measure is more accurate and robust in detecting connectivity patterns as compared to conditional Granger causality and partial directed coherence, especially when the circuit is intrinsically nonlinear. Moreover, the connectivity in PGC settles faster into a stable and correct configuration over time. After method verification, we applied PGC to reveal the causal connections of ERP trials of a mismatch negativity auditory oddball paradigm. The PGC analysis revealed a significant bilateral but asymmetrical localised activity in the temporal lobe close to the auditory cortex, and causal influences in the frontal, parietal and cingulate cortical areas, consistent with previous studies. Interestingly, the time to reach a stable connectivity configuration (~250–300 ms) coincides with the deviation of ensemble ERPs of oddball from standard tones. Finally, using a sliding time window, we showed higher resolution dynamics of causal connectivity within an ERP trial. In summary, time-domain PGC is promising in deciphering directed functional connectivity in nonlinear and ERP trials accurately, and at a sufficiently early stage. This data-driven approach can reduce computational time, and determine the key architecture for neural circuit modeling.

Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation

It has been suggested that dopamine (DA) represents reward-prediction-error (RPE) defined in reinforcement learning and therefore DA responds to unpredicted but not predicted reward. However, recent studies have found DA response sustained towards predictable reward in tasks involving self-paced behavior, and suggested that this response represents a motivational signal. We have previously shown that RPE can sustain if there is decay/forgetting of learned-values, which can be implemented as decay of synaptic strengths storing learned-values. This account, however, did not explain the suggested link between tonic/sustained DA and motivation. In the present work, we explored the motivational effects of the value-decay in self-paced approach behavior, modeled as a series of ‘Go’ or ‘No-Go’ selections towards a goal. Through simulations, we found that the value-decay can enhance motivation, specifically, facilitate fast goal-reaching, albeit counterintuitively. Mathematical analyses revealed that underlying potential mechanisms are twofold: (1) decay-induced sustained RPE creates a gradient of ‘Go’ values towards a goal, and (2) value-contrasts between ‘Go’ and ‘No-Go’ are generated because while chosen values are continually updated, unchosen values simply decay. Our model provides potential explanations for the key experimental findings that suggest DA's roles in motivation: (i) slowdown of behavior by post-training blockade of DA signaling, (ii) observations that DA blockade severely impairs effortful actions to obtain rewards while largely sparing seeking of easily obtainable rewards, and (iii) relationships between the reward amount, the level of motivation reflected in the speed of behavior, and the average level of DA. These results indicate that reinforcement learning with value-decay, or forgetting, provides a parsimonious mechanistic account for the DA's roles in value-learning and motivation. Our results also suggest that when biological systems for value-learning are active even though learning has apparently converged, the systems might be in a state of dynamic equilibrium, where learning and forgetting are balanced.

Dopamine (DA) has been suggested to have two reward-related roles: (1) representing reward-prediction-error (RPE), and (2) providing motivational drive. Role(1) is based on the physiological results that DA responds to unpredicted but not predicted reward, whereas role(2) is supported by the pharmacological results that blockade of DA signaling causes motivational impairments such as slowdown of self-paced behavior. So far, these two roles are considered to be played by two different temporal patterns of DA signals: role(1) by phasic signals and role(2) by tonic/sustained signals. However, recent studies have found sustained DA signals with features indicative of both roles (1) and (2), complicating this picture. Meanwhile, whereas synaptic/circuit mechanisms for role(1), i.e., how RPE is calculated in the upstream of DA neurons and how RPE-dependent update of learned-values occurs through DA-dependent synaptic plasticity, have now become clarified, mechanisms for role(2) remain unclear. In this work, we modeled self-paced behavior by a series of ‘Go’ or ‘No-Go’ selections in the framework of reinforcement-learning assuming DA's role(1), and demonstrated that incorporation of decay/forgetting of learned-values, which is presumably implemented as decay of synaptic strengths storing learned-values, provides a potential unified mechanistic account for the DA's two roles, together with its various temporal patterns.

Signal Propagation in the Human Visual Pathways: An Effective Connectivity Analysis

Although the visual system has been extensively investigated, an integrated account of the spatiotemporal dynamics of long-range signal propagation along the human visual pathways is not completely known or validated. In this work, we used dynamic causal modeling approach to provide insights into the underlying neural circuit dynamics of pattern reversal visual-evoked potentials extracted from concurrent EEG-fMRI data. A recurrent forward-backward connectivity model, consisting of multiple interacting brain regions identified by EEG source localization aided by fMRI spatial priors, best accounted for the data dynamics. Sources were first identified in the thalamic area, primary visual cortex, as well as higher cortical areas along the ventral and dorsal visual processing streams. Consistent with hierarchical early visual processing, the model disclosed and quantified the neural temporal dynamics across the identified activity sources. This signal propagation is dominated by a feedforward process, but we also found weaker effective feedback connectivity. Using effective connectivity analysis, the optimal dynamic causal modeling revealed enhanced connectivity along the dorsal pathway but slightly suppressed connectivity along the ventral pathway. A bias was also found in favor of the right hemisphere consistent with functional attentional asymmetry. This study validates, for the first time, the long-range signal propagation timing in the human visual pathways. A similar modeling approach can potentially be used to understand other cognitive processes and dysfunctions in signal propagation in neurological and neuropsychiatric disorders. Significance statement: An integrated account of long-range visual signal propagation in the human brain is currently incomplete. Using computational neural modeling on our acquired concurrent EEG-fMRI data under a visual evoked task, we found not only a substantial forward propagation toward "higher-order" brain regions but also a weaker backward propagation. Asymmetry in our model's long-range connectivity accounted for the various observed activity biases. Importantly, the model disclosed the timing of signal propagation across these connectivity pathways and validates, for the first time, long-range signal propagation in the human visual system. A similar modeling approach could be used to identify neural pathways for other cognitive processes and their dysfunctions in brain disorders.

Categorical evidence, confidence, and urgency during probabilistic categorization

We used a temporally extended categorization task to investigate the neural substrates underlying our ability to integrate information over time and across multiple stimulus features. Using model-based fMRI, we tracked the temporal evolution of two important variables as participants deliberated about impending choices: (1) categorical evidence, and (2) confidence (the total amount of evidence provided by the stimuli, irrespective of the particular category favored). Importantly, in each model, we also included a covariate that allowed us to differentiate signals related to information accumulation from other, evidence-independent functions that increased monotonically with time (such as urgency or cognitive load). We found that somatomotor regions tracked the temporal evolution of categorical evidence, while regions in both medial and lateral prefrontal cortex, inferior parietal cortex, and the striatum tracked decision confidence. As both theory and experimental work suggest that patterns of activity thought to be related to information-accumulation may reflect, in whole or in part, an interaction between sensory evidence and urgency, we additionally investigated whether urgency might modulate the slopes of the two evidence-dependent functions. We found that the slopes of both functions were likely modulated by urgency such that the difference between the high and low evidence states increased as the response deadline loomed.

Speed-accuracy tradeoff by a control signal with balanced excitation and inhibition

A hallmark of flexible behavior is the brain's ability to dynamically adjust speed and accuracy in decision-making. Recent studies suggested that such adjustments modulate not only the decision threshold, but also the rate of evidence accumulation. However, the underlying neuronal-level mechanism of the rate change remains unclear. In this work, using a spiking neural network model of perceptual decision, we demonstrate that speed and accuracy of a decision process can be effectively adjusted by manipulating a top-down control signal with balanced excitation and inhibition [balanced synaptic input (BSI)]. Our model predicts that emphasizing accuracy over speed leads to reduced rate of ramping activity and reduced baseline activity of decision neurons, which have been observed recently at the level of single neurons recorded from behaving monkeys in speed-accuracy tradeoff tasks. Moreover, we found that an increased inhibitory component of BSI skews the decision time distribution and produces a pronounced exponential tail, which is commonly observed in human studies. Our findings suggest that BSI can serve as a top-down control mechanism to rapidly and parametrically trade between speed and accuracy, and such a cognitive control signal presents both when the subjects emphasize accuracy or speed in perceptual decisions.