Decision amid uncertainty

Developmental Differences in Probabilistic Reversal Learning: A Computational Modeling Approach

Cognitive flexibility helps us to navigate through our ever-changing environment and has often been examined by reversal learning paradigms. Performance in reversal learning can be modeled using computational modeling which allows for the specification of biologically plausible models to infer psychological mechanisms. Although such models are increasingly used in cognitive neuroscience, developmental approaches are still scarce. Additionally, though most reversal learning paradigms have a comparable design regarding timing and feedback contingencies, the type of feedback differs substantially between studies. The present study used hierarchical Gaussian filter modeling to investigate cognitive flexibility in reversal learning in children and adolescents and the effect of various feedback types. The results demonstrate that children make more overall errors and regressive errors (when a previously learned response rule is chosen instead of the new correct response after the initial shift to the new correct target), but less perseverative errors (when a previously learned response set continues to be used despite a reversal) adolescents. Analyses of the extracted model parameters of the winning model revealed that children seem to use new and conflicting information less readily than adolescents to update their stimulus-reward associations. Furthermore, more subclinical rigidity in everyday life (parent-ratings) is related to less explorative choice behavior during the probabilistic reversal learning task. Taken together, this study provides first-time data on the development of the underlying processes of cognitive flexibility using computational modeling.

Risk-taking and risky decision-making in Internet gaming disorder: Implications regarding online gaming in the setting of negative consequences

Individuals with Internet gaming disorder (IGD) continue gaming despite adverse consequences. However, the precise mechanism underlying this behavior remains unknown. In this study, data from 20 IGD subjects and 16 otherwise comparable healthy control subjects (HCs) were recorded and compared when they were undergoing risk-taking and risky decision-making during functional magnetic resonance imaging (fMRI). During risk-taking and as compared to HCs, IGD subjects selected more risk-disadvantageous trials and demonstrated less activation of the anterior cingulate, posterior cingulate and middle temporal gyrus. During risky decision-making and as compared to HCs, IGD subjects showed shorter response times and less activations of the inferior frontal and superior temporal gyri. Taken together, data suggest that IGD subjects show impaired executive control in selecting risk-disadvantageous choices, and they make risky decisions more hastily and with less recruitment of regions implicated in impulse control. These results suggest a possible neurobiological underpinning for why IGD subjects may exhibit poor control over their game-seeking behaviors even when encountering negative consequences and provide possible therapeutic targets for interventions in this population.

Computational Psychiatry of ADHD: Neural Gain Impairments across Marrian Levels of Analysis

Attention-deficit hyperactivity disorder (ADHD), one of the most common psychiatric disorders, is characterised by unstable response patterns across multiple cognitive domains. However, the neural mechanisms that explain these characteristic features remain unclear. Using a computational multilevel approach, we propose that ADHD is caused by impaired gain modulation in systems that generate this phenotypic increased behavioural variability. Using Marr's three levels of analysis as a heuristic framework, we focus on this variable behaviour, detail how it can be explained algorithmically, and how it might be implemented at a neural level through catecholamine influences on corticostriatal loops. This computational, multilevel, approach to ADHD provides a framework for bridging gaps between descriptions of neuronal activity and behaviour, and provides testable predictions about impaired mechanisms.

How the risky features of previous selection affect subsequent decision-making: evidence from behavioral and fMRI measures

Human decision making is rarely conducted in temporal isolation. It is often biased and affected by environmental variables, particularly prior selections. In this study, we used a task that simulates a real gambling process to explore the effect of the risky features of a previous selection on subsequent decision making. Compared with decision making after an advantageous risk-taking situation (Risk_Adv), that after a disadvantageous risk-taking situation (Risk_Disadv) is associated with a longer response time (RT, the time spent in making decisions) and higher brain activations in the caudate and the dorsolateral prefrontal cortex (DLPFC). Compared with decisions after Risk_Adv, those after Risk_Disadv in loss trials are associated with higher brain activations in the left superior temporal gyrus (STG) and the precuneus. Brain activity and relevant RTs significantly correlated. Overall, people who experience disadvantageous risk-taking selections tend to focus on current decision making and engage cognitive endeavors in value evaluation and in the regulation of their risk-taking behaviors during decision making.

Pupil diameter reflects uncertainty in attentional selection during visual search

Pupil diameter has long been used as a metric of cognitive processing. However, recent advances suggest that the cognitive sources of change in pupil size may reflect LC-NE function and the calculation of unexpected uncertainty in decision processes (Aston-Jones and Cohen, 2005; Yu and Dayan, 2005). In the current experiments, we explored the role of uncertainty in attentional selection on task-evoked changes in pupil diameter during visual search. We found that task-evoked changes in pupil diameter were related to uncertainty during attentional selection as measured by reaction time (RT) and performance accuracy (Experiments 1-2). Control analyses demonstrated that the results are unlikely to be due to error monitoring or response uncertainty. Our results suggest that pupil diameter can be used as an implicit metric of uncertainty in ongoing attentional selection requiring effortful control processes.

Acute stress in adulthood impoverishes social choices and triggers aggressiveness in preclinical models

Adult C57BL/6J mice are known to exhibit high level of social flexibility while mice lacking the β2 subunit of nicotinic receptors (β2(-/-) mice) present social rigidity. We asked ourselves what would be the consequences of a restraint acute stress (45 min) on social interactions in adult mice of both genotypes, hence the contribution of neuronal nicotinic receptors in this process. We therefore dissected social interaction complexity of stressed and not stressed dyads of mice in a social interaction task. We also measured plasma corticosterone levels in our experimental conditions. We showed that a single stress exposure occurring in adulthood reduced and disorganized social interaction complexity in both C57BL/6J and β2(-/-) mice. These stress-induced maladaptive social interactions involved alteration of distinct social categories and strategies in both genotypes, suggesting a dissociable impact of stress depending on the functioning of the cholinergic nicotinic system. In both genotypes, social behaviors under stress were coupled to aggressive reactions with no plasma corticosterone changes. Thus, aggressiveness appeared a general response independent of nicotinic function. We demonstrate here that a single stress exposure occurring in adulthood is sufficient to impoverish social interactions: stress impaired social flexibility in C57BL/6J mice whereas it reinforced β2(-/-) mice behavioral rigidity.

Adaptive gain control during human perceptual choice

Neural systems adapt to background levels of stimulation. Adaptive gain control has been extensively studied in sensory systems but overlooked in decision-theoretic models. Here, we describe evidence for adaptive gain control during the serial integration of decision-relevant information. Human observers judged the average information provided by a rapid stream of visual events (samples). The impact that each sample wielded over choices depended on its consistency with the previous sample, with more consistent or expected samples wielding the greatest influence over choice. This bias was also visible in the encoding of decision information in pupillometric signals and in cortical responses measured with functional neuroimaging. These data can be accounted for with a serial sampling model in which the gain of information processing adapts rapidly to reflect the average of the available evidence.

Decision-making after continuous wins or losses in a randomized guessing task: implications for how the prior selection results affect subsequent decision-making

Background

Human decision-making is often affected by prior selections and their outcomes, even in situations where decisions are independent and outcomes are unpredictable.

Methods

In this study, we created a task that simulated real-life non-strategic gambling to examine the effect of prior outcomes on subsequent decisions in a group of male college students.

Results

Behavioral performance showed that participants needed more time to react after continuous losses (LOSS) than continuous wins (WIN) and discontinuous outcomes (CONTROL). In addition, participants were more likely to repeat their selections in both WIN and LOSS conditions. Functional MRI data revealed that decisions in WINs were associated with increased activation in the mesolimbic pathway, but decreased activation in the inferior frontal gyrus relative to LOSS. Increased prefrontal cortical activation was observed during LOSS relative to WIN and CONTROL conditions.

Conclusion

Taken together, the behavioral and neuroimaging findings suggest that participants tended to repeat previous selections during LOSS trials, a pattern resembling the gambler’s fallacy. However, during WIN trials, participants tended to follow their previous lucky decisions, like the ‘hot hand’ fallacy.

What makes Internet addicts continue playing online even when faced by severe negative consequences? Possible explanations from an fMRI study

In this study, we designed a continuous wins-and-losses task to monitor the mental activities during decision-making and their effects on subsequent decisions in Internet addiction disorder (IAD) subjects. In behavioral performance, IAD subjects show longer response time, lower repeat rate and greater Stroop effect than healthy controls. In neuroimaging results, IAD subjects show increased brain activities in the inferior frontal cortex, insula, anterior cingulate cortex and decreased activation in the caudate and posterior cingulate cortex after continuous wins than healthy controls. In addition, IAD subjects show increased brain activities in the inferior frontal gyrus and decreased brain activation in the posterior cingulate cortex after continuous losses. Thus, we concluded that IAD subjects engage more cognitive activities to finish the decision-making task. As a result, they cannot sufficiently focus on the executive function during this process. They also do not pay adequate attention to considering previous selections and relevant outcomes during decision-making.

Exploration-exploitation trade-off features a saltatory search behaviour

Searching experiments conducted in different virtual environments over a gender-balanced group of people revealed a gender irrelevant scale-free spread of searching activity on large spatio-temporal scales. We have suggested and solved analytically a simple statistical model of the coherent-noise type describing the exploration-exploitation trade-off in humans ('should I stay' or 'should I go'). The model exhibits a variety of saltatory behaviours, ranging from Lévy flights occurring under uncertainty to Brownian walks performed by a treasure hunter confident of the eventual success.

The proactive brain: memory for predictions

It is proposed that the human brain is proactive in that it continuously generates predictions that anticipate the relevant future. In this proposal, analogies are derived from elementary information that is extracted rapidly from the input, to link that input with the representations that exist in memory. Finding an analogical link results in the generation of focused predictions via associative activation of representations that are relevant to this analogy, in the given context. Predictions in complex circumstances, such as social interactions, combine multiple analogies. Such predictions need not be created afresh in new situations, but rather rely on existing scripts in memory, which are the result of real as well as of previously imagined experiences. This cognitive neuroscience framework provides a new hypothesis with which to consider the purpose of memory, and can help explain a variety of phenomena, ranging from recognition to first impressions, and from the brain's 'default mode' to a host of mental disorders.

Effects of the noradrenergic agonist clonidine on temporal and spatial attention

RATIONALE

Recent theories posit an important role for the noradrenergic system in attentional selection in the temporal domain. In contrast, the spatially diffuse topographical projections of the noradrenergic system are inconsistent with a direct role in spatial selection.

OBJECTIVES

To test the hypotheses that pharmacological attenuation of central noradrenergic activity should (1) impair performance on the attentional blink task, a task requiring the selection of targets in a rapid serial visual stream of stimuli; and (2) leave intact the efficiency of the search for a target in a two-dimensional visuospatial stimulus array.

MATERIALS AND METHODS

Thirty-two healthy adult human subjects performed an attentional blink task and a visual search task in a double-blind, placebo-controlled, between-subject study investigating the effects of the alpha2 adrenoceptor agonist clonidine (150 microg, oral dose).

RESULTS

No differential effects of clonidine vs placebo were found on the attentional blink performance. Clonidine slowed overall reaction times in the visual search task but did not impair the efficiency of the visual search.

CONCLUSIONS

The attentional blink results are inconsistent with recent theories about the role of the noradrenergic system in temporal filtering and in mediating the attentional blink. This discrepancy between theory and data is discussed in detail. The visual search results, in combination with previous findings, suggest that the noradrenergic system is not directly involved in spatial attention processes but instead can modulate these processes in an indirect fashion.

The proactive brain: using analogies and associations to generate predictions

Rather than passively 'waiting' to be activated by sensations, it is proposed that the human brain is continuously busy generating predictions that approximate the relevant future. Building on previous work, this proposal posits that rudimentary information is extracted rapidly from the input to derive analogies linking that input with representations in memory. The linked stored representations then activate the associations that are relevant in the specific context, which provides focused predictions. These predictions facilitate perception and cognition by pre-sensitizing relevant representations. Predictions regarding complex information, such as those required in social interactions, integrate multiple analogies. This cognitive neuroscience framework can help explain a variety of phenomena, ranging from recognition to first impressions, and from the brain's 'default mode' to a host of mental disorders.