Valuation of knowledge and ignorance in mesolimbic reward circuitry

The neuroscience of active learning and direct instruction

Throughout the educational system, students experiencing active learning pedagogy perform better and fail less than those taught through direct instruction. Can this be ascribed to differences in learning from a neuroscientific perspective? This review examines mechanistic, neuroscientific evidence that might explain differences in cognitive engagement contributing to learning outcomes between these instructional approaches. In classrooms, direct instruction comprehensively describes academic content, while active learning provides structured opportunities for learners to explore, apply, and manipulate content. Synaptic plasticity and its modulation by arousal or novelty are central to all learning and both approaches. As a form of social learning, direct instruction relies upon working memory. The reinforcement learning circuit, associated agency, curiosity, and peer-to-peer social interactions combine to enhance motivation, improve retention, and build higher-order-thinking skills in active learning environments. When working memory becomes overwhelmed, additionally engaging the reinforcement learning circuit improves retention, providing an explanation for the benefits of active learning. This analysis provides a mechanistic examination of how emerging neuroscience principles might inform pedagogical choices at all educational levels.

When the interoceptive and conceptual clash: The case of oppositional phenomenal self-modelling in Tourette syndrome

Tourette syndrome (TS) has been associated with a rich set of symptoms that are said to be uncomfortable, unwilled, and effortful to manage. Furthermore, tics, the canonical characteristic of TS, are multifaceted, and their onset and maintenance is complex. A formal account that integrates these features of TS symptomatology within a plausible theoretical framework is currently absent from the field. In this paper, we assess the explanatory power of hierarchical generative modelling in accounting for TS symptomatology from the perspective of active inference. We propose a fourfold analysis of sensory, motor, and cognitive phenomena associated with TS. In Section 1, we characterise tics as a form of action aimed at sensory attenuation. In Section 2, we introduce the notion of epistemic ticcing and describe such behaviour as the search for evidence that there is an agent (i.e., self) at the heart of the generative hierarchy. In Section 3, we characterise both epistemic (sensation-free) and nonepistemic (sensational) tics as habitual behaviour. Finally, in Section 4, we propose that ticcing behaviour involves an inevitable conflict between distinguishable aspects of selfhood; namely, between the minimal phenomenal sense of self-which is putatively underwritten by interoceptive inference-and the explicit preferences that constitute the individual's conceptual sense of self. In sum, we aim to provide an empirically informed analysis of TS symptomatology under active inference, revealing a continuity between covert and overt features of the condition.

The causal structure and computational value of narratives

Many human behavioral and brain imaging studies have used narratively structured stimuli (e.g., written, audio, or audiovisual stories) to better emulate real-world experience in the laboratory. However, narratives are a special class of real-world experience, largely defined by their causal connections across time. Much contemporary neuroscience research does not consider this key property. We review behavioral and neuroscientific work that speaks to how causal structure shapes comprehension of and memory for narratives. We further draw connections between this work and reinforcement learning, highlighting how narratives help link causes to outcomes in complex environments. By incorporating the plausibility of causal connections between classes of actions and outcomes, reinforcement learning models may become more ecologically valid, while simultaneously elucidating the value of narratives.

"How" web searches change under stress

To adjust to stressful environments, people seek information. Here, we show that in response to stressful public and private events the high-level features of information people seek online alter, reflecting their motives for seeking knowledge. We first show that when people want information to guide action they selectively ask "How" questions. Next, we reveal that "How" searches submitted to Google increased dramatically during the pandemic (controlling for search volume). Strikingly, the proportion of these searches predicted weekly self-reported stress of ~ 17K individuals. To rule out third factors we manipulate stress and find that "How" searches increase in response to stressful, personal, events. The findings suggest that under stress people ask questions to guide action, and mental state is reflected in features that tap into why people seek information rather than the topics they search for. Tracking such features may provide clues regrading population stress levels.

The effect of noninstrumental information on reward learning

Investigations of information-seeking often highlight people's tendency to forgo financial reward in return for advance information about future outcomes. Most of these experiments use tasks in which reward contingencies are described to participants. The use of such descriptions leaves open the question of whether the opportunity to obtain such noninstrumental information influences people's ability to learn and represent the underlying reward structure of an experimental environment. In two experiments, participants completed a two-armed bandit task with monetary incentives where reward contingencies were learned via trial-by-trial experience. We find, akin to description-based tasks, that participants are willing to forgo financial reward to receive information about a delayed, unchangeable outcome. Crucially, however, there is little evidence this willingness to pay for information is driven by an inaccurate representation of the reward structure: participants' representations approximated the underlying reward structure regardless of the presence of advance noninstrumental information. The results extend previous conclusions regarding the intrinsic value of information to an experience-based domain and highlight challenges of probing participants' memories for experienced rewards.

Dorsal raphe neurons integrate the values of reward amount, delay, and uncertainty in multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when confronting reward uncertainty. However, it has been unclear whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider these attributes to make a choice. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes, and this population tended to integrate the attributes in a manner that reflected monkeys' preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how the DRN participates in value computations, guiding theories about the role of the DRN in decision-making and psychiatric disease.

Neural mechanisms of information seeking

We ubiquitously seek information to make better decisions. Particularly in the modern age, when more information is available at our fingertips than ever, the information we choose to collect determines the quality of our decisions. Decision neuroscience has long adopted empirical approaches where the information available to decision-makers is fully controlled by the researchers, leaving neural mechanisms of information seeking less understood. Although information seeking has long been studied in the context of the exploration-exploitation trade-off, recent studies have widened the scope to investigate more overt information seeking in a way distinct from other decision processes. Insights gained from these studies, accumulated over the last few years, raise the possibility that information seeking is driven by the reward system signaling the subjective value of information. In this piece, we review findings from the recent studies, highlighting the conceptual and empirical relationships between distinct literatures, and discuss future research directions necessary to establish a more comprehensive understanding of how individuals seek information as a part of value-based decision-making.

Metacognition of curiosity: People underestimate the seductive lure of non-instrumental information

Curiosity - the desire to seek information - is fundamental for learning and performance. Studies on curiosity have shown that people are intrinsically motivated to seek information even if it does not bring an immediate tangible benefit (i.e., non-instrumental information), but little is known as to whether people have the metacognitive capability to accurately monitor their motivation for seeking information. We examined whether people can accurately predict their own non-instrumental information-seeking behavior. Across six experiments (Experiments 1A-1E and 2, total N = 579), participants predicted that they would engage in information-seeking behavior less frequently than they actually did, suggesting that people tend to underestimate the motivational lure of curiosity. Overall, there was no consistent statistical evidence that this underestimation was altered by contextual factors (e.g., the cost to seek information). These results were consistent with the theoretical account that it is difficult for people to make sense of the internally rewarding value of information in advance.

The neurobehavioral correlates of exploration without learning: Trading off value for explicit, prospective, and variable information gains

Exploration is typically motivated by gaining information, with previous research showing that potential information gains drive a "directed" type of exploration. Yet, this research usually studies exploration in the context of learning paradigms and does not directly manipulate multiple levels of information gain. Here, we present a task that isolates learning from decision-making and controls the magnitude of prospective information gains. As predicted, participants explore more with larger future information gains. Both value gains and information gains, at a trial-by-trial level, engage the ventromedial prefrontal cortex (vmPFC), the ventral striatum (VStr), the amygdala, the dorsal anterior cingulate cortex (dACC), and the anterior insula (aINS). Moreover, individual sensitivities to value gains and information gains modulate the vmPFC, dACC, and aINS, but the amygdala and VStr are modulated only by individual sensitivities to information gains. Overall, we identify the neural circuitry of information-based exploration and its relationship with inter-individual exploration biases.

Motivational drivers of costly information search

Acquiring information that aids decision-making is subject to a trade-off of accuracy versus cost, given that time, effort, or money are required to obtain decision-relevant information. Three studies (N = 2010) investigated the motivational dynamics shaping the priorities that govern this trade-off. Motivational orientations related to both the decision-making process and its outcome were examined. Regulatory focus theory describes two broad orientations to goal pursuit: promotion focus, prioritizing eager achievement, versus prevention focus, prioritizing vigilant security. We hypothesized that when the framing of a decision-making task activates a prevention focus rather than a promotion focus, individuals would be more willing to assume the costs of acquiring additional information before making their decisions. To test this hypothesis, participants made incentivized decisions with the option of acquiring additional information before making a final decision; importantly, obtaining this information incurred financial costs. Results consistently confirmed that prevention-focused decision makers were indeed more willing to assume the costs of acquiring additional information than promotion-focused individuals. The first two studies involved a scenario where participants were indifferent to the specific outcome of the decision process; accuracy was their only concern. In the final study, searchable, accuracy-enhancing information was also related to decision makers' partisan political preferences. Regulatory focus and the preference for partisan-congenial information were observed to be co-occurring but functionally orthogonal drivers of costly information search. Thus, prevention-framed messages can motivate the search for decision-relevant information, even when this search is costly and could lead to disagreeable data.

Motivation as a Lens for Understanding Information-seeking Behaviors

Most prior research characterizes information-seeking behaviors as serving utilitarian purposes, such as whether the obtained information can help solve practical problems. However, information-seeking behaviors are sensitive to different contexts (i.e., threat vs. curiosity), despite having equivalent utility. Furthermore, these search behaviors can be modulated by individuals' life history and personality traits. Yet the emphasis on utilitarian utility has precluded the development of a unified model, which explains when and how individuals actively seek information. To account for this variability and flexibility, we propose a unified information-seeking framework that examines information-seeking through the lens of motivation. This unified model accounts for integration across individuals' internal goal states and the salient features of the environment to influence information-seeking behavior. We propose that information-seeking is determined by motivation for information, invigorated either by instrumental utility or hedonic utility, wherein one's personal or environmental context moderates this relationship. Furthermore, we speculate that the final common denominator in guiding information-seeking is the engagement of different neuromodulatory circuits centered on dopaminergic and noradrenergic tone. Our framework provides a unified framework for information-seeking behaviors and generates several testable predictions for future studies.

A neural mechanism for conserved value computations integrating information and rewards

Behavioral and economic theory dictate that we decide between options based on their values. However, humans and animals eagerly seek information about uncertain future rewards, even when this does not provide any objective value. This implies that decisions are made by endowing information with subjective value and integrating it with the value of extrinsic rewards, but the mechanism is unknown. Here, we show that human and monkey value judgements obey strikingly conserved computational principles during multi-attribute decisions trading off information and extrinsic reward. We then identify a neural substrate in a highly conserved ancient structure, the lateral habenula (LHb). LHb neurons signal subjective value, integrating information's value with extrinsic rewards, and the LHb predicts and causally influences ongoing decisions. Neurons in key input areas to the LHb largely signal components of these computations, not integrated value signals. Thus, our data uncover neural mechanisms of conserved computations underlying decisions to seek information about the future.

Using curiosity to counter health information avoidance

OBJECTIVE

Information that is beneficial for health decision-making is often ignored or actively avoided. Countering information avoidance can increase knowledge of disease risk factors and symptoms, aiding early diagnoses and reducing disease transmission. We examine whether curiosity can be a useful tool in increasing demand for, and engagement with, potentially aversive but useful health information.

METHODS

Four pre-registered randomized online studies were conducted with 5795 participants recruited from online survey platforms. Curiosity for aversive health information was manipulated by providing a 'curiosity incentive' - identity-related information alongside aversive information - (Study 1), obscuring information (Studies 2 and 3), and eliciting guesses about the information (Studies 2 and 4). Willingness to view four types of aversive health information was elicited: alcohol consumption screening scores (Study 1), colon cancer risk scores (Study 2), cancer risk factors (Study 3), and the sugar content of drinks (Study 4).

RESULTS

In Study 1, the curiosity manipulation increased the likelihood that participants viewed information about the riskiness of their drinking. Studies 2 and 3 show that curiosity prompts can counter people's reluctance to learn about and assess their cancer risk. And Study 4 shows that using curiosity prompts to encourage engagement with aversive information (sugar content of drinks) also improves health-related choices (opting for a sugar-free drink alternative).

CONCLUSION

Curiosity prompts provide an effective and simple way to increase engagement with aversive health information.

A goal-centric outlook on learning

Goals play a central role in human cognition. However, computational theories of learning and decision-making often take goals as given. Here, we review key empirical findings showing that goals shape the representations of inputs, responses, and outcomes, such that setting a goal crucially influences the central aspects of any learning process: states, actions, and rewards. We thus argue that studying goal selection is essential to advance our understanding of learning. By following existing literature in framing goal selection within a hierarchy of decision-making problems, we synthesize important findings on the principles underlying goal value attribution and exploration strategies. Ultimately, we propose that a goal-centric perspective will help develop more complete accounts of learning in both biological and artificial agents.

Non-instrumental information seeking is resistant to acute stress

Previous research has shown that people intrinsically value non-instrumental information, which cannot be used to change the outcome of events, but only provides an early resolution of uncertainty. This is true even for information about rather inconsequential events, such as the outcomes of small lotteries. Here we investigated whether participants' willingness to pay for non-instrumental information about the outcome of simple coin-flip lotteries with guaranteed winnings was modulated by acute stress. Stress was induced using the Socially Evaluated Cold Pressor Test (SECPT), and information-seeking choices were compared to a warm water control group. Our results neither support the hypothesis that stress decreases information-seeking by directing cognitive resources away from the relevance of the lotteries, nor the opposite hypothesis that stress increases information-seeking by driving anxiety levels up. Instead, we found that despite successful stress induction, as evidenced by increased saliva cortisol levels in the SECPT group, information valuation was remarkably stable. This finding is in line with recent findings that experimentally increased state anxiety did not modulate non-instrumental information seeking. Together, these results suggest that the aversiveness of "not knowing" is a stable cognitive state and not easily modulated by situational context, such as acute stress.

Reliable retrieval is intrinsically rewarding: Recency, item difficulty, study session memory, and subjective confidence predict satisfaction in word-pair recall

The recall of a distant memory may appear satisfying and suggest successful retrieval is inherently rewarding. If the brain incentivizes retrieval attempts on the prospect of an internal retrieval reward, then the desire for that reward might natively reinforce declarative memory access. But what determines the level of retrieval satisfaction? We tested the idea that retrieval attempt uncertainty drives retrieval satisfaction. For instance, the more distant the memory, the more satisfying should it be to successfully retrieve it. Alternatively, the brain issues rewards based on the level of confidence in recall independent of the recall achievement. If so, then more confident retrieval is also more satisfying. In an online experiment containing five Swahili-English word pair study sessions spaced across one week, we tested 30 English-speaking participants' recall satisfaction and memory confidence during learning as well as in a final cued recall test. We hypothesized that retrieval satisfaction should either increase or decrease with retrieval uncertainty as indicated by time since encoding, and how little in overall they recalled from the session. We found that retrieval satisfaction decreased with time since encoding and with study session retrieval performance. Moreover, we found that retrieval confidence and satisfaction ratings were highly related in the experiment. We also found a reliable interaction between confidence and word difficulty indicating that confidently recalled difficult items induced more satisfaction. Thus, the brain appears to reward both retrieval confidence and to a lesser extent, fruitful retrieval effort. Our findings may explain seemingly irrational self-regulated study behavior such as avoiding learning-efficient but difficult training protocols, as effects of a system rationally seeking to accrue intrinsic cognitive reward.

Information Avoidance: Past Perspectives and Future Directions

In the present age of unprecedented access to information, it is important to understand how and why people avoid information. Multiple definitions of "information avoidance" exist, and key aspects of these definitions deserve attention, such as distinguishing information avoidance from (lack of) information seeking, considering the intentionality and temporal nature of information avoidance, and considering the personal relevance of the information. In this review, we provide a cross-disciplinary historical account of theories and empirical research on information avoidance and seeking, drawing from research in multiple fields. We provide a framework of antecedents of information avoidance, categorized into beliefs about the information (e.g., risk perceptions), beliefs about oneself (e.g., coping resources), and social and situational factors (e.g., social norms), noting that constructs across categories overlap and are intertwined. We suggest that research is needed on both positive and negative consequences of information avoidance and on interventions to reduce information avoidance (when appropriate). Research is also needed to better understand temporal dynamics of information avoidance and how it manifests in everyday life. Finally, comprehensive theoretical models are needed that differentiate avoidance from seeking. Research on information avoidance is quickly expanding, and the topic will only grow in importance.

The non-unitary nature of information preference

Factors affecting information-seeking behaviour can be task-endogenous (e.g., probability of winning a gamble), or task-exogenous (e.g., personality trait measures). Various task-endogenous factors affecting non-instrumental information-seeking behaviour have been identified, but it is unclear how task-exogenous factors affect such behaviour, and if they interact with task-endogenous factors. In an online information seeking experiment (N = 279), we focus on the role that outcome probability, as a task-endogenous factor, has on information preferences. We find reliable preference for advance information on highly probable gains and low preference for highly probable losses. Comparisons with individual trait measures of information preference (e.g., intolerance of uncertainty scale, obsessive-compulsive inventory, information preferences scale) reveal minimal association between these task-exogenous factors with choice task performance. We also find minimal interaction between outcome probability and individual trait measures. Despite the choice task and trait measures purportedly tapping the same (or similar) construct, the absence of clear relationships ultimately suggests a multi-dimensional nature of information preference.

The availability of non-instrumental information increases risky decision-making

Contemporary models of decision-making under risk focus on estimating the final value of each alternative course of action. According to such frameworks, information that has no capacity to alter a future payoff (i.e., is "non-instrumental") should have little effect on one's preference for risk. Importantly, however, recent work has shown that information, despite being non-instrumental, may nevertheless exert a striking influence on behavior. Here, we tested whether the opportunity to passively observe the sequence of events following a decision could modulate risky behavior, even if that information could not possibly influence the final result. Across three experiments, 71 individuals chose to accept or reject gambles on a five-window slot machine. If a gamble was accepted, each window was sequentially revealed prior to the outcome being declared. Critically, we informed participants about which windows would subsequently provide veridical information about the gamble outcome, should that gamble be accepted. Our analyses revealed three key findings. First, the opportunity to observe the consequences of one's choice significantly increased the likelihood of gambling, despite that information being entirely non-instrumental. Second, this effect generalized across different stakes. Finally, choices were driven predominantly by the likelihood that information could result in an earlier resolution of uncertainty. These findings demonstrate the importance of anticipatory information to decision-making under risk. More broadly, we provide strong evidence for the utility of non-instrumental information, by demonstrating its capacity to modulate primary economic decisions that should be driven by more motivationally salient variables associated with risk and reward.

Multifaceted information-seeking motives in children

From an early age, children need to gather information to learn about their environment. Deciding which knowledge to pursue can be difficult because information can serve several, sometimes competing, purposes. Here, we examine the developmental trajectories of such diverse information-seeking motives. Over five experiments involving 521 children (aged 4-12), we find that school-age children integrate three key factors into their information-seeking choices: whether information reduces uncertainty, is useful in directing action, and is likely to be positive. Choices that likely reveal positive information and are useful for action emerge as early as age 4, followed by choices that reduce uncertainty (at ~age 5). Our results suggest that motives related to usefulness and uncertainty reduction become stronger with age, while the tendency to seek positive news does not show a statistically significant change throughout development. This study reveals how the relative importance of diverging, sometimes conflicting, information-seeking motives emerges throughout development.

Sensitivity to intrinsic rewards is domain general and related to mental health

Humans frequently engage in intrinsically rewarding activities (for example, consuming art, reading). Despite such activities seeming diverse, we show that sensitivity to intrinsic rewards is domain general and associated with mental health. In this cross-sectional study, participants online (N = 483) were presented with putative visual, cognitive and social intrinsic rewards as well as monetary rewards and neutral stimuli. All rewards elicited positive feelings (were 'liked'), generated consummatory behaviour (were 'wanted') and increased the likelihood of the action leading to them (were 'reinforcing'). Factor analysis revealed that ~40% of response variance across stimuli was explained by a general sensitivity to all rewards, but not to neutral stimuli. Affective aspects of mental health were associated with sensitivity to intrinsic, but not monetary, rewards. These results may help explain thriving and suffering: individuals with high reward sensitivity will engage in a variety of intrinsically rewarding activities, eventually finding those they excel at, whereas low sensitivity individuals will not.

Blinding to Circumvent Human Biases: Deliberate Ignorance in Humans, Institutions, and Machines

Inequalities and injustices are thorny issues in liberal societies, manifesting in forms such as the gender-pay gap; sentencing discrepancies among Black, Hispanic, and White defendants; and unequal medical-resource distribution across ethnicities. One cause of these inequalities is implicit social bias-unconsciously formed associations between social groups and attributions such as "nurturing," "lazy," or "uneducated." One strategy to counteract implicit and explicit human biases is delegating crucial decisions, such as how to allocate benefits, resources, or opportunities, to algorithms. Algorithms, however, are not necessarily impartial and objective. Although they can detect and mitigate human biases, they can also perpetuate and even amplify existing inequalities and injustices. We explore how a philosophical thought experiment, Rawls's "veil of ignorance," and a psychological phenomenon, deliberate ignorance, can help shield individuals, institutions, and algorithms from biases. We discuss the benefits and drawbacks of methods for shielding human and artificial decision makers from potentially biasing information. We then broaden our discussion beyond the issues of bias and fairness and turn to a research agenda aimed at improving human judgment accuracy with the assistance of algorithms that conceal information that has the potential to undermine performance. Finally, we propose interdisciplinary research questions.

Do Pictograms on Medication Packages Cause People to Consult Package Inserts Less Often? If so, With What Consequences?

Overall, pharmaceutical pictograms seem to improve medication adherence. However, little is known about how warning pictograms (e.g., "do not drive after taking") on medication packages influence patients' information-seeking strategies such as consulting the package insert (PI) to determine other features such as the correct dosage. In this online study, participants (358 students) were presented with three fictitious scenarios (e.g., headache after alcohol consumption; factor scenario) in which medication use would be contraindicated. Each scenario was accompanied by a visual presentation of a medication package that could contain three possible pictogram selections or arrangements (factor warning); some arrangements contained pictograms relevant to the situation represented by the scenario, while others did not. Participants had to decide which dosage of the represented medication they were allowed to take in the given scenario. In making this decision, they could consult the PI or not. Overall, in two out of the three scenarios (driving and pregnancy), medication packages with relevant pictograms resulted in fewer PI consultations but led to more correct dosage decisions ("no pill") than packages with irrelevant pictograms. Pictograms generally played no role in either the review of the PI consultation or dosage decisions in the alcohol scenario. Providing warning-relevant pictograms on medication packages can help people know when they should not take medication even without reading the PI.

Dorsal raphe neurons signal integrated value during multi-attribute decision-making

The dorsal raphe nucleus (DRN) is implicated in psychiatric disorders that feature impaired sensitivity to reward amount, impulsivity when facing reward delays, and risk-seeking when grappling with reward uncertainty. However, whether and how DRN neurons signal reward amount, reward delay, and reward uncertainty during multi-attribute value-based decision-making, where subjects consider all these attributes to make a choice, is unclear. We recorded DRN neurons as monkeys chose between offers whose attributes, namely expected reward amount, reward delay, and reward uncertainty, varied independently. Many DRN neurons signaled offer attributes. Remarkably, these neurons commonly integrated offer attributes in a manner that reflected monkeys' overall preferences for amount, delay, and uncertainty. After decision-making, in response to post-decision feedback, these same neurons signaled signed reward prediction errors, suggesting a broader role in tracking value across task epochs and behavioral contexts. Our data illustrate how DRN participates in integrated value computations, guiding theories of DRN in decision-making and psychiatric disease.

Biased belief updating in depression

Cognitive approaches to depression have benefitted from recent research on belief updating, examining how new information is used to alter beliefs. This review presents recent advances in understanding various sources of bias in belief updating in depression. Specifically, research has demonstrated that people with depression have difficulty revising negative beliefs in response to novel positive information, whereas belief updating in depression is not related to an enhanced integration of negative information. In terms of mechanisms underlying the deficient processing of positive information, research has shown that people with depression use defensive cognitive strategies to devalue novel positive information. Furthermore, the disregard of novel positive information can be amplified by the presence of state negative affect, and the resulting persistence of negative beliefs in turn perpetuates chronically low mood, contributing to a self-reinforcing negative feedback loop of beliefs and affect. Synthesising previous research, this review proposes a coherent framework of when belief change is likely to occur, and argues that future research also needs to elucidate why people with depression hesitate to abandon negative beliefs. Recent insights from belief updating have not only improved the understanding of the psychopathology of depression, but also have the potential to improve its cognitive-behavioural treatment.

Uncertainty drives exploration of negative information across younger and older adults

Although individuals generally avoid negative information, recent research documents that they voluntarily explore negative information to resolve uncertainty. However, it remains unclear (a) whether uncertainty facilitates exploration similarly when exploration is expected to lead to negative, neutral, or positive information, and (b) whether older adults seek negative information to reduce uncertainty like younger adults do. This study addresses the two issues across four experimental studies (N = 407). The results indicate that individuals are more likely to expose themselves to negative information when uncertainty is high. In contrast, when information was expected to be neutral or positive, the uncertainty surrounding it did not significantly alter individuals' exploration behavior. Furthermore, we found that uncertainty increased the exploration of negative information in both older and younger adults. In addition, both younger and older adults chose to explore negative information to reduce uncertainty, even when there were positive or neutral alternatives. In contrast to the age-related similarities in these behavioral measures, older adults demonstrated reduced scores in questionnaires on sensation seeking and curiosity, relative to their counterparts who were younger. These results suggest that information uncertainty has a selective facilitation effect on exploration for negative information and that normal aging does not alter this tendency, despite age-related reductions in self-reported measures of personality traits relevant to information seeking.

Inefficient prioritization of task-relevant attributes during instrumental information demand

In natural settings, people evaluate complex multi-attribute situations and decide which attribute to request information about. Little is known about how people make this selection and specifically, how they identify individual observations that best predict the value of a multi-attribute situation. Here show that, in a simple task of information demand, participants inefficiently query attributes that have high individual value but are relatively uninformative about a total payoff. This inefficiency is robust in two instrumental conditions in which gathering less informative observations leads to significantly lower rewards. Across individuals, variations in the sensitivity to informativeness is associated with personality metrics, showing negative associations with extraversion and thrill seeking and positive associations with stress tolerance and need for cognition. Thus, people select informative queries using sub-optimal strategies that are associated with personality traits and influence consequential choices.

A belief systems analysis of fraud beliefs following the 2020 US election

Beliefs that the US 2020 Presidential election was fraudulent are prevalent despite substantial contradictory evidence. Why are such beliefs often resistant to counter-evidence? Is this resistance rational, and thus subject to evidence-based arguments, or fundamentally irrational? Here we surveyed 1,642 Americans during the 2020 vote count, testing fraud belief updates given hypothetical election outcomes. Participants' fraud beliefs increased when their preferred candidate lost and decreased when he won, and both effects scaled with partisan preferences, demonstrating partisan asymmetry (desirability effects). A Bayesian model of rational updating of a system of beliefs-beliefs in the true vote winner, fraud prevalence and beneficiary of fraud-accurately accounted for this partisan asymmetry, outperforming alternative models of irrational, motivated updating and models lacking the full belief system. Partisan asymmetries may not reflect motivated reasoning, but rather rational attributions over multiple potential causes of evidence. Changing such beliefs may require targeting multiple key beliefs simultaneously rather than direct debunking attempts.

Curiosity and mesolimbic functional connectivity drive information seeking in real life

Curiosity reflects an individual's intrinsic motivation to seek information in order to close information gaps. In laboratory-based experiments, both curiosity and information seeking have been associated with enhanced neural dynamics in the mesolimbic dopaminergic circuit. However, it is unclear whether curiosity and dopaminergic dynamics drive information seeking in real life. We investigated (i) whether curiosity predicts different characteristics of real-life information seeking and (ii) whether functional connectivity within the mesolimbic dopaminergic circuit is associated with information seeking outside the laboratory. Up to 15 months before the COVID-19 pandemic, curiosity and anxiety questionnaires and a 10-minute resting-state functional magnetic resonance imaging session were conducted. In a follow-up survey early during the COVID-19 pandemic, participants repeated the questionnaires and completed an additional questionnaire about their COVID-19-related information seeking. Individual differences in curiosity but not anxiety were positively associated with the frequency of information-seeking behaviour. Additionally, the frequency of information seeking was predicted by individual differences in resting-state functional connectivity between the ventral tegmental area and the nucleus accumbens. The present translational study paves the way for future studies on the role of curiosity in real-life information seeking by showing that both curiosity and the mesolimbic dopaminergic functional network support real-life information-seeking behaviour.

Emerging Principles of Attention and Information Demand

I review recent literature on information demand and its implications for attention control. I argue that this literature motivates a view of attention as a mechanism that reduces uncertainty by selectively sampling sensory stimuli on the basis of expected information gain (EIG). I discuss emerging evidence on how individuals estimate the two quantities that determine EIG, prior uncertainty and stimulus diagnosticity (predictive accuracy). I also discuss the neural mechanisms that compute EIG and integrate it with rewards in frontoparietal, executive, and neuromodulatory circuits. I end by considering the implications of this framework for a broader understanding of the factors that assign relevance to sensory stimuli and the role of attention in decision making and other cognitive functions.

Hedonism as a motive for information search: biased information-seeking leads to biased beliefs

Confirmation bias in information-search contributes to the formation of polarized echo-chambers of beliefs. However, the role of valence on information source selection remains poorly understood. In Experiment 1, participants won financial rewards depending on the outcomes of a set of lotteries. They were not shown these outcomes, but instead could choose to view a prediction of each lottery outcome made by one of two sources. Before choosing their favoured source, participants were first shown a series of example predictions made by each. The sources systematically varied in the accuracy and positivity (i.e., how often they predicted a win) of their predictions. Hierarchical Bayesian modeling indicated that both source accuracy and positivity impacted participants' choices. Importantly, those that viewed more positively-biased information believed that they had won more often and had higher confidence in those beliefs. In Experiment 2, we directly assessed the effect of positivity on the perceived credibility of a source. In each trial, participants watched a single source making a series of predictions of lottery outcomes and rated the strength of their beliefs in each source. Interestingly, positively-biased sources were not seen as more credible. Together, these findings suggest that positively-biased information is sought partly due to the desirable emotional state it induces rather than having enhanced perceived credibility. Information sought on this basis nevertheless produced consequential biased beliefs about the world-state, highlighting a potentially key role for hedonic preferences in information selection and subsequent belief formation.

Brain Systems Underlying Fundamental Motivations of Human Social Conformity

From birth to adulthood, we often align our behaviors, attitudes, and opinions with a majority, a phenomenon known as social conformity. A seminal framework has proposed that conformity behaviors are mainly driven by three fundamental motives: a desire to gain more information to be accurate, to obtain social approval from others, and to maintain a favorable self-concept. Despite extensive interest in neuroimaging investigation of social conformity, the relationship between brain systems and these fundamental motivations has yet to be established. Here, we reviewed brain imaging findings of social conformity with a componential framework, aiming to reveal the neuropsychological substrates underlying different conformity motivations. First, information-seeking engages the evaluation of social information, information integration, and modification of task-related activity, corresponding to brain networks implicated in reward, cognitive control, and tasks at hand. Second, social acceptance involves the anticipation of social acceptance or rejection and mental state attribution, mediated by networks of reward, punishment, and mentalizing. Third, self-enhancement entails the excessive representation of positive self-related information and suppression of negative self-related information, ingroup favoritism and/or outgroup derogation, and elaborated mentalizing processes to the ingroup, supported by brain systems of reward, punishment, and mentalizing. Therefore, recent brain imaging studies have provided important insights into the fundamental motivations of social conformity in terms of component processes and brain mechanisms.

Choice Boosts Curiosity

In our connected era, we spend significant time and effort satisfying our curiosity. Often, we choose which information we seek, but sometimes the selection is made for us. We hypothesized that humans exhibit enhanced curiosity in the context of choice. We designed a task in which healthy participants saw two lotteries on each trial. On some trials, participants chose which lottery to play. On other trials, the lottery was selected for them. Participants then indicated their curiosity about the outcome of the to-be-played lottery via self-report ratings (Experiment 1, N = 34) or willingness-to-wait decisions (Experiment 2, N = 34). We found that participants exhibited higher curiosity ratings and greater willingness to wait for the outcome of lotteries they had chosen than for lotteries that had been selected for them (controlling for initial preference). This demonstrates that choice boosts curiosity, which may have implications for boosting learning, memory, and motivation.

Why people choose deliberate ignorance in times of societal transformation

The opening of East Germany's Stasi archives in 1991 has often been lauded as a model of transparency in a transformative period. Yet many citizens have rejected the opportunity to read their files. To examine the reasons people invoke for this deliberate ignorance, we combined survey methods from psychology with historiographical methodologies. Our findings reveal a diverse range of reasons for deliberate ignorance, including regulation of negative emotions, avoidance of personal conflict, scepticism about the information compiled, and rejection of the victorious political system's authority over the files. Participants thus appear to prioritise cooperation and harmony over justice concerns-in stark contrast to the institutional norm of transparency and justice. Shining a light on the role of deliberate ignorance at the individual level-and specifically the convergence or divergence of individual and collective memory culture-may help explain the pace of societal change.

Neurocomputational mechanisms of affected beliefs

The feedback people receive on their behavior shapes the process of belief formation and self-efficacy in mastering a particular task. However, the neural and computational mechanisms of how the subjective value of self-efficacy beliefs, and the corresponding affect, influence the learning process remain unclear. We investigated these mechanisms during self-efficacy belief formation using fMRI, pupillometry, and computational modeling, and by analyzing individual differences in affective experience. Biases in the formation of self-efficacy beliefs were associated with affect, pupil dilation, and neural activity within the anterior insula, amygdala, ventral tegmental area/ substantia nigra, and mPFC. Specifically, neural and pupil responses mapped the valence of the prediction errors in correspondence with individuals’ experienced affective states and learning biases during self-efficacy belief formation. Together with the functional connectivity dynamics of the anterior insula within this network, our results provide evidence for neural and computational mechanisms of how we arrive at affected beliefs.

Uncertainty modulates visual maps during noninstrumental information demand

Animals are intrinsically motivated to obtain information independently of instrumental incentives. This motivation depends on two factors: a desire to resolve uncertainty by gathering accurate information and a desire to obtain positively-valenced observations, which predict favorable rather than unfavorable outcomes. To understand the neural mechanisms, we recorded parietal cortical activity implicated in prioritizing stimuli for spatial attention and gaze, in a task in which monkeys were free (but not trained) to obtain information about probabilistic non-contingent rewards. We show that valence and uncertainty independently modulated parietal neuronal activity, and uncertainty but not reward-related enhancement consistently correlated with behavioral sensitivity. The findings suggest uncertainty-driven and valence-driven information demand depend on partially distinct pathways, with the former being consistently related to parietal responses and the latter depending on additional mechanisms implemented in downstream structures.

Curiosity is motivated by uncertainty and valence, but how uncertainty and valence are encoded in the brain remains poorly understood. Here, the authors show that parietal neurons are enhanced by both factors, but that they specifically predict visual information seeking based on uncertainty.

Laser stimulation of the skin for quantitative study of decision-making and motivation

Neuroeconomics studies how decision-making is guided by the value of rewards and punishments. But to date, little is known about how noxious experiences impact decisions. A challenge is the lack of an aversive stimulus that is dynamically adjustable in intensity and location, readily usable over many trials in a single experimental session, and compatible with multiple ways to measure neuronal activity. We show that skin laser stimulation used in human studies of aversion can be used for this purpose in several key animal models. We then use laser stimulation to study how neurons in the orbitofrontal cortex (OFC), an area whose many roles include guiding decisions among different rewards, encode the value of rewards and punishments. We show that some OFC neurons integrated the positive value of rewards with the negative value of aversive laser stimulation, suggesting that the OFC can play a role in more complex choices than previously appreciated.

Controllability boosts neural and cognitive signatures of changes-of-mind in uncertain environments

In uncertain environments, seeking information about alternative choice options is essential for adaptive learning and decision-making. However, information seeking is usually confounded with changes-of-mind about the reliability of the preferred option. Here, we exploited the fact that information seeking requires control over which option to sample to isolate its behavioral and neurophysiological signatures. We found that changes-of-mind occurring with control require more evidence against the current option, are associated with reduced confidence, but are nevertheless more likely to be confirmed on the next decision. Multimodal neurophysiological recordings showed that these changes-of-mind are preceded by stronger activation of the dorsal attention network in magnetoencephalography, and followed by increased pupil-linked arousal during the presentation of decision outcomes. Together, these findings indicate that information seeking increases the saliency of evidence perceived as the direct consequence of one's own actions.

If it's important, then I'm curious: Increasing perceived usefulness stimulates curiosity

Curiosity is considered essential for learning and sustained engagement, yet stimulating curiosity in educational contexts remains a challenge. Can people's curiosity about a scientific topic be stimulated by providing evidence that knowledge about the topic has potential value to society? Here, we show that increasing perceptions of 'social usefulness' regarding a scientific topic also increases curiosity and subsequent information search. Our results also show that simply presenting interesting facts is not enough to influence curiosity, and that people are more likely to be curious about a scientific topic if they perceive it to be useful personally and socially. Given the link between curiosity and learning, these results have important implications for science communication and education more broadly.

Curiosity for information predicts wellbeing mediated by loneliness during COVID-19 pandemic

The COVID-19 pandemic confronted humans with high uncertainty and lockdowns, which severely disrupted people’s daily social and health lifestyles, enhanced loneliness, and reduced well-being. Curiosity and information-seeking are central to behavior, fostering well-being and adaptation in changing environments. They may be particularly important to maintain well-being during the pandemic. Here, we investigated which motives drive information-seeking, and whether and how curiosity and information-seeking related to well-being and mood (excitement, anxiety). Additionally, we tested whether daily diet contributed to this relationship during lockdown. Participants (N = 183) completed questionnaires measuring curiosity, information-seeking, social and mental health. Using a smartphone app, participants submitted their daily food intake and lifestyle ratings for a week. We found participants had highest motivation to seek positive (vs. negative) information, concerning themselves more than others. Both trait curiosity and information-seeking predicted higher well-being, mediated by loneliness. Trait curiosity also predicted well-being and excitement days later. Considering diet, participants with lower trait curiosity ate food containing more tyrosine (i.e., dopamine precursor). Furthermore, participants consuming food high in sugar reported higher anxiety, which was specifically found in participants with relatively low, but not high, trait curiosity. Taken together, curiosity and information-seeking may benefit well-being and mood in high uncertain and challenging times, by interacting with lifestyle measures (loneliness and nutrition).

Anxiety increases information-seeking in response to large changes

Seeking information when anxious may help reduce the aversive feeling of uncertainty and guide decision-making. If information is negative or confusing, however, this may increase anxiety further. Information gathered under anxiety can thus be beneficial and/or damaging. Here, we examine whether anxiety leads to a general increase in information-seeking, or rather to changes in the type of information and/or situations in which it is sought. In two controlled laboratory studies, we show that both trait anxiety and induced anxiety lead to a selective alteration in information-seeking. In particular, anxiety did not enhance the general tendency to seek information, nor did it alter the valence of the information gathered. Rather, anxiety amplified the tendency to seek information more in response to large changes in the environment. This was true even when the cause of the anxiety was not directly related to the information sought. As anxious individuals have been shown to have problems learning in changing environments, greater information-seeking in such environments may be an adaptive compensatory mechanism.

Decision neuroscience and neuroeconomics: Recent progress and ongoing challenges

In the past decade, decision neuroscience and neuroeconomics have developed many new insights in the study of decision making. This review provides an overarching update on how the field has advanced in this time period. Although our initial review a decade ago outlined several theoretical, conceptual, methodological, empirical, and practical challenges, there has only been limited progress in resolving these challenges. We summarize significant trends in decision neuroscience through the lens of the challenges outlined for the field and review examples where the field has had significant, direct, and applicable impacts across economics and psychology. First, we review progress on topics including reward learning, explore-exploit decisions, risk and ambiguity, intertemporal choice, and valuation. Next, we assess the impacts of emotion, social rewards, and social context on decision making. Then, we follow up with how individual differences impact choices and new exciting developments in the prediction and neuroforecasting of future decisions. Finally, we consider how trends in decision-neuroscience research reflect progress toward resolving past challenges, discuss new and exciting applications of recent research, and identify new challenges for the field. This article is categorized under: Psychology > Reasoning and Decision Making Psychology > Emotion and Motivation.

Independent and interacting value systems for reward and information in the human brain

Theories of prefrontal cortex (PFC) as optimizing reward value have been widely deployed to explain its activity in a diverse range of contexts, with substantial empirical support in neuroeconomics and decision neuroscience. Similar neural circuits, however, have also been associated with information processing. By using computational modeling, model-based functional magnetic resonance imaging analysis, and a novel experimental paradigm, we aim at establishing whether a dedicated and independent value system for information exists in the human PFC. We identify two regions in the human PFC that independently encode reward and information. Our results provide empirical evidence for PFC as an optimizer of independent information and reward signals during decision-making under realistic scenarios, with potential implications for the interpretation of PFC activity in both healthy and clinical populations.

The Role of Predictions, Their Confirmation, and Reward in Maintaining the Self-Concept

The predictive processing framework posits that people continuously use predictive principles when interacting with, learning from, and interpreting their surroundings. Here, we suggest that the same framework may help explain how people process self-relevant knowledge and maintain a stable and positive self-concept. Specifically, we recast two prominent self-relevant motivations, self-verification and self-enhancement, in predictive processing (PP) terms. We suggest that these self-relevant motivations interact with the self-concept (i.e., priors) to create strong predictions. These predictions, in turn, influence how people interpret information about themselves. In particular, we argue that these strong self-relevant predictions dictate how prediction error, the deviation from the original prediction, is processed. In contrast to many implementations of the PP framework, we suggest that predictions and priors emanating from stable constructs (such as the self-concept) cultivate belief-maintaining, rather than belief-updating, dynamics. Based on recent findings, we also postulate that evidence supporting a predicted model of the self (or interpreted as such) triggers subjective reward responses, potentially reinforcing existing beliefs. Characterizing the role of rewards in self-belief maintenance and reframing self-relevant motivations and rewards in predictive processing terms offers novel insights into how the self is maintained in neurotypical adults, as well as in pathological populations, potentially pointing to therapeutic implications.

Brain Structure and Optimism Bias: A Voxel-Based Morphometry Approach

Individuals often anticipate an unrealistically favorable future for themselves (personal optimism bias) or others (social optimism bias). While such biases are well established, little is known about their neuroanatomy. In this study, participants engaged in a soccer task and estimated the likelihood of successful passes in personal and social scenarios. Voxel-based morphometry revealed that personal optimism bias varied as a positive function of gray matter volume (GMV) in the putamen, frontal pole, hippocampus, temporal pole, inferior temporal gyrus, visual association areas, and mid-superior temporal gyrus. Social optimism bias correlated positively with GMV in the temporoparietal junction and negatively with GMV in the inferior temporal gyrus and pre-supplementary motor areas. Together, these findings suggest that parts of our optimistic outlook are biologically rooted. Moreover, while the two biases looked similar at the behavioral level, they were related to distinct gray matter structures, proposing that their underlying mechanisms are not identical.

Different drives of herding: An exploratory study of motivations underlying social conformity

We often align our behaviors, attitudes, and opinions in line with a majority of others, a phenomenon known as "social conformity." A seminal framework has proposed that conformity behaviors are mainly driven by three fundamental motives: a desire to gain more information to be accurate, to obtain social approval from others, and to maintain a favorable self-concept. However, previous studies usually have interpreted conformity behaviors as driven by one motive or another, largely ignoring the fact that human behaviors could be concurrently induced by multiple and even conflicting motivations. Adopting a typical conformity paradigm widely used in previous studies, we explored distinct and concurrent motives underlying the same conformity behavior, combining personality and individual differences with more nuanced analyses of observed conformity behaviors. Our findings provide novel evidence to show that three motivations exist within a single conformity behavior, suggesting that multiple motivations drive the conformity concurrently. These findings provide a potential solution for the extensive debate about what drives human social conformity and help to better understand the conformity behavior in daily life.