Differential impact of ventromedial prefrontal cortex damage on “hot” and “cold” decisions under risk

Neural Representation of Valenced and Generic Probability and Uncertainty

Representing the probability and uncertainty of outcomes facilitates adaptive behavior by allowing organisms to prepare in advance and devote attention to relevant events. Probability and uncertainty are often studied only for valenced (appetitive or aversive) outcomes, raising the question of whether the identified neural machinery also processes the probability and uncertainty of motivationally neutral outcomes. Here, we aimed to dissociate valenced from valence-independent (i.e., generic) probability (p; maximum at p = 1) and uncertainty (maximum at p = 0.5) signals using human neuroimaging. In a Pavlovian task (n = 41; 19 females), different cues predicted appetitive, aversive, or neutral liquids with different probabilities (p = 0, p = 0.5, p = 1). Cue-elicited motor responses accelerated, and pupil sizes increased primarily for cues that predicted valenced liquids with higher probability. For neutral liquids, uncertainty rather than probability tended to accelerate cue-induced responding and decrease pupil size. At the neural level, generic uncertainty signals were limited to the occipital cortex, while generic probability also activated the anterior ventromedial prefrontal cortex. These generic probability and uncertainty signals contrasted with cue-induced responses that only encoded the probability and uncertainty of valenced liquids in medial prefrontal, insular, and occipital cortices. Our findings show a behavioral and neural dissociation of generic and valenced signals. Thus, some parts of the brain keep track of motivational charge while others do not, highlighting the need and usefulness of characterizing the exact nature of learned representations.

Neural underpinnings of ethical decisions in life and death dilemmas in naïve and expert firefighters

When a single choice impacts on life outcomes, faculties to make ethical judgments come into play. Here we studied decisions in a real-life setting involving life-and-death outcomes that affect others and the decision-maker as well. We chose a genuine situation where prior training and expertise play a role: firefighting in life-threatening situations. By studying the neural correlates of dilemmas involving life-saving decisions, using realistic firefighting situations, allowed us to go beyond previously used hypothetical dilemmas, while addressing the role of expertise and the use of coping strategies (n = 47). We asked the question whether the neural underpinnings of deontologically based decisions are affected by expertise. These realistic life-saving dilemmas activate the same core reward and affective processing network, in particular the ventromedial prefrontal cortex, nucleus accumbens and amygdala, irrespective of prior expertise, thereby supporting general domain theories of ethical decision-making. We found that brain activity in the hippocampus and insula parametrically increased as the risk increased. Connectivity analysis showed a larger directed influence of the insula on circuits related to action selection in non-experts, which were slower than experts in non rescuing decisions. Relative neural activity related to the decision to rescue or not, in the caudate nucleus, insula and anterior cingulate cortex was negatively associated with coping strategies, in experts (firefighters) suggesting practice-based learning. This shows an association between activity and expert-related usage of coping strategies. Expertise enables salience network activation as a function of behavioural coping dimensions, with a distinct connectivity profile when facing life-rescuing dilemmas.

Ventromedial Prefrontal Cortex Does Not Play a Selective Role in Pattern Separation

Humans have the capacity to form new memories of events that are, at times, highly similar to events experienced in the past, as well as the capacity to integrate and associate new information within existing knowledge structures. The former process relies on mnemonic discrimination and is believed to depend on hippocampal pattern separation, whereas the latter is believed to depend on generalization signals and conceptual categorization supported by the neocortex. Here, we examine whether and how the ventromedial prefrontal cortex (vMPFC) supports discrimination and generalization on a widely used task that was primarily designed to tax hippocampal processes. Ten individuals with lesions to the vMPFC and 46 neurotypical control participants were administered an adapted version of the mnemonic similarity task [Stark, S. M., Yassa, M. A., Lacy, J. W., & Stark, C. E. L. A task to assess behavioral pattern separation (BPS) in humans: Data from healthy aging and mild cognitive impairment. Neuropsychologia, 51, 2442-2449, 2013], which assesses the ability to distinguish previously learned images of everyday objects (targets) from unstudied, highly similar images (lures) and dissimilar images (foils). Relative to controls, vMPFC-lesioned individuals showed intact discrimination of lures from targets but a propensity to mistake studied targets and similar lures for dissimilar foils. This pattern was accompanied by inflated confidence despite low accuracy when responding to similar lures. These findings demonstrate a more general role of the vMPFC in memory retrieval, rather than a specific role in supporting pattern separation.

Economic and social values in the brain: evidence from lesions to the human ventromedial prefrontal cortex

Making good economic and social decisions is essential for individual and social welfare. Decades of research have provided compelling evidence that damage to the ventromedial prefrontal cortex (vmPFC) is associated with dramatic personality changes and impairments in economic and social decision-making. However, whether the vmPFC subserves a unified mechanism in the social and non-social domains remains unclear. When choosing between economic options, the vmPFC is thought to guide decision by encoding value signals that reflect the motivational relevance of the options on a common scale. A recent framework, the "extended common neural currency" hypothesis, suggests that the vmPFC may also assign values to social factors and principles, thereby guiding social decision-making. Although neural value signals have been observed in the vmPFC in both social and non-social studies, it is yet to be determined whether they have a causal influence on behavior or merely correlate with decision-making. In this review, we assess whether lesion studies of patients with vmPFC damage offer evidence for such a causal role of the vmPFC in shaping economic and social behavior.

Less cortical complexity in ventromedial prefrontal cortex is associated with a greater preference for risky and immediate rewards

In our everyday lives, we are often faced with situations in which we have to make choices that involve risky or delayed rewards. However, the extent to which we are willing to accept larger risky (over smaller certain) or larger delayed (over smaller immediate) rewards vary across individuals. Here we investigated the relationship between cortical surface complexity in medial prefrontal cortex and individual differences in risky and intertemporal preferences. We found that lower cortical complexity in ventromedial prefrontal cortex (vmPFC) was associated with a greater preference for risky and immediate rewards. In addition to these common structural associations in mPFC, we also found associations between lower cortical complexity and a greater preference for immediate rewards that extended into left dorsomedial prefrontal cortex and right vmPFC. Taken together, the shared association suggests that lower cortical complexity in vmPFC may be a structural marker for individual differences in impulsive behavior.

Neural bases of frustration-aggression theory: A multi-domain meta-analysis of functional neuroimaging studies

BACKGROUND

Early evidence suggests that unexpected non-reward may increase the risk for aggressive behaviors. Despite the growing interest in understanding brain functions that may be implicated in aggressive behaviors, the neural processes underlying such frustrative events remain largely unknown. Furthermore, meta-analytic results have produced discrepant results, potentially due to substantial differences in the definition of anger/aggression constructs.

METHODS

Therefore, we conducted a coordinate-based meta-analysis, using the activation likelihood estimation algorithm, on neuroimaging studies examining reward omission and retaliatory behaviors in healthy subjects. Conjunction analyses were further examined to discover overlapping brain activations across these meta-analytic maps.

RESULTS

Frustrative non-reward deactivated the orbitofrontal cortex, ventral striatum and posterior cingulate cortex, whereas increased activations were observed in midcingulo-insular regions. Retaliatory behaviors recruited the left fronto-insular and anterior midcingulate cortices, the dorsal caudate and the primary somatosensory cortex. Conjunction analyses revealed that both strongly activated midcingulo-insular regions.

LIMITATIONS

Spatial overlap between neural correlates of frustration and retaliatory behaviors was conducted using a conjunction analysis. Therefore, neurobiological markers underlying the temporal sequence of the frustration-aggression theory should be interpreted with caution.

CONCLUSIONS

Nonetheless, our results underscore the role of anterior midcingulate/pre-supplementary motor area and fronto-insular cortex in both frustration and retaliatory behaviors. A neurobiological framework for understanding frustration-based impulsive aggression is provided.

A Neurocomputational Model for Intrinsic Reward

Standard economic indicators provide an incomplete picture of what we value both as individuals and as a society. Furthermore, canonical macroeconomic measures, such as GDP, do not account for non-market activities (e.g., cooking, childcare) that nevertheless impact well-being. Here, we introduce a computational tool that measures the affective value of experiences (e.g., playing a musical instrument without errors). We go on to validate this tool with neural data, using fMRI to measure neural activity in male and female human subjects performing a reinforcement learning task that incorporated periodic ratings of subjective affective state. Learning performance determined level of payment (i.e., extrinsic reward). Crucially, the task also incorporated a skilled performance component (i.e., intrinsic reward) which did not influence payment. Both extrinsic and intrinsic rewards influenced affective dynamics, and their relative influence could be captured in our computational model. Individuals for whom intrinsic rewards had a greater influence on affective state than extrinsic rewards had greater ventromedial prefrontal cortex (vmPFC) activity for intrinsic than extrinsic rewards. Thus, we show that computational modeling of affective dynamics can index the subjective value of intrinsic relative to extrinsic rewards, a “computational hedonometer” that reflects both behavior and neural activity that quantifies the affective value of experience.

SIGNIFICANCE STATEMENT Traditional economic indicators are increasingly recognized to provide an incomplete picture of what we value as a society. Standard economic approaches struggle to accurately assign values to non-market activities that nevertheless may be intrinsically rewarding, prompting a need for new tools to measure what really matters to individuals. Using a combination of neuroimaging and computational modeling, we show that despite their lack of instrumental value, intrinsic rewards influence subjective affective state and ventromedial prefrontal cortex (vmPFC) activity. The relative degree to which extrinsic and intrinsic rewards influence affective state is predictive of their relative impacts on neural activity, confirming the utility of our approach for measuring the affective value of experiences and other non-market activities in individuals.

Neuroscience of the yogic theory of consciousness

Yoga as a practice and philosophy of life has been followed for more than 4500 years with known evidence of yogic practices in the Indus Valley Civilization. The last few decades have seen a resurgence in the utility of yoga and meditation as a practice with growing scientific evidence behind it. Significant scientific literature has been published, illustrating the benefits of yogic practices including 'asana', 'pranayama' and 'dhyana' on mental and physical well-being. Electrophysiological and recent functional magnetic resonance imaging (fMRI) studies have found explicit neural signatures for yogic practices. In this article, we present a review of the philosophy of yoga, based on the dualistic 'Sankhya' school, as applied to consciousness summarized by Patanjali in his yoga sutras followed by a discussion on the five 'vritti' (modulations of mind), the practice of 'pratyahara', 'dharana', 'dhyana', different states of 'samadhi', and 'samapatti'. We formulate the yogic theory of consciousness (YTC), a cohesive theory that can model both external modulations and internal states of the mind. We propose that attention, sleep and mind wandering should be understood as unique modulatory states of the mind. YTC allows us to model the external states, internal states of meditation, 'samadhi' and even the disorders of consciousness. Furthermore, we list some testable neuroscientific hypotheses that could be answered using YTC and analyse the benefits, outcomes and possible limitations.

Does Ventromedial Prefrontal Cortex Damage Really Increase Impulsiveness? Delay and Probability Discounting in Patients with Focal Lesions

If the tendency to discount rewards reflects individuals' general level of impulsiveness, then the discounting of delayed and probabilistic rewards should be negatively correlated: The less a person is able to wait for delayed rewards, the more they should take chances on receiving probabilistic rewards. It has been suggested that damage to the ventromedial prefrontal cortex (vMPFC) increases individuals' impulsiveness, but both intertemporal choice and risky choice have only recently been assayed in the same patients with vMPFC damage. Here, we assess both delay and probability discounting in individuals with vMPFC damage (n = 8) or with medial temporal lobe (MTL) damage (n = 10), and in age- and education-matched controls (n = 30). On average, MTL-lesioned individuals discounted delayed rewards at normal rates but discounted probabilistic rewards more shallowly than controls. In contrast, vMPFC-lesioned individuals discounted delayed rewards more steeply but probabilistic rewards more shallowly than controls. These results suggest that vMPFC lesions affect the weighting of reward amount relative to delay and certainty in opposite ways. Moreover, whereas MTL-lesioned individuals and controls showed typical, nonsignificant correlations between the discounting of delayed and probabilistic rewards, vMPFC-lesioned individuals showed a significant negative correlation, as would be expected if vMPFC damage increases impulsiveness more in some patients than in others. Although these results are consistent with the hypothesis that vMPFC plays a role in impulsiveness, it is unclear how they could be explained by a single mechanism governing valuation of both delayed and probabilistic rewards.

Beyond a rod through the skull: A systematic review of lesion studies of the human ventromedial frontal lobe

Neuropsychological studies from the past century have associated damage to the ventromedial frontal lobes (VMF) with impairments in a variety of domains, including memory, executive function, emotion, social cognition, and valuation. A central question in the literature is whether these seemingly distinct functions are subserved by different sub-regions within the VMF, or whether VMF supports a broader cognitive process that is crucial to these varied domains. In this comprehensive review of the neuropsychological literature from the last two decades, we present a qualitative synthesis of 184 papers that have examined the psychological impairments that result from VMF damage. We discuss these findings in the context of several theoretical frameworks and advocate for the view that VMF is critical for the formation and representation of schema and cognitive maps.

Event-related potentials in response to feedback following risk-taking in the hot version of the Columbia Card Task

Given the importance of risk-taking in individuals' personal and professional life, several behavioral tasks for measuring the construct have been developed. Recently, a new task was introduced, the Columbia Card Task (CCT). This task measures participants' risk levels and establishes how sensitive participants are to gains, losses, and probabilities when taking risk. So far, the CCT has been examined in behavioral studies and in combination with several (neuro)biological techniques. However, no electroencephalography (EEG) research has been done on the task. The present study fills this gap and helps to validate this relatively new experimental task. To this end, n = 126 students were asked to complete self-reports (reward responsiveness, impulsiveness, and sensation-seeking) and to perform the CCT (and other risk tasks) in an EEG setup. The results show that feedback appraisal after risky decision-making in the CCT was accompanied by a feedback-related negativity (FRN) and a P300, which were stronger in response to negative than positive feedback. Correlations between the FRN and P300 difference wave on the one hand and risk-related self-reports and behavior on the other were nonsignificant and small, but were mostly in the expected direction. This pattern did not change after excluding participants with psychiatric/neurological disorders and outliers. Excluding participants with reversed (positive > negative) difference waves strengthened FRN correlations. The impact such individuals can have on the data should be taken into account in future studies. Regarding the CCT in particular, future studies should also address its oddball structure and its masking of true values (censoring).