Neural substrates of norm compliance in perceptual decisions

Societal norms exert a powerful influence on our decisions. Behaviours motivated by norms, however, do not always concur with the responses mandated by decision relevant information potentially generating a conflict. To probe the interplay between normative and informational influences, we examined how prosocial norms impact on perceptual decisions subjects made in the context of a simultaneous presentation of social information. Participants displayed a bias in their perceptual decisions towards that mandated by social information. However, normative prescriptions modulated this bias bi-directionally depending on whether norms mandated a decision in accord or contrary to the contextual social information. At a neural level, the addition of a norms increased activity in prefrontal cortex and modulated functional connectivity between prefrontal and parietal areas. The bi-directional effect of our norms was captured by differential activations when participants decided against the social information. When norms indicated a decision in line with social information, non-compliance modulated lateral prefrontal cortex activity. By contrast, when norms mandated a decision against social information norm compliance increased activity in the anterior cingulate cortex. Hence, social norms changed the balance between a reliance on perceptual and social information by modulating brain activity in regions associated with response inhibition and conflict monitoring.

The impact of traumatic stress on Pavlovian biases

BACKGROUND

Disturbances in Pavlovian valuation systems are reported to follow traumatic stress exposure. However, motivated decisions are also guided by instrumental mechanisms, but to date the effect of traumatic stress on these instrumental systems remain poorly investigated. Here, we examine whether a single episode of severe traumatic stress influences flexible instrumental decisions through an impact on a Pavlovian system.

METHODS

Twenty-six survivors of the 2011 Norwegian terror attack and 30 matched control subjects performed an instrumental learning task in which Pavlovian and instrumental associations promoted congruent or conflicting responses. We used reinforcement learning models to infer how traumatic stress affected learning and decision-making. Based on the importance of dorsal anterior cingulate cortex (dACC) for cognitive control, we also investigated if individual concentrations of Glx (=glutamate + glutamine) in dACC predicted the Pavlovian bias of choice.

RESULTS

Survivors of traumatic stress expressed a greater Pavlovian interference with instrumental action selection and had significantly lower levels of Glx in the dACC. Across subjects, the degree of Pavlovian interference was negatively associated with dACC Glx concentrations.

CONCLUSIONS

Experiencing traumatic stress appears to render instrumental decisions less flexible by increasing the susceptibility to Pavlovian influences. An observed association between prefrontal glutamatergic levels and this Pavlovian bias provides novel insight into the neurochemical basis of decision-making, and suggests a mechanism by which traumatic stress can impair flexible instrumental behaviours.

Increased fronto-striatal reward prediction errors moderate decision making in obsessive-compulsive disorder

BACKGROUND

Obsessive-compulsive disorder (OCD) has been linked to functional abnormalities in fronto-striatal networks as well as impairments in decision making and learning. Little is known about the neurocognitive mechanisms causing these decision-making and learning deficits in OCD, and how they relate to dysfunction in fronto-striatal networks.

METHOD

We investigated neural mechanisms of decision making in OCD patients, including early and late onset of disorder, in terms of reward prediction errors (RPEs) using functional magnetic resonance imaging. RPEs index a mismatch between expected and received outcomes, encoded by the dopaminergic system, and are known to drive learning and decision making in humans and animals. We used reinforcement learning models and RPE signals to infer the learning mechanisms and to compare behavioural parameters and neural RPE responses of the OCD patients with those of healthy matched controls.

RESULTS

Patients with OCD showed significantly increased RPE responses in the anterior cingulate cortex (ACC) and the putamen compared with controls. OCD patients also had a significantly lower perseveration parameter than controls.

CONCLUSIONS

Enhanced RPE signals in the ACC and putamen extend previous findings of fronto-striatal deficits in OCD. These abnormally strong RPEs suggest a hyper-responsive learning network in patients with OCD, which might explain their indecisiveness and intolerance of uncertainty.

Computational neuroimaging strategies for single patient predictions

Neuroimaging increasingly exploits machine learning techniques in an attempt to achieve clinically relevant single-subject predictions. An alternative to machine learning, which tries to establish predictive links between features of the observed data and clinical variables, is the deployment of computational models for inferring on the (patho)physiological and cognitive mechanisms that generate behavioural and neuroimaging responses. This paper discusses the rationale behind a computational approach to neuroimaging-based single-subject inference, focusing on its potential for characterising disease mechanisms in individual subjects and mapping these characterisations to clinical predictions. Following an overview of two main approaches - Bayesian model selection and generative embedding - which can link computational models to individual predictions, we review how these methods accommodate heterogeneity in psychiatric and neurological spectrum disorders, help avoid erroneous interpretations of neuroimaging data, and establish a link between a mechanistic, model-based approach and the statistical perspectives afforded by machine learning.

The specificity of Pavlovian regulation is associated with recovery from depression

BACKGROUND

Changes in reflexive emotional responses are hallmarks of depression, but how emotional reflexes make an impact on adaptive decision-making in depression has not been examined formally. Using a Pavlovian-instrumental transfer (PIT) task, we compared the influence of affectively valenced stimuli on decision-making in depression and generalized anxiety disorder compared with healthy controls; and related this to the longitudinal course of the illness.

METHOD

A total of 40 subjects with a current DSM-IV-TR diagnosis of major depressive disorder, dysthymia, generalized anxiety disorder, or a combination thereof, and 40 matched healthy controls performed a PIT task that assesses how instrumental approach and withdrawal behaviours are influenced by appetitive and aversive Pavlovian conditioned stimuli (CSs). Patients were followed up after 4-6 months. Analyses focused on patients with depression alone (n = 25).

RESULTS

In healthy controls, Pavlovian CSs exerted action-specific effects, with appetitive CSs boosting active approach and aversive CSs active withdrawal. This action-specificity was absent in currently depressed subjects. Greater action-specificity in patients was associated with better recovery over the follow-up period.

CONCLUSIONS

Depression is associated with an abnormal influence of emotional reactions on decision-making in a way that may predict recovery.

Unmasking Latent Inhibitory Connections in Human Cortex to Reveal Dormant Cortical Memories

Balance of cortical excitation and inhibition (EI) is thought to be disrupted in several neuropsychiatric conditions, yet it is not clear how it is maintained in the healthy human brain. When EI balance is disturbed during learning and memory in animal models, it can be restabilized via formation of inhibitory replicas of newly formed excitatory connections. Here we assess evidence for such selective inhibitory rebalancing in humans. Using fMRI repetition suppression we measure newly formed cortical associations in the human brain. We show that expression of these associations reduces over time despite persistence in behavior, consistent with inhibitory rebalancing. To test this, we modulated excitation/inhibition balance with transcranial direct current stimulation (tDCS). Using ultra-high-field (7T) MRI and spectroscopy, we show that reducing GABA allows cortical associations to be re-expressed. This suggests that in humans associative memories are stored in balanced excitatory-inhibitory ensembles that lie dormant unless latent inhibitory connections are unmasked.

Video Abstract

•

Associative memories can be measured in human cortex following learning

•

Over time the expression of these memories becomes silenced

•

By reducing cortical GABA with brain stimulation these memories are re-expressed

•

Cortical memories appear to be stored in balanced excitatory-inhibitory ensembles

The computational psychiatry of reward: broken brains or misguided minds?

Research into the biological basis of emotional and motivational disorders is in danger of riding roughshod over a patient-centered psychiatry and falling into the dualist errors of the past, i.e., by treating mind and brain as conceptually distinct. We argue that a psychiatry informed by computational neuroscience, computational psychiatry, can obviate this danger. Through a focus on the reasoning processes by which humans attempt to maximize reward (and minimize punishment), and how such reasoning is expressed neurally, computational psychiatry can render obsolete the polarity between biological and psychosocial conceptions of illness. Here, the term ‘psychological’ comes to refer to information processing performed by biological agents, seen in light of underlying goals. We reflect on the implications of this perspective for a definition of mental disorder, including what is entailed in asserting that a particular disorder is ‘biological’ or ‘psychological’ in origin. We propose that a computational approach assists in understanding the topography of mental disorder, while cautioning that the point at which eccentric reasoning constitutes disorder often remains a matter of cultural judgment.

Arbitration between controlled and impulsive choices

The impulse to act for immediate reward often conflicts with more deliberate evaluations that support long-term benefit. The neural architecture that negotiates this conflict remains unclear. One account proposes a single neural circuit that evaluates both immediate and delayed outcomes, while another outlines separate impulsive and patient systems that compete for behavioral control. Here we designed a task in which a complex payout structure divorces the immediate value of acting from the overall long-term value, within the same outcome modality. Using model-based fMRI in humans, we demonstrate separate neural representations of immediate and long-term values, with the former tracked in the anterior caudate (AC) and the latter in the ventromedial prefrontal cortex (vmPFC). Crucially, when subjects' choices were compatible with long-run consequences, value signals in AC were down-weighted and those in vmPFC were enhanced, while the opposite occurred when choice was impulsive. Thus, our data implicate a trade-off in value representation between AC and vmPFC as underlying controlled versus impulsive choice.

Dopamine, Salience, and Response Set Shifting in Prefrontal Cortex

Dopamine is implicated in multiple functions, including motor execution, action learning for hedonically salient outcomes, maintenance, and switching of behavioral response set. Here, we used a novel within-subject psychopharmacological and combined functional neuroimaging paradigm, investigating the interaction between hedonic salience, dopamine, and response set shifting, distinct from effects on action learning or motor execution. We asked whether behavioral performance in response set shifting depends on the hedonic salience of reversal cues, by presenting these as null (neutral) or salient (monetary loss) outcomes. We observed marked effects of reversal cue salience on set-switching, with more efficient reversals following salient loss outcomes. L-Dopa degraded this discrimination, leading to inappropriate perseveration. Generic activation in thalamus, insula, and striatum preceded response set switches, with an opposite pattern in ventromedial prefrontal cortex (vmPFC). However, the behavioral effect of hedonic salience was reflected in differential vmPFC deactivation following salient relative to null reversal cues. l-Dopa reversed this pattern in vmPFC, suggesting that its behavioral effects are due to disruption of the stability and switching of firing patterns in prefrontal cortex. Our findings provide a potential neurobiological explanation for paradoxical phenomena, including maintenance of behavioral set despite negative outcomes, seen in impulse control disorders in Parkinson's disease.

Optimistic update bias increases in older age

BACKGROUND

Healthy older adults report greater well-being and life satisfaction than their younger counterparts. One potential explanation for this is enhanced optimism. We tested the influence of age on optimistic and pessimistic beliefs about the future and the associated structural neural correlates.

METHOD

Eighteen young and 18 healthy older adults performed a belief updating paradigm, measuring differences in updating beliefs for desirable and undesirable information about future negative events. These measures were related to regional brain volume, focusing on the anterior cingulate cortex (ACC) because this region is strongly linked to a positivity bias in older age.

RESULTS

We demonstrate an age-related reduction in updating beliefs when older adults are faced with undesirable, but not desirable, information about negative events. This greater 'update bias' in older age persisted even after controlling for a variety of variables including subjective rating scales and poorer overall memory. A structural brain correlate of this greater 'update bias' was evident in greater grey matter volume in the dorsal ACC in older but not in young adults.

CONCLUSIONS

We show a greater update bias in healthy older age. The link between this bias and relative volume of the ACC suggests a shared mechanism with an age-related positivity bias. Older adults frequently have to make important decisions relating to personal, health and financial issues. Our findings have wider behavioural implications in these contexts because an enhanced optimistic update bias may skew such real-world decision making.

Depression is related to an absence of optimistically biased belief updating about future life events

BACKGROUND

When challenged with information about the future, healthy participants show an optimistically biased updating pattern, taking desirable information more into account than undesirable information. However, it is unknown how patients suffering from major depressive disorder (MDD), who express pervasive pessimistic beliefs, update their beliefs when receiving information about their future. Here we tested whether an optimistically biased information processing pattern found in healthy individuals is absent in MDD patients.

METHOD

MDD patients (n = 18; 13 medicated; eight with co-morbid anxiety disorder) and healthy controls (n = 19) estimated their personal probability of experiencing 70 adverse life events. After each estimate participants were presented with the average probability of the event occurring to a person living in the same sociocultural environment. This information could be desirable (i.e. average probability better than expected) or undesirable (i.e. average probability worse than expected). To assess how desirable versus undesirable information influenced beliefs, participants estimated their personal probability of experiencing the 70 events a second time.

RESULTS

Healthy controls showed an optimistic bias in updating, that is they changed their beliefs more toward desirable versus undesirable information. Overall, this optimistic bias was absent in MDD patients. Symptom severity correlated with biased updating: more severely depressed individuals showed a more pessimistic updating pattern. Furthermore, MDD patients estimated the probability of experiencing adverse life events as higher than healthy controls.

CONCLUSIONS

Our findings raise the intriguing possibility that optimistically biased updating of expectations about one's personal future is associated with mental health.

Learning and generalization under ambiguity: an fMRI study

Adaptive behavior often exploits generalizations from past experience by applying them judiciously in new situations. This requires a means of quantifying the relative importance of prior experience and current information, so they can be balanced optimally. In this study, we ask whether the brain generalizes in an optimal way. Specifically, we used Bayesian learning theory and fMRI to test whether neuronal responses reflect context-sensitive changes in ambiguity or uncertainty about experience-dependent beliefs. We found that the hippocampus expresses clear ambiguity-dependent responses that are associated with an augmented rate of learning. These findings suggest candidate neuronal systems that may be involved in aberrations of generalization, such as over-confidence.

Intelligent behavior requires flexible responses to new situations, which exploit learned principles or abstractions. When no such principles exist, the imperative is to learn quickly from scratch. Behaviorally, we show that subjects learn action-reward relationships in a manner that enables them to generalize rules to new situations. Our fMRI results show that when subjects have no evidence that such a rule exists, medial temporal lobe responses (that reflect uncertainty) predict their augmented learning.

Optimistic biases in observational learning of value

Action-outcome contingencies can be learnt either by active trial-and-error, or vicariously, by observing the outcomes of actions performed by others. The extant literature is ambiguous as to which of these modes of learning is more effective, as controlled comparisons of operant and observational learning are rare. Here, we contrasted human operant and observational value learning, assessing implicit and explicit measures of learning from positive and negative reinforcement. Compared to direct operant learning, we show observational learning is associated with an optimistic over-valuation of low-value options, a pattern apparent both in participants’ choice preferences and their explicit post-hoc estimates of value. Learning of higher value options showed no such bias. We suggest that such a bias can be explained as a tendency for optimistic underestimation of the chance of experiencing negative events, an optimism repressed when information is gathered through direct operant learning.

Rewarding feedback after correct visual discriminations has both general and specific influences on visual cortex

Reward can influence visual performance, but the neural basis of this effect remains poorly understood. Here we used functional magnetic resonance imaging to investigate how rewarding feedback affected activity in distinct areas of human visual cortex, separating rewarding feedback events after correct performance from preceding visual events. Participants discriminated oriented gratings in either hemifield, receiving auditory feedback at trial end that signaled financial reward after correct performance. Greater rewards improved performance for all but the most difficult trials. Rewarding feedback increased blood-oxygen-level-dependent (BOLD) signals in striatum and orbitofrontal cortex. It also increased BOLD signals in visual areas beyond retinotopic cortex, but not in primary visual cortex representing the judged stimuli. These modulations were seen at a time point in which no visual stimuli were presented or expected, demonstrating a novel type of activity change in visual cortex that cannot reflect modulation of response to incoming or anticipated visual stimuli. Rewarded trials led on the next trial to improved performance and enhanced visual activity contralateral to the judged stimulus, for retinotopic representations of the judged visual stimuli in V1. Our findings distinguish general effects in nonretinotopic visual cortex when receiving rewarding feedback after correct performance from consequences of reward for spatially specific responses in V1.

Choosing to make an effort: the role of striatum in signaling physical effort of a chosen action

The possibility that we will have to invest effort influences our future choice behavior. Indeed deciding whether an action is actually worth taking is a key element in the expression of human apathy or inertia. There is a well developed literature on brain activity related to the anticipation of effort, but how effort affects actual choice is less well understood. Furthermore, prior work is largely restricted to mental as opposed to physical effort or has confounded temporal with effortful costs. Here we investigated choice behavior and brain activity, using functional magnetic resonance imaging, in a study where healthy participants are required to make decisions between effortful gripping, where the factors of force (high and low) and reward (high and low) were varied, and a choice of merely holding a grip device for minimal monetary reward. Behaviorally, we show that force level influences the likelihood of choosing an effortful grip. We observed greater activity in the putamen when participants opt to grip an option with low effort compared with when they opt to grip an option with high effort. The results suggest that, over and above a nonspecific role in movement anticipation and salience, the putamen plays a crucial role in computations for choice that involves effort costs.

Pain relativity in motor control

Motivational theories of pain highlight its role in people's choices of actions that avoid bodily damage. By contrast, little is known regarding how pain influences action implementation. To explore this less-understood area, we conducted a study in which participants had to rapidly point to a target area to win money while avoiding an overlapping penalty area that would cause pain in their contralateral hand. We found that pain intensity and target-penalty proximity repelled participants' movement away from pain and that motor execution was influenced not by absolute pain magnitudes but by relative pain differences. Our results indicate that the magnitude and probability of pain have a precise role in guiding motor control and that representations of pain that guide action are, at least in part, relative rather than absolute. Additionally, our study shows that the implicit monetary valuation of pain, like many explicit valuations (e.g., patients' use of rating scales in medical contexts), is unstable, a finding that has implications for pain treatment in clinical contexts.

Modulation of perception and brain activity by predictable trajectories of facial expressions

People track facial expression dynamics with ease to accurately perceive distinct emotions. Although the superior temporal sulcus (STS) appears to possess mechanisms for perceiving changeable facial attributes such as expressions, the nature of the underlying neural computations is not known. Motivated by novel theoretical accounts, we hypothesized that visual and motor areas represent expressions as anticipated motion trajectories. Using magnetoencephalography, we show predictable transitions between fearful and neutral expressions (compared with scrambled and static presentations) heighten activity in visual cortex as quickly as 165 ms poststimulus onset and later (237 ms) engage fusiform gyrus, STS and premotor areas. Consistent with proposed models of biological motion representation, we suggest that visual areas predictively represent coherent facial trajectories. We show that such representations bias emotion perception of subsequent static faces, suggesting that facial movements elicit predictions that bias perception. Our findings reveal critical processes evoked in the perception of dynamic stimuli such as facial expressions, which can endow perception with temporal continuity.

Neuroimaging of cognition: past, present, and future

Neuroimaging, particularly that based upon functional magnetic resonance (fMRI), has become a dominant tool in cognitive neuroscience. This review provides a personal and selective perspective on its past, present, and future. Two trends currently characterize the field that broadly reflect a pursuit of "where"- and "how"-type questions. The latter addresses basic mechanisms related to the expression of task-induced neural activity and is likely to be an increasingly important theme in the future. This trend entails an enhanced symbiosis among investigators pursuing similar questions in fields such as computational and theoretical neuroscience as well as through the detailed analysis of microcircuitry.

Dynamic causal models of steady-state responses

In this paper, we describe a dynamic causal model (DCM) of steady-state responses in electrophysiological data that are summarised in terms of their cross-spectral density. These spectral data-features are generated by a biologically plausible, neural-mass model of coupled electromagnetic sources; where each source comprises three sub-populations. Under linearity and stationarity assumptions, the model's biophysical parameters (e.g., post-synaptic receptor density and time constants) prescribe the cross-spectral density of responses measured directly (e.g., local field potentials) or indirectly through some lead-field (e.g., electroencephalographic and magnetoencephalographic data). Inversion of the ensuing DCM provides conditional probabilities on the synaptic parameters of intrinsic and extrinsic connections in the underlying neuronal network. This means we can make inferences about synaptic physiology, as well as changes induced by pharmacological or behavioural manipulations, using the cross-spectral density of invasive or non-invasive electrophysiological recordings. In this paper, we focus on the form of the model, its inversion and validation using synthetic and real data. We conclude with an illustrative application to multi-channel local field potential data acquired during a learning experiment in mice.

Keynote address: revaluing the orbital prefrontal cortex

The importance of orbitofrontal cortex (OFC) in human behavioral regulation is no longer a matter of dispute, though its precise role remains a matter of ongoing investigation. It is ironic that this revaluation of OFC required a major departure from a historical nadir, during which it was viewed as redundant or "silent cortex," a situation that prevailed even up to the latter half of the 20th century. The increasing wealth of data from diverse fields within neuroscience now provides an unambiguous testament to the importance of this cortical region in behavioral regulation and cognition in general.

The neurotransmitter basis of cognition: psychopharmacological activation studies using positron emission tomography

The neuromodulatory effect of manipulating monoaminergic receptor function was assessed by combining a psychological and a pharmacological activation during repeated positron emission tomographic (PET) scans. The effects of buspirone (a 5-HT1A receptor partial agonist) on changes in regional cerebral blood flow (rCBF) associated with free word recall were examined. A factorial design was used to demonstrate a significant interaction (changes in rCBF brought about by psychological activation which depend on drug administration) in the left parahippocampal region. This interaction was an attenuation of increases in local neuronal activity (rCBF) related to memory function. Buspirone-induced decreases in rCBF, independent of the memory effect, were seen in the left prefrontal and parietal cortices. We suggest that combined psychological and pharmacological activation is a way of measuring direct (main) drug effects and modulatory effects on neurotransmission associated with cognitive functions (interaction).

The human amygdala and orbital prefrontal cortex in behavioural regulation

Survival in complex environments depends on an ability to optimize future behaviour based on past experience. Learning from experience enables an organism to generate predictive expectancies regarding probable future states of the world, enabling deployment of flexible behavioural strategies. However, behavioural flexibility cannot rely on predictive expectancies alone and options for action need to be deployed in a manner that is responsive to a changing environment. Important moderators on learning-based predictions include those provided by context and inputs regarding an organism's current state, including its physiological state. In this paper, I consider human experimental approaches using functional magnetic resonance imaging that have addressed the role of the amygdala and prefrontal cortex (PFC), in particular the orbital PFC, in acquiring predictive information regarding the probable value of future events, updating this information, and shaping behaviour and decision processes on the basis of these value representations.

Face adaptation aftereffects reveal anterior medial temporal cortex role in high level category representation

Previous studies have shown reductions of the functional magnetic resonance imaging (fMRI) signal in response to repetition of specific visual stimuli. We examined how adaptation affects the neural responses associated with categorization behavior, using face adaptation aftereffects. Adaptation to a given facial category biases categorization towards non-adapted facial categories in response to presentation of ambiguous morphs. We explored a hypothesis, posed by recent psychophysical studies, that these adaptation-induced categorizations are mediated by activity in relatively advanced stages within the occipitotemporal visual processing stream. Replicating these studies, we find that adaptation to a facial expression heightens perception of non-adapted expressions. Using comparable behavioral methods, we also show that adaptation to a specific identity heightens perception of a second identity in morph faces. We show both expression and identity effects to be associated with heightened anterior medial temporal lobe activity, specifically when perceiving the non-adapted category. These regions, incorporating bilateral anterior ventral rhinal cortices, perirhinal cortex and left anterior hippocampus are regions previously implicated in high-level visual perception. These categorization effects were not evident in fusiform or occipital gyri, although activity in these regions was reduced to repeated faces. The findings suggest that adaptation-induced perception is mediated by activity in regions downstream to those showing reductions due to stimulus repetition.

Imaging informational conflict: a functional magnetic resonance imaging study of numerical stroop

We employed a parametric version of the comparison Stroop paradigm to investigate the processing of numerical magnitude and physical size under task-relevant and -irrelevant conditions to investigate two theoretical issues: (1) What is the neural fate of task-irrelevant information? (2) What is the neural basis of the resolution of the conflict between task-relevant and -irrelevant information? We show in 18 healthy adults that numerical magnitudes of numbers call for higher processing requirements than physical sizes. The enhanced activation elicited by numerical magnitudes is not modulated by task relevance, indicating autonomous processing. Moreover, the normal behavioral distance effect when the numerical dimension is task relevant and reversed distance effect when it is not show that autonomous processing fully encodes numerical magnitudes. Conflict trials elicited greater activation in bilateral inferior frontal gyri, right middle frontal gyri, and right superior frontal gyri. We postulate two sources to the conflict, namely, at cognitive and response levels.

Mechanisms of top-down facilitation in perception of visual objects studied by FMRI

Prior knowledge regarding the possible identity of an object facilitates its recognition from a degraded visual input, though the underlying mechanisms are unclear. Previous work implicated ventral visual cortex but did not disambiguate whether activity-changes in these regions are causal to or merely reflect an effect of facilitated recognition. We used functional magnetic resonance imaging to study top-down influences on processing of gradually revealed objects, by preceding each object with a name that was congruent or incongruent with the object. Congruently primed objects were recognized earlier than incongruently primed, and this was paralleled by shifts in activation profiles for ventral visual, parietal, and prefrontal cortices. Prior to recognition, defined on a trial-by-trial basis, activity in ventral visual cortex rose gradually but equivalently for congruently and incongruently primed objects. In contrast, prerecognition activity was greater with congruent priming in lateral parietal, retrosplenial, and lateral prefrontal cortices, whereas functional coupling between parietal and ventral visual (and also left lateral prefrontal and parietal) cortices was enhanced in the same context. Thus, when controlling for recognition point and stimulus information, activity in ventral visual cortex mirrors recognition success, independent of condition. Facilitation by top-down cues involves lateral parietal cortex interacting with ventral visual areas, potentially explaining why parietal lesions can lead to deficits in recognizing degraded objects even in the context of top-down knowledge.

Left prefrontal cortex control of novel occurrences during recollection: A psychopharmacological study using scopolamine and event-related fMRI

Recollection and familiarity represent two processes involved in episodic memory retrieval. We investigated how scopolamine (an antagonist of acetylcholine muscarinic receptors) influenced brain activity during memory retrieval, using a paradigm that separated recollection and familiarity. Eighteen healthy volunteers were recruited in a randomized, placebo-controlled, double-blind design using event-related fMRI. Participants were required to perform a verbal recognition memory task within the scanner, either under placebo or scopolamine conditions. Depending on the subcondition, participants were required to make a simple recognition decision (old/new items) or base their decision on more specific information related to prior experience (target/non-target/new items). We show a drug modulation in left prefrontal and perirhinal cortex during recollection. Such an effect was specifically driven by novelty and showed an inverse correlation with accuracy performance. Additionally, we show a direct correlation between drug-related signal change in left prefrontal and perirhinal cortices. We discuss the findings in terms of acetylcholine mediation of the familiarity/novelty signal through perirhinal cortex and the control of the relative signal strength through prefrontal cortex.

Magnetoencephalography (MEG) determined temporal modulation of visual and auditory sensory processing in the context of classical conditioning to faces

Using magnetoencephalography (MEG), we determined the time course of sensory-evoked modulations during differential aversive conditioning to faces, with an aversive noise event (UCS). Conditioning was associated with the development of a differential event-related waveform peaking at approximately 150 ms. Source analysis indicated the localization of this modulation to ventral occipital regions. In the auditory domain, a modulation of auditory-evoked responses to a probe sound was evident in a late component emerging at approximately 180 ms over sensors in fronto-temporal regions. The findings indicate the time course in processing sensory stimuli can be altered on the basis of their acquired value.

Neural correlates of processing valence and arousal in affective words

Psychological frameworks conceptualize emotion along 2 dimensions, "valence" and "arousal." Arousal invokes a single axis of intensity increasing from neutral to maximally arousing. Valence can be described variously as a bipolar continuum, as independent positive and negative dimensions, or as hedonic value (distance from neutral). In this study, we used functional magnetic resonance imaging to characterize neural activity correlating with arousal and with distinct models of valence during presentation of affective word stimuli. Our results extend observations in the chemosensory domain suggesting a double dissociation in which subregions of orbitofrontal cortex process valence, whereas amygdala preferentially processes arousal. In addition, our data support the physiological validity of descriptions of valence along independent axes or as absolute distance from neutral but fail to support the validity of descriptions of valence along a bipolar continuum.

Affective response to one's own moral violations

Morality depends on a set of cultural rules that regulate interpersonal behaviour and provide a basis for social cohesion. The interpretation of moral transgressions and their affective consequences depends on whether the action is intentional or accidental, and whether one is the agent of or witness to the action. We used event-related functional magnetic resonance imaging (fMRI) to investigate whether the amygdala is involved in judging one's own moral violation of social norms. In this study, participants (n = 12) were asked to make evaluations regarding the degree of inappropriateness of social behaviours described in stories in which they themselves, or someone else, transgressed social norms either intentionally or accidentally. Consistent with our hypothesis, the amygdala was activated when participants considered stories narrating their own intentional transgression of social norms. This result suggests the amygdala is important for affective responsiveness to moral transgressions.

Unconscious fear influences emotional awareness of faces and voices

Nonconscious recognition of facial expressions opens an intriguing possibility that two emotions can be present together in one brain with unconsciously and consciously perceived inputs interacting. We investigated this interaction in three experiments by using a hemianope patient with residual nonconscious vision. During simultaneous presentation of facial expressions to the intact and the blind field, we measured interactions between conscious and nonconsciously recognized images. Fear-specific congruence effects were expressed as enhanced neuronal activity in fusiform gyrus, amygdala, and pulvinar. Nonconscious facial expressions also influenced processing of consciously recognized emotional voices. Emotional congruency between visual and an auditory input enhances activity in amygdala and superior colliculus for blind, relative to intact, field presentation of faces. Our findings indicate that recognition of fear is mandatory and independent of awareness. Most importantly, unconscious fear recognition remains robust even in the light of a concurrent incongruent happy facial expression or an emotional voice of which the observer is aware.

Functional dissociation of amygdala-modulated arousal and cognitive appraisal, in Turner syndrome

The amygdala is preferentially activated by facial expressions of fear. Right and left amygdala are hypothesized to play distinct, but complementary, roles that influence somatic and cognitive responses to facial expressions. Right amygdala activation is linked to autonomic arousal, and thus indirectly influences left hemisphere cognitive processing centres. Left amygdala activation is more closely associated with cognitive processing and differentiation of facial emotions. A double-dissociation between the functions of left and right amygdala is implied by lesion studies but supportive evidence is inconsistent, partly because patients with structural anteromedial temporal anomalies have experienced variable surgical procedures. A functional dissociation can be demonstrated between arousal and the cognitive appraisal of fearful faces in the condition of X-monosomy or Turner syndrome. Previous research found Turner syndrome women of normal verbal intelligence are seriously impaired in their ability cognitively to differentiate fearful from other facial expressions but they acquire fear conditioning normally, with enhanced autonomic responses. These findings supported the dissociation hypothesis, which was formally tested in a study of 12 X-monosomic and 12 control females who participated in functional magnetic resonance imaging during which simultaneous skin conductance recordings were acquired. Faces depicting fear or neutral emotions were presented to both case and control subjects in random order. Arousal to (fearful-neutral) faces was associated with transiently increased skin conductance responses and bilateral amygdala activation in both groups, but X-monosomic females had proportionately greater--and more persistent--right amygdala activation than controls. In both groups, cognitive accuracy correlated positively with differential activity of left fusiform gyrus. There was a significant correlation between the left fusiform and left medial amygdala activation only in normal females, and only in them did differential SCRs (to fearful-neutral faces) correlate positively with left fusiform responses. Arousal and cognitive appraisal functions of the amygdala can thus be functionally dissociated. X-monosomy selectively impairs explicit recognition of fearful faces in the presence of normal or enhanced autonomic reactivity, and is associated with a functional dissociation of activity in left amygdala and left fusiform gyrus. These findings imply X-linked genes are essential for binding somatic responses to the cognitive appraisal of emotional stimuli.

Brain mechanisms for mood congruent memory facilitation

Emotional information is better remembered when mood at the time of retrieval matches it in valence (positive mood, positive material). An associative memory model predicts that this 'mood congruent' facilitation is due to the mood-related reactivation at retrieval of emotional responses which were linked to valenced information at encoding. To test this model, we presented subjects with positive and negative words at study and manipulated their mood at test while using functional imaging to monitor brain activity. Subjective mood ratings and heart rate variability both indicated that the manipulation was effective, and memory performance showed a strong trend towards facilitation in congruent conditions. In the functional imaging data, valence-specific conjunctions between encoding activity predicting subsequent memory in a congruent mood and retrieval activity relating to mood congruent recollection revealed shared responses in subgenual cingulate for positive valence and posteriolateral orbitofrontal cortex for negative valence, thus supporting the associative model. To elucidate the mnemonic basis of facilitation, independent of valence, we examined the shared correlates of positive and negative congruence and found that parts of the episodic memory system were activated by congruence in correct rejection trials, but no part of this system was activated by congruence in correctly remembered trials. This pattern suggests that mood congruent facilitation occurs at the level of attempted recall rather than that of successful recollection.

Familiarity enhances invariance of face representations in human ventral visual cortex: fMRI evidence

Face recognition across different viewing conditions is strongly improved by familiarity. In the present study, we tested the hypothesis that the neural basis of this effect is a less view-dependent representation of familiar faces in ventral visual cortex by assessing priming-related fMRI repetition effects. 15 healthy volunteers made male/female judgements on familiar (famous) and unfamiliar (novel) faces preceded by the same image, a different image of the same face, or another (unprimed) face. Reaction times revealed priming by same and different images independent of familiarity and more pronounced for same than different images. In the imaging data, a main effect of prime condition was found in bilateral fusiform and orbitofrontal regions. A right anterior fusiform region expressed stronger response decreases to repetition of familiar than unfamiliar faces. Bilateral mid-fusiform areas showed stronger response decreases to repetition of same than different images. A regions-of-interest analysis focussing specifically on face responsive regions suggested differences in the degree of image dependency across fusiform cortex. Collapsing across familiarity, there was greater image dependency of repetition effects in right than left anterior fusiform, replicating previous imaging findings obtained with common objects. For familiar faces alone, there was greater generalisation of repetition effects over different images in anterior than middle fusiform. This suggests a role of anterior fusiform cortex in coding image-independent representations of familiar faces.

Brain activity relating to the contingent negative variation: an fMRI investigation

The contingent negative variation (CNV) is a long-latency electroencephalography (EEG) surface negative potential with cognitive and motor components, observed during response anticipation. CNV is an index of cortical arousal during orienting and attention, yet its functional neuroanatomical basis is poorly understood. We used functional magnetic resonance imaging (fMRI) with simultaneous EEG and recording of galvanic skin response (GSR) to investigate CNV-related central neural activity and its relationship to peripheral autonomic arousal. In a group analysis, blood oxygenation level dependent (BOLD) activity during the period of CNV generation was enhanced in thalamus, somatomotor cortex, bilateral midcingulate, supplementary motor, and insular cortices. Enhancement of CNV-related activity in anterior and midcingulate, SMA, and insular cortices was associated with decreases in peripheral sympathetic arousal. In a subset of subjects in whom we acquired simultaneous EEG and fMRI data, we observed activity in bilateral thalamus, anterior cingulate, and supplementary motor cortex that was modulated by trial-by-trial amplitude of CNV. These findings provide a likely functional neuroanatomical substrate for the CNV and demonstrate modulation of components of this neural circuitry by peripheral autonomic arousal. Moreover, these data suggest a mechanistic model whereby thalamocortical interactions regulate CNV amplitude.

Beta-adrenergic modulation of emotional memory-evoked human amygdala and hippocampal responses

Human emotional experience is typically associated with enhanced episodic memory. We have used functional magnetic resonance imaging to demonstrate that successful encoding of emotional, compared to neutral, verbal stimuli evokes increased human amygdala responses. Items that evoke amygdala activation at encoding evoke greater hippocampal responses at retrieval compared to neutral items. Administration of the beta-adrenergic antagonist propranolol at encoding abolishes the enhanced amygdala encoding and hippocampal retrieval effects, despite propranolol being no longer present at retrieval. Thus, memory-related amygdala responses at encoding and hippocampal responses at recognition for emotional items depend on beta-adrenergic engagement at encoding. Our results suggest that human emotional memory is associated with a beta-adrenergic-dependent modulation of amygdala-hippocampal interactions.

fMRI correlates of the episodic retrieval of emotional contexts

Functional neuroimaging studies reveal differences in neural correlates of the retrieval of emotional and nonemotional memories. In the present experiment, encoding of emotionally neutral pictures in association with positively, neutrally or negatively valenced background contexts led to differential modulation of neural activity elicited in a subsequent recognition memory test for these pictures. Recognition of stimuli previously studied in emotional compared to neutral contexts elicited enhanced activity in structures previously implicated in episodic memory, including the parahippocampal cortex, hippocampus and prefrontal cortex. In addition, there was engagement of structures linked more specifically to emotional processing, including the amygdala, orbitofrontal cortex and anterior cingulate cortex. These emotion-related effects displayed both valence-independent and valence-specific components. We discuss the findings in terms of current models of emotional memory retrieval.

Effects of cholinergic enhancement on visual stimulation, spatial attention, and spatial working memory

We compared behavioral and neural effects of cholinergic enhancement between spatial attention, spatial working memory (WM), and visual control tasks, using fMRI and the anticholinesterase physostigmine. Physostigmine speeded responses nonselectively but increased accuracy selectively for attention. Physostigmine also decreased activations to visual stimulation across all tasks within primary visual cortex, increased extrastriate occipital cortex activation selectively during maintained attention and WM encoding, and decreased parietal activation selectively during maintained attention. Finally, lateralization of occipital activation as a function of the visual hemifield toward which attention or memory was directed was decreased under physostigmine. In the case of attention, this effect correlated strongly with a decrease in a behavioral measure of selective spatial processing. Our results suggest that, while cholinergic enhancement facilitates visual attention by increasing activity in extrastriate cortex generally, it accomplishes this in a manner that reduces expectation-driven selective biasing of extrastriate cortex.

Dissociable amygdala and orbitofrontal responses during reversal fear conditioning

The neural mechanisms underlying the persistence and plasticity of human emotional learning are unknown. Here we describe dissociable neural responses in amygdala and orbitofrontal cortex during acquisition and reversal of discriminatory fear conditioning. During acquisition, increased responses in bilateral amygdala were elicited by a face stimulus (A = CS+) predictive of an aversive noise compared to another nonpredictive face (B = CS-). With subsequent reversal of the conditioning contingency, face B (new CS+) elicited enhanced responses in right orbitofrontal cortex, while face A (old CS+) continued to evoke increased responses in right ventral amygdala. Thus, while orbitofrontal cortex exhibited rapid reversal of acquired fear responses, ventral amygdala showed a persistent, nonreversing "memory" for previous fear-related stimulus associations.

Activity in ventromedial prefrontal cortex covaries with sympathetic skin conductance level: a physiological account of a “default mode” of brain function

We examined neural activity related to modulation of skin conductance level (SCL), an index of sympathetic tone, using functional magnetic resonance imaging (fMRI) while subjects performed biofeedback arousal and relaxation tasks. Neural activity within the ventromedial prefrontal cortex (VMPFC) and the orbitofrontal cortex (OFC) covaried with skin conductance level (SCL), irrespective of task. Activity within striate and extrastriate cortices, anterior cingulate and insular cortices, thalamus, hypothalamus and lateral regions of prefrontal cortex reflected the rate of change in electrodermal activity, highlighting areas supporting transient skin conductance responses (SCRs). Successful performance of either biofeedback task (where SCL changed in the intended direction) was associated with enhanced activity in mid-OFC. The findings point to a dissociation between neural systems controlling basal sympathetic tone (SCL) and transient skin conductance responses (SCRs). The level of activity in VMPFC has been related to a default mode of brain function and our findings provide a physiological account of this state, indicating that activity within VMPFC and OFC reflects a dynamic between exteroceptive and interoceptive deployment of attention.

fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception

The distributed model of face processing proposes an anatomical dissociation between brain regions that encode invariant aspects of faces, such as identity, and those that encode changeable aspects of faces, such as expression. We tested for a neuroanatomical dissociation for identity and expression in face perception using a functional MRI (fMRI) adaptation paradigm. Repeating identity across face pairs led to reduced fMRI signal in fusiform cortex and posterior superior temporal sulcus (STS), whereas repeating emotional expression across pairs led to reduced signal in a more anterior region of STS. These results provide neuroanatomical evidence for the distributed model of face processing and highlight a dissociation within right STS between a caudal segment coding identity and a more rostral region coding emotional expression.

BOLD repetition decreases in object-responsive ventral visual areas depend on spatial attention

Functional imaging studies of priming-related repetition phenomena have become widely used to study neural object representation. Although blood oxygenation level-dependent (BOLD) repetition decreases can sometimes be observed without awareness of repetition, any role for spatial attention in BOLD repetition effects remains largely unknown. We used fMRI in 13 healthy subjects to test whether BOLD repetition decreases for repeated objects in ventral visual cortices depend on allocation of spatial attention to the prime. Subjects performed a size-judgment task on a probe object that had been attended or ignored in a preceding prime display of 2 lateralized objects. Reaction times showed faster responses when the probe was the same object as the attended prime, independent of the view tested (identical vs. mirror image). No behavioral effect was evident from unattended primes. BOLD repetition decreases for attended primes were found in lateral occipital and fusiform regions bilaterally, which generalized across identical and mirror-image repeats. No repetition decreases were observed for ignored primes. Our results suggest a critical role for attention in achieving visual representations of objects that lead to both BOLD signal decreases and behavioral priming on repeated presentation.

An emotion-induced retrograde amnesia in humans is amygdala- and beta-adrenergic-dependent

The influence of emotion on human memory is associated with two contradictory effects in the form of either emotion-induced enhancements or decrements in memory. In a series of experiments involving single word presentation, we show that enhanced memory for emotional words is strongly coupled to decrements in memory for items preceding the emotional stimulus, an effect that is more pronounced in women. These memory effects would appear to depend on a common neurobiological substrate, in that enhancements and decrements are reversed by propranolol, a beta-adrenergic antagonist, and abolished by selective bilateral amygdala damage. Thus, our findings suggest that amygdala-dependent beta-adrenergic modulation of episodic encoding has costs as well as benefits.

Common and distinct neural responses during direct and incidental processing of multiple facial emotions

Whether common or distinct neural systems underpin perception of different emotions and the degree to which these systems are automatically engaged during emotional perception are unresolved. We performed an event-related fMRI experiment in which subjects viewed morphed emotional faces displaying low or high intensities of disgust, fear, happiness, or sadness under two task conditions. The amygdala and fusiform cortex responded to high-intensity expressions of all emotions, independent of task. Right superior temporal sulcus showed an additive effect of the emotion-directed task and high-intensity emotion. Ventromedial prefrontal and somatosensory cortices, regions implicated in providing representations of somatic states, showed enhanced activity during explicit emotional judgments. We failed to find predicted differences between emotions. The results suggest that amygdala contributes to task-independent perceptual processing of a range of emotions. We interpret ventromedial prefrontal and somatosensory cortex activations as evidence that these regions contribute to explicit emotion processing through linking emotion perception with representations of somatic states previously engendered by emotions.

Amygdala automaticity in emotional processing

The question addressed in this paper is whether the human amygdala processes threat-related stimuli independent of selective attention. This is considered from a functional neuroimaging perspective, describing studies in normal volunteers and patients with brain lesions. The conclusion is that the evidence for such automaticity is strong, indicating that important distinctions exist between emotion and other forms of cognition.

Beauty in a smile: the role of medial orbitofrontal cortex in facial attractiveness

The attractiveness of a face is a highly salient social signal, influencing mate choice and other social judgements. In this study, we used event-related functional magnetic resonance imaging (fMRI) to investigate brain regions that respond to attractive faces which manifested either a neutral or mildly happy face expression. Attractive faces produced activation of medial orbitofrontal cortex (OFC), a region involved in representing stimulus-reward value. Responses in this region were further enhanced by a smiling facial expression, suggesting that the reward value of an attractive face as indexed by medial OFC activity is modulated by a perceiver directed smile.