Minimizing threat via heuristic and optimal policies recruits hippocampus and medial prefrontal cortex

Non-human contributions to personality neuroscience: From fish through primates - a concluding editorial overview

This special issue attempts to integrate personality, psychopathology, and neuroscience as means to improve understanding of specific traits and trait structures in humans. The key strategy is to dive into comparative research using a range of species to provide simple models. This strategy has, as its foundation, the fact that the most basic functions, and their supporting neural systems, are highly conserved in evolution. The papers collected in the issue show that, from fish, through rats, to primates, the homologies in brain systems and underlying functions (despite species-specific forms of expression) allow simpler cases to provide insights into the neurobiology behind more complex ones including human. Our introductory editorial paper to this special issue took a bottom-up approach, starting with the genetics of conserved brain systems and working up to cognition. Here, we deconstruct the different aspects of personality, progressing from more complex ones in primates to least complex in fish. With the primate section, we summarize papers that discuss the factors that contribute to sociability in primates and how they apply to healthy and pathological human personality traits. In the rat section, the focus is driven by psychopathology and the way that "high" strains selected for extreme behaviors can illuminate the neurobiology of motivated responses to environmental cues. The section on fish summarizes papers that look into the most fundamental emotional reactions to the environment that are governed by primitive and conserved brain structures. This raises metatheoretical questions on the nature of traits and to a section that asks "which animals have personalities." We believe that the issue as a whole provides a nuanced answer to this question and shines a new, comparative, light on the interpretation of personality structure and the effects on it of evolution.

How it ends: A review of behavioral and psychological phenomena, physiological processes and neural circuits in the termination of aggression in other animals and anger in people

More is known about aggression initiation and persistence in other animals, and anger in people, than about their cessation. This review summarizes knowledge of relevant factors in aggression, mostly in vertebrates, and anger termination in people. The latency, probability and intensity of offensive aggression in mice is controlled by activity in a neuronal subpopulation in ventromedial hypothalamus [VMH]. This activity instantiates an aggressive state termed angriffsbereitschaft ["attack-readiness"]. Fighting in many species is broken into bouts with interbout breaks due to fatigue and/or signals from dorsal raphe to VMH. Eventually, losers decide durations and outcomes of fighting by transitioning to submission or flight. Factors reducing angriffsbereitschaft and triggering these defeat behaviors could include metabolic costs, e.g., lactate accumulation and glucose depletion detected by the hypothalamus, central fatigue perhaps sensed by the Salience Network [insula and anterior cingulate gyrus] and pain of injuries, the latter insufficiently blunted by opioid and non-opioid stress analgesia and transduced by anterior VMH neurons. Winners' angriffsbereitschaft continue for awhile, as indicated by post-victory attacks and, perhaps, triumph displays of some species, including humans. In longer term situations, sensory and/or response habituation of aggression may explain the "Dear enemy" tolerance of competitive neighbors. Prolonged satiation of predatory behavior could involve habenula-regulated reduction of dopaminergic reward in nucleus accumbens. Termination of human anger involves at least three processes, metaphorically termed decay, quenching and catharsis. Hypothesized neural mechanisms include anger diminution by negative feedback from accumbens to anterior cingulate and/or activity in the Salience Network that controls anger's "accumulation/offset" phase.

Functional sophistication in human escape

Animals including humans must cope with immediate threat and make rapid decisions to survive. Without much leeway for cognitive or motor errors, this poses a formidable computational problem. Utilizing fully immersive virtual reality with 13 natural threats, we examined escape decisions in N = 59 humans. We show that escape goals are dynamically updated according to environmental changes. The decision whether and when to escape depends on time-to-impact, threat identity and predicted trajectory, and stable personal characteristics. Its implementation appears to integrate secondary goals such as behavioral affordances. Perturbance experiments show that the underlying decision algorithm exhibits planning properties and can integrate novel actions. In contrast, rapid information-seeking and foraging-suppression are only partly devaluation-sensitive. Instead of being instinctive or hardwired stimulus-response patterns, human escape decisions integrate multiple variables in a flexible computational architecture. Taken together, we provide steps toward a computational model of how the human brain rapidly solves survival challenges.

Elucidating medial temporal and frontal lobe contributions to approach-avoidance conflict decision-making using functional MRI and the hierarchical drift diffusion model

The prefrontal cortex (PFC) has long been associated with arbitrating between approach and avoidance in the face of conflicting and uncertain motivational information, but recent work has also highlighted medial temporal lobe (MTL) involvement. It remains unclear, however, how the contributions of these regions differ in their resolution of conflict information and uncertainty. We designed an fMRI paradigm in which participants approached or avoided object pairs that differed by motivational conflict and outcome uncertainty (complete certainty vs. complete uncertainty). Behavioral data and decision-making parameters estimated using the hierarchical drift diffusion model revealed that participants' responding was driven by conflict rather than uncertainty. Our neural data suggest that PFC areas contribute to cognitive control during approach-avoidance conflict by potentially adjusting response caution and the strength of evidence generated towards either choice, with differential involvement of anterior cingulate cortex and dorsolateral prefrontal cortex. The MTL, on the other hand, appears to contribute to evidence generation, with the hippocampus linked to evidence accumulation for stimuli. Although findings within perirhinal cortex were comparatively equivocal, some evidence suggests contributions to perceptual representations, particularly under conditions of threat. Our findings provide evidence that MTL and PFC regions may contribute uniquely to arbitrating approach-avoidance conflict.

Neural predictors of cognitive-behavior therapy outcome in anxiety-related disorders: a meta-analysis of task-based fMRI studies

BACKGROUND

Cognitive-behavior therapy (CBT) is a well-established first-line intervention for anxiety-related disorders, including specific phobia, social anxiety disorder, panic disorder/agoraphobia, generalized anxiety disorder, obsessive-compulsive disorder, and posttraumatic stress disorder. Several neural predictors of CBT outcome for anxiety-related disorders have been proposed, but previous results are inconsistent.

METHODS

We conducted a systematic review and meta-analysis of task-based functional magnetic resonance imaging (fMRI) studies investigating whole-brain predictors of CBT outcome in anxiety-related disorders (17 studies, n = 442).

RESULTS

Across different tasks, we observed that brain response in a network of regions involved in salience and interoception processing, encompassing fronto-insular (the right inferior frontal gyrus-anterior insular cortex) and fronto-limbic (the dorsomedial prefrontal cortex-dorsal anterior cingulate cortex) cortices was strongly associated with a positive CBT outcome.

CONCLUSIONS

Our results suggest that there are robust neural predictors of CBT outcome in anxiety-related disorders that may eventually lead (probably in combination with other data) to develop personalized approaches for the treatment of these mental disorders.

A neuro-computational social learning framework to facilitate transdiagnostic classification and treatment across psychiatric disorders

Social deficits are among the core and most striking psychiatric symptoms, present in most psychiatric disorders. Here, we introduce a novel social learning framework, which consists of neuro-computational models that combine reinforcement learning with various types of social knowledge structures. We outline how this social learning framework can help specify and quantify social psychopathology across disorders and provide an overview of the brain regions that may be involved in this type of social learning. We highlight how this framework can specify commonalities and differences in the social psychopathology of individuals with autism spectrum disorder (ASD), personality disorders (PD), and major depressive disorder (MDD) and improve treatments on an individual basis. We conjecture that individuals with psychiatric disorders rely on rigid social knowledge representations when learning about others, albeit the nature of their rigidity and the behavioral consequences can greatly differ. While non-clinical cohorts tend to efficiently adapt social knowledge representations to relevant environmental constraints, psychiatric cohorts may rigidly stick to their preconceived notions or overly coarse knowledge representations during learning.

Decision heuristics in contexts integrating action selection and execution

Heuristics can inform human decision making in complex environments through a reduction of computational requirements (accuracy-resource trade-off) and a robustness to overparameterisation (less-is-more). However, tasks capturing the efficiency of heuristics typically ignore action proficiency in determining rewards. The requisite movement parameterisation in sensorimotor control questions whether heuristics preserve efficiency when actions are nontrivial. We developed a novel action selection-execution task requiring joint optimisation of action selection and spatio-temporal skillful execution. State-appropriate choices could be determined by a simple spatial heuristic, or by more complex planning. Computational models of action selection parsimoniously distinguished human participants who adopted the heuristic from those using a more complex planning strategy. Broader comparative analyses then revealed that participants using the heuristic showed combined decisional (selection) and skill (execution) advantages, consistent with a less-is-more framework. In addition, the skill advantage of the heuristic group was predominantly in the core spatial features that also shaped their decision policy, evidence that the dimensions of information guiding action selection might be yoked to salient features in skill learning.

Non-angry aggressive arousal and angriffsberietschaft: A narrative review of the phenomenology and physiology of proactive/offensive aggression motivation and escalation in people and other animals

Human aggression typologies largely correspond with those for other animals. While there may be no non-human equivalent of angry reactive aggression, we propose that human proactive aggression is similar to offense in other animals' dominance contests for territory or social status. Like predation/hunting, but unlike defense, offense and proactive aggression are positively reinforcing, involving dopamine release in accumbens. The drive these motivational states provide must suffice to overcome fear associated with initiating risky fights. We term the neural activity motivating proactive aggression "non-angry aggressive arousal", but use "angriffsberietschaft" for offense motivation in other animals to acknowledge possible differences. Temporal variation in angriffsberietschaft partitions fights into bouts; engendering reduced anti-predator vigilance, redirected aggression and motivational over-ride. Increased aggressive arousal drives threat-to-attack transitions, as in verbal-to-physical escalation and beyond that, into hyper-aggression. Proactive aggression and offense involve related neural activity states. Cingulate, insular and prefrontal cortices energize/modulate aggression through a subcortical core containing subnuclei for each aggression type. These proposals will deepen understanding of aggression across taxa, guiding prevention/intervention for human violence.

Inferring danger with minimal aversive experience

Learning about threats is crucial for survival and fundamentally rests upon Pavlovian conditioning. However, Pavlovian threat learning is largely limited to detecting known (or similar) threats and involves first-hand exposure to danger, which inevitably poses a risk of harm. We discuss how individuals leverage a rich repertoire of mnemonic processes that operate largely in safety and significantly expand our ability to recognize danger beyond Pavlovian threat associations. These processes result in complementary memories - acquired individually or through social interactions - that represent potential threats and the relational structure of our environment. The interplay between these memories allows danger to be inferred rather than directly learned, thereby flexibly protecting us from potential harm in novel situations despite minimal prior aversive experience.

Incorporating social knowledge structures into computational models

To navigate social interactions successfully, humans need to continuously learn about the personality traits of other people (e.g., how helpful or aggressive is the other person?). However, formal models that capture the complexities of social learning processes are currently lacking. In this study, we specify and test potential strategies that humans can employ for learning about others. Standard Rescorla-Wagner (RW) learning models only capture parts of the learning process because they neglect inherent knowledge structures and omit previously acquired knowledge. We therefore formalize two social knowledge structures and implement them in hybrid RW models to test their usefulness across multiple social learning tasks. We name these concepts granularity (knowledge structures about personality traits that can be utilized at different levels of detail during learning) and reference points (previous knowledge formalized into representations of average people within a social group). In five behavioural experiments, results from model comparisons and statistical analyses indicate that participants efficiently combine the concepts of granularity and reference points-with the specific combinations in models depending on the people and traits that participants learned about. Overall, our experiments demonstrate that variants of RW algorithms, which incorporate social knowledge structures, describe crucial aspects of the dynamics at play when people interact with each other.

Changes in brain function during negative emotion processing in the long-term course of depression

BACKGROUND

Relapses in major depression are frequent and are associated with a high burden of disease. Although short-term studies suggest a normalisation of depression-associated brain functional alterations directly after treatment, long-term investigations are sparse.

AIMS

To examine brain function during negative emotion processing in association with course of illness over a 2-year span.

METHOD

In this prospective case-control study, 72 in-patients with current depression and 42 healthy controls were investigated during a negative emotional face processing paradigm, at baseline and after 2 years. According to their course of illness during the study interval, patients were divided into subgroups (n = 25 no-relapse, n = 47 relapse). The differential changes in brain activity were investigated by a group × time analysis of covariance for the amygdala, hippocampus, insula and at whole-brain level.

RESULTS

A significant relapse × time interaction emerged within the amygdala (P_TFCE-FWE = 0.011), insula (P_TFCE-FWE = 0.001) and at the whole-brain level mainly in the temporal and prefrontal cortex (P_TFCE-FWE = 0.027), resulting from activity increases within the no-relapse group, whereas in the relapse group, activity decreased during the study interval. At baseline, the no-relapse group showed amygdala, hippocampus and insula hypoactivity compared with healthy controls and the relapse group.

CONCLUSIONS

This study reveals course of illness-associated activity changes in emotion processing areas. Patients in full remission show a normalisation of their baseline hypo-responsiveness to the activation level of healthy controls after 2 years. Brain function during emotion processing could further serve as a potential predictive marker for future relapse.

Spatial-topographic nestedness of interoceptive regions within the networks of decision making and emotion regulation: Combining ALE meta-analysis and MACM analysis

Prominent theories propose that interoception modulates our behavioral and emotional responses involving decision-making and emotion regulation. Are the regions implicated in interoception also spatially related to and possibly nested within the networks of decision making and emotion regulation? Addressing this question, we performed three meta-analyses of functional magnetic resonance imaging studies to identify the regions that are commonly activated by the three domains using activation likelihood estimation (ALE). Additionally, we assessed the coactivation pattern of identified common regions using meta-analytic connectivity modeling (MACM). The results showed major overlaps of interoception with both decision making and emotion regulation in specifically the right dorsal anterior insula. The pairwise contrast analyses confirmed this finding and revealed conjunction-based activities in decision making and emotion regulation in the dorsal anterior cingulate cortex (dACC). MACM based on the identified insula revealed a widespread convergent coactivation pattern with the left anterior insula, dACC, and bilateral thalamus which, together, constitute the salience network. Among these co-activated regions, bilateral insula and the dACC were shared among all three domains. These results suggest that the regions mediating interoception including intero-exteroceptive integration and salience attribution are contained and thus spatially nested within the more extensive networks recruited during decision making and emotion regulation.

Medial and orbital frontal cortex in decision-making and flexible behavior

The medial frontal cortex and adjacent orbitofrontal cortex have been the focus of investigations of decision-making, behavioral flexibility, and social behavior. We review studies conducted in humans, macaques, and rodents and argue that several regions with different functional roles can be identified in the dorsal anterior cingulate cortex, perigenual anterior cingulate cortex, anterior medial frontal cortex, ventromedial prefrontal cortex, and medial and lateral parts of the orbitofrontal cortex. There is increasing evidence that the manner in which these areas represent the value of the environment and specific choices is different from subcortical brain regions and more complex than previously thought. Although activity in some regions reflects distributions of reward and opportunities across the environment, in other cases, activity reflects the structural relationships between features of the environment that animals can use to infer what decision to take even if they have not encountered identical opportunities in the past.

Humans perseverate on punishment avoidance goals in multigoal reinforcement learning

Managing multiple goals is essential to adaptation, yet we are only beginning to understand computations by which we navigate the resource demands entailed in so doing. Here, we sought to elucidate how humans balance reward seeking and punishment avoidance goals, and relate this to variation in its expression within anxious individuals. To do so, we developed a novel multigoal pursuit task that includes trial-specific instructed goals to either pursue reward (without risk of punishment) or avoid punishment (without the opportunity for reward). We constructed a computational model of multigoal pursuit to quantify the degree to which participants could disengage from the pursuit goals when instructed to, as well as devote less model-based resources toward goals that were less abundant. In general, participants (n = 192) were less flexible in avoiding punishment than in pursuing reward. Thus, when instructed to pursue reward, participants often persisted in avoiding features that had previously been associated with punishment, even though at decision time these features were unambiguously benign. In a similar vein, participants showed no significant downregulation of avoidance when punishment avoidance goals were less abundant in the task. Importantly, we show preliminary evidence that individuals with chronic worry may have difficulty disengaging from punishment avoidance when instructed to seek reward. Taken together, the findings demonstrate that people avoid punishment less flexibly than they pursue reward. Future studies should test in larger samples whether a difficulty to disengage from punishment avoidance contributes to chronic worry.

Cross-species anxiety tests in psychiatry: pitfalls and promises

Behavioural anxiety tests in non-human animals are used for anxiolytic drug discovery, and to investigate the neurobiology of threat avoidance. Over the past decade, several of them were translated to humans with three clinically relevant goals: to assess potential efficacy of candidate treatments in healthy humans; to develop diagnostic tests or biomarkers; and to elucidate the pathophysiology of anxiety disorders. In this review, we scrutinise these promises and compare seven anxiety tests that are validated across species: five approach-avoidance conflict tests, unpredictable shock anticipation, and the social intrusion test in children. Regarding the first goal, three tests appear suitable for anxiolytic drug screening in humans. However, they have not become part of the drug development pipeline and achieving this may require independent confirmation of predictive validity and cost-effectiveness. Secondly, two tests have shown potential to measure clinically relevant individual differences, but their psychometric properties, predictive value, and clinical applicability need to be clarified. Finally, cross-species research has not yet revealed new evidence that the physiology of healthy human behaviour in anxiety tests relates to the physiology of anxiety symptoms in patients. To summarise, cross-species anxiety tests could be rendered useful for drug screening and for development of diagnostic instruments. Using these tests for aetiology research in healthy humans or animals needs to be queried and may turn out to be unrealistic.

Non-human contributions to personality neuroscience – from fish through primates. An introduction to the special issue

The most fundamental emotional systems that show trait control are evolutionarily old and extensively conserved. Psychology in general has benefited from non-human neuroscience and from the analytical simplicity of behaviour in those with simpler nervous systems. It has been argued that integration between personality, psychopathology, and neuroscience is particularly promising if we are to understand the neurobiology of human experience. Here, we provide some general arguments for a non-human approach being at least as productive in relation to personality, psychopathology, and their interface. Some early personality theories were directly linked to psychopathology (e.g., Eysenck, Panksepp, and Cloninger). They shared a common interest in brain systems that naturally led to the use of non-human data; behavioural, neural, and pharmacological. In Eysenck’s case, this also led to the selective breeding, at the Maudsley Institute, of emotionally reactive and non-reactive strains of rat as models of trait neuroticism or trait emotionality. Dimensional personality research and categorical approaches to clinical disorder then drifted apart from each other, from neuropsychology, and from non-human data. Recently, the conceptualizations of both healthy personality and psychopathology have moved towards a common hierarchical trait perspective. Indeed, the proposed two sets of trait dimensions appear similar and may even be eventually the same. We provide, here, an introduction to this special issue of Personality Neuroscience, where the authors provide overviews of detailed areas where non-human data inform human personality and its psychopathology or provide explicit models for translation to human neuroscience. Once all the papers in the issue have appeared, we will also provide a concluding summary of them.

Right frontal anxiolytic-sensitive EEG 'theta' rhythm in the stop-signal task is a theory-based anxiety disorder biomarker

Psychiatric diagnoses currently rely on a patient’s presenting symptoms or signs, lacking much-needed theory-based biomarkers. Our neuropsychological theory of anxiety, recently supported by human imaging, is founded on a longstanding, reliable, rodent ‘theta’ brain rhythm model of human clinical anxiolytic drug action. We have now developed a human scalp EEG homolog—goal-conflict-specific rhythmicity (GCSR), i.e., EEG rhythmicity specific to a balanced conflict between goals (e.g., approach-avoidance). Critically, GCSR is consistently reduced by different classes of anxiolytic drug and correlates with clinically-relevant trait anxiety scores (STAI-T). Here we show elevated GCSR in student volunteers divided, after testing, on their STAI-T scores into low, medium, and high (typical of clinical anxiety) groups. We then tested anxiety disorder patients (meeting diagnostic criteria) and similar controls recruited separately from the community. The patient group had higher average GCSR than their controls—with a mixture of high and low GCSR that varied with, but cut across, conventional disorder diagnosis. Consequently, GCSR scores should provide the first theoretically-based biomarker that could help diagnose, and so redefine, a psychiatric disorder.

[Negative valence systems in the system of research domain criteria : Empirical results and new developments]

BACKGROUND

The research domain criteria (RDoC) domain of negative valence systems can be used to subsume long established and recently developed research approaches, which build upon theoretical knowledge and clinical practice of various psychiatric disorders.

OBJECTIVE

This article outlines how the five constructs within the RDoC domain of negative valence systems can contribute to integrating empirical studies into a coherent and differentiated biopsychosocial model.

MATERIAL AND METHODS

This is a qualitative review article that summarizes empirical results and discusses new developments on the basis of exemplary studies and selected reviews.

RESULTS AND DISCUSSION

The RDoC domain of negative valence systems differentiates in three constructs the time horizon, in which persons need to adequately react to (1) acute, (2) potential, and (3) sustained threats elicited by negative stimuli or situations. These three constructs can be outlined relatively well with specific experimental paradigms and neuronal circuits. Two further constructs focus on the negative consequences of (4) losses and (5) frustrative non-rewards. The former seems to be currently relatively diffusely defined whereas the latter is clearly circumscribed by its relation to specific forms of aggression. Behavioral, physiological, and neuronal reactions to acute and potential threats can be well compared between humans and animals and can be specified with the help of mathematical models. These models can contribute to a better understanding of how healthy and diseased persons process negative stimuli or situations.

Laterality of an EEG anxiety disorder biomarker largely follows handedness

Anxiety disorders are the most common mental disorders impacting people worldwide. Using an auditory Stop Signal Task (SST), we have developed an anxiety disorder biomarker (goal-conflict specific rhythmicity/GCSR) that occurs at the right frontal site F8 in right-handed participants. Here, we compare its laterality in left-handers (n = 26) versus demographically-matched right-handers (n = 26) between the ages of 18-30. We assessed the effects on GCSR power of the handedness of the participants (left or right), blocks of the SST, left-right variation across frontal channels (F7, F3, Fz, F4, F8), and EEG frequency (4-12 Hz). Left-handers differed from right-handers most at the channels furthest from the midline. This difference was largely a mirroring of right hander responses by left handers. With frontal channels coded in reverse order for left handers the original significant differences disappeared. Some differences remained between the groups in the frequency variation across blocks of testing. These and other data suggest that the circuitry engaged by conflict in the SST is different from that directly controlling stopping behaviour. Our results also suggest that where GCSR is used as an anxiety process or disorder biomarker in groups that combine both left and right-handed people, data only from the channel ipsilateral to the dominant hand should be used (F7, or F8, respectively).

Perirhinal Cortex is Involved in the Resolution of Learned Approach-Avoidance Conflict Associated with Discrete Objects

The rodent ventral and primate anterior hippocampus have been implicated in approach-avoidance (AA) conflict processing. It is unclear, however, whether this structure contributes to AA conflict detection and/or resolution, and if its involvement extends to conditions of AA conflict devoid of spatial/contextual information. To investigate this, neurologically healthy human participants first learned to approach or avoid single novel visual objects with the goal of maximizing earned points. Approaching led to point gain and loss for positive and negative objects, respectively, whereas avoidance had no impact on score. Pairs of these objects, each possessing nonconflicting (positive-positive/negative-negative) or conflicting (positive-negative) valences, were then presented during functional magnetic resonance imaging. Participants either made an AA decision to score points (Decision task), indicated whether the objects had identical or differing valences (Memory task), or followed a visual instruction to approach or avoid (Action task). Converging multivariate and univariate results revealed that within the medial temporal lobe, perirhinal cortex, rather than the anterior hippocampus, was predominantly associated with object-based AA conflict resolution. We suggest the anterior hippocampus may not contribute equally to all learned AA conflict scenarios and that stimulus information type may be a critical and overlooked determinant of the neural mechanisms underlying AA conflict behavior.

Conflict between Threat Sensitivity and Sensation Seeking in the Adolescent Brain: Role of the Hippocampus, and Neurobehavioural Plasticity Induced by Pleasurable Early Enriched Experience

Adolescence is characterized both by the exacerbation of the experience of anxiety, fear or threat, on one hand, and by increased reward seeking (reward sensitivity) and risk taking on the other hand. The rise of these apparently opposite processes, i.e., threat-related anxiety and reward-related sensation seeking, seems to stem from a relatively decreased top-down inhibition of amygdala and striatal circuits by regulatory systems (e.g., prefrontal cortex, hippocampus) that mature later. The present commentary article aims to discuss recent related literature and focusses on two main issues: (i) the septo-hippocampal system (in particular the ventral hippocampus) might be a crucial region for the regulation of approach–avoidance conflict and also for the selection of the most appropriate responses during adolescence, and (ii) developmental studies involving early-life pleasurable-enriched experience (as opposed to early-life adversity) might be a useful study paradigm in order to decipher whether neuroplasticity induced by such experiences (for example, in the hippocampus and associated circuitry) may lead to better top-down inhibition and more “balanced” adolescent responses to environmental demands.

Advances in the computational understanding of mental illness

Computational psychiatry is a rapidly growing field attempting to translate advances in computational neuroscience and machine learning into improved outcomes for patients suffering from mental illness. It encompasses both data-driven and theory-driven efforts. Here, recent advances in theory-driven work are reviewed. We argue that the brain is a computational organ. As such, an understanding of the illnesses arising from it will require a computational framework. The review divides work up into three theoretical approaches that have deep mathematical connections: dynamical systems, Bayesian inference and reinforcement learning. We discuss both general and specific challenges for the field, and suggest ways forward.

Expecting social punishment facilitates control over a decision under uncertainty by recruiting medial prefrontal cortex

In many decision-making situations, sub-optimal choices are increased by uncertainty. However, when wrong choices could lead to social punishment, such as blame, people might try to improve their performance by minimizing sub-optimal choices, which could be achieved by increasing the subjective cost of errors, thereby globally reducing decision noise or reducing an uncertainty-induced component of decision noise. In this functional magnetic resonance imaging (fMRI) study, 46 participants performed a choice task in which the probability of a correct choice with a given cue and the conditional probability of blame feedback (by making an incorrect choice) changed continuously. By comparing computational models of behaviour, we found that participants optimized their performance by preferentially reducing a component of decision noise associated with uncertainty. Simultaneously, expecting blame significantly deteriorated participants' mood. Model-based fMRI analyses and dynamic causal modelling indicate that the optimization mechanism based on the expectation of being blamed would be controlled by a neural circuit centred on the right medial prefrontal cortex. These results show novel behavioural and neural mechanisms regarding how humans optimize uncertain decisions under the expectation of being blamed.

Neural substrates of the interplay between cognitive load and emotional involvement in bilingual decision making

Prior work has reported that foreign language influences decision making by either reducing access to emotion or imposing additional cognitive demands. In this fMRI study, we employed a cross-task design to assess at the neural level whether and how the interaction between cognitive load and emotional involvement is affected by language (native L1 vs. foreign L2). Participants completed a Lexico-semantic task where in each trial they were presented with a neutrally or a negatively valenced word either in L1 or L2, either under cognitive load or not. We manipulated cognitive load by varying the difficulty of the task: to increase cognitive demands, we used traditional characters instead of simplified ones in L1 (Chinese), and words with capital letters instead of lowercase letters in L2 (English). After each trial, participants decided whether to take a risky decision in a gambling game. During the Gamling task, left amygdala and right insula were more activated after having processed a negative word under cognitive load in the Lexico-semantic task. However, this was true for L1 but not for L2. In particular, in L1, cognitive load facilitated rather than hindered access to emotion. Further suggesting that cognitive load can enhance emotional sensitivity in L1 but not in L2, we found that functional connectivity between reward-related striatum and right insula increased under cognitive load only in L1. Overall, results suggest that cognitive load in L1 can favor access to emotion and lead to impulsive decision making, whereas cognitive load in L2 can attenuate access to emotion and lead to more rational decisions.

Hippocampal Representation of Threat Features and Behavior in a Human Approach-Avoidance Conflict Anxiety Task

Decisions under threat are crucial to survival and require integration of distinct situational features, such as threat probability and magnitude. Recent evidence from human lesion and neuroimaging studies implicated anterior hippocampus (aHC) and amygdala in approach-avoidance decisions under threat, and linked their integrity to cautious behavior. Here we sought to elucidate how threat dimensions and behavior are represented in these structures. Twenty human participants (11 female) completed an approach-avoidance conflict task during high-resolution fMRI. Participants could gather tokens under threat of capture by a virtual predator, which would lead to token loss. Threat probability (predator wake-up rate) and magnitude (amount of token loss) varied on each trial. To disentangle effects of threat features, and ensuing behavior, we performed a multifold parametric analysis. We found that high threat probability and magnitude related to BOLD signal in left aHC/entorhinal cortex. However, BOLD signal in this region was better explained by avoidance behavior than by these threat features. A priori ROI analysis confirmed the relation of aHC BOLD response with avoidance. Exploratory subfield analysis revealed that this relation was specific to anterior CA2/3 but not CA1. Left lateral amygdala responded to low and high, but not intermediate, threat probability. Our results suggest that aHC BOLD signal is better explained by avoidance behavior than by threat features in approach-avoidance conflict. Rather than representing threat features in a monotonic manner, it appears that aHC may compute approach-avoidance decisions based on integration of situational threat features represented in other neural structures.SIGNIFICANCE STATEMENT An effective threat anticipation system is crucial to survival across species. Natural threats, however, are diverse and have distinct features. To be able to adapt to different modes of danger, the brain needs to recognize these features, integrate them, and use them to modify behavior. Our results disclose the human anterior hippocampus as a likely arbiter of approach-avoidance decisions harnessing compound environmental information while partially replicating previous findings and blending into recent efforts to illuminate the neural basis of approach-avoidance conflict in humans.

Predictors of risky foraging behaviour in healthy young people

During adolescence and early adulthood, learning when to avoid threats and when to pursue rewards becomes crucial. Using a risky foraging task, we investigated individual differences in this dynamic across 781 individuals aged 14-24 years who were split into a hypothesis-generating discovery sample and a hold-out confirmation sample. Sex was the most important predictor of cautious behaviour and performance. Males earned one standard deviation (or 20%) more reward than females, collected more reward when there was little to lose and reduced foraging to the same level as females when potential losses became high. Other independent predictors of cautiousness and performance were self-reported daringness, IQ and self-reported cognitive complexity. We found no evidence for an impact of age or maturation. Thus, maleness, a high IQ or self-reported cognitive complexity, and self-reported daringness predicted greater success in risky foraging, possibly due to better exploitation of low-risk opportunities in high-risk environments.

Representation of probabilistic outcomes during risky decision-making

Goal-directed behaviour requires prospectively retrieving and evaluating multiple possible action outcomes. While a plethora of studies suggested sequential retrieval for deterministic choice outcomes, it remains unclear whether this is also the case when integrating multiple probabilistic outcomes of the same action. We address this question by capitalising on magnetoencephalography (MEG) in humans who made choices in a risky foraging task. We train classifiers to distinguish MEG field patterns during presentation of two probabilistic outcomes (reward, loss), and then apply these to decode such patterns during deliberation. First, decoded outcome representations have a temporal structure, suggesting alternating retrieval of the outcomes. Moreover, the probability that one or the other outcome is being represented depends on loss magnitude, but not on loss probability, and it predicts the chosen action. In summary, we demonstrate decodable outcome representations during probabilistic decision-making, which are sequentially structured, depend on task features, and predict subsequent action.

How interindividual differences shape approach-avoidance behavior: Relating self-report and diagnostic measures of interindividual differences to behavioral measurements of approach and avoidance

Responding to stimuli in ambiguous environments is partially governed by approach-avoidance tendencies. Imbalances in these approach-avoidance behaviors are implicated in many mental disorders including anxiety disorders, phobias and substance use disorders. While factors biasing human behavior in approach-avoidance conflicts have been researched in numerous experiments, a much-needed comprehensive overview integrating those findings is missing. Here, we systematically searched the existing literature on individual differences in task-based approach-avoidance behavior and aggregated the current evidence for the effect of self-reported approach/avoidance traits, anxiety and anxiety disorders, specific phobias, depression, aggression, anger and psychopathy, substance use and related disorders, eating disorders and habits, trauma, acute stress and, finally, hormone levels (mainly testosterone, oxytocin). We highlight consistent findings, underrepresented research areas and unexpected results, and detail the amount of controversy between studies. We discuss potential reasons for ambiguous results in some research areas, offer practical advice for future studies and highlight potential variables such as task-related researcher decisions that may influence how interindividual differences and disorders drive automatic approach-avoidance biases in behavioral experiments.

Threat-induced anxiety during goal pursuit disrupts amygdala-prefrontal cortex connectivity in posttraumatic stress disorder

To investigate how unpredictable threat during goal pursuit impacts fronto-limbic activity and functional connectivity in posttraumatic stress disorder (PTSD), we compared military veterans with PTSD (n = 25) vs. trauma-exposed control (n = 25). Participants underwent functional magnetic resonance imaging (fMRI) while engaged in a computerized chase-and-capture game task that involved optimizing monetary rewards obtained from capturing virtual prey while simultaneously avoiding capture by virtual predators. The game was played under two alternating contexts-one involving exposure to unpredictable task-irrelevant threat from randomly occurring electrical shocks, and a nonthreat control condition. Activation in and functional connectivity between the amygdala and ventromedial prefrontal cortex (vmPFC) was tested across threat and nonthreat task contexts with generalized psychophysiological interaction (gPPI) analyses. PTSD patients reported higher anxiety than controls across contexts. Better task performance represented by successfully avoiding capture by predators under threat compared with nonthreat contexts was associated with stronger left amygdala-vmPFC functional connectivity in controls and greater vmPFC activation in PTSD patients. PTSD symptom severity was negatively correlated with vmPFC activation in trauma-exposed controls and with right amygdala-vmPFC functional connectivity across all participants in the threat relative to nonthreat contexts. The findings showed that veterans with PTSD have disrupted amygdala-vmPFC functional connectivity and greater localized vmPFC processing under threat modulation of goal-directed behavior, specifically related to successfully avoiding loss of monetary rewards. In contrast, trauma survivors without PTSD relied on stronger threat-modulated left amygdala-vmPFC functional connectivity during goal-directed behavior, which may represent a resilience-related functional adaptation.

Understanding Brain Mechanisms of Reactive Aggression

PURPOSE OF REVIEW

To review the current literature on biobehavioral mechanisms involved in reactive aggression in a transdiagnostic approach.

RECENT FINDINGS

Aggressive reactions are closely related to activations in the brain's threat circuitry. They occur in response to social threat that is experienced as inescapable, which, in turn, facilitates angry approach rather than fearful avoidance. Provocation-induced aggression is strongly associated with anger and deficits in cognitive control including emotion regulation and inhibitory control. Furthermore, the brain's reward system plays a particular role in anger-related, tit-for-tat-like retaliatory aggression in response to frustration. More research is needed to further disentangle specific brain responses to social threat, provocation, and frustration. A better understanding of the psychological and neurobiological mechanisms involved in reactive aggression may pave the way for specific mechanism-based treatments, involving biological or psychotherapeutic approaches or a combination of the two.

Disentangling Hippocampal and Amygdala Contribution to Human Anxiety-Like Behavior

Anxiety comprises a suite of behaviors to deal with potential threat and is often modeled in approach–avoidance conflict tasks. Collectively, these tests constitute a predominant preclinical model of anxiety disorder. A body of evidence suggests that both ventral hippocampus and amygdala lesions impair anxiety-like behavior, but the relative contribution of these two structures is unclear. A possible reason is that approach–avoidance conflict tasks involve a series of decisions and actions, which may be controlled by distinct neural mechanisms that are difficult to disentangle from behavioral readouts. Here, we capitalize on a human approach–avoidance conflict test, implemented as computer game, that separately measures several action components. We investigate three patients of both sexes with unspecific unilateral medial temporal lobe (MTL) damage, one male with selective bilateral hippocampal (HC), and one female with selective bilateral amygdala lesions, and compare them to matched controls. MTL and selective HC lesions, but not selective amygdala lesions, increased approach decision when possible loss was high. In contrast, MTL and selective amygdala lesions, but not selective HC lesions, increased return latency. Additionally, selective HC and selective amygdala lesions reduced approach latency. In a task targeted at revealing subjective assumptions about the structure of the computer game, MTL and selective HC lesions impacted on reaction time generation but not on the subjective task structure. We conclude that deciding to approach reward under threat relies on hippocampus but not amygdala, whereas vigor of returning to safety depends on amygdala but not on hippocampus.

SIGNIFICANCE STATEMENT Approach–avoidance conflict tests are widely investigated in rodents, and increasingly in humans, to understand the neural basis of anxiety-like behavior. However, the contribution of the most relevant brain regions, ventral hippocampus and amygdala, is incompletely understood. We use a human computerized test that separates different action components and find that hippocampus, but not amygdala, lesions impair approach decisions, whereas amygdala, but not hippocampus, lesions impair the vigor of return to safety.