Face-selective and auditory neurons in the primate orbitofrontal cortex

Two what, two where, visual cortical streams in humans

ROLLS, E. T. Two What, Two Where, Visual Cortical Streams in Humans. NEUROSCI BIOBEHAV REV 2024. Recent cortical connectivity investigations lead to new concepts about 'What' and 'Where' visual cortical streams in humans, and how they connect to other cortical systems. A ventrolateral 'What' visual stream leads to the inferior temporal visual cortex for object and face identity, and provides 'What' information to the hippocampal episodic memory system, the anterior temporal lobe semantic system, and the orbitofrontal cortex emotion system. A superior temporal sulcus (STS) 'What' visual stream utilising connectivity from the temporal and parietal visual cortex responds to moving objects and faces, and face expression, and connects to the orbitofrontal cortex for emotion and social behaviour. A ventromedial 'Where' visual stream builds feature combinations for scenes, and provides 'Where' inputs via the parahippocampal scene area to the hippocampal episodic memory system that are also useful for landmark-based navigation. The dorsal 'Where' visual pathway to the parietal cortex provides for actions in space, but also provides coordinate transforms to provide inputs to the parahippocampal scene area for self-motion update of locations in scenes in the dark or when the view is obscured.

Modality-specific brain representations during automatic processing of face, voice and body expressions

A central question in affective science and one that is relevant for its clinical applications is how emotions provided by different stimuli are experienced and represented in the brain. Following the traditional view emotional signals are recognized with the help of emotion concepts that are typically used in descriptions of mental states and emotional experiences, irrespective of the sensory modality. This perspective motivated the search for abstract representations of emotions in the brain, shared across variations in stimulus type (face, body, voice) and sensory origin (visual, auditory). On the other hand, emotion signals like for example an aggressive gesture, trigger rapid automatic behavioral responses and this may take place before or independently of full abstract representation of the emotion. This pleads in favor specific emotion signals that may trigger rapid adaptative behavior only by mobilizing modality and stimulus specific brain representations without relying on higher order abstract emotion categories. To test this hypothesis, we presented participants with naturalistic dynamic emotion expressions of the face, the whole body, or the voice in a functional magnetic resonance (fMRI) study. To focus on automatic emotion processing and sidestep explicit concept-based emotion recognition, participants performed an unrelated target detection task presented in a different sensory modality than the stimulus. By using multivariate analyses to assess neural activity patterns in response to the different stimulus types, we reveal a stimulus category and modality specific brain organization of affective signals. Our findings are consistent with the notion that under ecological conditions emotion expressions of the face, body and voice may have different functional roles in triggering rapid adaptive behavior, even if when viewed from an abstract conceptual vantage point, they may all exemplify the same emotion. This has implications for a neuroethologically grounded emotion research program that should start from detailed behavioral observations of how face, body, and voice expressions function in naturalistic contexts.

Emotion, motivation, decision-making, the orbitofrontal cortex, anterior cingulate cortex, and the amygdala

The orbitofrontal cortex and amygdala are involved in emotion and in motivation, but the relationship between these functions performed by these brain structures is not clear. To address this, a unified theory of emotion and motivation is described in which motivational states are states in which instrumental goal-directed actions are performed to obtain rewards or avoid punishers, and emotional states are states that are elicited when the reward or punisher is or is not received. This greatly simplifies our understanding of emotion and motivation, for the same set of genes and associated brain systems can define the primary or unlearned rewards and punishers such as sweet taste or pain. Recent evidence on the connectivity of human brain systems involved in emotion and motivation indicates that the orbitofrontal cortex is involved in reward value and experienced emotion with outputs to cortical regions including those involved in language, and is a key brain region involved in depression and the associated changes in motivation. The amygdala has weak effective connectivity back to the cortex in humans, and is implicated in brainstem-mediated responses to stimuli such as freezing and autonomic activity, rather than in declarative emotion. The anterior cingulate cortex is involved in learning actions to obtain rewards, and with the orbitofrontal cortex and ventromedial prefrontal cortex in providing the goals for navigation and in reward-related effects on memory consolidation mediated partly via the cholinergic system.

Auditory cortical connectivity in humans

To understand auditory cortical processing, the effective connectivity between 15 auditory cortical regions and 360 cortical regions was measured in 171 Human Connectome Project participants, and complemented with functional connectivity and diffusion tractography. 1. A hierarchy of auditory cortical processing was identified from Core regions (including A1) to Belt regions LBelt, MBelt, and 52; then to PBelt; and then to HCP A4. 2. A4 has connectivity to anterior temporal lobe TA2, and to HCP A5, which connects to dorsal-bank superior temporal sulcus (STS) regions STGa, STSda, and STSdp. These STS regions also receive visual inputs about moving faces and objects, which are combined with auditory information to help implement multimodal object identification, such as who is speaking, and what is being said. Consistent with this being a "what" ventral auditory stream, these STS regions then have effective connectivity to TPOJ1, STV, PSL, TGv, TGd, and PGi, which are language-related semantic regions connecting to Broca's area, especially BA45. 3. A4 and A5 also have effective connectivity to MT and MST, which connect to superior parietal regions forming a dorsal auditory "where" stream involved in actions in space. Connections of PBelt, A4, and A5 with BA44 may form a language-related dorsal stream.

Morphometry of the lateral orbitofrontal cortex is associated with eating dispositions in early adolescence: findings from a large population-based study

Early adolescence is a critical period for eating behaviors as children gain autonomy around food choice and peer influences increase in potency. From a neurodevelopmental perspective, significant structural changes take place in the prefrontal cortex during this time, including the orbitofrontal cortex (OFC), which is involved in socially contextualized decision-making. We examined the morphological features of the OFC in relation to food choice in a sample of 10 309 early adolescent children from the Adolescent Brain and Cognitive Development Study. Structural parameters of the OFC and insula were examined for relationships with two important aspects of food choice: limiting the consumption of fast/fried food and maximizing the consumption of nutritious foods. Raw, partially adjusted and fully adjusted models were evaluated. Findings revealed that a larger surface area of the lateral OFC was associated with higher odds of limiting fast/fried food consumption in raw [odds ratio (OR) = 1.07, confidence interval (CI): 1.02, 1.12, P = 0.002, PFDR = 0.012], partially adjusted (OR = 1.11, CI: 1.03, 1.19, P = 0.004, PFDR = 0.024) and fully adjusted models (OR = 1.11, CI: 1.03, 1.19, P = 0.006, PFDR = 0.036). In contrast, a larger insula volume was associated with lower odds of maximizing healthy foods in raw (OR = 0.94, CI: 0.91, 0.97, P <0.001, PFDR = 0.003) and partially adjusted (OR = 0.93, CI: 0.88, 0.98, P = 0.008, PFDR = 0.048) models. These findings refine our understanding of the OFC as a network node implicated in socially mediated eating behaviors.

Human amygdala compared to orbitofrontal cortex connectivity, and emotion

The amygdala and orbitofrontal cortex have been implicated in emotion. To understand these regions better in humans, their effective connectivity with 360 cortical regions was measured in 171 humans from the Human Connectome Project, and complemented with functional connectivity and diffusion tractography. The human amygdala has effective connectivity from few cortical regions compared to the orbitofrontal cortex: primarily from auditory cortex A5 and the related superior temporal gyrus and temporal pole regions; the piriform (olfactory) cortex; the lateral orbitofrontal cortex 47m; somatosensory cortex; the hippocampus, entorhinal cortex, perirhinal cortex, and parahippocampal TF; and from the cholinergic nucleus basalis. The amygdala has effective connectivity to the hippocampus, entorhinal and perirhinal cortex; to the temporal pole; and to the lateral orbitofrontal cortex. The orbitofrontal cortex has effective connectivity from gustatory, olfactory, and temporal visual, auditory and pole cortex, and to the pregenual anterior and posterior cingulate cortex, hippocampal system, and prefrontal cortex, and provides for rewards and punishers to be used in reported emotions, and memory and navigation to goals. Given the paucity of amygdalo-neocortical connectivity in humans, it is proposed that the human amygdala is involved primarily in autonomic and conditioned responses via brainstem connectivity, rather than in reported (declarative) emotion.

The human orbitofrontal cortex, vmPFC, and anterior cingulate cortex effective connectome: emotion, memory, and action

The human orbitofrontal cortex, ventromedial prefrontal cortex (vmPFC), and anterior cingulate cortex are involved in reward processing and thereby in emotion but are also implicated in episodic memory. To understand these regions better, the effective connectivity between 360 cortical regions and 24 subcortical regions was measured in 172 humans from the Human Connectome Project and complemented with functional connectivity and diffusion tractography. The orbitofrontal cortex has effective connectivity from gustatory, olfactory, and temporal visual, auditory, and pole cortical areas. The orbitofrontal cortex has connectivity to the pregenual anterior and posterior cingulate cortex and hippocampal system and provides for rewards to be used in memory and navigation to goals. The orbitofrontal and pregenual anterior cortex have connectivity to the supracallosal anterior cingulate cortex, which projects to midcingulate and other premotor cortical areas and provides for action-outcome learning including limb withdrawal or flight or fight to aversive and nonreward stimuli. The lateral orbitofrontal cortex has outputs to language systems in the inferior frontal gyrus. The medial orbitofrontal cortex connects to the nucleus basalis of Meynert and the pregenual cingulate to the septum, and damage to these cortical regions may contribute to memory impairments by disrupting cholinergic influences on the neocortex and hippocampus.

The hippocampus, ventromedial prefrontal cortex, and episodic and semantic memory

The human ventromedial prefrontal cortex (vmPFC)/anterior cingulate cortex is implicated in reward and emotion, but also in memory. It is shown how the human orbitofrontal cortex connecting with the vmPFC and anterior cingulate cortex provide a route to the hippocampus for reward and emotional value to be incorporated into episodic memory, enabling memory of where a reward was seen. It is proposed that this value component results in primarily episodic memories with some value component to be repeatedly recalled from the hippocampus so that they are more likely to become incorporated into neocortical semantic and autobiographical memories. The same orbitofrontal and anterior cingulate regions also connect in humans to the septal and basal forebrain cholinergic nuclei, thereby helping to consolidate memory, and helping to account for why damage to the vMPFC impairs memory. The human hippocampus and vmPFC thus contribute in complementary ways to forming episodic and semantic memories.

Multiple cortical visual streams in humans

The effective connectivity between 55 visual cortical regions and 360 cortical regions was measured in 171 HCP participants using the HCP-MMP atlas, and complemented with functional connectivity and diffusion tractography. A Ventrolateral Visual "What" Stream for object and face recognition projects hierarchically to the inferior temporal visual cortex, which projects to the orbitofrontal cortex for reward value and emotion, and to the hippocampal memory system. A Ventromedial Visual "Where" Stream for scene representations connects to the parahippocampal gyrus and hippocampus. An Inferior STS (superior temporal sulcus) cortex Semantic Stream receives from the Ventrolateral Visual Stream, from visual inferior parietal PGi, and from the ventromedial-prefrontal reward system and connects to language systems. A Dorsal Visual Stream connects via V2 and V3A to MT+ Complex regions (including MT and MST), which connect to intraparietal regions (including LIP, VIP and MIP) involved in visual motion and actions in space. It performs coordinate transforms for idiothetic update of Ventromedial Stream scene representations. A Superior STS cortex Semantic Stream receives visual inputs from the Inferior STS Visual Stream, PGi, and STV, and auditory inputs from A5, is activated by face expression, motion and vocalization, and is important in social behaviour, and connects to language systems.

Widespread implementations of interactive social gaze neurons in the primate prefrontal-amygdala networks

Social gaze interaction powerfully shapes interpersonal communication. However, compared with social perception, very little is known about the neuronal underpinnings of real-life social gaze interaction. Here, we studied a large number of neurons spanning four regions in primate prefrontal-amygdala networks and demonstrate robust single-cell foundations of interactive social gaze in the orbitofrontal, dorsomedial prefrontal, and anterior cingulate cortices, in addition to the amygdala. Many neurons in these areas exhibited high temporal heterogeneity for social discriminability, with a selectivity bias for looking at a conspecific compared with an object. Notably, a large proportion of neurons in each brain region parametrically tracked the gaze of self or other, providing substrates for social gaze monitoring. Furthermore, several neurons displayed selective encoding of mutual eye contact in an agent-specific manner. These findings provide evidence of widespread implementations of interactive social gaze neurons in the primate prefrontal-amygdala networks during social gaze interaction.

Effects of visual attention modulation on dynamic functional connectivity during own-face viewing in body dysmorphic disorder

Body dysmorphic disorder (BDD) is characterized by preoccupations with misperceptions of one's physical appearance. Previous neuroimaging studies in BDD have yet to examine dynamic functional connectivity (FC) patterns between brain areas, necessary to capture changes in activity in response to stimuli and task conditions. We used Leading Eigenvector Dynamics Analysis to examine whole-brain dynamic FC from fMRI data during an own-face viewing task in 29 unmedicated adults with BDD with facial concerns and 30 healthy controls. The task involved two parts: (1) unconstrained, naturalistic viewing and (2) holding visual attention in the center of the image, to reduce scanning and fixation on perceived facial flaws. An FC state consisting of bilateral medial orbitofrontal cortex regions occurred significantly less often during the visual attention condition and afterward during the unconstrained face viewing in BDD participants, compared to the first unconstrained face viewing, a pattern that differed from controls. Moreover, the probability of this state during the second unconstrained face viewing was associated with severity of obsessions and compulsions and degree of poor insight in BDD, suggesting its clinical significance. These findings have implications for understanding the pathophysiology of own-face viewing in BDD and how it is affected by modification of viewing patterns, which may have implications for novel perceptual retraining treatment designs.

Neuronal Circuits for Social Decision-Making and Their Clinical Implications

Social living facilitates individual access to rewards, cognitive resources, and objects that would not be otherwise accessible. There are, however, some drawbacks to social living, particularly when competing for scarce resources. Furthermore, variability in our ability to make social decisions can be associated with neuropsychiatric disorders. The neuronal mechanisms underlying social decision-making are beginning to be understood. The momentum to study this phenomenon has been partially carried over by the study of economic decision-making. Yet, because of the similarities between these different types of decision-making, it is unclear what is a social decision. Here, we propose a definition of social decision-making as choices taken in a context where one or more conspecifics are involved in the decision or the consequences of it. Social decisions can be conceptualized as complex economic decisions since they are based on the subjective preferences between different goods. During social decisions, individuals choose based on their internal value estimate of the different alternatives. These are complex decisions given that conspecifics beliefs or actions could modify the subject's internal valuations at every choice. Here, we first review recent developments in our collective understanding of the neuronal mechanisms and circuits of social decision-making in primates. We then review literature characterizing populations with neuropsychiatric disorders showing deficits in social decision-making and the underlying neuronal circuitries associated with these deficits.

The neuroscience of emotional disorders

Emotions can be defined as states elicited by rewards or punishments, and indeed the neurology of emotional disorders can be understood in terms of this foundation. The orbitofrontal cortex in humans and other primates is a critical area in emotion processing, determining the value of stimuli and whether they are rewarding or nonrewarding. The cortical processing that occurs before the orbitofrontal cortex primarily involves defining the identity of stimuli, i.e., "what" is present and not reward value. There is evidence that this holds true for taste, visual, somatosensory, and olfactory stimuli. The human medial orbitofrontal cortex is important in processing many different types of reward, and the lateral orbitofrontal cortex in processing nonreward and punishment. Humans with damage to the orbitofrontal cortex have an impaired ability to identify facial and voice expressions of emotions, and impaired subjective experience of emotion. They can have an altered personality and be impulsive because they are impaired at processing failures to receive expected rewards and at processing punishments. In humans, the role of the amygdala in the processing of emotions is reduced because of the great evolutionary development of the orbitofrontal cortex: amygdala damage has much less effect on emotion than does orbitofrontal cortex damage. The orbitofrontal cortex projects reward value information to the anterior cingulate cortex, which is involved in learning those actions required to obtain rewards and avoid punishments. The cingulate cortex thus provides an output route for emotional behavior. In depression, the medial orbitofrontal cortex has decreased connectivity and sensitivity to reward, and the lateral orbitofrontal cortex has increased connectivity and sensitivity to nonreward. The orbitofrontal cortex has major projections to the anterior cingulate cortex, including its subcommissural region, and the anterior cingulate cortex is also implicated in depression.

A fast link between face perception and memory in the temporal pole

The question of how the brain recognizes the faces of familiar individuals has been important throughout the history of neuroscience. Cells linking visual processing to person memory have been proposed but not found. Here, we report the discovery of such cells through recordings from an area in the macaque temporal pole identified with functional magnetic resonance imaging. These cells responded to faces that were personally familiar. They responded nonlinearly to stepwise changes in face visibility and detail and holistically to face parts, reflecting key signatures of familiar face recognition. They discriminated between familiar identities, as fast as a general face identity area. The discovery of these cells establishes a new pathway for the fast recognition of familiar individuals.

Memory guidance of value-based decision making at an abstract level of representation

Value-based decisions about alternatives we have never experienced can be guided by associations between current choice options and memories of prior reward. A critical question is how similar memories need to be to the current situation to effectively guide decisions. We address this question in the context of associative learning of faces using a sensory preconditioning paradigm. We find that memories of reward spread along established associations between faces to guide decision making. While memory guidance is specific for associated facial identities, it does not only occur for the specific images that were originally encountered. Instead, memory guidance generalizes across different images of the associated identities. This suggests that memory guidance does not rely on a pictorial format of representation but on a higher, view-invariant level of abstraction. Thus, memory guidance operates on a level of representation that neither over- nor underspecifies associative relationships in the context of obtaining reward.

The orbitofrontal cortex: reward, emotion and depression

The orbitofrontal cortex in primates including humans is the key brain area in emotion, and in the representation of reward value and in non-reward, that is not obtaining an expected reward. Cortical processing before the orbitofrontal cortex is about the identity of stimuli, i.e. 'what' is present, and not about reward value. There is evidence that this holds for taste, visual, somatosensory and olfactory stimuli. The human medial orbitofrontal cortex represents many different types of reward, and the lateral orbitofrontal cortex represents non-reward and punishment. Not obtaining an expected reward can lead to sadness, and feeling depressed. The concept is advanced that an important brain region in depression is the orbitofrontal cortex, with depression related to over-responsiveness and over-connectedness of the non-reward-related lateral orbitofrontal cortex, and to under-responsiveness and under-connectivity of the reward-related medial orbitofrontal cortex. Evidence from large-scale voxel-level studies and supported by an activation study is described that provides support for this hypothesis. Increased functional connectivity of the lateral orbitofrontal cortex with brain areas that include the precuneus, posterior cingulate cortex and angular gyrus is found in patients with depression and is reduced towards the levels in controls when treated with medication. Decreased functional connectivity of the medial orbitofrontal cortex with medial temporal lobe areas involved in memory is found in patients with depression. Some treatments for depression may act by reducing activity or connectivity of the lateral orbitofrontal cortex. New treatments that increase the activity or connectivity of the medial orbitofrontal cortex may be useful for depression. These concepts, and that of increased activity in non-reward attractor networks, have potential for advancing our understanding and treatment of depression. The focus is on the orbitofrontal cortex in primates including humans, because of differences of operation of the orbitofrontal cortex, and indeed of reward systems, in rodents. Finally, the hypothesis is developed that the orbitofrontal cortex has a special role in emotion and decision-making in part because as a cortical area it can implement attractor networks useful in maintaining reward and emotional states online, and in decision-making.

Parallel Lemniscal and Non-Lemniscal Sources Control Auditory Responses in the Orbitofrontal Cortex (OFC)

The orbitofrontal cortex (OFC) controls flexible behavior through stimulus value updating based on stimulus outcome associations, allowing seamless navigation in dynamic sensory environments with changing contingencies. Sensory cue driven responses, primarily studied through behavior, exist in the OFC. However, OFC neurons' sensory response properties, particularly auditory, are unknown in the mouse, a genetically tractable animal. We show that mouse OFC single neurons have unique auditory response properties showing pure oddball detection and long timescales of adaptation resulting in stimulus-history dependence. Further, we show that OFC auditory responses are shaped by two parallel sources in the auditory thalamus, lemniscal and non-lemniscal. The latter underlies a large component of the observed oddball detection and additionally controls persistent activity in the OFC through the amygdala. The deviant selectivity can serve as a signal for important changes in the auditory environment. Such signals, if coupled with persistent activity, obtained by disinhibitory control from the non-lemniscal auditory thalamus or amygdala, will allow for associations with a delayed outcome related signal, like reward prediction error, and potentially forms the basis of updating stimulus outcome associations in the OFC. Thus, the baseline sensory responses allow the behavioral requirement-based response modification through relevant inputs from other structures related to reward, punishment, or memory. Thus, alterations in these responses in neurologic disorders can lead to behavioral deficits.

White Matter Microstructure Reflects Individual Differences in Music Reward Sensitivity

People show considerable variability in the degree of pleasure they experience from music. These individual differences in music reward sensitivity are driven by variability in functional connectivity between the nucleus accumbens (NAcc), a key structure of the reward system, and the right superior temporal gyrus (STG). However, it is unknown whether a neuroanatomical basis exists for this variability. We used diffusion tensor imaging and probabilistic tractography to study the relationship between music reward sensitivity and white matter microstructure connecting these two regions via the orbitofrontal cortex (OFC) in 38 healthy human participants (24 females and 14 males). We found that right axial diffusivity (AD) in the STG-OFC connectivity inversely correlated with music reward sensitivity. Additionally, right mean diffusivity and left AD in the NAcc-OFC tract also showed an inverse correlation. Further, AD in this tract also correlated with previously acquired BOLD activity during music listening, but not for a control monetary reward task in the NAcc. Finally, we used mediation analysis to show that AD in the NAcc-OFC tract explains the influence of NAcc activation during a music task on music reward sensitivity. Overall, our results provide further support for the idea that the exchange of information among perceptual, integrative, and reward systems is important for musical pleasure, and that individual differences in the structure of the relevant anatomical connectivity influences the degree to which people are able to derive such pleasure.SIGNIFICANCE STATEMENT Music is one of the most important sources of pleasure for many people, but at the same time there are important individual differences in the sensitivity to musical reward. Previous studies have revealed the critical involvement of the functional connectivity between perceptual and subcortical brain areas in the enjoyment of music. However, it is unknown whether individual differences in music sensitivity might arise from variability in the structural connectivity among these areas. Here we show that structural connectivity between supratemporal and orbitofrontal cortices, and between orbitofrontal and nucleus accumbens, predict individual differences in sensibility to music reward. These results provide evidence for the critical involvement of the interaction between the subcortical reward system and higher-order cortical areas in music-induced pleasure.

Face cells in orbitofrontal cortex represent social categories

Perceiving social and emotional information from faces is a critical primate skill. For this purpose, primates evolved dedicated cortical architecture, especially in occipitotemporal areas, utilizing face-selective cells. Less understood face-selective neurons are present in the orbitofrontal cortex (OFC) and are our object of study. We examined 179 face-selective cells in the lateral sulcus of the OFC by characterizing their responses to a rich set of photographs of conspecific faces varying in age, gender, and facial expression. Principal component analysis and unsupervised cluster analysis of stimulus space both revealed that face cells encode face dimensions for social categories and emotions. Categories represented strongly were facial expressions (grin and threat versus lip smack), juvenile, and female monkeys. Cluster analyses of a control population of nearby cells lacking face selectivity did not categorize face stimuli in a meaningful way, suggesting that only face-selective cells directly support face categorization in OFC. Time course analyses of face cell activity from stimulus onset showed that faces were discriminated from nonfaces early, followed by within-face categorization for social and emotion content (i.e., young and facial expression). Face cells revealed no response to acoustic stimuli such as vocalizations and were poorly modulated by vocalizations added to faces. Neuronal responses remained stable when paired with positive or negative reinforcement, implying that face cells encode social information but not learned reward value associated to faces. Overall, our results shed light on a substantial role of the OFC in the characterizations of facial information bearing on social and emotional behavior.

Face Processing Systems: From Neurons to Real-World Social Perception

Primate face processing depends on a distributed network of interlinked face-selective areas composed of face-selective neurons. In both humans and macaques, the network is divided into a ventral stream and a dorsal stream, and the functional similarities of the areas in humans and macaques indicate they are homologous. Neural correlates for face detection, holistic processing, face space, and other key properties of human face processing have been identified at the single neuron level, and studies providing causal evidence have established firmly that face-selective brain areas are central to face processing. These mechanisms give rise to our highly accurate familiar face recognition but also to our error-prone performance with unfamiliar faces. This limitation of the face system has important implications for consequential situations such as eyewitness identification and policing.

Development of social systems neuroscience using macaques

This paper reviews the literature on social neuroscience studies using macaques in the hope of encouraging as many researchers as possible to participate in this field of research and thereby accelerate the system-level understanding of social cognition and behavior. We describe how different parts of the primate brain are engaged in different aspects of social information processing, with particular emphasis on the use of experimental paradigms involving more than one monkey in laboratory settings. The description begins with how individual neurons are used for evaluating socially relevant information, such as the identity, face, and focus of attention of others in various social contexts. A description of the neural bases of social reward processing and social action monitoring follows. Finally, we provide several perspectives on novel experimental strategies to help clarify the nature of interacting brains under more socially and ecologically plausible conditions.

How thoughts arise from sights: inferotemporal and prefrontal contributions to vision

We are rapidly approaching a comprehensive understanding of the neural mechanisms behind object recognition. How we use this knowledge of the visual world to plan and act is comparatively mysterious. To fill this gap, we must understand how visual representations are transformed within cognitive regions, and how these cognitive representations of visual information act back upon earlier sensory representations. Here, we summarize our current understanding of visual representation in inferotemporal cortex (IT) and prefrontal cortex (PFC), and the interactions between them. We emphasize the apparent consistency of visual representation in PFC across tasks, and suggest ways to leverage advances in our understanding of high-level vision to better understand cognitive processing.

Women are better at seeing faces where there are none: an ERP study of face pareidolia

Event-related potentials (ERPs) were recorded in 26 right-handed students while they detected pictures of animals intermixed with those of familiar objects, faces and faces-in-things (FITs). The face-specific N170 ERP component over the right hemisphere was larger in response to faces and FITs than to objects. The vertex positive potential (VPP) showed a difference in FIT encoding processes between males and females at frontal sites; while for men, the FIT stimuli elicited a VPP of intermediate amplitude (between that for faces and objects), for women, there was no difference in VPP responses to faces or FITs, suggesting a marked anthropomorphization of objects in women. SwLORETA source reconstructions carried out to estimate the intracortical generators of ERPs in the 150-190 ms time window showed how, in the female brain, FIT perception was associated with the activation of brain areas involved in the affective processing of faces (right STS, BA22; posterior cingulate cortex, BA22; and orbitofrontal cortex, BA10) in addition to regions linked to shape processing (left cuneus, BA18/30). Conversely, in the men, the activation of occipito/parietal regions was prevalent, with a considerably smaller activation of BA10. The data suggest that the female brain is more inclined to anthropomorphize perfectly real objects compared to the male brain.

Neurocomputational model of moral behaviour

Our understanding of human morality has dramatically improved in the last decades, thanks to efforts carried out with scientific methods, in addition to the traditional speculative approach. Substantial contributions and relevant empirical data have come from neuroscience, psychology, genetics, comparative ethology, anthropology, and the social sciences. In this fruitful synergy, one useful approach is still missing: computational modeling. More precisely, a neurocomputational model aimed at simulating forms of moral behavior, to our knowledge, has not yet been designed. The purpose of this work is to start filling this gap, proposing MOral Neural Engine (MONE), a model that simulates the emergence of moral cognition. The neural engine in this model is assumed to be based in frontal areas, specifically the orbitofrontal and the ventromedial prefrontal cortex, and in connections to limbic areas involved in emotions and reward, such as the ventral striatum and the amygdala. Moral cognition is probably the result of a collection of several different neural processes, activated depending on the type of moral problem, each associated with a variety of emotions. This model, in its first implementation, deals with only a single moral situation: stealing someone's food, a transgression that typically elicits guilt, learned in the model from the angry facial expressions of the victim.

Autism: reduced connectivity between cortical areas involved in face expression, theory of mind, and the sense of self

Whole-brain voxel-based unbiased resting state functional connectivity was analysed in 418 subjects with autism and 509 matched typically developing individuals. We identified a key system in the middle temporal gyrus/superior temporal sulcus region that has reduced cortical functional connectivity (and increased with the medial thalamus), which is implicated in face expression processing involved in social behaviour. This system has reduced functional connectivity with the ventromedial prefrontal cortex, which is implicated in emotion and social communication. The middle temporal gyrus system is also implicated in theory of mind processing. We also identified in autism a second key system in the precuneus/superior parietal lobule region with reduced functional connectivity, which is implicated in spatial functions including of oneself, and of the spatial environment. It is proposed that these two types of functionality, face expression-related, and of one's self and the environment, are important components of the computations involved in theory of mind, whether of oneself or of others, and that reduced connectivity within and between these regions may make a major contribution to the symptoms of autism.

Anatomic organization of the auditory cortex

The auditory cortex is a network of areas in the part of the brain that receives inputs from the subcortical auditory pathways in the brainstem and thalamus. Through an elaborate network of intrinsic and extrinsic connections, the auditory cortex is thought to bring about the conscious perception of sound and provide a basis for the comprehension and production of meaningful utterances. In this chapter, the organization of auditory cortex is described with an emphasis on its anatomic features and the flow of information within the network. These features are then used to introduce key neurophysiologic concepts that are being intensively studied in humans and animal models. The discussion is presented in the context of our working model of the primate auditory cortex and extensions to humans. The material is presented in the context of six underlying principles, which reflect distinct, but related, aspects of anatomic and physiologic organization: (1) the division of auditory cortex into regions; (2) the subdivision of regions into areas; (3) tonotopic organization of areas; (4) thalamocortical connections; (5) serial and parallel organization of connections; and (6) topographic relationships between auditory and auditory-related areas. Although the functional roles of the various components of this network remain poorly defined, a more complete understanding is emerging from ongoing studies that link auditory behavior to its anatomic and physiologic substrates.

Common and unique representations in pFC for face and place attractiveness

Although previous neuroimaging research has identified overlapping correlates of subjective value across different reward types in the ventromedial pFC (vmPFC), it is not clear whether this "common currency" evaluative signal extends to the aesthetic domain. To examine this issue, we scanned human participants with fMRI while they made attractiveness judgments of faces and places-two stimulus categories that are associated with different underlying rewards, have very different visual properties, and are rarely compared with each other. We found overlapping signals for face and place attractiveness in the vmPFC, consistent with the idea that this region codes a signal for value that applies across disparate reward types and across both economic and aesthetic judgments. However, we also identified a subregion of vmPFC within which activity patterns for face and place attractiveness were distinguishable, suggesting that some category-specific attractiveness information is retained in this region. Finally, we observed two separate functional regions in lateral OFC: one region that exhibited a category-unique response to face attractiveness and another region that responded strongly to faces but was insensitive to their value. Our results suggest that vmPFC supports a common mechanism for reward evaluation while also retaining a degree of category-specific information, whereas lateral OFC may be involved in basic reward processing that is specific to only some stimulus categories.

The amygdala as a hub in brain networks that support social life

A growing body of evidence suggests that the amygdala is central to handling the demands of complex social life in primates. In this paper, we synthesize extant anatomical and functional data from rodents, monkeys, and humans to describe the topography of three partially distinct large-scale brain networks anchored in the amygdala that each support unique functions for effectively managing social interactions and maintaining social relationships. These findings provide a powerful componential framework for parsing social behavior into partially distinct neural underpinnings that differ among healthy people and disintegrate or fail to develop in neuropsychiatric populations marked by social impairment, such as autism, antisocial personality disorder, and frontotemporal dementia.

Taste and olfactory status in a gourmand with a right amygdala lesion

In a patient with a lesion of the right amygdala and temporal pole who had the characteristics of the gourmand syndrome, sensory and hedonic testing was performed to examine the processing of taste, olfactory, and some emotional stimuli. The gourmand syndrome describes a preoccupation with food and a preference for fine eating and is associated with right anterior lesions. It was found that the taste thresholds for sweet, salt, bitter, and sour were normal; that the patient did not dislike the taste of salt (NaCl) at low and moderate concentrations as much as age-matched controls; that this also occurred for monosodium glutamate (MSG); that there were some olfactory differences from normal controls; and that there was a marked reduction in the ability to detect face expressions of disgust.

Effects of acute alcohol consumption and processing of emotion in faces: Implications for understanding alcohol-related aggression

The negative consequences of chronic alcohol abuse are well known, but heavy episodic consumption ("binge drinking") is also associated with significant personal and societal harms. Aggressive tendencies are increased after alcohol but the mechanisms underlying these changes are not fully understood. While effects on behavioural control are likely to be important, other effects may be involved given the widespread action of alcohol. Altered processing of social signals is associated with changes in social behaviours, including aggression, but until recently there has been little research investigating the effects of acute alcohol consumption on these outcomes. Recent work investigating the effects of acute alcohol on emotional face processing has suggested reduced sensitivity to submissive signals (sad faces) and increased perceptual bias towards provocative signals (angry faces) after alcohol consumption, which may play a role in alcohol-related aggression. Here we discuss a putative mechanism that may explain how alcohol consumption influences emotional processing and subsequent aggressive responding, via disruption of orbitofrontal cortex (OFC)-amygdala connectivity. While the importance of emotional processing on social behaviours is well established, research into acute alcohol consumption and emotional processing is still in its infancy. Further research is needed and we outline a research agenda to address gaps in the literature.

Limbic systems for emotion and for memory, but no single limbic system

The concept of a (single) limbic system is shown to be outmoded. Instead, anatomical, neurophysiological, functional neuroimaging, and neuropsychological evidence is described that anterior limbic and related structures including the orbitofrontal cortex and amygdala are involved in emotion, reward valuation, and reward-related decision-making (but not memory), with the value representations transmitted to the anterior cingulate cortex for action-outcome learning. In this 'emotion limbic system' a computational principle is that feedforward pattern association networks learn associations from visual, olfactory and auditory stimuli, to primary reinforcers such as taste, touch, and pain. In primates including humans this learning can be very rapid and rule-based, with the orbitofrontal cortex overshadowing the amygdala in this learning important for social and emotional behaviour. Complementary evidence is described showing that the hippocampus and limbic structures to which it is connected including the posterior cingulate cortex and the fornix-mammillary body-anterior thalamus-posterior cingulate circuit are involved in episodic or event memory, but not emotion. This 'hippocampal system' receives information from neocortical areas about spatial location, and objects, and can rapidly associate this information together by the different computational principle of autoassociation in the CA3 region of the hippocampus involving feedback. The system can later recall the whole of this information in the CA3 region from any component, a feedback process, and can recall the information back to neocortical areas, again a feedback (to neocortex) recall process. Emotion can enter this memory system from the orbitofrontal cortex etc., and be recalled back to the orbitofrontal cortex etc. during memory recall, but the emotional and hippocampal networks or 'limbic systems' operate by different computational principles, and operate independently of each other except insofar as an emotional state or reward value attribute may be part of an episodic memory.

Different cortical dynamics in face and body perception: an MEG study

Evidence from functional neuroimaging indicates that visual perception of human faces and bodies is carried out by distributed networks of face and body-sensitive areas in the occipito-temporal cortex. However, the dynamics of activity in these areas, needed to understand their respective functional roles, are still largely unknown. We monitored brain activity with millisecond time resolution by recording magnetoencephalographic (MEG) responses while participants viewed photographs of faces, bodies, and control stimuli. The cortical activity underlying the evoked responses was estimated with anatomically-constrained noise-normalised minimum-norm estimate and statistically analysed with spatiotemporal cluster analysis.

Our findings point to distinct spatiotemporal organization of the neural systems for face and body perception. Face-selective cortical currents were found at early latencies (120–200 ms) in a widespread occipito-temporal network including the ventral temporal cortex (VTC). In contrast, early body-related responses were confined to the lateral occipito-temporal cortex (LOTC). These were followed by strong sustained body-selective responses in the orbitofrontal cortex from 200–700 ms, and in the lateral temporal cortex and VTC after 500 ms latency. Our data suggest that the VTC region has a key role in the early processing of faces, but not of bodies. Instead, the LOTC, which includes the extra-striate body area (EBA), appears the dominant area for early body perception, whereas the VTC contributes to late and post-perceptual processing.

Visual predictions in the orbitofrontal cortex rely on associative content

Predicting upcoming events from incomplete information is an essential brain function. The orbitofrontal cortex (OFC) plays a critical role in this process by facilitating recognition of sensory inputs via predictive feedback to sensory cortices. In the visual domain, the OFC is engaged by low spatial frequency (LSF) and magnocellular-biased inputs, but beyond this, we know little about the information content required to activate it. Is the OFC automatically engaged to analyze any LSF information for meaning? Or is it engaged only when LSF information matches preexisting memory associations? We tested these hypotheses and show that only LSF information that could be linked to memory associations engages the OFC. Specifically, LSF stimuli activated the OFC in 2 distinct medial and lateral regions only if they resembled known visual objects. More identifiable objects increased activity in the medial OFC, known for its function in affective responses. Furthermore, these objects also increased the connectivity of the lateral OFC with the ventral visual cortex, a crucial region for object identification. At the interface between sensory, memory, and affective processing, the OFC thus appears to be attuned to the associative content of visual information and to play a central role in visuo-affective prediction.

Evaluative vs. trait representation in intergroup social judgments: distinct roles of anterior temporal lobe and prefrontal cortex

When interacting with someone from another social group, one's responses may be influenced by both stereotypes and evaluations. Given behavioral results suggesting that stereotypes and evaluative associations operate independently, we used fMRI to test whether these biases are mediated by distinct brain systems. White participants viewed pairs of Black or White faces and judged them based on an evaluation (who would you befriend?) or a stereotype-relevant trait (who is more likely to enjoy athletic activities?). Multi-voxel pattern analysis revealed that a predominantly occipital network represented race in a context-invariant manner. However, lateral orbitofrontal cortex preferentially represented race during friendship judgments, whereas anterior medial prefrontal cortex preferentially represented race during trait judgments. Furthermore, representation of race in left temporal pole correlated with a behavioral measure of evaluative bias during friendship judgments and, independently, a measure of stereotyping during trait judgments. Whereas early sensory regions represent race in an apparently invariant manner, representations in higher-level regions are multi-componential and context-dependent.

Integration of faces and vocalizations in ventral prefrontal cortex: implications for the evolution of audiovisual speech

The integration of facial gestures and vocal signals is an essential process in human communication and relies on an interconnected circuit of brain regions, including language regions in the inferior frontal gyrus (IFG). Studies have determined that ventral prefrontal cortical regions in macaques [e.g., the ventrolateral prefrontal cortex (VLPFC)] share similar cytoarchitectonic features as cortical areas in the human IFG, suggesting structural homology. Anterograde and retrograde tracing studies show that macaque VLPFC receives afferents from the superior and inferior temporal gyrus, which provide complex auditory and visual information, respectively. Moreover, physiological studies have shown that single neurons in VLPFC integrate species-specific face and vocal stimuli. Although bimodal responses may be found across a wide region of prefrontal cortex, vocalization responsive cells, which also respond to faces, are mainly found in anterior VLPFC. This suggests that VLPFC may be specialized to process and integrate social communication information, just as the IFG is specialized to process and integrate speech and gestures in the human brain.

Timing of audiovisual inputs to the prefrontal cortex and multisensory integration

A number of studies have demonstrated that the relative timing of audiovisual stimuli is especially important for multisensory integration of speech signals although the neuronal mechanisms underlying this complex behavior are unknown. Temporal coincidence and congruency are thought to underlie the successful merging of two intermodal stimuli into a coherent perceptual representation. It has been previously shown that single neurons in the non-human primate prefrontal cortex integrate face and vocalization information. However, these multisensory responses and the degree to which they depend on temporal coincidence have yet to be determined. In this study we analyzed the response latency of ventrolateral prefrontal (VLPFC) neurons to face, vocalization and combined face-vocalization stimuli and an offset (asynchronous) version of the face-vocalization stimulus. Our results indicate that for most prefrontal multisensory neurons, the response latency for the vocalization was the shortest, followed by the combined face-vocalization stimuli. The face stimulus had the longest onset response latency. When tested with a dynamic face-vocalization stimulus that had been temporally offset (asynchronous) one-third of multisensory cells in VLPFC demonstrated a change in response compared to the response to the natural, synchronous face-vocalization movie. Our results indicate that prefrontal neurons are sensitive to the temporal properties of audiovisual stimuli. A disruption in the temporal synchrony of an audiovisual signal which results in a change in the firing of communication related prefrontal neurons could underlie the loss in intelligibility which occurs with asynchronous speech stimuli.