Asymmetrical use of eye information from faces following unilateral amygdala damage

From Motion to Emotion: Visual Pathways and Potential Interconnections

The two visual pathway description of [Ungerleider, L. G., & Mishkin, M. Two cortical visual systems. In D. J. Dingle, M. A. Goodale, & R. J. W. Mansfield (Eds.), Analysis of visual behavior (pp. 549-586). Cambridge, MA: MIT, 1982] changed the course of late 20th century systems and cognitive neuroscience. Here, I try to reexamine our laboratory's work through the lens of the [Pitcher, D., & Ungerleider, L. G. Evidence for a third visual pathway specialized for social perception. Trends in Cognitive Sciences, 25, 100-110, 2021] new third visual pathway. I also briefly review the literature related to brain responses to static and dynamic visual displays, visual stimulation involving multiple individuals, and compare existing models of social information processing for the face and body. In this context, I examine how the posterior STS might generate unique social information relative to other brain regions that also respond to social stimuli. I discuss some of the existing challenges we face with assessing how information flow progresses between structures in the proposed functional pathways and how some stimulus types and experimental designs may have complicated our data interpretation and model generation. I also note a series of outstanding questions for the field. Finally, I examine the idea of a potential expansion of the third visual pathway, to include aspects of previously proposed "lateral" visual pathways. Doing this would yield a more general entity for processing motion/action (i.e., "[inter]action") that deals with interactions between people, as well as people and objects. In this framework, a brief discussion of potential hemispheric biases for function, and different forms of neuropsychological impairments created by focal lesions in the posterior brain is highlighted to help situate various brain regions into an expanded [inter]action pathway.

Impaired empathic accuracy following damage to the left hemisphere

Failing to understand others accurately can be extremely costly. Unfortunately, events such as strokes can lead to a decline in emotional understanding. Such impairments have been documented in stroke patients and are widely hypothesized to be related to right-hemisphere lesions, as well as to the amygdala, and are thought to be driven in part by attentional biases, for example, less fixation on the eyes. Notably, most of the previous research relied on measurements of emotional understanding from simplified cues, such as facial expressions or prosody. We hypothesize that chronic damage to the left hemisphere could hinder empathic accuracy and emotion recognition in naturalistic social settings that require complex language comprehension, even after a patient regains core language capacities. To assess this notion, we use an empathic accuracy task and eye-tracking measurements with chronic stroke patients with either right (N = 13) or left (N = 11) hemispheric damage-together with aged-matched controls (N = 15)-to explore the patients' understanding of others' affect inferred from stimuli that separates audio and visual cues. While we find that patients with right-hemisphere lesions showed visual attention bias compared to the other two groups, we uncover a disadvantage for patients with left-hemisphere lesions in empathic accuracy, especially when only auditory cues are present. These results suggest that patients with left-hemisphere damage have long-lasting difficulties comprehending real-world complex emotional situations.

Amygdala-pons connectivity is hyperactive and associated with symptom severity in depression

Knowledge of the neural underpinnings of processing sad information and how it differs in people with depression could elucidate the neural mechanisms perpetuating sad mood in depression. Here, we conduct a 7 T fMRI study to delineate the neural correlates involved only in processing sad information, including pons, amygdala, and corticolimbic regions. We then conduct a 3 T fMRI study to examine the resting-state connectivity in another sample of people with and without depression. Only clinically depressed people demonstrate hyperactive amygdala–pons connectivity. Furthermore, this connectivity is related to depression symptom severity and is a significant indicator of depression. We speculate that visual sad information reinforces depressed mood and stimulates the pons, strengthening the amygdala–pons connectivity. The relationship between this connectivity and depressive symptom severity suggests that guiding one’s visual attention and processing of sad information may benefit mood regulation.

A study on patients with major depressive disorder (MDD) suggests that a specific sadness-processing connection between the amygdala and pons appears to be dysfunctional among people with MDD and associated with severity of depression.

Orienting to fear under transient focal disruption of the human amygdala

Responding to threat is under strong survival pressure, promoting the evolution of systems highly optimized for the task. Though the amygdala is implicated in 'detecting' threat, its role in the action that immediately follows-'orienting'-remains unclear. Critical to mounting a targeted response, such early action requires speed, accuracy, and resilience optimally achieved through conserved, parsimonious, dedicated systems, insured against neural loss by a parallelized functional organization. These characteristics tend to conceal the underlying substrate not only from correlative methods but also from focal disruption over time scales long enough for compensatory adaptation to take place. In a study of six patients with intracranial electrodes temporarily implanted for the clinical evaluation of focal epilepsy, we investigated gaze orienting to fear during focal, transient, unilateral direct electrical disruption of the amygdala. We showed that the amygdala is necessary for rapid gaze shifts towards faces presented in the contralateral hemifield regardless of their emotional expression, establishing its functional lateralization. Behaviourally dissociating the location of presented fear from the direction of the response, we implicated the amygdala not only in detecting contralateral faces, but also in automatically orienting specifically towards fearful ones. This salience-specific role was demonstrated within a drift-diffusion model of action to manifest as an orientation bias towards the location of potential threat. Pixel-wise analysis of target facial morphology revealed scleral exposure as its primary driver, and induced gamma oscillations-obtained from intracranial local field potentials-as its time-locked electrophysiological correlate. The amygdala is here reconceptualized as a functionally lateralized instrument of early action, reconciling previous conflicting accounts confined to detection, and revealing a neural organisation analogous to the superior colliculus, with which it is phylogenetically kin. Greater clarity on its role has the potential to guide therapeutic resection, still frequently complicated by impairments of cognition and behaviour related to threat, and inform novel focal stimulation techniques for the management of neuropsychiatric conditions.

Low-level image properties in facial expressions

We studied low-level image properties of face photographs and analyzed whether they change with different emotional expressions displayed by an individual. Differences in image properties were measured in three databases that depicted a total of 167 individuals. Face images were used either in their original form, cut to a standard format or superimposed with a mask. Image properties analyzed were: brightness, redness, yellowness, contrast, spectral slope, overall power and relative power in low, medium and high spatial frequencies. Results showed that image properties differed significantly between expressions within each individual image set. Further, specific facial expressions corresponded to patterns of image properties that were consistent across all three databases. In order to experimentally validate our findings, we equalized the luminance histograms and spectral slopes of three images from a given individual who showed two expressions. Participants were significantly slower in matching the expression in an equalized compared to an original image triad. Thus, existing differences in these image properties (i.e., spectral slope, brightness or contrast) facilitate emotion detection in particular sets of face images.

Single-neuron correlates of atypical face processing in autism

People with autism spectrum disorder (ASD) show abnormal processing of faces. A range of morphometric, histological, and neuroimaging studies suggest the hypothesis that this abnormality may be linked to the amygdala. We recorded data from single neurons within the amygdalae of two rare neurosurgical patients with ASD. While basic electrophysiological response parameters were normal, there were specific and striking abnormalities in how individual facial features drove neuronal response. Compared to control patients, a population of neurons in the two ASD patients responded significantly more to the mouth, but less to the eyes. Moreover, we found a second class of face-responsive neurons for which responses to faces appeared normal. The findings confirm the amygdala's pivotal role in abnormal face processing by people with ASD at the cellular level and suggest that dysfunction may be traced to a specific subpopulation of neurons with altered selectivity for the features of faces.

Introspective minds: using ALE meta-analyses to study commonalities in the neural correlates of emotional processing, social & unconstrained cognition

Previous research suggests overlap between brain regions that show task-induced deactivations and those activated during the performance of social-cognitive tasks. Here, we present results of quantitative meta-analyses of neuroimaging studies, which confirm a statistical convergence in the neural correlates of social and resting state cognition. Based on the idea that both social and unconstrained cognition might be characterized by introspective processes, which are also thought to be highly relevant for emotional experiences, a third meta-analysis was performed investigating studies on emotional processing. By using conjunction analyses across all three sets of studies, we can demonstrate significant overlap of task-related signal change in dorso-medial prefrontal and medial parietal cortex, brain regions that have, indeed, recently been linked to introspective abilities. Our findings, therefore, provide evidence for the existence of a core neural network, which shows task-related signal change during socio-emotional tasks and during resting states.

Faces in the mist: illusory face and letter detection

We report three behavioral experiments on the spatial characteristics evoking illusory face and letter detection. False detections made to pure noise images were analyzed using a modified reverse correlation method in which hundreds of observers rated a modest number of noise images (480) during a single session. This method was originally developed for brain imaging research, and has been used in a number of fMRI publications, but this is the first report of the behavioral classification images. In Experiment 1 illusory face detection occurred in response to scattered dark patches throughout the images, with a bias to the left visual field. This occurred despite the use of a fixation cross and expectations that faces would be centered. In contrast, illusory letter detection (Experiment 2) occurred in response to centrally positioned dark patches. Experiment 3 included an oval in all displays to spatially constrain illusory face detection. With the addition of this oval the classification image revealed an eyes/nose/mouth pattern. These results suggest that face detection is triggered by a minimal face-like pattern even when these features are not centered in visual focus.