Magnocellular and parvocellular pathway contributions to facial threat cue processing

A double-blind trial of decoded neurofeedback intervention for specific phobias

AIM

A new closed-loop functional magnetic resonance imaging method called multivoxel neuroreinforcement has the potential to alleviate the subjective aversiveness of exposure-based interventions by directly inducing phobic representations in the brain, outside of conscious awareness. The current study seeks to test this method as an intervention for specific phobia.

METHODS

In a randomized, double-blind, controlled single-university trial, individuals diagnosed with at least two (one target, one control) animal subtype-specific phobias were randomly assigned (1:1:1) to receive one, three, or five sessions of multivoxel neuroreinforcement in which they were rewarded for implicit activation of a target animal representation. Amygdala response to phobic stimuli was assessed by study staff blind to target and control animal assignments. Pretreatment to posttreatment differences were analyzed with a two-way repeated-measures anova.

RESULTS

A total of 23 participants (69.6% female) were randomized to receive one (n = 8), three (n = 7), or five (n = 7) sessions of multivoxel neuroreinforcement. Eighteen (n = 6 each group) participants were analyzed for our primary outcome. After neuroreinforcement, we observed an interaction indicating a significant decrease in amygdala response for the target phobia but not the control phobia. No adverse events or dropouts were reported as a result of the intervention.

CONCLUSION

Results suggest that multivoxel neuroreinforcement can specifically reduce threat signatures in specific phobia. Consequently, this intervention may complement conventional psychotherapy approaches with a nondistressing experience for patients seeking treatment. This trial sets the stage for a larger randomized clinical trial to replicate these results and examine the effects on real-life exposure.

CLINICAL TRIAL REGISTRATION

The now-closed trial was prospectively registered at ClinicalTrials.gov with ID NCT03655262.

A double-blind trial of decoded neurofeedback intervention for specific phobias

Aim

A new closed-loop fMRI method called multi-voxel neuro-reinforcement has the potential to alleviate the subjective aversiveness of exposure-based interventions by directly inducing phobic representations in the brain, outside of conscious awareness. The current study seeks to test this method as an intervention for specific phobia.

Methods

In a randomized, double-blind, controlled single-university trial, individuals diagnosed with at least two (1 target, 1 control) animal subtype specific phobias were randomly assigned (1:1:1) to receive 1, 3, or 5 sessions of multi-voxel neuro-reinforcement in which they were rewarded for implicit activation of a target animal representation. Amygdala response to phobic stimuli was assessed by study staff blind to target and control animal assignments. Pre-treatment to post-treatment differences were analyzed with a 2-way repeated-measures ANOVA.

Results

A total of 23 participants (69.6% female) were randomized to receive 1 (n=8), 3 (n=7), or 5 (n=7) sessions of multi-voxel neuro-reinforcement. Eighteen (n=6 each group) participants were analyzed for our primary outcome. After neuro-reinforcement, we observed an interaction indicating a significant decrease in amygdala response for the target phobia but not the control phobia. No adverse events or dropouts were reported as a result of the intervention.

Conclusion

Results suggest multi-voxel neuro-reinforcement can specifically reduce threat signatures in specific phobia. Consequently, this intervention may complement conventional psychotherapy approaches with a non-distressing experience for patients seeking treatment. This trial sets the stage for a larger randomized clinical trial to replicate these results and examine the effects on real-life exposure.

Clinical Trial Registration

The now-closed trial was prospectively registered at ClinicalTrials.gov with ID NCT03655262.

The Impact of Spatial Frequency on the Perception of Crowd Emotion: An fMRI Study

Recognizing the emotions of faces in a crowd is crucial for understanding overall behavior and intention as well as for smooth and friendly social interactions. However, it is unclear whether the spatial frequency of faces affects the discrimination of crowd emotion. Although high- and low-spatial-frequency information for individual faces is processed by distinct neural channels, there is a lack of evidence on how this applies to crowd faces. Here, we used functional magnetic resonance imaging (fMRI) to investigate neural representations of crowd faces at different spatial frequencies. Thirty-three participants were asked to compare whether a test face was happy or more fearful than a crowd face that varied in high, low, and broad spatial frequencies. Our findings revealed that fearful faces with low spatial frequencies were easier to recognize in terms of accuracy (78.9%) and response time (927 ms). Brain regions, such as the fusiform gyrus, located in the ventral visual stream, were preferentially activated in high spatial frequency crowds, which, however, were the most difficult to recognize behaviorally (68.9%). Finally, the right inferior frontal gyrus was found to be better activated in the broad spatial frequency crowds. Our study suggests that people are more sensitive to fearful crowd faces with low spatial frequency and that high spatial frequency does not promote crowd face recognition.

Structural and functional alterations in the brains of patients with anisometropic and strabismic amblyopia: a systematic review of magnetic resonance imaging studies

Amblyopia is the most common cause of vision loss in children and can persist into adulthood in the absence of effective intervention. Previous clinical and neuroimaging studies have suggested that the neural mechanisms underlying strabismic amblyopia and anisometropic amblyopia may be different. Therefore, we performed a systematic review of magnetic resonance imaging studies investigating brain alterations in patients with these two subtypes of amblyopia; this study is registered with PROSPERO (registration ID: CRD42022349191). We searched three online databases (PubMed, EMBASE, and Web of Science) from inception to April 1, 2022; 39 studies with 633 patients (324 patients with anisometropic amblyopia and 309 patients with strabismic amblyopia) and 580 healthy controls met the inclusion criteria (e.g., case-control designed, peer-reviewed articles) and were included in this review. These studies highlighted that both strabismic amblyopia and anisometropic amblyopia patients showed reduced activation and distorted topological cortical activated maps in the striate and extrastriate cortices during task-based functional magnetic resonance imaging with spatial-frequency stimulus and retinotopic representations, respectively; these may have arisen from abnormal visual experiences. Compensations for amblyopia that are reflected in enhanced spontaneous brain function have been reported in the early visual cortices in the resting state, as well as reduced functional connectivity in the dorsal pathway and structural connections in the ventral pathway in both anisometropic amblyopia and strabismic amblyopia patients. The shared dysfunction of anisometropic amblyopia and strabismic amblyopia patients, relative to controls, is also characterized by reduced spontaneous brain activity in the oculomotor cortex, mainly involving the frontal and parietal eye fields and the cerebellum; this may underlie the neural mechanisms of fixation instability and anomalous saccades in amblyopia. With regards to specific alterations of the two forms of amblyopia, anisometropic amblyopia patients suffer more microstructural impairments in the precortical pathway than strabismic amblyopia patients, as reflected by diffusion tensor imaging, and more significant dysfunction and structural loss in the ventral pathway. Strabismic amblyopia patients experience more attenuation of activation in the extrastriate cortex than in the striate cortex when compared to anisometropic amblyopia patients. Finally, brain structural magnetic resonance imaging alterations tend to be lateralized in the adult anisometropic amblyopia patients, and the patterns of brain alterations are more limited in amblyopic adults than in children. In conclusion, magnetic resonance imaging studies provide important insights into the brain alterations underlying the pathophysiology of amblyopia and demonstrate common and specific alterations in anisometropic amblyopia and strabismic amblyopia patients; these alterations may improve our understanding of the neural mechanisms underlying amblyopia.

A generative adversarial model of intrusive imagery in the human brain

The mechanisms underlying the subjective experiences of mental disorders remain poorly understood. This is partly due to long-standing over-emphasis on behavioral and physiological symptoms and a de-emphasis of the patient's subjective experiences when searching for treatments. Here, we provide a new perspective on the subjective experience of mental disorders based on findings in neuroscience and artificial intelligence (AI). Specifically, we propose the subjective experience that occurs in visual imagination depends on mechanisms similar to generative adversarial networks that have recently been developed in AI. The basic idea is that a generator network fabricates a prediction of the world, and a discriminator network determines whether it is likely real or not. Given that similar adversarial interactions occur in the two major visual pathways of perception in people, we explored whether we could leverage this AI-inspired approach to better understand the intrusive imagery experiences of patients suffering from mental illnesses such as post-traumatic stress disorder (PTSD) and acute stress disorder. In our model, a nonconscious visual pathway generates predictions of the environment that influence the parallel but interacting conscious pathway. We propose that in some patients, an imbalance in these adversarial interactions leads to an overrepresentation of disturbing content relative to current reality, and results in debilitating flashbacks. By situating the subjective experience of intrusive visual imagery in the adversarial interaction of these visual pathways, we propose testable hypotheses on novel mechanisms and clinical applications for controlling and possibly preventing symptoms resulting from intrusive imagery.

A deep neural network model of the primate superior colliculus for emotion recognition

Although sensory processing is pivotal to nearly every theory of emotion, the evaluation of the visual input as 'emotional' (e.g. a smile as signalling happiness) has been traditionally assumed to take place in supramodal 'limbic' brain regions. Accordingly, subcortical structures of ancient evolutionary origin that receive direct input from the retina, such as the superior colliculus (SC), are traditionally conceptualized as passive relay centres. However, mounting evidence suggests that the SC is endowed with the necessary infrastructure and computational capabilities for the innate recognition and initial categorization of emotionally salient features from retinal information. Here, we built a neurobiologically inspired convolutional deep neural network (DNN) model that approximates physiological, anatomical and connectional properties of the retino-collicular circuit. This enabled us to characterize and isolate the initial computations and discriminations that the DNN model of the SC can perform on facial expressions, based uniquely on the information it directly receives from the virtual retina. Trained to discriminate facial expressions of basic emotions, our model matches human error patterns and above chance, yet suboptimal, classification accuracy analogous to that reported in patients with V1 damage, who rely on retino-collicular pathways for non-conscious vision of emotional attributes. When presented with gratings of different spatial frequencies and orientations never 'seen' before, the SC model exhibits spontaneous tuning to low spatial frequencies and reduced orientation discrimination, as can be expected from the prevalence of the magnocellular (M) over parvocellular (P) projections. Likewise, face manipulation that biases processing towards the M or P pathway affects expression recognition in the SC model accordingly, an effect that dovetails with variations of activity in the human SC purposely measured with ultra-high field functional magnetic resonance imaging. Lastly, the DNN generates saliency maps and extracts visual features, demonstrating that certain face parts, like the mouth or the eyes, provide higher discriminative information than other parts as a function of emotional expressions like happiness and sadness. The present findings support the contention that the SC possesses the necessary infrastructure to analyse the visual features that define facial emotional stimuli also without additional processing stages in the visual cortex or in 'limbic' areas. This article is part of the theme issue 'Cracking the laugh code: laughter through the lens of biology, psychology and neuroscience'.

Localized task-invariant emotional valence encoding revealed by intracranial recordings

The ability to distinguish between negative, positive and neutral valence is a key part of emotion perception. Emotional valence has conceptual meaning that supersedes any particular type of stimulus, although it is typically captured experimentally in association with particular tasks. We sought to identify neural encoding for task-invariant emotional valence. We evaluated whether high-gamma responses (HGRs) to visually displayed words conveying emotions could be used to decode emotional valence from HGRs to facial expressions. Intracranial electroencephalography was recorded from 14 individuals while they participated in two tasks, one involving reading words with positive, negative, and neutral valence, and the other involving viewing faces with positive, negative, and neutral facial expressions. Quadratic discriminant analysis was used to identify information in the HGR that differentiates the three emotion conditions. A classifier was trained on the emotional valence labels from one task and was cross-validated on data from the same task (within-task classifier) as well as the other task (between-task classifier). Emotional valence could be decoded in the left medial orbitofrontal cortex and middle temporal gyrus, both using within-task classifiers and between-task classifiers. These observations suggest the presence of task-independent emotional valence information in the signals from these regions.

Data-point-wise spatiotemporal mapping of human ventral visual areas: Use of spatial frequency/luminance-modulated chromatic faces

Visual information involving facial identity and expression is crucial for social communication. Although the influence of facial features such as spatial frequency (SF) and luminance on face processing in visual areas has been studied extensively using grayscale stimuli, the combined effects of other features in this process have not been characterized. To determine the combined effects of different SFs and color, we created chromatic stimuli with low, high or no SF components, which bring distinct SF and color information into the ventral stream simultaneously. To obtain neural activity data with high spatiotemporal resolution we recorded face-selective responses (M170) using magnetoencephalography. We used a permutation test procedure with threshold-free cluster enhancement to assess statistical significance while resolving problems related to multiple comparisons and arbitrariness found in traditional statistical methods. We found that time windows with statistically significant threshold levels were distributed differently among the stimulus conditions. Face stimuli containing any SF components evoked M170 in the fusiform gyrus (FG), whereas a significant emotional effect on M170 was only observed with the original images. Low SF faces elicited larger activation of the FG and the inferior occipital gyrus than the original images, suggesting an interaction between low and high SF information processing. Interestingly, chromatic face stimuli without SF first activated color-selective regions and then the FG, indicating that facial color was processed according to a hierarchy in the ventral stream. These findings suggest complex effects of SFs in the presence of color information, reflected in M170, and unveil the detailed spatiotemporal dynamics of face processing in the human brain.

Differential neurodynamics and connectivity in the dorsal and ventral visual pathways during perception of emotional crowds and individuals: a MEG study

Reading the prevailing emotion of groups of people ("crowd emotion") is critical to understanding their overall intention and disposition. It alerts us to potential dangers, such as angry mobs or panicked crowds, giving us time to escape. A critical aspect of processing crowd emotion is that it must occur rapidly, because delays often are costly. Although knowing the timing of neural events is crucial for understanding how the brain guides behaviors using coherent signals from a glimpse of multiple faces, this information is currently lacking in the literature on face ensemble coding. Therefore, we used magnetoencephalography to examine the neurodynamics in the dorsal and ventral visual streams and the periamygdaloid cortex to compare perception of groups of faces versus individual faces. Forty-six participants compared two groups of four faces or two individual faces with varying emotional expressions and chose which group or individual they would avoid. We found that the dorsal stream was activated as early as 68 msec after the onset of stimuli containing groups of faces. In contrast, the ventral stream was activated later and predominantly for individual face stimuli. The latencies of the dorsal stream activation peaks correlated with participants' response times for facial crowds. We also found enhanced connectivity earlier between the periamygdaloid cortex and the dorsal stream regions for crowd emotion perception. Our findings suggest that ensemble coding of facial crowds proceeds rapidly and in parallel by engaging the dorsal stream to mediate adaptive social behaviors, via a distinct route from single face perception.

Resting EEG in alpha band predicts individual differences in visual size perception

Human visual size perception results from an interaction of external sensory information and internal state. The cognitive mechanisms involved in the processing of context-dependent visual size perception have been found to be innate in nature to some extent, suggesting that visual size perception might correlate with human intrinsic brain activity. Here we recorded human resting alpha activity (8-12 Hz), which is an inverse indicator of sustained alertness. Moreover, we measured an object's perceived size in a two-alternative forced-choice manner and the Ebbinghaus illusion magnitude which is a classic illustration of context-dependent visual size perception. The results showed that alpha activity along the ventral visual pathway, including left V1, right LOC and bilateral inferior temporal gyrus, negatively correlated with an object's perceived size. Moreover, alpha activity in the left superior temporal gyrus positively correlated with size discrimination threshold and size illusion magnitude. The findings provide clear evidence that human visual size perception scales as a function of intrinsic alertness, with higher alertness linking to larger perceived size of objects and better performance in size discrimination and size illusion tasks, and suggest that individual variation in resting-state brain activity provides a neural explanation for individual variation in cognitive performance of normal participants.

Fast saccadic and manual responses to faces presented to the koniocellular visual pathway

The parallel pathways of the human visual system differ in their tuning to luminance, color, and spatial frequency. These attunements recently have been shown to propagate to differential processing of higher-order stimuli, facial threat cues, in the magnocellular (M) and parvocellular (P) pathways, with greater sensitivity to clear and ambiguous threat, respectively. The role of the third, koniocellular (K) pathway in facial threat processing, however, remains unknown. To address this gap in knowledge, we briefly presented peripheral face stimuli psychophysically biased towards M, P, or K pathways. Observers were instructed to report via a key-press whether the face was angry or neutral while their eye movements and manual responses were recorded. We found that short-latency saccades were made more frequently to faces presented in the K channel than to P or M channels. Saccade latencies were not significantly modulated by expressive and identity cues. In contrast, manual response latencies and accuracy were modulated by both pathway biasing and by interactions of facial expression with facial masculinity, such that angry male faces elicited the fastest, and angry female faces, the least accurate, responses. We conclude that face stimuli can evoke fast saccadic and manual responses when projected to the K pathway.