A steady-state visual evoked potential approach to individual face perception: effect of inversion, contrast-reversal and temporal dynamics

Cross-Validating the Electrophysiological Markers of Early Face Categorization

Human face categorization has been extensively studied using event-related potentials (ERPs), positing the N170 ERP component as a robust neural marker of face categorization. Recently, the fast periodic visual stimulation (FPVS) approach relying on steady-state visual evoked potentials (SSVEPs) has also been used to investigate face categorization. FPVS studies consistently report strong bilateral SSVEP face categorization responses over the occipitotemporal cortex, with a right hemispheric dominance, closely mirroring the N170 scalp topography. However, it remains unclear whether SSVEP responses can be considered a proxy for the N170 or are driven by different components. To address this question, we recorded electrophysiological signals from observers viewing face and object images during FPVS and ERP paradigms. We quantified the FPVS response in the frequency domain and extracted ERP components, including the P1, N170, and P2, from both the FPVS time domain and ERP paradigms. Our results revealed little relationship between any single ERP component and the FPVS frequency response. Only the peak-to-peak differences between N170 and P2 components consistently explained the FPVS frequency response. Our data show that the FPVS frequency response reflects a later complex neural integration rather than any isolated ERP component, such as the N170. These findings raise important methodological and theoretical considerations regarding the relationship between SSVEPs and transient ERPs. While both markers are indicative of human face categorization, they appear to capture different stages of this cognitive process.

Frequency-tagging EEG reveals the effect of attentional focus on abstract magnitude processing

While humans can readily access the common magnitude of various codes such as digits, number words, or dot sets, it remains unclear whether this process occurs automatically, or only when explicitly attending to magnitude information. We addressed this question by examining the neural distance effect, a robust marker of magnitude processing, with a frequency-tagging approach. Electrophysiological responses were recorded while participants viewed rapid sequences of a base numerosity presented at 6 Hz (e.g., "2") in randomly mixed codes: digits, number words, canonical dot, and finger configurations. A deviant numerosity either close (e.g., "3") or distant (e.g., "8") from the base was inserted every five items. Participants were instructed to focus their attention either on the magnitude number feature (from a previous study), the parity number feature, a nonnumerical color feature or no specific feature. In the four attentional conditions, we found clear discrimination responses of the deviant numerosity despite its code variation. Critically, the distance effect (larger responses when base/deviant are distant than close) was present when participants were explicitly attending to magnitude and parity, but it faded with color and simple viewing instructions. Taken together, these results suggest automatic access to an abstract number representation but highlight the role of selective attention in processing the underlying magnitude information. This study therefore provides insights into how attention can modulate the neural activity supporting abstract magnitude processing.

Between faces: childhood adversity is associated with reduced threat-safety discrimination during facial expression processing in adolescence

BACKGROUND

Childhood adversity has been associated with alterations in threat-related information processing, including heightened perceptual sensitivity and attention bias towards threatening facial expressions, as well as hostile attributions of neutral faces, although there is a large degree of variability and inconsistency in reported findings.

METHODS

Here, we aimed to implicitly measure neural facial expression processing in 120 adolescents between 12 and 16 years old with and without exposure to childhood adversity. Participants were excluded if they had any major medical or neurological disorder or intellectual disability, were pregnant, used psychotropic medication or reported acute suicidality or an ongoing abusive situation. We combined fast periodic visual stimulation with electroencephalography in two separate paradigms to assess the neural sensitivity and responsivity towards neutral and expressive, i.e. happy and angry, faces. Linear mixed effects models were used to assess the impact of childhood adversity on facial expression processing.

RESULTS

Sixty-six girls, 53 boys and one adolescent who identified as 'other', between 12 and 16 years old (M = 13.93), participated in the current study. Of those, 64 participants were exposed to childhood adversity. In contrast to our hypotheses, adolescents exposed to adversity show lower expression-discrimination responses for angry faces presented in between neutral faces and higher expression-discrimination responses for happy faces presented in between neutral faces than unexposed controls. Moreover, adolescents exposed to adversity, but not unexposed controls, showed lower neural responsivity to both angry and neutral faces that were simultaneously presented.

CONCLUSIONS

We therefore conclude that childhood adversity is associated with a hostile attribution of neutral faces, thereby reducing the dissimilarity between neutral and angry faces. This reduced threat-safety discrimination may increase risk for psychopathology in individuals exposed to childhood adversity.

Top-down biological motion perception does not differ between adults scoring high versus low on autism traits

The perception of biological motion is an important social cognitive ability. Models of biological motion perception recognize two processes that contribute to the perception of biological motion: a bottom-up process that binds optic-flow patterns into a coherent percept of biological motion and a top-down process that binds sequences of body-posture 'snapshots' over time into a fluent percept of biological motion. The vast majority of studies on autism and biological motion perception have used point-light figure stimuli, which elicit biological motion perception predominantly via bottom-up processes. Here, we investigated whether autism is associated with deviances in the top-down processing of biological motion. For this, we tested a sample of adults scoring low vs high on autism traits on a recently validated EEG paradigm in which apparent biological motion is combined with frequency tagging (Cracco et al., 2022) to dissociate between two percepts: 1) the representation of individual body postures, and 2) their temporal integration into movements. In contrast to our hypothesis, we found no evidence for a diminished temporal body posture integration in the high-scoring group. We did, however, find a group difference that suggests that adults scoring high on autism traits have a visual processing style that focuses more on a single percept (i.e. either body postures or movements, contingent on saliency) compared to adults scoring low on autism traits who instead seemed to represent the two percepts included in the paradigm in a more balanced manner. Although unexpected, this finding aligns well with the autism literature on perceptual stability.

Effect of inverted faces as visual stimuli on the performance of the hybrid SSVEP + P300 brain computer interface

INTRODUCTION

This study proposes a hybrid brain-computer interface (BCI) system that simultaneously evokes steady-state visual evoked potentials (SSVEP) and event-related potentials (P300). The goal of this study was to improve the performance of the current hybrid SSVEP + P300 BCI systems by incorporating inverted faces into visual stimuli.

METHODS

In this study, upright and inverted faces were added to visual stimulus to elicit stronger cortical responses in a hybrid SSVEP + P300 BCI. We also considered triggering the P300 signals with facial stimuli and the SSVEP signals with non-facial stimuli. We have tested four paradigms: the upright face paradigm (UF), the inverted face paradigm (IF), the upright face and flicker paradigm (UFF), and the inverted face and flicker paradigm (IFF).

RESULTS AND CONCLUSIONS

The results showed that the IFF paradigm evoked more robust cortical responses, which led to enhanced system accuracy and ITR. The IFF paradigm had an average accuracy of 96.6% and a system communication rate of 26.45 bits per second. The UFF paradigm is the best candidate for BCI applications among other paradigms because it provides maximum comfort while maintaining a reasonable ITR.

Linguistic and attentional factors - Not statistical regularities - Contribute to word-selective neural responses with FPVS-oddball paradigms

Studies using frequency-tagging in electroencephalography (EEG) have dramatically increased in the past 10 years, in a variety of domains and populations. Here we used Fast Periodic Visual Stimulation (FPVS) combined with an oddball design to explore visual word recognition. Given the paradigm's high sensitivity, it is crucial for future basic research and clinical application to prove its robustness across variations of designs, stimulus types and tasks. This paradigm uses periodicity of brain responses to measure discrimination between two experimentally defined categories of stimuli presented periodically. EEG was recorded in 22 adults who viewed words inserted every 5 stimuli (at 2 Hz) within base stimuli presented at 10 Hz. Using two discrimination levels (deviant words among nonwords or pseudowords), we assessed the impact of relative frequency of item repetition (set size or item repetition controlled for deviant versus base stimuli), and of the orthogonal task (focused or deployed spatial attention). Word-selective occipito-temporal responses were robust at the individual level (significant in 95% of participants), left-lateralized, larger for the prelexical (nonwords) than lexical (pseudowords) contrast, and stronger with a deployed spatial attention task as compared to the typically used focused task. Importantly, amplitudes were not affected by item repetition. These results help understanding the factors influencing word-selective EEG responses and support the validity of FPVS-EEG oddball paradigms, as they confirm that word-selective responses are linguistic. Second, they show its robustness against design-related factors that could induce statistical (ir)regularities in item rate. They also confirm its high individual sensitivity and demonstrate how it can be optimized, using a deployed rather than focused attention task, to measure implicit word recognition processes in typical and atypical populations.

Perceptual Cycles Travel Across Retinotopic Space

Visual perception waxes and wanes periodically over time at low frequencies (theta: 4-7 Hz; alpha: 8-13 Hz), creating "perceptual cycles." These perceptual cycles can be induced when stimulating the brain with a flickering visual stimulus at the theta or alpha frequency. Here, we took advantage of the well-known organization of the visual system into retinotopic maps (topographic correspondence between visual and cortical spaces) to assess the spatial organization of induced perceptual cycles. Specifically, we tested the hypothesis that they can propagate across the retinotopic space. A disk oscillating in luminance (inducer) at 4, 6, 8, or 10 Hz was presented in the periphery of the visual field to induce perceptual cycles at specific frequencies. EEG recordings verified that the brain responded at the corresponding inducer frequencies and their first harmonics. Perceptual cycles were assessed with a concurrent detection task-target stimuli were displayed at threshold contrast (50% detection) at random times during the inducer. Behavioral results confirmed that perceptual performance was modulated periodically by the inducer at each frequency. We additionally manipulated the distance between the target and the inducer (three possible positions) and showed that the optimal phase, that is, moment of highest target detection, shifted across target distance to the inducer, specifically when its flicker frequency was in the alpha range (8 and 10 Hz). These results demonstrate that induced alpha perceptual cycles travel across the retinotopic space in humans at a propagation speed of 0.3-0.5 m/sec, consistent with the speed of unmyelinated horizontal connections in the visual cortex.

Neural sensitivity to facial identity and facial expression discrimination in adults with autism

The fluent processing of faces can be challenging for autistic individuals. Here, we assessed the neural sensitivity to rapid changes in subtle facial cues in 23 autistic men and 23 age and IQ matched non-autistic (NA) controls using frequency-tagging electroencephalography (EEG). In oddball paradigms examining the automatic and implicit discrimination of facial identity and facial expression, base rate images were presented at 6 Hz, periodically interleaved every fifth image with an oddball image (i.e. 1.2 Hz oddball frequency). These distinctive frequency tags for base rate and oddball stimuli allowed direct and objective quantification of the neural discrimination responses. We found no large differences in the neural sensitivity of participants in both groups, not for facial identity discrimination, nor for facial expression discrimination. Both groups also showed a clear face-inversion effect, with reduced brain responses for inverted versus upright faces. Furthermore, sad faces generally elicited significantly lower neural amplitudes than angry, fearful and happy faces. The only minor group difference is the larger involvement of high-level right-hemisphere visual areas in NA men for facial expression processing. These findings are discussed from a developmental perspective, as they strikingly contrast with robust face processing deficits observed in autistic children using identical EEG paradigms.

Cortical signatures of visual body representation develop in human infancy

Human infants cannot report their experiences, limiting what we can learn about their bodily awareness. However, visual cortical responses to the body, linked to visual awareness and selective attention in adults, can be easily measured in infants and provide a promising marker of bodily awareness in early life. We presented 4- and 8-month-old infants with a flickering (7.5 Hz) video of a hand being stroked and recorded steady-state visual evoked potentials (SSVEPs). In half of the trials, the infants also received tactile stroking synchronously with visual stroking. The 8-month-old, but not the 4-month-old infants, showed a significant enhancement of SSVEP responses when they received tactile stimulation concurrent with the visually observed stroking. Follow-up experiments showed that this enhancement did not occur when the visual hand was presented in an incompatible posture with the infant's own body or when the visual stimulus was a body-irrelevant video. Our findings provide a novel insight into the development of bodily self-awareness in the first year of life.

Higher amplitudes in steady-state visual evoked potentials driven by square-wave versus sine-wave contrast modulation - A dual-laboratory study

Steady-state visual evoked potentials (ssVEPs) are an established tool for assessing visuocortical responses in visual perception and attention. They have the same temporal frequency characteristics as a periodically modulated stimulus (e.g., in contrast or luminance) that drives them. It has been hypothesized that the amplitude of a given ssVEP may depend on the shape of the stimulus modulation function, but the size and robustness of these effects is not well established. The current study systematically compared the effect of the two most common functions in the ssVEP literature, square-wave and sine-wave functions. Across two laboratories, we presented mid-complex color patterns to 30 participants with square-wave or sine-wave contrast modulation and at different driving frequencies (6 Hz, 8.57 Hz, 15 Hz). When ssVEPs were analyzed independently for the samples, with each laboratory's standard processing pipeline, ssVEP amplitudes in both samples decreased at higher driving frequencies and square-wave modulation evoked higher amplitudes at lower frequencies (i.e., 6 Hz, 8.57 Hz) compared to sine-wave modulation. These effects were replicated when samples were aggregated and analyzed with the same processing pipeline. In addition, when using signal-to-noise ratios as outcome measures, this joint analysis indicated a somewhat weaker effect of increased ssVEP amplitudes to square-wave modulation at 15 Hz. The present study suggests that square-wave modulation should be used in ssVEP research when the goal is to maximize signal amplitude or signal-to-noise ratio. Given effects of modulation function across laboratories, and data processing pipelines, the findings appear robust to differences in data collection and analysis.

Neural response and representation: Facial expressions in scenes

Previous studies have shown that the brain generates expectations based on scenes, which affects facial expression recognition. However, although facial expressions are known to interact with perception, the mechanism underlying this interaction remains poorly understood. Here, we used frequency labeling and decoding techniques to reveal the effects of scene-based expectation on the amplitude and representational strength of neural activity. We also reduced the relative reliability between expectation and sensory input by blurring facial expressions to further investigate the effects of this relative reliability on the pattern of neural activation and representation. Participants viewed emotional changes in unblurred or blurred facial expressions, which flickered at a rate of 6 Hz within a scene. We found that facial expressions that were congruent with the emotional significance of the scene elicited a larger steady-state visual evoked potential amplitude than did facial expressions that were incongruent with the emotional significance of a scene, in both unblurred and blurred conditions. We also found that expected facial expression representations were stronger than unexpected representations during the unblurred condition. In the blurred condition, unexpected representations were stronger than expected representations. Taken together, these results suggested that facial expression processing in the visual cortex is modulated by top-down signals. The relative reliability of expectation and sensory input moderated the influence of a scene on facial expression representation. Furthermore, our study showed that neural activation amplitudes did not correspond to representational strength.

Intracerebral Electrophysiological Recordings to Understand the Neural Basis of Human Face Recognition

Understanding how the human brain recognizes faces is a primary scientific goal in cognitive neuroscience. Given the limitations of the monkey model of human face recognition, a key approach in this endeavor is the recording of electrophysiological activity with electrodes implanted inside the brain of human epileptic patients. However, this approach faces a number of challenges that must be overcome for meaningful scientific knowledge to emerge. Here we synthesize a 10 year research program combining the recording of intracerebral activity (StereoElectroEncephaloGraphy, SEEG) in the ventral occipito-temporal cortex (VOTC) of large samples of participants and fast periodic visual stimulation (FPVS), to objectively define, quantify, and characterize the neural basis of human face recognition. These large-scale studies reconcile the wide distribution of neural face recognition activity with its (right) hemispheric and regional specialization and extend face-selectivity to anterior regions of the VOTC, including the ventral anterior temporal lobe (VATL) typically affected by magnetic susceptibility artifacts in functional magnetic resonance imaging (fMRI). Clear spatial dissociations in category-selectivity between faces and other meaningful stimuli such as landmarks (houses, medial VOTC regions) or written words (left lateralized VOTC) are found, confirming and extending neuroimaging observations while supporting the validity of the clinical population tested to inform about normal brain function. The recognition of face identity - arguably the ultimate form of recognition for the human brain - beyond mere differences in physical features is essentially supported by selective populations of neurons in the right inferior occipital gyrus and the lateral portion of the middle and anterior fusiform gyrus. In addition, low-frequency and high-frequency broadband iEEG signals of face recognition appear to be largely concordant in the human association cortex. We conclude by outlining the challenges of this research program to understand the neural basis of human face recognition in the next 10 years.

Children show neural sensitivity to facial trustworthiness as measured by fast periodic visual stimulation

Adults exhibit neural responses over the visual occipito-temporal area in response to faces that vary in how trustworthy they appear. However, it is not yet known when a mature pattern of neural sensitivity can be seen in children. Using a fast periodic visual stimulation (FPVS) paradigm, face images were presented to 8-to-9-year-old children (an age group which shows development of trust impressions; N = 31) and adult (N = 33) participants at a rate of 6 Hz (6 face images per second). Within this sequence, an 'oddball' face differing in the level of facial trustworthiness compared to the other faces, was presented at a rate of 1 Hz (once per second). Children were sensitive to variations in facial trustworthiness, showing reliable and significant neural responses at 1 Hz in the absence of instructions to respond to facial trustworthiness. Additionally, the magnitude of children's and adults' neural responses was similar, with strong Bayesian evidence that implicit neural responses to facial trustworthiness did not differ across the groups, and therefore, that visual sensitivity to differences in facial trustworthiness can show mature patterns by this age. Thus, nine or less years of social experience, perceptual and/or cognitive development may be sufficient for adult-like neural sensitivity to facial trustworthiness to emerge. We also validate the use of the FPVS methodology to examine children's implicit face-based trust processing for the first time, which is especially valuable in developmental research because this paradigm requires no explicit instructions or responses from participants.

Trustworthiness perception is mandatory: Task instructions do not modulate fast periodic visual stimulation trustworthiness responses

Although it is often assumed that humans spontaneously respond to the trustworthiness of others’ faces, it is still unclear whether responses to facial trust are mandatory or can be modulated by instructions. Considerable scientific interest lies in understanding whether trust processing is mandatory, given the societal consequences of biased trusting behavior. We tested whether neural responses indexing trustworthiness discrimination depended on whether the task involved focusing on facial trustworthiness or not, using a fast periodic visual stimulation electroencephalography oddball paradigm with a neural marker of trustworthiness discrimination at 1 Hz. Participants judged faces on size without any reference to trust, explicitly formed impressions of facial trust, or were given a financial lending context that primed trust, without explicit trust judgement instructions. Significant trustworthiness discrimination responses at 1 Hz were found in all three conditions, demonstrating the robust nature of trustworthiness discrimination at the neural level. Moreover, no effect of task instruction was observed, with Bayesian analyses providing moderate to decisive evidence that task instruction did not affect trustworthiness discrimination. Our finding that visual trustworthiness discrimination is mandatory points to the remarkable spontaneity of trustworthiness processing, providing clues regarding why these often unreliable impressions are ubiquitous.

Monitoring the effect of oxytocin on the neural sensitivity to emotional faces via frequency-tagging EEG: A double-blind, cross-over study

The neuropeptide oxytocin (OXT) is suggested to exert an important role in human social behaviors by modulating the salience of social cues. To date, however, there is mixed evidence whether a single dose of OXT can improve the behavioral and neural sensitivity for emotional face processing. To overcome difficulties encountered with classic event-related potential studies assessing stimulus-saliency, we applied frequency-tagging EEG to implicitly assess the effect of a single dose of OXT (24 IU) on the neural sensitivity for positive and negative facial emotions. Neutral faces with different identities were presented at 6 Hz, periodically interleaved with an expressive face (angry, fearful, and happy, in separate sequences) every fifth image (i.e., 1.2 Hz oddball frequency). These distinctive frequency tags for neutral and expressive stimuli allowed direct and objective quantification of the neural expression-categorization responses. The study involved a double-blind, placebo-controlled, cross-over trial with 31 healthy adult men. Contrary to our expectations, we did not find an effect of OXT on facial emotion processing, neither at the neural, nor at the behavioral level. A single dose of OXT did not evoke social enhancement in general, nor did it affect social approach-avoidance tendencies. Possibly ceiling performances in facial emotion processing might have hampered further improvement.

The FreqTag toolbox: A principled approach to analyzing electrophysiological time series in frequency tagging paradigms

Steady-state visual evoked potential (ssVEP) frequency tagging is an increasingly used method in electrophysiological studies of visual attention and perception. Frequency tagging is suitable for studies examining a wide range of populations, including infants and children. Frequency tagging involves the presentation of different elements of a visual array at different temporal rates, thus using stimulus timing to “tag” the brain response to a given element by means of a unique time signature. Leveraging the strength of the ssVEP frequency tagging method to isolate brain responses to concurrently presented and spatially overlapping visual objects requires specific signal processing methods. Here, we introduce the FreqTag suite of functions, an open source MATLAB toolbox. The purpose of the FreqTag toolbox is three-fold. First, it will equip users with a set of transparent and reproducible analytical tools for the analysis of ssVEP data. Second, the toolbox is designed to illustrate fundamental features of frequency domain and time-frequency domain approaches. Finally, decision criteria for the application of different functions and analyses are described. To promote reproducibility, raw algorithms are provided in a modular fashion, without additional hidden functions or transformations. This approach is intended to facilitate a fundamental understanding of the transformations and algorithmic steps in FreqTag, and to allow users to visualize and test each step in the toolbox.

Neural correlates of integration processes during dynamic face perception

Integrating the spatiotemporal information acquired from the highly dynamic world around us is essential to navigate, reason, and decide properly. Although this is particularly important in a face-to-face conversation, very little research to date has specifically examined the neural correlates of temporal integration in dynamic face perception. Here we present statistically robust observations regarding the brain activations measured via electroencephalography (EEG) that are specific to the temporal integration. To that end, we generate videos of neutral faces of individuals and non-face objects, modulate the contrast of the even and odd frames at two specific frequencies (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$f_1$$\end{document}f1 and \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$f_2$$\end{document}f2) in an interlaced manner, and measure the steady-state visual evoked potential as participants view the videos. Then, we analyze the intermodulation components (IMs: (\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$nf_1\pm mf_2$$\end{document}nf1±mf2), a linear combination of the fundamentals with integer multipliers) that consequently reflect the nonlinear processing and indicate temporal integration by design. We show that electrodes around the medial temporal, inferior, and medial frontal areas respond strongly and selectively when viewing dynamic faces, which manifests the essential processes underlying our ability to perceive and understand our social world. The generation of IMs is only possible if even and odd frames are processed in succession and integrated temporally, therefore, the strong IMs in our frequency spectrum analysis show that the time between frames (1/60 s) is sufficient for temporal integration.

Contrast Adaptation in Face Perception Revealed Through EEG and Behavior

Exposure to a face can produce biases in the perception of subsequent faces. Typically, these face aftereffects are studied by adapting to an individual face or category (e.g., faces of a given gender) and can result in renormalization of perceptions such that the adapting face appears more neutral. These shifts are analogous to chromatic adaptation, where a renormalization for the average adapting color occurs. However, in color vision, adaptation can also adjust to the variance or range of colors in the distribution. We examined whether this variance or contrast adaptation also occurs for faces, using an objective EEG measure to assess response changes following adaptation. An average female face was contracted or expanded along the horizontal or vertical axis to form four images. Observers viewed a 20 s sequence of the four images presented in a fixed order at a rate of 6 Hz, while responses to the faces were recorded with EEG. A 6 Hz signal was observed over right occipito-temporal channels, indicating symmetric responses to the four images. This test sequence was repeated after 20 s adaptation to alternations between two of the faces (e.g., horizontal contracted and expanded). This adaptation resulted in an additional signal at 3 Hz, consistent with asymmetric responses to adapted and non-adapted test faces. Adapting pairs have the same mean (undistorted) as the test sequence and thus should not bias responses driven only by the mean. Instead, the results are consistent with selective adaptation to the distortion axis. A 3 Hz signal was also observed after adapting to face pairs selected to induce a mean bias (e.g., expanded vertical and expanded horizontal), and this signal was not significantly different from that observed following adaption to a single image that did not form part of the test sequence (e.g., a single image expanded both vertically and horizontally). In a further experiment, we found that this variance adaptation can also be observed behaviorally. Our results suggest that adaptation calibrates face perception not only for the average characteristics of the faces we experience but also for the gamut of faces to which we are exposed.

Face-selective responses in combined EEG/MEG recordings with fast periodic visual stimulation (FPVS)

Fast periodic visual stimulation (FPVS) allows the recording of objective brain responses of human face categorization (i.e., generalizable face-selective responses) with high signal-to-noise ratio. This approach has been successfully employed in a number of scalp electroencephalography (EEG) studies but has not been used with magnetoencephalography (MEG) yet, let alone with combined MEG/EEG recordings and distributed source estimation. Here, we presented various natural images of faces periodically (1.2 Hz) among natural images of objects (base frequency 6 Hz) whilst recording simultaneous EEG and MEG in 15 participants. Both measurement modalities showed face-selective responses at 1.2 Hz and harmonics across participants, with high and comparable signal-to-noise ratio (SNR) in about 3 min of stimulation. The correlation of face categorization responses between EEG and two MEG sensor types was lower than between the two MEG sensor types, indicating that the two sensor modalities provide independent information about the sources of face-selective responses. Face-selective EEG responses were right-lateralized as reported previously, and were numerically but non-significantly right-lateralized in MEG data. Distributed source estimation based on combined EEG/MEG signals confirmed a more bilateral face-selective response in visual brain regions located anteriorly to the common response to all stimuli at 6 Hz and harmonics. Conventional sensor and source space analyses of evoked responses in the time domain further corroborated this result. Our results demonstrate that FPVS in combination with simultaneously recorded EEG and MEG may serve as an efficient localizer paradigm for human face categorization.

EEG Frequency Tagging Reveals the Integration of Form and Motion Cues into the Perception of Group Movement

The human brain has dedicated mechanisms for processing other people’s movements. Previous research has revealed how these mechanisms contribute to perceiving the movements of individuals but has left open how we perceive groups of people moving together. Across three experiments, we test whether movement perception depends on the spatiotemporal relationships among the movements of multiple agents. In Experiment 1, we combine EEG frequency tagging with apparent human motion and show that posture and movement perception can be dissociated at harmonically related frequencies of stimulus presentation. We then show that movement but not posture processing is enhanced when observing multiple agents move in synchrony. Movement processing was strongest for fluently moving synchronous groups (Experiment 2) and was perturbed by inversion (Experiment 3). Our findings suggest that processing group movement relies on binding body postures into movements and individual movements into groups. Enhanced perceptual processing of movement synchrony may form the basis for higher order social phenomena such as group alignment and its social consequences.

Steady state evoked potentials indicate changes in nonlinear neural mechanisms of vision in sight recovery individuals

Humans with a transient phase of congenital pattern vision deprivation have been observed to feature prevailing deficits, particularly in higher order visual functions. However, the neural correlates of these prevalent visual impairments remain unclear. To probe different visual processing stages, we measured steady state visual evoked potentials (SSVEPs) generated by luminance flicker stimuli at 6.1 Hz, with superimposed horizontal periodic motion at 2.1 Hz or 2.4 Hz. SSVEP responses at the fundamental and second harmonic of luminance flicker frequency, and at their intermodulation frequencies with motion information, were analyzed. Three groups were tested: (1) 15 individuals who had suffered a lack of pattern vision from birth due to the presence of bilateral total congenital cataracts (CC group), which were surgically removed between 4 months and 22 years of age, (2) 13 individuals with reversed developmental i.e., later developing cataracts (DC group), and (3) normally sighted control participants (SC group; n = 13) matched in age and sex to the CC individuals. SSVEPs at the second harmonic frequency (i.e., 12.2 Hz) and at the intermodulation frequencies (8.2 Hz, and 8.5 Hz) were attenuated in the CC group. In contrast, fundamental frequency responses (i.e., at 6.1 Hz) were not significantly altered in the CC group compared to the control groups (SC and DC groups). Based on previous evidence on the role of striate vs. extrastriate generators of fundamental vs. second harmonics of SSVEPs, these results provide evidence for a stronger experience dependence of extrastriate than striate cortical processing, and furthermore, suggest a sensitive period for the development of putative nonlinear neural mechanisms hypothesized to mediate visual feature binding.

Distinct neural sources underlying visual word form processing as revealed by steady state visual evoked potentials (SSVEP)

EEG has been central to investigations of the time course of various neural functions underpinning visual word recognition. Recently the steady-state visual evoked potential (SSVEP) paradigm has been increasingly adopted for word recognition studies due to its high signal-to-noise ratio. Such studies, however, have been typically framed around a single source in the left ventral occipitotemporal cortex (vOT). Here, we combine SSVEP recorded from 16 adult native English speakers with a data-driven spatial filtering approach—Reliable Components Analysis (RCA)—to elucidate distinct functional sources with overlapping yet separable time courses and topographies that emerge when contrasting words with pseudofont visual controls. The first component topography was maximal over left vOT regions with a shorter latency (approximately 180 ms). A second component was maximal over more dorsal parietal regions with a longer latency (approximately 260 ms). Both components consistently emerged across a range of parameter manipulations including changes in the spatial overlap between successive stimuli, and changes in both base and deviation frequency. We then contrasted word-in-nonword and word-in-pseudoword to test the hierarchical processing mechanisms underlying visual word recognition. Results suggest that these hierarchical contrasts fail to evoke a unitary component that might be reasonably associated with lexical access.

Neural Entrainment Meets Behavior: The Stability Index as a Neural Outcome Measure of Auditory-Motor Coupling

Understanding rhythmic behavior in the context of coupled auditory and motor systems has been of interest to neurological rehabilitation, in particular, to facilitate walking. Recent work based on behavioral measures revealed an entrainment effect of auditory rhythms on motor rhythms. In this study, we propose a method to compute the neural component of such a process from an electroencephalographic (EEG) signal. A simple auditory-motor synchronization paradigm was used, where 28 healthy participants were instructed to synchronize their finger-tapping with a metronome. The computation of the neural outcome measure was carried out in two blocks. In the first block, we used Generalized Eigendecomposition (GED) to reduce the data dimensionality to the component which maximally entrained to the metronome frequency. The scalp topography pointed at brain activity over contralateral sensorimotor regions. In the second block, we computed instantaneous frequency from the analytic signal of the extracted component. This returned a time-varying measure of frequency fluctuations, whose standard deviation provided our "stability index" as a neural outcome measure of auditory-motor coupling. Finally, the proposed neural measure was validated by conducting a correlation analysis with a set of behavioral outcomes from the synchronization task: resultant vector length, relative phase angle, mean asynchrony, and tempo matching. Significant moderate negative correlations were found with the first three measures, suggesting that the stability index provided a quantifiable neural outcome measure of entrainment, with selectivity towards phase-correction mechanisms. We address further adoption of the proposed approach, especially with populations where sensorimotor abilities are compromised by an underlying pathological condition. The impact of using stability index can potentially be used as an outcome measure to assess rehabilitation protocols, and possibly provide further insight into neuropathological models of auditory-motor coupling.

Does automatic human face categorization depend on head orientation?

Whether human categorization of visual stimuli as faces is optimal for full-front views, best revealing diagnostic features but lacking depth cues, remains largely unknown. To address this question, we presented 16 human observers with unsegmented natural images of different living and non-living objects at a fast rate (f = 12 Hz), with natural face images appearing at f/9 = 1.33 Hz. Faces posing all full-front or at ¾ side view angles appeared in separate sequences. Robust frequency-tagged 1.33 Hz (and harmonic) occipito-temporal electroencephalographic (EEG) responses reflecting face-selective neural activity did not differ in overall amplitude between full-front and ¾ side views. Despite this, alternating between full-front and ¾ side views within a sequence led to significant responses at specific harmonics of .67 Hz (f/18), objectively isolating view-dependent face-selective responses over occipito-temporal regions. Critically, a time-domain analysis showed that these view-dependent face-selective responses reflected only an earlier response to full-front than ¾ side views by 8-13 ms. Overall, these findings indicate that the face-selective neural representation is as robust for ¾ side faces as for full-front faces in the human brain, but full-front views provide a slightly earlier processing-time advantage as compared to rotated face views.

Brain Oscillation Entrainment by Perceptible and Non-perceptible Rhythmic Light Stimulation

Objective and Background: Decades of research in the field of steady-state visual evoked potentials (SSVEPs) have revealed great potential of rhythmic light stimulation for brain-computer interfaces. Additionally, rhythmic light stimulation provides a non-invasive method for entrainment of oscillatory activity in the brain. Especially effective protocols enabling non-perceptible rhythmic stimulation and, thereby, reducing eye fatigue and user discomfort are favorable. Here, we investigate effects of (1) perceptible and (2) non-perceptible rhythmic light stimulation as well as attention-based effects of the stimulation by asking participants to focus (a) on the stimulation source directly in an overt attention condition or (b) on a cross-hair below the stimulation source in a covert attention condition. Method: SSVEPs at 10 Hz were evoked with a light-emitting diode (LED) driven by frequency-modulated signals and amplitudes of the current intensity either below or above a previously estimated individual threshold. Furthermore, we explored the effect of attention by asking participants to fixate on the LED directly in the overt attention condition and indirectly attend it in the covert attention condition. By measuring electroencephalography, we analyzed differences between conditions regarding the detection of reliable SSVEPs via the signal-to-noise ratio (SNR) and functional connectivity in occipito-frontal(-central) regions. Results: We could observe SSVEPs at 10 Hz for the perceptible and non-perceptible rhythmic light stimulation not only in the overt but also in the covert attention condition. The SNR and SSVEP amplitudes did not differ between the conditions and SNR values were in all except one participant above significance thresholds suggested by previous literature indicating reliable SSVEP responses. No difference between the conditions could be observed in the functional connectivity in occipito-frontal(-central) regions. Conclusion: The finding of robust SSVEPs even for non-intrusive rhythmic stimulation protocols below an individual perceptibility threshold and without direct fixation on the stimulation source reveals strong potential as a safe stimulation method for oscillatory entrainment in naturalistic applications.

Optimal Approach for Signal Detection in Steady-State Visual Evoked Potentials in Humans Using Single-Channel EEG and Stereoscopic Stimuli

In EEG studies, one of the most common ways to detect a weak periodic signal in the steady-state visual evoked potential (SSVEP) is spectral evaluation, a process that detects peaks of power present at notable temporal frequencies. However, the presence of noise decreases the signal-to-noise ratio (SNR), which in turn lowers the probability of successful detection of these spectral peaks. In this paper, using a single EEG channel, we compare the detection performance of four different metrics to analyse the SSVEP: two metrics that use spectral power density, and two other metrics that use phase coherency. We employ these metrics find weak signals with a known temporal frequency hidden in the SSVEP, using both simulation and real data from a stereoscopic apparent depth movement perception task. We demonstrate that out of these metrics, the phase coherency analysis is the most sensitive way to find weak signals in the SSVEP, provided that the phase information of the stimulus eliciting the SSVEP is preserved.

Reversing the Luminance Polarity of Control Faces: Why Are Some Negative Faces Harder to Recognize, but Easier to See?

Control stimuli are key for understanding the extent to which face processing relies on holistic processing, and affective evaluation versus the encoding of low-level image properties. Luminance polarity (LP) reversal combined with face inversion is a popular tool for severely disrupting the recognition of face controls. However, recent findings demonstrate visibility-recognition trade-offs for LP-reversed faces, where these face controls sometimes appear more salient despite being harder to recognize. The present report brings together findings from image analysis, simple stimuli, and behavioral data for facial recognition and visibility, in an attempt to disentangle instances where LP-reversed control faces are associated with a performance bias in terms of their perceived salience. These findings have important implications for studies of subjective face appearance, and highlight that future research must be aware of behavioral artifacts due to the possibility of trade-off effects.

Pinpointing the optimal spatial frequency range for automatic neural facial fear processing

Faces convey an assortment of emotional information via low and high spatial frequencies (LSFs and HSFs). However, there is no consensus on the role of particular spatial frequency (SF) information during facial fear processing. Comparison across studies is hampered by the high variability in cut-off values for demarcating the SF spectrum and by differences in task demands. We investigated which SF information is minimally required to rapidly detect briefly presented fearful faces in an implicit and automatic manner, by sweeping through an entire SF range without constraints of predefined cut-offs for LSFs and HSFs. We combined fast periodic visual stimulation with electroencephalography. We presented neutral faces at 6 ​Hz, periodically interleaved every 5th image with a fearful face, allowing us to quantify an objective neural index of fear discrimination at exactly 1.2 ​Hz. We started from a stimulus containing either only very low or very high SFs and gradually increased the SF content by adding higher or lower SF information, respectively, to reach the full SF spectrum over the course of 70 ​s. We found that faces require at least SF information higher than 5.93 cycles per image (cpi) to implicitly differentiate fearful from neutral faces. However, exclusive HSF faces, even in a restricted SF range between 94.82 and 189.63 cpi already carry the critical information to extract the emotional expression of the faces.

Consistent behavioral and electrophysiological evidence for rapid perceptual discrimination among the six human basic facial expressions

The extent to which the six basic human facial expressions perceptually differ from one another remains controversial. For instance, despite the importance of rapidly decoding fearful faces, this expression often is confused with other expressions, such as Surprise in explicit behavioral categorization tasks. We quantified implicit visual discrimination among rapidly presented facial expressions with an oddball periodic visual stimulation approach combined with electroencephalography (EEG), testing for the relationship with behavioral explicit measures of facial emotion discrimination. We report robust facial expression discrimination responses bilaterally over the occipito-temporal cortex for each pairwise expression change. While fearful faces presented as repeated stimuli led to the smallest deviant responses from all other basic expressions, deviant fearful faces were well discriminated overall and to a larger extent than expressions of Sadness and Anger. Expressions of Happiness did not differ quantitatively as much in EEG as for behavioral subjective judgments, suggesting that the clear dissociation between happy and other expressions, typically observed in behavioral studies, reflects higher-order processes. However, this expression differed from all others in terms of scalp topography, pointing to a qualitative rather than quantitative difference. Despite this difference, overall, we report for the first time a tight relationship of the similarity matrices across facial expressions obtained for implicit EEG responses and behavioral explicit measures collected under the same temporal constraints, paving the way for new approaches of understanding facial expression discrimination in developmental, intercultural, and clinical populations.

Rapid neural categorization of angry and fearful faces is specifically impaired in boys with autism spectrum disorder

BACKGROUND

Difficulties with facial expression processing may be associated with the characteristic social impairments in individuals with autism spectrum disorder (ASD). Emotional face processing in ASD has been investigated in an abundance of behavioral and EEG studies, yielding, however, mixed and inconsistent results.

METHODS

We combined fast periodic visual stimulation (FPVS) with EEG to assess the neural sensitivity to implicitly detect briefly presented facial expressions among a stream of neutral faces, in 23 boys with ASD and 23 matched typically developing (TD) boys. Neutral faces with different identities were presented at 6 Hz, periodically interleaved with an expressive face (angry, fearful, happy, sad in separate sequences) every fifth image (i.e., 1.2 Hz oddball frequency). These distinguishable frequency tags for neutral and expressive stimuli allowed direct and objective quantification of the expression-categorization responses, needing only four sequences of 60 s of recording per condition.

RESULTS

Both groups show equal neural synchronization to the general face stimulation and similar neural responses to happy and sad faces. However, the ASD group displays significantly reduced responses to angry and fearful faces, compared to TD boys. At the individual subject level, these neural responses allow to predict membership of the ASD group with an accuracy of 87%. Whereas TD participants show a significantly lower sensitivity to sad faces than to the other expressions, ASD participants show an equally low sensitivity to all the expressions.

CONCLUSIONS

Our results indicate an emotion-specific processing deficit, instead of a general emotion-processing problem: Boys with ASD are less sensitive than TD boys to rapidly and implicitly detect angry and fearful faces. The implicit, fast, and straightforward nature of FPVS-EEG opens new perspectives for clinical diagnosis.

A validation of Emotiv EPOC Flex saline for EEG and ERP research

Background

Previous work has validated consumer-grade electroencephalography (EEG) systems for use in research. Systems in this class are cost-effective and easy to set up and can facilitate neuroscience outside of the laboratory. The aim of the current study was to determine if a new consumer-grade system, the Emotiv EPOC Saline Flex, was capable of capturing research-quality data.

Method

The Emotiv system was used simultaneously with a research-grade EEG system, Neuroscan Synamps2, to collect EEG data across 16 channels during five well-established paradigms: (1) a mismatch negativity (MMN) paradigm that involved a passive listening task in which rare deviant (1,500 Hz) tones were interspersed amongst frequent standard tones (1,000 Hz), with instructions to ignore the tones while watching a silent movie; (2) a P300 paradigm that involved an active listening task in which participants were asked to count rare deviant tones presented amongst frequent standard tones; (3) an N170 paradigm in which participants were shown images of faces and watches and asked to indicate whether the images were upright or inverted; (4) a steady-state visual evoked potential (SSVEP) paradigm in which participants passively viewed a flickering screen (15 Hz) for 2 min; and (5) a resting state paradigm in which participants sat quietly with their eyes open and then closed for 3 min each.

Results

The MMN components and P300 peaks were equivalent between the two systems (BF10 = 0.25 and BF10 = 0.26, respectively), with high intraclass correlations (ICCs) between the ERP waveforms (>0.81). Although the N170 peak values recorded by the two systems were different (BF10 = 35.88), ICCs demonstrated that the N170 ERP waveforms were strongly correlated over the right hemisphere (P8; 0.87–0.97), and moderately-to-strongly correlated over the left hemisphere (P7; 0.52–0.84). For the SSVEP, the signal-to-noise ratio (SNR) was larger for Neuroscan than Emotiv EPOC Flex (19.94 vs. 8.98, BF10 = 51,764), but SNR z-scores indicated a significant brain response at the stimulus frequency for both Neuroscan (z = 12.47) and Flex (z = 11.22). In the resting state task, both systems measured similar alpha power (BF10 = 0.28) and higher alpha power when the eyes were closed than open (BF10 = 32.27).

Conclusions

The saline version of the Emotiv EPOC Flex captures data similar to that of a research-grade EEG system. It can be used to measure reliable auditory and visual research-quality ERPs. In addition, it can index SSVEP signatures and is sensitive to changes in alpha oscillations.

Neural correlates of perceptual color inferences as revealed by #thedress

Color constancy involves disambiguating the spectral characteristics of lights and surfaces, for example to distinguish red in white light from white in red light. Solving this problem appears especially challenging for bluish tints, which may be attributed more often to shading, and this bias may underlie the individual differences in whether people described the widely publicized image of #thedress as blue-black or white-gold. To probe these higher-level color inferences, we examined neural correlates of the blue-bias, using frequency-tagging and high-density electroencephalography to monitor responses to 3-Hz alternations between different color versions of #thedress. Specifically, we compared relative neural responses to the original “blue” dress image alternated with the complementary “yellow” image (formed by inverting the chromatic contrast of each pixel). This image pair produced a large modulation of the electroencephalography amplitude at the alternation frequency, consistent with a perceived contrast difference between the blue and yellow images. Furthermore, decoding topographical differences in the blue-yellow asymmetries over occipitoparietal channels predicted blue-black and white-gold observers with over 80% accuracy. The blue-yellow asymmetry was stronger than for a “red” versus “green” pair matched for the same component differences in L versus M or S versus LM chromatic contrast as the blue-yellow pair and thus cannot be accounted for by asymmetries within either precortical cardinal mechanism. Instead, the results may point to neural correlates of a higher-level perceptual representation of surface colors.

Fast periodic visual stimulation to highlight the relationship between human intracerebral recordings and scalp electroencephalography

Despite being of primary importance for fundamental research and clinical studies, the relationship between local neural population activity and scalp electroencephalography (EEG) in humans remains largely unknown. Here we report simultaneous scalp and intracerebral EEG responses to face stimuli in a unique epileptic patient implanted with 27 intracerebral recording contacts in the right occipitotemporal cortex. The patient was shown images of faces appearing at a frequency of 6 Hz, which elicits neural responses at this exact frequency. Response quantification at this frequency allowed to objectively relate the neural activity measured inside and outside the brain. The patient exhibited typical 6 Hz responses on the scalp at the right occipitotemporal sites. Moreover, there was a clear spatial correspondence between these scalp responses and intracerebral signals in the right lateral inferior occipital gyrus, both in amplitude and in phase. Nevertheless, the signal measured on the scalp and inside the brain at nearby locations showed a 10-fold difference in amplitude due to electrical insulation from the head. To further quantify the relationship between the scalp and intracerebral recordings, we used an approach correlating time-varying signals at the stimulation frequency across scalp and intracerebral channels. This analysis revealed a focused and right-lateralized correspondence between the scalp and intracerebral recordings that were specific to the face stimulation is more broadly distributed in various control situations. These results demonstrate the interest of a frequency tagging approach in characterizing the electrical propagation from brain sources to scalp EEG sensors and in identifying the cortical sources of brain functions from these recordings.

Unconscious Number Discrimination in the Human Visual System

How do humans compute approximate number? According to one influential theory, approximate number representations arise in the intraparietal sulcus and are amodal, meaning that they arise independent of any sensory modality. Alternatively, approximate number may be computed initially within sensory systems. Here we tested for sensitivity to approximate number in the visual system using steady state visual evoked potentials. We recorded electroencephalography from humans while they viewed dotclouds presented at 30 Hz, which alternated in numerosity (ranging from 10 to 20 dots) at 15 Hz. At this rate, each dotcloud backward masked the previous dotcloud, disrupting top-down feedback to visual cortex and preventing conscious awareness of the dotclouds' numerosities. Spectral amplitude at 15 Hz measured over the occipital lobe (Oz) correlated positively with the numerical ratio of the stimuli, even when nonnumerical stimulus attributes were controlled, indicating that subjects' visual systems were differentiating dotclouds on the basis of their numerical ratios. Crucially, subjects were unable to discriminate the numerosities of the dotclouds consciously, indicating the backward masking of the stimuli disrupted reentrant feedback to visual cortex. Approximate number appears to be computed within the visual system, independently of higher-order areas, such as the intraparietal sulcus.

An objective and reliable electrophysiological marker for implicit trustworthiness perception

Trustworthiness is assumed to be processed implicitly from faces, despite the fact that the overwhelming majority of research has only involved explicit trustworthiness judgements. To answer the question whether or not trustworthiness processing can be implicit, we apply an electroencephalography fast periodic visual stimulation (FPVS) paradigm, where electrophysiological cortical activity is triggered in synchrony with facial trustworthiness cues, without explicit judgements. Face images were presented at 6 Hz, with facial trustworthiness varying at 1 Hz. Significant responses at 1 Hz were observed, indicating that differences in the trustworthiness of the faces were reflected in the neural signature. These responses were significantly reduced for inverted faces, suggesting that the results are associated with higher order face processing. The neural responses were reliable, and correlated with explicit trustworthiness judgements, suggesting that the technique is capable of picking up on stable individual differences in trustworthiness processing. By demonstrating neural activity associated with implicit trustworthiness judgements, our results contribute to resolving a key theoretical debate. Moreover, our data show that FPVS is a valuable tool to examine face processing at the individual level, with potential application in pre-verbal and clinical populations who struggle with verbalization, understanding or memory.

Nonlinear transduction of emotional facial expression

To create neural representations of external stimuli, the brain performs a number of processing steps that transform its inputs. For fundamental attributes, such as stimulus contrast, this involves one or more nonlinearities that are believed to optimise the neural code to represent features of the natural environment. Here we ask if the same is also true of more complex stimulus dimensions, such as emotional facial expression. We report the results of three experiments combining morphed facial stimuli with electrophysiological and psychophysical methods to measure the function mapping emotional expression intensity to internal response. The results converge on a nonlinearity that accelerates over weak expressions, and then becomes shallower for stronger expressions, similar to the situation for lower level stimulus properties. We further demonstrate that the nonlinearity is not attributable to the morphing procedure used in stimulus generation.

An ecological measure of rapid and automatic face-sex categorization

Sex categorization is essential for mate choice and social interactions in many animal species. In humans, sex categorization is readily performed from the face. However, clear neural markers of face-sex categorization, i.e., common responses to widely variable individuals from one sex, have not been identified so far in humans. To isolate a direct signature of rapid and automatic face-sex categorization generalized across a wide range of variable exemplars, we recorded scalp electroencephalogram (EEG) from 32 participants (16 females) while they were exposed to variable natural face images from one sex alternating at a rapid rate of 6 Hz (i.e., 6 images per second). Images from the other sex were inserted every 6th stimulus (i.e., at a 1-Hz rate). A robust categorization response to both sex contrasts emerged at 1 Hz and harmonics in the EEG frequency spectrum over the occipito-temporal cortex of most participants. The response was larger for female faces presented among male faces than the reverse, suggesting that the two sex categories are not equally homogenous. This asymmetrical response pattern disappeared for upside-down faces, ruling out the contribution of low-level physical variability across images. Overall, these observations demonstrate that sex categorization occurs automatically after a single glance at natural face images and can be objectively isolated and quantified in the human brain within a few minutes.

Effects of Monocular Perceptual Learning on Binocular Visual Processing in Adolescent and Adult Amblyopia

Re-establishing normal binocular visual processing is the key to amblyopia recovery beyond the critical period of visual development. Here, by combining perceptual learning, behavioral testing, and steady-state visually evoked potentials (SSVEPs), we examined how monocular perceptual learning in the amblyopic eye could change binocular visual processing in the adolescent and adult amblyopic visual system. We found that training reduced the interocular difference between amblyopic and fellow eyes and increased the amplitude of a binocular SSVEP component, with a significant negative correlation between the two measures. Our results demonstrate that training in the amblyopic eye primarily improves binocular rather than monocular visual processing in the amblyopic visual system, suggesting that behavioral training could potentially address key neural deficits in adolescent and adult amblyopia.

The bottom-up and top-down processing of faces in the human occipitotemporal cortex

Although face processing has been studied extensively, the dynamics of how face-selective cortical areas are engaged remains unclear. Here, we uncovered the timing of activation in core face-selective regions using functional Magnetic Resonance Imaging and Magnetoencephalography in humans. Processing of normal faces started in the posterior occipital areas and then proceeded to anterior regions. This bottom-up processing sequence was also observed even when internal facial features were misarranged. However, processing of two-tone Mooney faces lacking explicit prototypical facial features engaged top-down projection from the right posterior fusiform face area to right occipital face area. Further, face-specific responses elicited by contextual cues alone emerged simultaneously in the right ventral face-selective regions, suggesting parallel contextual facilitation. Together, our findings chronicle the precise timing of bottom-up, top-down, as well as context-facilitated processing sequences in the occipital-temporal face network, highlighting the importance of the top-down operations especially when faced with incomplete or ambiguous input.

An objective, sensitive and ecologically valid neural measure of rapid human individual face recognition

Humans may be the only species able to rapidly and automatically recognize a familiar face identity in a crowd of unfamiliar faces, an important social skill. Here, by combining electroencephalography (EEG) and fast periodic visual stimulation (FPVS), we introduce an ecologically valid, objective and sensitive neural measure of this human individual face recognition function. Natural images of various unfamiliar faces are presented at a fast rate of 6 Hz, allowing one fixation per face, with variable natural images of a highly familiar face identity, a celebrity, appearing every seven images (0.86 Hz). Following a few minutes of stimulation, a high signal-to-noise ratio neural response reflecting the generalized discrimination of the familiar face identity from unfamiliar faces is observed over the occipito-temporal cortex at 0.86 Hz and harmonics. When face images are presented upside-down, the individual familiar face recognition response is negligible, being reduced by a factor of 5 over occipito-temporal regions. Differences in the magnitude of the individual face recognition response across different familiar face identities suggest that factors such as exposure, within-person variability and distinctiveness mediate this response. Our findings of a biological marker for fast and automatic recognition of individual familiar faces with ecological stimuli open an avenue for understanding this function, its development and neural basis in neurotypical individual brains along with its pathology. This should also have implications for the use of facial recognition measures in forensic science.

Reduced neural sensitivity to rapid individual face discrimination in autism spectrum disorder

Background

Individuals with autism spectrum disorder (ASD) are characterized by impairments in social communication and interaction. Although difficulties at processing social signals from the face in ASD have been observed and emphasized for many years, there is a lot of inconsistency across both behavioral and neural studies.

Methods

We recorded scalp electroencephalography (EEG) in 23 8-to-12 year old boys with ASD and 23 matched typically developing boys using a fast periodic visual stimulation (FPVS) paradigm, providing objective (i.e., frequency-tagged), fast (i.e., few minutes) and highly sensitive measures of rapid face categorization, without requiring any explicit face processing task. We tested both the sensitivity to rapidly (i.e., at a glance) categorize faces among other objects and to individuate unfamiliar faces.

Outcomes

While general neural synchronization to the visual stimulation and neural responses indexing generic face categorization were undistinguishable between children with ASD and typically developing controls, neural responses indexing individual face discrimination over the occipito-temporal cortex were substantially reduced in the individuals with ASD. This difference vanished when faces were presented upside-down, due to the lack of significant face inversion effect in ASD.

Interpretation

These data provide original evidence for a selective high-level impairment in individual face discrimination in ASD in an implicit task. The objective and rapid assessment of this function opens new perspectives for ASD diagnosis in clinical settings.

•

We assess implicit face processing in ASD via Fast Periodic Visual Stimulation EEG.

•

Rapid categorization of a face as a face is not impaired in children with ASD.

•

Individual face discrimination is selectively impaired in ASD.

•

Children with ASD show no face inversion effect.

•

FPVS-EEG opens new perspectives for clinical settings.

An objective neural signature of rapid perspective taking

The frequency-tagging approach has generally been confined to study low-level sensory processes and always found related activation over the occipital region. Here for the first time, we investigated with it, high-level socio-cognitive functions, i.e. the processing of what other people are looking at which is referred to as level 1 visual perspective taking (VPT). Sixteen participants were presented with visual scenes alternating at 2.5 Hz which were depicting a person and an object in a room, while recording electrophysiological brain activity. The person orientation and object position changed at every stimulus but the person in the room always faced the object, except on every fifth stimulus. We found responses in the electroencephalography (EEG) spectrum exactly at the frequency corresponding to the presentation of the scenes where the person could not see the object, i.e. 0.5 Hz. While the 2.5 Hz stimulation rate response focused on typical medial occipital sites, the specific 0.5 Hz response was found mainly over a centro-parietal region. Besides a robust group effect, these responses were significant and quantifiable for most individual participants. Overall, these observations reveal a clear measure of level 1-VPT representation, highlighting the potential of EEG frequency-tagging to capture high-level socio-cognitive functions in the brain.