Spatial and temporal attention modulate the early stages of face processing: behavioural evidence from a reaching paradigm

Visual periodicity reveals distinct attentional signatures for face and non-face categories

Observers can selectively deploy attention to regions of space, moments in time, specific visual features, individual objects, and even specific high-level categories-for example, when keeping an eye out for dogs while jogging. Here, we exploited visual periodicity to examine how category-based attention differentially modulates selective neural processing of face and non-face categories. We combined electroencephalography with a novel frequency-tagging paradigm capable of capturing selective neural responses for multiple visual categories contained within the same rapid image stream (faces/birds in Exp 1; houses/birds in Exp 2). We found that the pattern of attentional enhancement and suppression for face-selective processing is unique compared to other object categories: Where attending to non-face objects strongly enhances their selective neural signals during a later stage of processing (300-500 ms), attentional enhancement of face-selective processing is both earlier and comparatively more modest. Moreover, only the selective neural response for faces appears to be actively suppressed by attending towards an alternate visual category. These results underscore the special status that faces hold within the human visual system, and highlight the utility of visual periodicity as a powerful tool for indexing selective neural processing of multiple visual categories contained within the same image sequence.

Movement trajectories as a window into the dynamics of emerging neural representations

The rapid transformation of sensory inputs into meaningful neural representations is critical to adaptive human behaviour. While non-invasive neuroimaging methods are the de-facto method for investigating neural representations, they remain expensive, not widely available, time-consuming, and restrictive. Here we show that movement trajectories can be used to measure emerging neural representations with fine temporal resolution. By combining online computer mouse-tracking and publicly available neuroimaging data via representational similarity analysis (RSA), we show that movement trajectories track the unfolding of stimulus- and category-wise neural representations along key dimensions of the human visual system. We demonstrate that time-resolved representational structures derived from movement trajectories overlap with those derived from M/EEG (albeit delayed) and those derived from fMRI in functionally-relevant brain areas. Our findings highlight the richness of movement trajectories and the power of the RSA framework to reveal and compare their information content, opening new avenues to better understand human perception.

A reach-to-touch investigation on the nature of reading in the Stroop task

In a Stroop task, participants can be presented with a color name printed in color and need to classify the print color while ignoring the word. The Stroop effect is typically calculated as the difference in mean response time (RT) between congruent (e.g., the word RED printed in red) and incongruent (GREEN in red) trials. Delta plots compare not just mean performance, but the entire RT distributions of congruent and incongruent conditions. However, both mean RT and delta plots have some limitations. Arm-reaching trajectories allow a more continuous measure for assessing the time course of the Stroop effect. We compared arm movements to congruent and incongruent stimuli in a standard Stroop task and a control task that encourages processing of each and every word. The Stroop effect emerged over time in the control task, but not in the standard Stroop, suggesting words may be processed differently in the two tasks.

Processing of masked and unmasked emotional faces under different attentional conditions: an electrophysiological investigation

In order to investigate the interactions between non-spatial selective attention, awareness and emotion processing, we carried out an ERP study using a backward masking paradigm, in which angry, fearful, happy, and neutral facial expressions were presented, while participants attempted to detect the presence of one or the other category of facial expressions in the different experimental blocks. ERP results showed that negative emotions enhanced an early N170 response over temporal-occipital leads in both masked and unmasked conditions, independently of selective attention. A later effect arising at the P2 was linked to awareness. Finally, selective attention was found to affect the N2 and N3 components over occipito-parietal leads. Our findings reveal that (i) the initial processing of facial expressions arises prior to attention and awareness; (ii) attention and awareness give rise to temporally distinct periods of activation independently of the type of emotion with only a partial degree of overlap; and (iii) selective attention appears to be influenced by the emotional nature of the stimuli, which in turn impinges on unconscious processing at a very early stage. This study confirms previous reports that negative facial expressions can be processed rapidly, in absence of visual awareness and independently of selective attention. On the other hand, attention and awareness may operate in a synergistic way, depending on task demand.

Gaining the upper hand: evidence of vertical asymmetry in sex-categorisation of human hands

Visual perception is characterised by asymmetries arising from the brain's preferential response to particular stimulus types at different retinal locations. Where the lower visual field (LVF) holds an advantage over the upper visual field (UVF) for many tasks (e.g., hue discrimination, contrast sensitivity, motion processing), face-perception appears best supported at above-fixation locations (Quek & Finkbeiner, 2014a). This finding is consistent with Previc's (1990) suggestion that vision in the UVF has become specialised for object recognition processes often required in "extrapersonal" space. Outside of faces, however, there have been very few investigations of vertical asymmetry effects for higher-level objects. Our aim in the present study was, thus, to determine whether the UVF advantage reported for face-perception would extend to a nonface object - human hands. Participants classified the sex of hand images presented above or below central fixation by reaching out to touch a left or right response panel. On each trial, a briefly presented spatial cue captured the participant's spatial attention to either the location where the hand was about to appear (valid cue) or the opposite location (invalid cue). We observed that cue validity only modulated the efficiency of the sex-categorisation response for targets in the LVLVF and not the UVF, just as we have reported previously for face-sex categorisation (Quek & Finkbeiner, 2014a). Taken together, the data from these studies provide some empirical support for Previc's (1990) speculation that object recognition processes may enjoy an advantage in the upper-hemifield.

The negative compatibility effect with relevant masks: a case for automatic motor inhibition

For many years controversy has surrounded the so-called "negative compatibility effect" (NCE), a surprising phenomenon whereby responses to a target stimulus are delayed when the target is preceded by an unconscious, response-compatible prime. According to proponents of the "self-inhibition" hypothesis, the NCE occurs when a low-level self-inhibitory mechanism supresses early motor activations that are no longer supported by perceptual evidence. This account has been debated, however, by those who regard the NCE to be a stimulus-specific phenomenon that can be explained without recourse to a self-inhibitory mechanism. The present study used a novel reach-to-touch paradigm to test whether unconscious response priming would manifest as motor activation of the opposite-to-prime response (supporting mask-induced priming accounts), or motor inhibition of the primed response (supporting the notion of low-level self-inhibition). This paper presents new findings that show the emergence of positive and negative compatibility effects as they occur in stimulus processing time. In addition, evidence is provided suggesting that the NCE is not driven by the activation of the incorrect, "opposite-to-prime" response, but rather might reflect automatic motor inhibition.