Conscious perception of fear in faces: Insights from high-density EEG and perceptual awareness scale with threshold stimuli

Contrary to the extensive research on processing subliminal and/or unattended emotional facial expressions, only a minority of studies have investigated the neural correlates of consciousness (NCCs) of emotions conveyed by faces. In the present high-density electroencephalography (EEG) study, we first employed a staircase procedure to identify each participant's perceptual threshold of the emotion expressed by the face and then compared the EEG signals elicited in trials where the participants were aware with the activity elicited in trials where participants were unaware of the emotions expressed by these, otherwise identical, faces. Drawing on existing knowledge of the neural mechanisms of face processing and NCCs, we hypothesized that activity in frontal electrodes would be modulated in relation to participants' awareness of facial emotional content. More specifically, we hypothesized that the NCC of fear seen on someone else's face could be detected as a modulation of a later and more anterior (i.e., at frontal sites) event-related potential (ERP) than the face-sensitive N170. By adopting a data-driven approach and cluster-based statistics to the analysis of EEG signals, the results were clear-cut in showing that visual awareness of fear was associated with the modulation of a frontal ERP component in a 150-300 msec interval. These insights are dissected and contextualized in relation to prevailing theories of visual consciousness and their proposed NCC benchmarks.

On target selection as reflected by posterior ERP components in feature-guided visual search

The N2pc event-related potential is a widely studied ERP component that reflects the covert deployment of visuo-spatial attention to target stimuli displayed laterally relative to fixation. Recently, an analogous ERP component, named N2pcb, has been proposed as a marker of the deployment of visuo-spatial attention to targets displayed on the vertical midline. Two studies that investigated the N2pcb component found analogous results, using however two different algorithms to compute the amplitude of N2pcb. One study subtracted the ipsilateral activity elicited by a lateral target from the bilateral activity elicited by a target displayed on the vertical midline, whereas the other study subtracted the bilateral activity elicited by target-absent displays from the bilateral activity elicited by a target displayed on the vertical midline. Here we show both algorithms estimate properly the N2pc as well as the N2pcb components. In addition, we explored whether the singleton detection positivity (SDP) component, a posterior bilateral positivity temporally concomitant to N2pc recently reported in studies using singleton search, could be observed in the present study in which a target was defined by a combination of features. Given that such component was indeed found using feature search, we named this component posterior processing positivity (PPP), and showed that bilateral activity elicited by target-absent displays is an adequate baseline for its correct isolation.

A bilateral SPCN is elicited by to-be-memorized visual stimuli displayed along the vertical midline

We recently showed that deploying attention to target stimuli displayed along the vertical meridian elicits a bilateral N2pc, that we labeled N2pcb (Psychophysiology). Here we investigated whether a different component, the sustained posterior contralateral negativity (SPCN), shows the same property when a varying number of visual stimuli are displayed either laterally or on the vertical meridian. We displayed one or two cues that designated candidate targets to be detected in a search array that was displayed after a retention interval. The cues were either on the horizontal meridian or on the vertical meridian. When the cues were on the horizontal meridian, we observed an N2pc followed by an SPCN in their classic form, as negativity increments contralateral to the cues. As expected, SPCN amplitude was greater when two cues had to be memorized than when only one cue had to be memorized. When the cues were on the vertical meridian, we observed an N2pcb followed by a bilateral SPCN (or SPCNb). Critically, like SPCN, SPCNb amplitude was greater when two cues had to be memorized than when only one cue had to be memorized. A series of additional parametrical and topographical comparisons between N2pcb and SPCNb revealed similarities but also some important differences between these two components that we interpreted as evidence for their distinct neural sources.

We challenge the view that the SPCN ERP component cannot track the memory maintenance of objects displayed along the vertical meridian. Owing to the receptive fields of posterior neurons straddling on the intersection of the two visual hemifields, bilateral N2pc (N2pcb) and SPCN (SPCNb) activity can be detected using a cued visual search design.

A neural network predicting the amplitude of the N2pc in individual EEG datasets

Objective.The N2pc is a small amplitude transient interhemispheric voltage asymmetry used in cognitive neuroscience to investigate subject's allocation of selective visuo-spatial attention. N2pc is typically estimated by averaging the sweeps of the electroencephalographic (EEG) signal but, in absence of explicit normative indications, the number of sweeps is often based on arbitrariness or personal experience. With the final aim of reducing duration and cost of experimental protocols, here we developed a new approach to reliably predict N2pc amplitude from a minimal EEG dataset.Approach.First, features predictive of N2pc amplitude were identified in the time-frequency domain. Then, an artificial neural network (NN) was trained to predict N2pc mean amplitude at the individual level. By resorting to simulated data, accuracy of the NN was assessed by computing the mean squared error (MSE) and the amplitude discretization error (ADE) and compared to the standard time averaging (TA) technique. The NN was then tested against two real datasets consisting of 14 and 12 subjects, respectively.Main result.In simulated scenarios entailing different number of sweeps (between 10 and 100), the MSE obtained with the proposed method resulted, on average, 1/5 of that obtained with the TA technique. Implementation on real EEG datasets showed that N2pc amplitude could be reliably predicted with as few as 40 EEG sweeps per cell of the experimental design.Significance.The developed approach allows to reduce duration and cost of experiments involving the N2pc, for instance in studies investigating attention deficits in pathological subjects.

A Time-Frequency Analysis for the Online Detection of the N2pc Event-Related Potential (ERP) Component in Individual EEG Datasets

The N2pc event-related potential component measures direction and time course of selective visual attention and represents an important biomarker in cognitive neuroscience. While its subtractive origin strongly influences the amplitude, thus hindering its detection, other external factors, such as subject's inefficiency to allocate attention to the cued target, or the heterogeneity of the visual context, may strongly affect the elicitation of the component itself. It would therefore be extremely important to create a tool that, using as few sweeps as possible, could reliably establish whether an N2pc is present in an individual subject. In the present work, we propose an approach by resorting to a time-frequency analysis of N2pc individual signals; in particular, power at each frequency band (α/β/δ/θ) was computed in the N2 time range and correlated to the estimated amplitude of the N2pc. Preliminary results on fourteen human volunteers of a visual search design showed a very high correlation coefficient (over 0.9) between the low frequency bands power and the mean absolute amplitude of the component, using only 40 sweeps. Results also seemed to suggest that N2pc amplitude values higher than 0.5 μV could be accurately classified according to time-frequency indices.Clinical Relevance - The online detection of the N2pc presence in individual EEG datasets would allow not only to study the factors responsible of N2pc variability across subjects and conditions, but also to investigate novel search variants on participants with a predisposition to show an N2pc, reducing time and costs and the possibility to obtain biased results.

Distilling the distinct contralateral and ipsilateral attentional responses to lateral stimuli and the bilateral response to midline stimuli for upper and lower visual hemifield locations

A contralateral posterior negativity elicited by lateral oddballs (N2pc) and a bilateral posterior negativity elicited by vertical midline oddballs (bilateral N2) are ERP components reflecting attentional deployment that have been rarely compared. In different tasks, we explored to what extent they reflect similar underlying mechanisms of attention. We used a multiple-frame procedure to present pop-out color oddballs among distractors. A homogeneous condition contained only distractors (0 oddballs) and served as a control condition that was subtracted from oddball-present conditions to isolate attention effects. The number of oddballs and the vertical hemifield containing them (upper vs. lower) were two critical factors. For the lower hemifield, the signal amplitude increased with the number of oddballs, otherwise had similar effects and scalp distributions, suggesting the bilateral N2 acted as a bilateral N2pc and likely reflected similar underlying generators. For the upper hemifield, component amplitude also increased with the number of oddballs, but the scalp distributions were positive and more centered, suggesting inverted generators across the two vertical hemifields. An ipsilateral positivity occurred about 50 ms after a contralateral positivity, similar in magnitude, producing a biphasic contra-minus-ipsi difference wave. Previously reported smaller negative N2pc components for upper hemifield oddballs likely reflected a negative lobe artificially created by the subtraction of a lagged positive ipsilateral response. The results compel us to argue for a systematic separation of data for upper versus lower hemifields in studies of visuo-spatial attention, and the use of an experimental design permitting the separate estimation of contralateral and ipsilateral responses.

Multishell Diffusion MRI-Based Tractography of the Facial Nerve in Vestibular Schwannoma

BACKGROUND AND PURPOSE

Tractography of the facial nerve based on single-shell diffusion MR imaging is thought to be helpful before surgery for resection of vestibular schwannoma. However, this paradigm can be vitiated by the isotropic diffusion of the CSF, the convoluted path of the facial nerve, and its crossing with other bundles. Here we propose a multishell diffusion MR imaging acquisition scheme combined with probabilistic tractography that has the potential to provide a presurgical facial nerve reconstruction uncontaminated by such effects.

MATERIALS AND METHODS

Five patients scheduled for vestibular schwannoma resection underwent multishell diffusion MR imaging (b-values = 0, 300, 1000, 2000 s/mm²). Facial nerve tractography was performed with a probabilistic algorithm and anatomic seeds located in the brain stem, cerebellopontine cistern, and internal auditory canal. A single-shell diffusion MR imaging (b-value = 0, 1000 s/mm²) subset was extrapolated from the multishell diffusion MR imaging data. The quality of the facial nerve reconstruction based on both multishell diffusion MR imaging and single-shell diffusion MR imaging sequences was assessed against intraoperative videos recorded during the operation.

RESULTS

Single-shell diffusion MR imaging-based tractography was characterized by failures in facial nerve tracking (2/5 cases) and inaccurate facial nerve reconstructions displaying false-positives and partial volume effects. In contrast, multishell diffusion MR imaging-based tractography provided accurate facial nerve reconstructions (4/5 cases), even in the presence of ostensibly complex patterns.

CONCLUSIONS

In comparison with single-shell diffusion MR imaging, the combination of multishell diffusion MR imaging-based tractography and probabilistic algorithms is a more valuable aid for surgeons before vestibular schwannoma resection, providing more accurate facial nerve reconstructions, which may ultimately improve the postsurgical patient's outcome.

Computer data simulator to assess the accuracy of estimates of visual N2/N2pc event-related potential components

OBJECTIVE

Event-related potentials (ERPs) evoked by visual stimulations comprise several components, with different amplitudes and latencies. Among them, the N2 and N2pc components have been demonstrated to be a measure of subjects' allocation of visual attention to possible targets and to be involved in the suppression of irrelevant items. Unfortunately, the N2 and N2pc components have smaller amplitudes compared with those of the background electroencephalogram (EEG), and their measurement requires employing techniques such as conventional averaging, which in turn necessitates several sweeps to provide acceptable estimates. In visual search studies, the number of sweeps (Nswp) used to extrapolate reliable estimates of N2/N2pc components has always been somehow arbitrary, with studies using 50-500 sweeps. In-silico studies relying on synthetic data providing a close-to-realistic fit to the variability of the visual N2 component and background EEG signals are therefore needed to go beyond arbitrary choices in this context.

APPROACH

In the present work, we sought to take a step in this direction by developing a simulator of ERP variations in the N2 time range based on real experimental data while monitoring variations in the estimation accuracy of N2/N2pc components as a function of two factors, i.e. signal-to-noise ratio (SNR) and number of averaged sweeps.

MAIN RESULTS

The results revealed that both Nswp and SNR had a strong impact on the accuracy of N2/N2pc estimates. Critically, the present simulation showed that, for a given level of SNR, a non-arbitrary Nswp could be parametrically determined, after which no additional significant improvements in noise suppression and N2/N2pc accuracy estimation were observed.

SIGNIFICANCE

The present simulator is thought to provide investigators with quantitative guidelines for designing experimental protocols aimed at improving the detection accuracy of N2/N2pc components. The parameters of the simulator can be tuned, adapted, or integrated to fit other ERP modulations.

Reward motivation and neurostimulation interact to improve working memory performance in healthy older adults: A simultaneous tDCS-fNIRS study

Several studies have evaluated the effect of anodal transcranial direct current stimulation (tDCS) over the prefrontal cortex (PFC) for the enhancement of working memory (WM) performance in healthy older adults. However, the mixed results obtained so far suggest the need for concurrent brain imaging, in order to more directly examine tDCS effects. The present study adopted a continuous multimodal approach utilizing functional near-infrared spectroscopy (fNIRS) to examine the interactive effects of tDCS combined with manipulations of reward motivation. Twenty-one older adults (mean age = 69.7 years; SD = 5.05) performed an experimental visuo-spatial WM task before, during and after the delivery of 1.5 mA anodal tDCS/sham over the left prefrontal cortex (PFC). During stimulation, participants received performance-contingent reward for every fast and correct response during the WM task. In both sessions, hemodynamic activity of the bilateral frontal, motor and parietal areas was recorded across the entire duration of the WM task. Cognitive functions and reward sensitivity were also assessed with standard measures. Results demonstrated a significant impact of tDCS on both WM performance and hemodynamic activity. Specifically, faster responses in the WM task were observed both during and after anodal tDCS, while no differences were found under sham control conditions. However, these effects emerged only when taking into account individual visuo-spatial WM capacity. Additionally, during and after the anodal tDCS, increased hemodynamic activity relative to sham was observed in the bilateral PFC, while no effects of tDCS were detected in the motor and parietal areas. These results provide the first evidence of tDCS-dependent functional changes in PFC activity in healthy older adults during the execution of a WM task. Moreover, they highlight the utility of combining reward motivation with prefrontal anodal tDCS, as a potential strategy to improve WM efficiency in low performing healthy older adults.

N2pc reflects two modes for coding the number of visual targets

Humans share with a variety of animal species the spontaneous ability to detect the numerical correspondence between limited quantities of visual objects and discrete auditory events. Here, we explored how such mental representation is generated in the visual modality by monitoring a parieto-occipital ERP component, N2pc, whose amplitude covaries with the number of visual targets in explicit enumeration. Participants listened to an auditory sequence of one to three tones followed by a visual search display containing one to three targets. In Experiment 1, participants were asked to respond based on the numerical correspondence between tones and visual targets. In Experiment 2, participants were asked to ignore the tones and detect a target presence in the search display. The results of Experiment 1 showed an N2pc amplitude increase determined by the number of visual targets followed by a centroparietal ERP component modulated by the numerical correspondence between tones and visual targets. The results of Experiment 2 did not show an N2pc amplitude increase as a function of the number of visual targets. However, the numerical correspondence between tones and visual targets influenced N2pc amplitude. By comparing a subset of amplitude/latency parameters between Experiment 1 and 2, the present results suggest N2pc reflects two modes for representing the number of visual targets. One mode, susceptible to subjective control, relies on visual target segregation for exact target individuation, whereas a different mode, likely enabling spontaneous cross-modal matching, relies on the extraction of rough information about number of targets from visual input.

On the Role of the Inferior Intraparietal Sulcus in Visual Working Memory for Lateralized Single-feature Objects

A consolidated practice in cognitive neuroscience is to explore the properties of human visual working memory through the analysis of electromagnetic signals using cued change detection tasks. Under these conditions, EEG/MEG activity increments in the posterior parietal cortex scaling with the number of memoranda are often reported in the hemisphere contralateral to the objects' position in the memory array. This highly replicable finding clashes with several reported failures to observe compatible hemodynamic activity modulations using fMRI or fNIRS in comparable tasks. Here, we reconcile this apparent discrepancy by acquiring fMRI data on healthy participants and employing a cluster analysis to group voxels in the posterior parietal cortex based on their functional response. The analysis identified two distinct subpopulations of voxels in the intraparietal sulcus (IPS) showing a consistent functional response among participants. One subpopulation, located in the superior IPS, showed a bilateral response to the number of objects coded in visual working memory. A different subpopulation, located in the inferior IPS, showed an increased unilateral response when the objects were displayed contralaterally. The results suggest that a cluster of neurons in the inferior IPS is a candidate source of electromagnetic contralateral responses to working memory load in cued change detection tasks.

The Attentional Blink Impairs Detection and Delays Encoding of Visual Information: Evidence from Human Electrophysiology

This article explores the time course of the functional interplay between detection and encoding stages of information processing in the brain and the role they play in conscious visual perception. We employed a multitarget rapid serial visual presentation (RSVP) approach and examined the electrophysiological P3 component elicited by a target terminating an RSVP sequence. Target-locked P3 activity was detected both at frontal and parietal recording sites and an independent component analysis confirmed the presence of two distinct P3 components. The posterior P3b varied with intertarget lag, with diminished amplitude and postponed latency at short relative to long lags—an electroencephalographic signature of the attentional blink (AB). Under analogous conditions, the anterior P3a was also reduced in amplitude but did not vary in latency. Collectively, the results provide an electrophysiological record of the interaction between frontal and posterior components linked to detection (P3a) and encoding (P3b) of visual information. Our findings suggest that, although the AB delays target encoding into working memory, it does not slow down detection of a target but instead reduces the efficacy of this process. A functional characterization of P3a in attentive tasks is discussed with reference to current models of the AB phenomenon.

The attentional blink freezes spatial attention allocation to targets, not distractors: evidence from human electrophysiology

Previous work found a significant reduction of the amplitude of the N2pc ERP component during the attentional blink in response to lateral visual targets, suggesting that the allocation of attention to visual targets is impaired during the attentional blink. Recent theorizing on the processes reflected by the N2pc suggests the possibility of distinct sets of neural mechanisms underlying its generation, one responsible for target activation, and one for distractor inhibition. To disentangle whether either or both of these mechanisms are impaired during the attentional blink, an RSVP sequence of circles, equidistant from fixation was used. The first target frame (T1) contained the same repeated target colour circle and target whereas the second target frame (T2) contained a distractor colour singleton as well as a target colour singleton. Only the target or only the distractor was presented at a lateral position; the other singleton was presented on the vertical midline so as not to elicit any event-related lateralization. Impaired T2 report accuracy at a short stimulus-onset asynchrony (SOA) was accompanied by a significant delay of the N2pc to lateral T2 targets when compared to a long SOA condition. No such delay was found when the lateralized stimulus was a distractor, suggesting that the attentional blink impacts attention allocation to targets, not distractors. We also observed a lateralized component earlier than the N2pc, a posterior contralateral positivity (Ppc) that did not depend on T1-T2 SOA and that was elicited by both lateral targets and distractors. We conclude that, contrary to N2pc, the Ppc likely reflects activity of bottom-up mechanisms responding unselectively to asymmetrical visual displays.

Colour-specific differences in attentional deployment for equiluminant pop-out colours: evidence from lateralised potentials

We investigated how target colour affected behavioural and electrophysiological results in a visual search task. Perceptual and attentional mechanisms were tracked using the N2pc component of the event-related potential and other lateralised components. Four colours (red, green, blue, or yellow) were calibrated for each participant for luminance through heterochromatic flicker photometry and equated to the luminance of grey distracters. Each visual display contained 10 circles, 1 colored and 9 grey, each of which contained an oriented line segment. The task required deploying attention to the colored circle, which was either in the left or right visual hemifield. Three lateralised ERP components relative to the side of the lateral coloured circle were examined: a posterior contralateral positivity (Ppc) prior to N2pc, the N2pc, reflecting the deployment of visual spatial attention, and a temporal and contralateral positivity (Ptc) following N2pc. Red or blue stimuli, as compared to green or yellow, had an earlier N2pc. Both the Ppc and Ptc had higher amplitudes to red stimuli, suggesting particular selectivity for red. The results suggest that attention may be deployed to red and blue more quickly than to other colours and suggests special caution when designing ERP experiments involving stimuli in different colours, even when all colours are equiluminant.

Exploring the role of primary and supplementary motor areas in simple motor tasks with fNIRS

Studies employing functional magnetic resonance imaging (fMRI) have highlighted a covariation between the amplitude of hemodynamic responses recorded in primary and supplementary motor areas (M1 and SMA) and the duration of a motor task. A subset of these studies have hinted to a possible functional dissociation between processing carried out in these areas, with SMA primarily involved in action preparation, while M1 involved in action execution. This proposed functional dissociation was explored in the present study using a different technique--functional near-infrared spectroscopy--which enabled a finer-grained monitoring of the temporal characteristics of the hemodynamic response compared to fMRI. Here, hemodynamic responses in M1 and SMA were recorded in 7 participants during a right-finger-tapping task of short (1 s) or long (3 s) duration. Hemodynamic responses of larger amplitude were recorded from both contralateral M1 and SMA during long-duration than short-duration tapping. Furthermore, the analysis of the temporal profiles of these responses revealed a more sustained and prolonged activity for long-duration versus short-duration tapping in M1, but not in SMA. Rather than functionally dissociable areas, the present results are more compatible with the hypothesis that M1 and SMA subserve different, though strongly interacting, functional subroutines subtended in motor task preparation and execution.

N1pc reversal following repeated eccentric visual stimulation

Early event-related potential (ERP) hemispheric asymmetries recorded at occipitoparietal sites are usually observed following the sudden onset of a lateral peripheral stimulus. This is usually reflected in an onset-locked larger N1 over the posterior contralateral hemisphere relative to the ipsilateral hemisphere, an early ERP asymmetry labeled N1pc. When the peripheral sudden onset is followed by a central stimulus, or by a bilaterally balanced visual array of stimuli, these events evoke a reversed N1pc, that is, a larger N1 over the hemisphere ipsilateral to the peripheral sudden onset. This N1pc reversal has been taken as evidence for a remapping of the visual space from an absolute, retinally based frame of reference to a relative, attentionally based frame of reference that codes the spatial positions of objects relative to the peripheral sudden onset, rather than relative to the fovea. Here, we pit the reference frame-remapping account against an alternative account based on reduced neural reactivity following the peripheral sudden onset. In three experiments, we varied the spatial location of an object relative to a preceding sudden onset, and tested the opposite predictions generated by the frame-remapping and the reduced neural reactivity accounts. Taken together, the results from the present experiments were consistent with the reduced neural reactivity account and inconsistent with the frame-remapping account.

Taking one's time in feeling other-race pain: an event-related potential investigation on the time-course of cross-racial empathy

Using the event-related potential (ERP) approach, we tracked the time-course of white participants' empathic reactions to white (own-race) and black (other-race) faces displayed in a painful condition (i.e. with a needle penetrating the skin) and in a nonpainful condition (i.e. with Q-tip touching the skin). In a 280-340 ms time-window, neural responses to the pain of own-race individuals under needle penetration conditions were amplified relative to neural responses to the pain of other-race individuals displayed under analogous conditions. This ERP reaction to pain, whose source was localized in the inferior frontal gyrus, correlated with the empathic concern ratings of the Interpersonal Reactivity Index questionnaire. In a 400-750 ms time-window, the difference between neural reactions to the pain of own-race individuals, localized in the middle frontal gyrus and other-race individuals, localized in the temporoparietal junction was reduced to nil. These findings support a functional, neural and temporal distinction between two sequential processing stages underlying empathy, namely, a race-biased stage of pain sharing/mirroring followed by a race-unbiased stage of cognitive evaluation of pain.

Event-related potential evidence for two functionally dissociable sources of semantic effects in the attentional blink

Three target words (T1, T2, and T3) were embedded in a rapid serial visual presentation (RSVP) stream of non-word distractors, and participants were required to report the targets at the end of each RSVP stream. T2 and T3 were semantically related words in half of the RSVP streams, and semantically unrelated words in the other half of the RSVP streams. Using an identical design, a recent study reported distinct reflections of the T2–T3 semantic relationship on the P2 and N400 components of event-related potentials (ERPs) time-locked to T3, suggesting an early, automatic, source of P2 semantic effects and a late, controlled, source of N400 semantic effects. Here, P2 and N400 semantic effects were examined by manipulating list-wide context. Relative to participants performing in a semantically unbiased context, participants over-exposed to filler RSVP streams always including semantically related T2/T3 words reported a dilution of T3-locked P2 semantic effects and a magnification of T3-locked N400 semantic effects. Opposite effects on P2 and N400 ERP components of list-wide semantic context are discussed in relation to recent proposals on the representational status of RSVP targets at processing stages prior to consolidation in visual short-term memory.

Number-space interactions in the human parietal cortex: Enlightening the SNARC effect with functional near-infrared spectroscopy

Interactions between numbers and space have become a major issue in cognitive neuroscience, because they suggest that numerical representations might be deeply rooted in cortical networks that also subserve spatial cognition. The spatial-numerical association of response codes (SNARC) is the most robust and widely replicated demonstration of the link between numbers and space: in magnitude comparison or parity judgments, participants' reaction times to small numbers are faster with left than right effectors, whereas the converse is found for large numbers. However, despite the massive body of research on number-space interactions, the nature of the SNARC effect remains controversial and no study to date has identified its hemodynamic correlates. Using functional near-infrared spectroscopy, we found a hemodynamic signature of the SNARC effect in the bilateral intraparietal sulcus, a core region for numerical magnitude representation, and left angular gyrus (ANG), a region implicated in verbal number processing. Activation of intraparietal sulcus was also modulated by numerical distance. Our findings point to number semantics as cognitive locus of number-space interactions, thereby revealing the intrinsic spatial nature of numerical magnitude representation. Moreover, the involvement of left ANG is consistent with the mediating role of verbal/cultural factors in shaping interactions between numbers and space.

Look out for strangers! Sustained neural activity during visual working memory maintenance of other-race faces is modulated by implicit racial prejudice

We tested the ability of white participants to encode and retain over a brief period of time information about the identity of white and black people, using faces as stimuli in a standard change detection task and tracking neural activity using electroencephalography. Neural responses recorded over the posterior parietal cortex reflecting visual working memory activity increased in amplitude as a function of the number of faces that had to be maintained in memory. Critically, these memory-related neural responses varied as a function of participants' implicit racial prejudice toward black people. High-prejudiced participants encoded black people faces with a lower degree of precision compared to low-prejudiced participants, suggesting that the class of mental operations affected by implicit racial prejudice includes basic cognitive mechanisms underpinning the encoding and maintenance of faces' visual representations in visual working memory.

A methodology to improve estimation of stimulus-evoked hemodynamic response from fNIRS measurements

Functional near-infrared spectroscopy (fNIRS) is a non-invasive optical neuroimaging method used to investigate functional activity of the cerebral cortex evoked by cognitive, visual, auditory and motor tasks, detecting regional changes of oxy- and deoxy-hemoglobin concentration. Accurate estimation of the stimulus-evoked hemodynamic response (HR) from fNIRS signals in order to quantitatively investigate cognitive functions requires to cope with several noise components. Some of them appear as random disturbances (typically tackled through averaging techniques), while others are due to physiological sources, such as heart beat, respiration, vasomotor waves, and are particularly challenging to be dealt with because they lie in the same frequency band of HR. In this work we present a new two-steps methodology for the HR estimation from fNIRS data. The first step is a pre-processing stage where physiological trends in fNIRS data are reduced by exploiting a mathematical model identified from the signal of a reference channel. In the second step, the pre-processed data of the other channels are filtered with a recently presented non-parametric Bayesian approach (Scarpa et al., Optics Express, 2010). The presented method for HR estimation is compared with widely used methods: conventional averaging, band-pass filtering and principal component analysis (PCA). Results on simulated data reveal the ability of the proposed method to improve the accuracy of the estimates of the functional hemodynamic response, as well as the estimate of peak amplitude and latency. Encouraging preliminary results in a representative real data set showing an improvement of contrast to noise ratio are also reported.

A hemodynamic correlate of lateralized visual short-term memories

Neuroimaging studies attempting to isolate the neural substrate of visual short-term memory in humans have concentrated on the behavior of neurons populating the posterior part of the parietal cortex as a possible source of visual short-term memory capacity limits. Using a standard change-detection task, fMRI studies have shown that maintenance of bilaterally encoded objects elicited bilateral increases of hemodynamic activation in the intra-parietal and intra-occipital sulci (IPS-IOS) proportional to the number of objects retained in visual short-term memory. We used a spatially cued variant of the change-detection task to record hemodynamic responses to unilaterally encoded objects using functional near-infrared spectroscopy (fNIRS). Electrophysiological studies that employed this task have shown that maintenance of unilaterally encoded objects elicited posterior unilateral (contralateral) increase in event-related negativity proportional to the number of objects retained in visual short-term memory. We therefore examined whether contralateral increases in oxy-hemoglobin concentration correlated with the number of retained objects. Contrary to the idea that bilateral increases in BOLD responses and unilateral increases in event-related negativity may be different reflections of the same underlying neural/functional processing, memory-related increases in oxy-hemoglobin concentration were found bilaterally even when objects had to be encoded unilaterally. The present findings suggest that EEG and fMRI/fNIRS techniques reveal distinct neural signatures of the mechanisms supporting visual short-term memory.

Bayesian filtering of human brain hemodynamic activity elicited by visual short-term maintenance recorded through functional near-infrared spectroscopy (fNIRS)

Functional near-infrared spectroscopy (fNIRS) is a neuroimaging technique that measures changes in oxy-hemoglobin (ΔHbO) and deoxy-hemoglobin (ΔHbR) concentration associated with brain activity. The signal acquired with fNIRS is naturally affected by disturbances engendering from ongoing physiological activity (e.g., cardiac, respiratory, Mayer wave) and random measurement noise. Despite its several drawbacks, the so-called conventional averaging (CA) is still widely used to estimate the hemodynamic response function (HRF) from noisy signal. One such drawback is related to the number of trials necessary to derive stable HRF functions adopting the CA approach, which must be substantial (N >> 50). In this work, a pre-processing procedure to remove artifacts followed by the application of a non-parametric Bayesian approach is proposed that capitalizes on a priori available knowledge about HRF and noise. Results with the proposed Bayesian approach were compared with CA and with a straightforward band-pass filtering approach. On simulated data, a five times lower estimation error on HRF was obtained with respect to that obtained by CA, and 2.5 times lower than that obtained by band pass filtering. On real data, the improvement achieved by the present method was attested by an increase in the contrast to noise ratio (CNR) and by a reduced variability in single trial estimation. An application of the present Bayesian approach is illustrated that was optimized to monitor changes in hemodynamic activity reflecting variations in visual short-term memory load in humans, which are notoriously hard to detect using functional magnetic resonance imaging (fMRI). In particular, statistical analyses of HRFs recorded during a memory task established with high reliability the crucial role of the intraparietal sulcus and the intra-occipital sulcus in posterior areas of the human brain in visual short-term memory maintenance.

Object-substitution masking modulates spatial attention deployment and the encoding of information in visual short-term memory: insights from occipito-parietal ERP components

If object-substitution masking (OSM) arises from mask representations replacing target representations, OSM should impede the formation of representations in visual short-term memory (VSTM). We utilized event-related potentials to examine the effect of OSM on target processing. An N2pc was observed on trials with delayed-offset masks, indicating that focused attention was directed to the target. The sustained posterior contralateral negativity (SPCN), an index of VSTM storage, was observed in delayed-offset trials only on trials with correct responses. This supports the hypothesis that inaccurate performance on delayed-offset trials arises from a failure to encode the target in VSTM. On co-termination trials, accuracy was high and neither the N2pc nor SPCN was observed. This indicates that, in the absence of masking, the task was accomplished by maintaining a diffuse attentional state that enabled the joint encoding of the potential target items.

Visual short-term memory capacity for simple and complex objects

Does the capacity of visual short-term memory (VSTM) depend on the complexity of the objects represented in memory? Although some previous findings indicated lower capacity for more complex stimuli, other results suggest that complexity effects arise during retrieval (due to errors in the comparison process with what is in memory) that is not related to storage limitations of VSTM, per se. We used ERPs to track neuronal activity specifically related to retention in VSTM by measuring the sustained posterior contralateral negativity during a change detection task (which required detecting if an item was changed between a memory and a test array). The sustained posterior contralateral negativity, during the retention interval, was larger for complex objects than for simple objects, suggesting that neurons mediating VSTM needed to work harder to maintain more complex objects. This, in turn, is consistent with the view that VSTM capacity depends on complexity.

Orienting attention to objects in visual short-term memory

We measured electroencephalographic activity during visual search of a target object among objects available to perception or among objects held in visual short-term memory (VSTM). For perceptual search, a single shape was shown first (pre-cue) followed by a search-array, and the task was to decide whether the pre-cue was or was not in the search-array. For search of VSTM, a search-array was shown first followed by a single shape (post-cue), and the task was to decide whether the post-cue was or was not in the previously displayed search-array. We focused on early lateralized electrical brain activity over posterior and temporal areas time-locked to search-arrays in pre-cue trials and to post-cues in post-cue trials. In Experiment 1, search-arrays were composed of two lateralized shapes, displayed in the upper/lower two quadrants of the monitor. In Experiment 2, search-arrays were composed of four shapes, displayed at the corners of an imaginary square centered on fixation. In pre-cue trials, we observed an N2pc of about equal amplitude and latency for search-arrays composed of two or four shapes. In post-cue trials, we observed N2pc-like activity with search-arrays composed of two shapes, that was however substantially attenuated with search-arrays composed of four shapes. For many aspects, attending to a perceptual object was functionally and neurally analogous to attending to an object held in VSTM, suggesting that spatial selective attention biases search of objects during both ongoing perception and retention.

Short-term consolidation of individual identities leads to Lag-1 sparing

A rapid serial visual presentation (RSVP) technique was used to investigate the role of the nature of processing carried out on targets in the Lag-1 sparing phenomenon. Lag-1 sparing refers to a higher accuracy in the task associated with the 2nd target when the 2 targets are immediately successive in the RSVP stream relative to when there are 1 or 2 intervening items between the targets. In 5 experiments, 0, 1, or 2 digits were embedded with equal probability in RSVP streams of letter distractors. In 4 of the experiments, subjects identified the digits in some blocks of trials, and they counted the number of presented digits in other blocks. In a 5th experiment, the counting task was replaced with a digit-sum task. The most interesting results were those from trials with 2 digits. Lag-1 sparing was always evident when the task involved the explicit identification of the digits. In addition, Lag-1 sparing was evident when subjects were required to sum 2 digits or to count digits of a prespecified parity subclass (e.g., count only even digits). In striking contrast, Lag-1 sparing was absent when subjects were required to count the digits independent of their parity subclass. These results suggest that the occurrence of Lag-1 sparing depends on the type of mental representation that must be generated on the basis of target information.

The interdependence of spatial attention and lexical access as revealed by early asymmetries in occipito-parietal ERP activity

A test of the possible functional interaction between mechanisms subserving spatial attention and lexical access was devised by displaying one green and one red string of letters, one to the left and one to the right of fixation, and having participants attend to a target string defined by color while ignoring the other distractor string. The target string for a delayed lexical decision task could be a word or a nonword. The distractor was always a word. When the target was a word, target and distractor were associatively related on half of the trials and not related in the other trials. The event-related potential time-locked to the onset of the letter strings produced an N2pc (a greater negativity at scalp sites contralateral to the target relative to the ipsilateral sites arising at about 170 ms poststimulus). N2pc amplitude was reduced when the words were related relative to when they were not related. The results provide direct, online evidence that the rapid activation of meaning by visual words can influence the efficiency of the deployment of spatial attention.

P3 latency shifts in the attentional blink: Further evidence for second target processing postponement

A rapid serial visual presentation technique was used to display sequentially two targets, T1 and T2, and monitor P3 amplitude and latency variations associated with the attentional blink (AB) effect. A red T1 digit was embedded on each trial in a sequence of black letters. T2 was either masked by a trailing stimulus or not masked. T1 had to be identified on a proportion of trials, or ignored in other trials. T2 was the black letter 'E' on 20% of the trials, or any other non-'E' black letter in the other 80% of the trials. A delayed 'E' detection task was required at the end of each trial. An AB was observed when T1 had to be reported and T2 was masked. The AB effect was associated with a sizable amplitude reduction of the P3 component time locked to T2 onset. When T2 was not masked, no AB or P3 amplitude variations were observed. When T1 had to be reported, a delayed P3 peak latency was observed at short compared to long T1-T2 intervals. No effect of T1-T2 interval was observed on the T2-locked P3 peak latency when T1 could be ignored. Taken together these findings provide converging evidence in support of temporal attention models bridging behavior and electrophysiology that postulate a direct link between the cause of the AB effect and the sources of both amplitude and latency variations in the T2-locked P3 component.

Spatial attention freezes during the attention blink

A variant of the rapid serial visual presentation paradigm was used to display sequentially two lateral sequences of stimuli, one to the left and one to the right of fixation, embedding two pairs of target stimuli, T1 and T2. T1 was composed of a pair of alphanumeric characters, and subjects had either to ignore T1 or to encode T1 for a delayed response. T2 was a lateral square of a prespecified color. The square had a small gap in one side, and the task for this stimulus was to report which side had the gap. When subjects were required to ignore T1, the T2-locked ERP produced a clear N2pc, that is, a greater negativity at electrode sites contralateral to the position occupied by T2. This N2pc was followed by a sustained posterior contralateral negativity (SPCN). When subjects were required to monitor T1 in addition to T2, both the N2pc and the SPCN components amplitude depended on the difficulty of the task associated with T1. If T1 was composed of digits that had to be encoded for a delayed same/different judgment, both the N2pc and the SPCN components were entirely suppressed. Although attenuated, such components were present when T1 was composed of a pair of symbols that subjects could disregard. The results suggest that a set of mechanisms subserving the allocation of attention in the spatial domain, resulting in the N2pc, suffer significant interference from concurrent cognitive operations required to encode information into visual short-term memory.

Bidirectional semantic priming in the attentional blink

The time course of semantic priming between two associated words was tracked using rapid serial visual presentation of two synchronized streams of stimuli appearing at about 20 items/sec, each stream including a target word. The two words were semantically related or unrelated and were separated by stimulus onset asynchronies (SOAs) of 0-213 msec. Accuracy in reporting the first target (T1) versus the second target (T2) has been shown to interact dramatically with SOA over this range. The materials were in English in Experiment 1 and Italian in Experiment 2. T1 was semantically primed only at short SOAs, whereas T2 was primed at all SOAs (Experiment 1) or at all SOAs except the shortest one (Experiment 2). The results indicate a strong competition between target words early in processing, with T2 often becoming the first word identified at short SOAs, thus priming T1.

On the control of visual spatial attention: evidence from human electrophysiology

We used electrophysiological methods to track the deployment of visual spatial attention while observers were engaged in concurrent central attentional processing, using a variant of the attentional blink paradigm. Two visual targets (T1, T2) were presented at a stimulus onset asynchrony of either 200 ms or 800 ms. T1 was a white digit among white letters presented on a dark background using rapid serial visual presentation at fixation. T2 was another digit that was presented to the left or right of fixation simultaneously with a distractor digit in the opposite visual field, each followed by a pattern mask. In each T2 display, one digit was red and one was green. Half of the subjects reported the red digit and ignored the green one, whereas the other half reported the green digit and ignored the red one. T1 and T2 were reported in one block of trials, and only T2 in another block (order counterbalanced across subjects). Accuracy of report of T2 was lower at short SOA than at long SOA when both T1 and T2 were reported, but was similar across SOA when only T2 was reported. The electrophysiological results focused on the N2pc component, which was used as an index of the locus of spatial attention. N2pc was reduced in amplitude when subjects reported T1, and particularly so at the short SOA. The results suggest that attention to T1 interfered with the deployment of visual spatial attention to T2.

A neuropsychological assessment of dual-task costs in closed-head injury patients using Cohen’s effect size estimation method

A test of whether patients suffering from a severe closed-head injury (CHI) were affected by disproportionate dual-task costs compared to those of healthy control participants was carried out through a direct comparison of CHI effects on dual-task (psychological refractory period, or PRP) performance and on single-task performance. In the dual-task condition of the present experiment, independent choice-responses were required to two sequential stimuli presented at a variable stimulus onset asynchrony (SOA). A significant delay of the reaction time (RT) to the second stimulus was reported by both CHI patients and controls at short (SOA) compared to long SOA, i.e., a PRP effect. The PRP effect was more pronounced for CHI patients than controls. In the single-task condition, a single choice-response was required to a stimulus presented in isolation. The RT produced by CHI patients in the single-task paradigm was longer than the RT produced by controls. CHI effects on dual-task performance and on single-task performance were compared following (1) their transformation into Cohen's ds, and (2) the application of a correction algorithm taking into account the different reliability of single-task and dual-task measures. The analysis of Cohen's ds revealed that CHI effects on performance were, if anything, smaller in the dual-task condition than in the single-task condition. The results imply that CHI patient's slower responding in single- and dual-task performance reflects a single common cause--slowing of the central processing.

Electrophysiological evidence of visual encoding deficits in a cross-modal attentional blink paradigm

Two experiments are reported in which two target stimuli, T1 and T2, were presented at variable stimulus onset asynchronies (SOAs). In Experiment 1, T1 and T2 were visual stimuli embedded in a rapid serial visual presentation (RSVP) stream of distractors. Participants were asked to report T1 and T2 at the end of the stream. In Experiment 2, T1 was an auditory stimulus, and T2 a visual stimulus embedded in an RSVP stream. Participants made a speeded discriminative response to T1, and reported T2 at the end of the stream. An attentional blink (AB) effect was observed in both experiments: T2 report suffered at short SOA compared to long SOA. During the AB, the amplitude of the P300 component of the event-related potential (ERP) locked to T2 onset was sensibly reduced in both experiments. Behavioral and ERP results were very similar across the two experiments. Implications for models of the AB effect are discussed.

Multitasking costs in close-head injury patients. A fine-grained analysis

The issue of whether severe close-head injury (CHI) patients suffer from disproportionate dual-task deficits compared with matched controls was investigated in two experiments. In the first experiment, either one or three masked letters were presented at the center of a monitor, followed by a pure tone at variable stimulus-onset asynchronies (SOAs). In half of the blocks of trials, the task on the letters required a delayed report of the letters at the end of each trial; in the other half of the blocks, the letters had to be ignored. The tone task always required an immediate manual response based on the tone pitch. In the second experiment, either three masked letters or three masked digits were presented with equal probability in each trial, followed by a tone at variable SOAs. The task required the delayed report of the characters only if they were letters, or ignoring the characters if they were digits. In both experiments, CHI patients and matched controls both exhibited an SOA-locked slowing of the reaction time (RT) to the tone: When characters had to be encoded for delayed report, tone RT increased progressively as SOA was decreased. The SOA effect on tone RT was more pronounced for CHI patients than for controls, suggesting that a substantial component of the slower processing time for CHI patients was related to a selective increase at a central stage of processing shared by the two tasks. Implications for models of the CHI effects on human performance are discussed.

Four-dot masking produces the attentional blink

When two target stimuli (T1 and T2) are presented sequentially within half a second of each other, identification accuracy is often poor for T2. This phenomenon, known as attentional blink (AB), can be observed generally only if the stimulus terminating the presentation of T2 acts as an interruption mask. Recent evidence suggests that even four small dots surrounding a target item can exert masking effects, provided the target onset occurs at an unattended spatial location. In order to test whether an AB could be observed under conditions of four-dot masking of T2, five rapid serial visual presentation streams of letters were synchronously displayed on each trial of the present experiment. T1 and T2 were digits presented at unpredictable locations and unpredictable temporal intervals. T2 was followed by either a blank field, a letter, or four-dots. No AB was observed when T2 was not masked, but robust and equally sized ABs were observed when T2 was followed by both the letter mask and the four-dots.