A brief introduction to the use of event-related potentials in studies of perception and attention

Central and Divided Visual Field Presentation of Emotional Images to Measure Hemispheric Differences in Motivated Attention

Two dominant theories on lateralized processing of emotional information exist in the literature. One theory posits that unpleasant emotions are processed by right frontal regions, while pleasant emotions are processed by left frontal regions. The other theory posits that the right hemisphere is more specialized for the processing of emotional information overall, particularly in posterior regions. Assessing the different roles of the cerebral hemispheres in processing emotional information can be difficult without the use of neuroimaging methodologies, which are not accessible or affordable to all scientists. Divided visual field presentation of stimuli can allow for the investigation of lateralized processing of information without the use of neuroimaging technology. This study compared central versus divided visual field presentations of emotional images to assess differences in motivated attention between the two hemispheres. The late positive potential (LPP) was recorded using electroencephalography (EEG) and event-related potentials (ERPs) methodologies to assess motivated attention. Future work will pair this paradigm with a more active behavioral task to explore the behavioral impacts on the attentional differences found.

Converging evidence for [coronal] underspecification in English-speaking adults

The goal of this study was to test the predictions of the Featurally Underspecified Lexicon (FUL) theory by examining event-related potential (ERP) indices of phonological representation. Two English consonants differing in place of articulation were selected: [labial] /b/ and [coronal] /d/. It was assumed that the phonological representation of /d/ contained less distinctive feature information due to its [coronal] place of articulation, as compared to /b/. English-speaking adults were presented with two syllables, /bɑ/ and /dɑ/, in an ERP oddball paradigm where both syllables served as the standard and deviant stimulus in opposite stimulus sets. Three types of analyses were conducted: traditional mean amplitude measurements, cluster-based permutation tests, and single-trial general linear model (GLM) analyses of group-level and single-subject data. The less specified /dɑ/ deviant elicited a large MMN while no MMN was elicited by the more specified deviant /bɑ/. Additionally, the /dɑ/ standard syllable elicited larger responses than did the /bɑ/ standard, while deviant syllables did not differ. This implies that the MMN was driven by responses elicited by the standards rather than the deviants. At the single-subject level, not all participants demonstrated significant MMN responses, though all had measurable differences between the standard syllables. Thus, to continue to propose that [coronal] underspecification is a language universal phenomenon, ERP indices other than the MMN should be examined.

Neural bases of automaticity

Automaticity allows us to perform tasks in a fast, efficient, and effortless manner after sufficient practice. Theories of automaticity propose that across practice processing transitions from being controlled by working memory to being controlled by long-term memory retrieval. Recent event-related potential (ERP) studies have sought to test this prediction, however, these experiments did not use the canonical paradigms used to study automaticity. Specifically, automaticity is typically studied using practice regimes with consistent mapping between targets and distractors and spaced practice with individual targets, features that these previous studies lacked. The aim of the present work was to examine whether the practice-induced shift from working memory to long-term memory inferred from subjects' ERPs is observed under the conditions in which automaticity is traditionally studied. We found that to be the case in 3 experiments, firmly supporting the predictions of theories. In addition, we found that the temporal distribution of practice (massed vs. spaced) modulates the shape of learning curves. The ERP data revealed that the switch to long-term memory is slower for spaced than massed practice, suggesting that memory systems are used in a strategic manner. This finding provides new constraints for theories of learning and automaticity. (PsycINFO Database Record

The form of causation in health, disease and intervention: biopsychosocial dispositionalism, conserved quantity transfers and dualist mechanistic chains

Causation is important when considering: how an organism maintains health; why disease arises in a healthy person; and, how one may intervene to change the course of a disease. This paper explores the form of causative relationships in health, disease and intervention, with particular regard to the pathological and biopsychosocial models. Consistent with the philosophical view of dispositionalism, we believe that objects are the fundamental relata of causation. By accepting the broad scope of the biopsychosocial model, we argue that psychological and social constructs be considered objects. We think that this 'biopsychosocial dispositionalism' offers the flexibility required to describe causation throughout health, disease and intervention pathways. When constructing mechanistic chains to describe causative pathways, we argue that an object will causally connect with others through actions; transfers of energy from one object to another, initiated by the manifestation of one or more dispositional property. Finally, our analysis of causative interactions utilises the concept that a common form of interaction exists between disease and intervention pathways. This common form will always be an object, but the mode of interaction will vary with each disease. We describe how intervention may act through objects being shared between converging mechanistic chains, or through the removal and/or insertion of objects in such chains. We believe that this analysis provides novel insight to the forms of causative transactions that can occur. In addition, we hope that the findings of this analysis represent the first step towards developing a framework for appraising the composition of mechanistic theories.

Neurophysiological Correlates of the Rubber Hand Illusion in Late Evoked and Alpha/Beta Band Activity

The rubber hand illusion (RHI) allows insights into how the brain resolves conflicting multisensory information regarding body position and ownership. Previous neuroimaging studies have reported a variety of neurophysiological correlates of illusory hand ownership, with conflicting results likely originating from differences in experimental parameters and control conditions. Here, we overcome these limitations by using a fully automated and precisely-timed visuo-tactile stimulation setup to record evoked responses and oscillatory responses in participants who felt the RHI. Importantly, we relied on a combination of experimental conditions to rule out confounds of attention, body-stimulus position and stimulus duration and on the combination of two control conditions to identify neurophysiological correlates of illusory hand ownership. In two separate experiments we observed a consistent illusion-related attenuation of ERPs around 330 ms over frontocentral electrodes, as well as decreases of frontal alpha and beta power during the illusion that could not be attributed to changes in attention, body-stimulus position or stimulus duration. Our results reveal neural correlates of illusory hand ownership in late and likely higher-order rather than early sensory processes, and support a role of premotor and possibly intraparietal areas in mediating illusory body ownership.

ICA-Based Imagined Conceptual Words Classification on EEG Signals

Independent component analysis (ICA) has been used for detecting and removing the eye artifacts conventionally. However, in this research, it was used not only for detecting the eye artifacts, but also for detecting the brain-produced signals of two conceptual danger and information category words. In this cross-sectional research, electroencephalography (EEG) signals were recorded using Micromed and 19-channel helmet devices in unipolar mode, wherein Cz electrode was selected as the reference electrode. In the first part of this research, the statistical community test case included four men and four women, who were 25-30 years old. In the designed task, three groups of traffic signs were considered, in which two groups referred to the concept of danger, and the third one referred to the concept of information. In the second part, the three volunteers, two men and one woman, who had the best results, were chosen from among eight participants. In the second designed task, direction arrows (up, down, left, and right) were used. For the 2/8 volunteers in the rest times, very high-power alpha waves were observed from the back of the head; however, in the thinking times, they were different. According to this result, alpha waves for changing the task from thinking to rest condition took at least 3 s for the two volunteers, and it was at most 5 s until they went to the absolute rest condition. For the 7/8 volunteers, the danger and information signals were well classified; these differences for the 5/8 volunteers were observed in the right hemisphere, and, for the other three volunteers, the differences were observed in the left hemisphere. For the second task, simulations showed that the best classification accuracies resulted when the time window was 2.5 s. In addition, it also showed that the features of the autoregressive (AR)-15 model coefficients were the best choices for extracting the features. For all the states of neural network except hardlim discriminator function, the classification accuracies were almost the same and not very different. Linear discriminant analysis (LDA) in comparison with the neural network yielded higher classification accuracies. ICA is a suitable algorithm for recognizing of the word's concept and its place in the brain. Achieved results from this experiment were the same compared with the results from other methods such as functional magnetic resonance imaging and methods based on the brain signals (EEG) in the vowel imagination and covert speech. Herein, the highest classification accuracy was obtained by extracting the target signal from the output of the ICA and extracting the features of coefficients AR model with time interval of 2.5 s. Finally, LDA resulted in the highest classification accuracy more than 60%.

Effect of Postural Control Demands on Early Visual Evoked Potentials during a Subjective Visual Vertical Perception Task in Adolescents with Idiopathic Scoliosis

Subjective visual vertical (SVV) judgment and standing stability were separately investigated among patients with adolescent idiopathic scoliosis (AIS). Although, one study has investigated the central mechanism of stability control in the AIS population, the relationships between SVV, decreased standing stability, and AIS have never been investigated. Through event-related potentials (ERPs), the present study examined the effect of postural control demands (PDs) on AIS central mechanisms related to SVV judgment and standing stability to elucidate the time-serial stability control process. Thirteen AIS subjects (AIS group) and 13 age-matched adolescents (control group) aged 12–18 years were recruited. Each subject had to complete an SVV task (i.e., the modified rod-and-frame [mRAF] test) as a stimulus, with online electroencephalogram recording being performed in the following three standing postures: feet shoulder-width apart standing, feet together standing, and tandem standing. The behavioral performance in terms of postural stability (center of pressure excursion), SVV (accuracy and reaction time), and mRAF-locked ERPs (mean amplitude and peak latency of the P1, N1, and P2 components) was then compared between the AIS and control groups. In the behavioral domain, the results revealed that only the AIS group demonstrated a significantly accelerated SVV reaction time as the PDs increased. In the cerebral domain, significantly larger P2 mean amplitudes were observed during both feet shoulder-width-apart standing and feet together standing postures compared with during tandem standing. No group differences were noted in the cerebral domain. The results indicated that (1) during the dual-task paradigm, a differential behavioral strategy of accelerated SVV reaction time was observed in the AIS group only when the PDs increased and (2) the decrease in P2 mean amplitudes with the increase in the PD levels might be direct evidence of the competition for central processing attentional resources under the dual-task postural control paradigm.

Assessing the internal consistency of the event-related potential: An example analysis

ERPs are widely and increasingly used to address questions in psychophysiological research. As discussed in this special issue, a renewed focus on questions of reliability and stability marks the need for intuitive, quantitative descriptors that allow researchers to communicate the robustness of ERP measures used in a given study. This report argues that well-established indices of internal consistency and effect size meet this need and can be easily extracted from most ERP datasets, as demonstrated with example analyses using a representative dataset from a feature-based visual selective attention task. We demonstrate how to measure the internal consistency of three aspects commonly considered in ERP studies: voltage measurements for specific time ranges at selected sensors, voltage dynamics across all time points of the ERP waveform, and the distribution of voltages across the scalp. We illustrate methods for quantifying the robustness of experimental condition differences, by calculating effect size for different indices derived from the ERP. The number of trials contributing to the ERP waveform was manipulated to examine the relationship between signal-to-noise ratio (SNR), internal consistency, and effect size. In the present example dataset, satisfactory consistency (Cronbach's alpha > 0.7) of individual voltage measurements was reached at lower trial counts than were required to reach satisfactory effect sizes for differences between experimental conditions. Comparing different metrics of robustness, we conclude that the internal consistency and effect size of ERP findings greatly depend on the quantification strategy, the comparisons and analyses performed, and the SNR.

Movement Interferes with Visuospatial Working Memory during the Encoding: An ERP Study

The present study focuses on the functional interactions of cognition and manual action control. Particularly, we investigated the neurophysiological correlates of the dual-task costs of a manual-motor task (requiring grasping an object, holding it, and subsequently placing it on a target) for working memory (WM) domains (verbal and visuospatial) and processes (encoding and retrieval). Thirty participants were tested in a cognitive-motor dual-task paradigm, in which a single block (a verbal or visuospatial WM task) was compared with a dual block (concurrent performance of a WM task and a motor task). Event-related potentials (ERPs) were analyzed separately for the encoding and retrieval processes of verbal and visuospatial WM domains both in single and dual blocks. The behavioral analyses show that the motor task interfered with WM and decreased the memory performance. The performance decrease was larger for the visuospatial task compared with the verbal task, i.e., domain-specific memory costs were obtained. The ERP analyses show the domain-specific interference also at the neurophysiological level, which is further process-specific to encoding. That is, comparing the patterns of WM-related ERPs in the single block and dual block, we showed that visuospatial ERPs changed only for the encoding process when a motor task was performed at the same time. Generally, the present study provides evidence for domain- and process-specific interactions of a prepared manual-motor movement with WM (visuospatial domain during the encoding process). This study, therefore, provides an initial neurophysiological characterization of functional interactions of WM and manual actions in a cognitive-motor dual-task setting, and contributes to a better understanding of the neuro-cognitive mechanisms of motor action control.

Acetylcholine Release in Prefrontal Cortex Promotes Gamma Oscillations and Theta-Gamma Coupling during Cue Detection

The capacity for using external cues to guide behavior ("cue detection") constitutes an essential aspect of attention and goal-directed behavior. The cortical cholinergic input system, via phasic increases in prefrontal acetylcholine release, plays an essential role in attention by mediating such cue detection. However, the relationship between cholinergic signaling during cue detection and neural activity dynamics in prefrontal networks remains unclear. Here we combined subsecond measures of cholinergic signaling, neurophysiological recordings, and cholinergic receptor blockade to delineate the cholinergic contributions to prefrontal oscillations during cue detection in rats. We first confirmed that detected cues evoke phasic acetylcholine release. These cholinergic signals were coincident with increased neuronal synchrony across several frequency bands and the emergence of theta-gamma coupling. Muscarinic and nicotinic cholinergic receptors both contributed specifically to gamma synchrony evoked by detected cues, but the effects of blocking the two receptor subtypes were dissociable. Blocking nicotinic receptors primarily attenuated high-gamma oscillations occurring during the earliest phases of the cue detection process, while muscarinic (M1) receptor activity was preferentially involved in the transition from high to low gamma power that followed and corresponded to the mobilization of networks involved in cue-guided decision making. Detected cues also promoted coupling between gamma and theta oscillations, and both nicotinic and muscarinic receptor activity contributed to this process. These results indicate that acetylcholine release coordinates neural oscillations during the process of cue detection.SIGNIFICANCE STATEMENT The capacity of learned cues to direct attention and guide responding ("cue detection") is a key component of goal-directed behavior. Rhythmic neural activity and increases in acetylcholine release in the prefrontal cortex contribute to this process; however, the relationship between these neuronal mechanisms is not well understood. Using a combination of in vivo neurochemistry, neurophysiology, and pharmacological methods, we demonstrate that cue-evoked acetylcholine release, through distinct actions at both nicotinic and muscarinic receptors, triggers a procession of neural oscillations that map onto the multiple stages of cue detection. Our data offer new insights into cholinergic function by revealing the temporally orchestrated changes in prefrontal network synchrony modulated by acetylcholine release during cue detection.

Using transcranial direct-current stimulation (tDCS) to understand cognitive processing

Noninvasive brain stimulation methods are becoming increasingly common tools in the kit of the cognitive scientist. In particular, transcranial direct-current stimulation (tDCS) is showing great promise as a tool to causally manipulate the brain and understand how information is processed. The popularity of this method of brain stimulation is based on the fact that it is safe, inexpensive, its effects are long lasting, and you can increase the likelihood that neurons will fire near one electrode and decrease the likelihood that neurons will fire near another. However, this method of manipulating the brain to draw causal inferences is not without complication. Because tDCS methods continue to be refined and are not yet standardized, there are reports in the literature that show some striking inconsistencies. Primary among the complications of the technique is that the tDCS method uses two or more electrodes to pass current and all of these electrodes will have effects on the tissue underneath them. In this tutorial, we will share what we have learned about using tDCS to manipulate how the brain perceives, attends, remembers, and responds to information from our environment. Our goal is to provide a starting point for new users of tDCS and spur discussion of the standardization of methods to enhance replicability.

Iconic faces are not real faces: enhanced emotion detection and altered neural processing as faces become more iconic

Iconic representations are ubiquitous; they fill children's cartoons, add humor to newspapers, and bring emotional tone to online communication. Yet, the communicative function they serve remains unaddressed by cognitive psychology. Here, we examined the hypothesis that iconic representations communicate emotional information more efficiently than their realistic counterparts. In Experiment 1, we manipulated low-level features of emotional faces to create five sets of stimuli that ranged from photorealistic to fully iconic. Participants identified emotions on briefly presented faces. Results showed that, at short presentation times, accuracy for identifying emotion on more "cartoonized" images was enhanced. In addition, increasing contrast and decreasing featural complexity benefited accuracy. In Experiment 2, we examined an event-related potential component, the P1, which is sensitive to low-level visual stimulus features. Lower levels of contrast and complexity within schematic stimuli were also associated with lower P1 amplitudes. These findings support the hypothesis that iconic representations differ from realistic images in their ability to communicate specific information, including emotion, quickly and efficiently, and that this effect is driven by changes in low-level visual features in the stimuli.

Using concurrent EEG and fMRI to probe the state of the brain in schizophrenia

Perceptional abnormalities in schizophrenia are associated with hallucinations and delusions, but also with negative symptoms and poor functional outcome. Perception can be studied using EEG-derived event related potentials (ERPs). Because of their excellent temporal resolution, ERPs have been used to ask when perception is affected by schizophrenia. Because of its excellent spatial resolution, functional magnetic resonance imaging (fMRI) has been used to ask where in the brain these effects are seen. We acquired EEG and fMRI data simultaneously to explore when and where auditory perception is affected by schizophrenia. Thirty schizophrenia (SZ) patients and 23 healthy comparison subjects (HC) listened to 1000 Hz tones occurring about every second. We used joint independent components analysis (jICA) to combine EEG-based event-related potential (ERP) and fMRI responses to tones. Five ERP-fMRI joint independent components (JIC) were extracted. The "N100" JIC had temporal weights during N100 (peaking at 100 ms post-tone onset) and fMRI spatial weights in superior and middle temporal gyri (STG/MTG); however, it did not differ between groups. The "P200" JIC had temporal weights during P200 and positive fMRI spatial weights in STG/MTG and frontal areas, and negative spatial weights in the nodes of the default mode network (DMN) and visual cortex. Groups differed on the "P200" JIC: SZ had smaller "P200" JIC, especially those with more severe avolition/apathy. This is consistent with negative symptoms being related to perceptual deficits, and suggests patients with avolition/apathy may allocate too few resources to processing external auditory events and too many to processing internal events.

Proactive inhibitory control: A general biasing account

Flexible behavior requires a control system that can inhibit actions in response to changes in the environment. Recent studies suggest that people proactively adjust response parameters in anticipation of a stop signal. In three experiments, we tested the hypothesis that proactive inhibitory control involves adjusting both attentional and response settings, and we explored the relationship with other forms of proactive and anticipatory control. Subjects responded to the color of a stimulus. On some trials, an extra signal occurred. The response to this signal depended on the task context subjects were in: in the 'ignore' context, they ignored it; in the 'stop' context, they had to withhold their response; and in the 'double-response' context, they had to execute a secondary response. An analysis of event-related brain potentials for no-signal trials in the stop context revealed that proactive inhibitory control works by biasing the settings of lower-level systems that are involved in stimulus detection, action selection, and action execution. Furthermore, subjects made similar adjustments in the double-response and stop-signal contexts, indicating an overlap between various forms of proactive action control. The results of Experiment 1 also suggest an overlap between proactive inhibitory control and preparatory control in task-switching studies: both require reconfiguration of task-set parameters to bias or alter subordinate processes. We conclude that much of the top-down control in response inhibition tasks takes place before the inhibition signal is presented.

Attention's Accelerator

How do people get attention to operate at peak efficiency in high-pressure situations? We tested the hypothesis that the general mechanism that allows this is the maintenance of multiple target representations in working and long-term memory. We recorded subjects' event-related potentials (ERPs) indexing the working memory and long-term memory representations used to control attention while performing visual search. We found that subjects used both types of memories to control attention when they performed the visual search task with a large reward at stake, or when they were cued to respond as fast as possible. However, under normal circumstances, one type of target memory was sufficient for slower task performance. The use of multiple types of memory representations appears to provide converging top-down control of attention, allowing people to step on the attentional accelerator in a variety of high-pressure situations.

Attentional guidance by relative features: Behavioral and electrophysiological evidence

Our ability to select task-relevant information from cluttered visual environments is widely believed to be due to our ability to tune attention to the particular elementary feature values of a sought-after target (e.g., red, orange, yellow). By contrast, recent findings showed that attention is often tuned to feature relationships, that is, features that the target has relative to irrelevant features in the context (e.g., redder, yellower). However, the evidence for such a relational account is so far exclusively based on behavioral measures that do not allow a safe inference about early perceptual processes. The present study provides a critical test of the relational account, by measuring an electrophysiological marker in the EEG of participants (N2pc) in response to briefly presented distractors (cues) that could either match the physical features of the target or its relative features. In a first experiment, the target color and nontarget color were kept constant across trials. In line with a relational account, we found that only cues with the same relative color as the target were attended, regardless of whether the cues had the same physical color as the target. In a second experiment, we demonstrate that attention is biased to the exact target feature value when the target is embedded in a randomly varying context. Taken together, these results provide the first electrophysiological evidence that attention can modulate early perceptual processes differently; in a context-dependent manner versus a context-independent manner, resulting in marked differences in the range of colors that can attract attention.

Cerebral Correlates of Automatic Associations Towards Performance Enhancing Substances

The direct assessment of explicit attitudes toward performance enhancing substances, for example Neuroenhancement or doping in sports, can be affected by social desirability biases and cheating attempts. According to Dual Process Theories of cognition, indirect measures like the Implicit Association Test (IAT) measure automatic associations toward a topic (as opposed to explicit attitudes measured by self-report measures). Such automatic associations are thought to occur rapidly and to evade voluntary control. However, whether or not such indirect tests actually reflect automatic associations is difficult to validate. Electroencephalography (EEG) has a superior time resolution which can differentiate between highly automatic compared to more elaborate processing stages. We therefore used EEG to examine on which processing stages cortical differences between negative or positive attitudes to doping occur, and whether or not these differences can be related to BIAT scores. We tested 42 university students (31 females, 24.43 ± 3.17 years old), who were requested to complete a brief doping IAT (BIAT) on attitudes toward doping. Cerebral activity during doping BIAT completion was assessed using high-density EEG. Behaviorally, participants D-scores exhibited negative attitudes toward doping, represented by faster reaction times in the doping + dislike pairing task. Event-related potentials (ERPs) revealed earliest effects between 200 and 300 ms. Here, a relatively larger occipital positivity was found for the doping + dislike pairing task. Further, in the LPP time range between 400 and 600 ms a larger late positive potential was found for the doping + dislike pairing task over central regions. These LPP amplitude differences were successfully predicting participants' BIAT D-scores. Results indicate that event-related potentials differentiate between positive and negative doping attitudes at stages of mid-latency. However, it seems that IAT scores can be predicted only by the later occurring LPP. Our study is the first to investigate the cerebral correlates that contribute to test scores obtained in the indirect testing of automatic associations toward doping. The implications of our results for the broader NE concept are discussed in light of the conceptual similarity of doping and NE.

Electrophysiological measurement of information flow during visual search

The temporal relationship between different stages of cognitive processing is long debated. This debate is ongoing, primarily because it is often difficult to measure the time course of multiple cognitive processes simultaneously. We employed a manipulation that allowed us to isolate ERP components related to perceptual processing, working memory, and response preparation, and then examined the temporal relationship between these components while observers performed a visual search task. We found that, when response speed and accuracy were equally stressed, our index of perceptual processing ended before both the transfer of information into working memory and response preparation began. However, when we stressed speed over accuracy, response preparation began before the completion of perceptual processing or transfer of information into working memory on trials with the fastest reaction times. These findings show that individuals can control the flow of information transmission between stages, either waiting for perceptual processing to be completed before preparing a response or configuring these stages to overlap in time.

Electrophysiological evidence for preparatory reconfiguration before voluntary task switches but not cued task switches

An unresolved issue in the task-switching literature is whether preparatory reconfiguration occurs before a change of task. In this study, we used event-related potentials (ERPs) to determine whether preparatory reconfiguration occurs during two different task-switching procedures: voluntary and cued task switching. We focused on two ERP components that index different cognitive operations. The contingent negative variation (CNV) is a sensitive measure of a participant's preparedness to use a specific stimulus-response mapping. In contrast, the P3 indexes memory updating. We found a pronounced modulation of the CNV before voluntary task switches, but not before cued task switches. Instead, cued task switches were preceded by a larger P3, as compared with task repetitions. Our findings suggest that task set reconfiguration is carried out prior to voluntary task switches, whereas memory processes dominate cued task switches.

What Do You Mean by That?! An Electrophysiological Study of Emotional and Attitudinal Prosody

The use of prosody during verbal communication is pervasive in everyday language and whilst there is a wealth of research examining the prosodic processing of emotional information, much less is known about the prosodic processing of attitudinal information. The current study investigated the online neural processes underlying the prosodic processing of non-verbal emotional and attitudinal components of speech via the analysis of event-related brain potentials related to the processing of anger and sarcasm. To examine these, sentences with prosodic expectancy violations created by cross-splicing a prosodically neutral head (‘he has’) and a prosodically neutral, angry, or sarcastic ending (e.g., ‘a serious face’) were used. Task demands were also manipulated, with participants in one experiment performing prosodic classification and participants in another performing probe-verification. Overall, whilst minor differences were found across the tasks, the results suggest that angry and sarcastic prosodic expectancy violations follow a similar processing time-course underpinned by similar neural resources.

Predicting and Improving Recognition Memory Using Multiple Electrophysiological Signals in Real Time

Although people are capable of storing a virtually infinite amount of information in memory, their ability to encode new information is far from perfect. The quality of encoding varies from moment to moment and renders some memories more accessible than others. Here, we were able to forecast the likelihood that a given item will be later recognized by monitoring two dissociable fluctuations of the electroencephalogram during encoding. Next, we identified individual items that were poorly encoded, using our electrophysiological measures in real time, and we successfully improved the efficacy of learning by having participants restudy these items. Thus, our memory forecasts using multiple electrophysiological signals demonstrate the feasibility and the effectiveness of using real-time monitoring of the moment-to-moment fluctuations of the quality of memory encoding to improve learning.

Neural correlates of visualizations of concrete and abstract words in preschool children: a developmental embodied approach

The neural correlates of visualization underlying word comprehension were examined in preschool children. On each trial, a concrete or abstract word was delivered binaurally (part 1: post-auditory visualization), followed by a four-picture array (a target plus three distractors; part 2: matching visualization). Children were to select the picture matching the word they heard in part 1. Event-related potentials (ERPs) locked to each stimulus presentation and task interval were averaged over sets of trials of increasing word abstractness. ERP time-course during both parts of the task showed that early activity (i.e., <300 ms) was predominant in response to concrete words, while activity in response to abstract words became evident only at intermediate (i.e., 300–699 ms) and late (i.e., 700–1000 ms) ERP intervals. Specifically, ERP topography showed that while early activity during post-auditory visualization was linked to left temporo-parietal areas for concrete words, early activity during matching visualization occurred mostly in occipito-parietal areas for concrete words, but more anteriorly in centro-parietal areas for abstract words. In intermediate ERPs, post-auditory visualization coincided with parieto-occipital and parieto-frontal activity in response to both concrete and abstract words, while in matching visualization a parieto-central activity was common to both types of words. In the late ERPs for both types of words, the post-auditory visualization involved right-hemispheric activity following a “post-anterior” pathway sequence: occipital, parietal, and temporal areas; conversely, matching visualization involved left-hemispheric activity following an “ant-posterior” pathway sequence: frontal, temporal, parietal, and occipital areas. These results suggest that, similarly, for concrete and abstract words, meaning in young children depends on variably complex visualization processes integrating visuo-auditory experiences and supramodal embodying representations.

Visualizing Trumps Vision in Training Attention

Mental imagery can have powerful training effects on behavior, but how this occurs is not well understood. Here we show that even a single instance of mental imagery can improve attentional selection of a target more effectively than actually practicing visual search. By recording subjects' brain activity, we found that these imagery-induced training effects were due to perceptual attention being more effectively focused on targets following imagined training. Next, we examined the downside of this potent training by changing the target after several trials of training attention with imagery and found that imagined search resulted in more potent interference than actual practice following these target changes. Finally, we found that proactive interference from task-irrelevant elements in the visual displays appears to underlie the superiority of imagined training relative to actual practice. Our findings demonstrate that visual attention mechanisms can be effectively trained to select target objects in the absence of visual input, and this results in more effective control of attention than practicing the task itself.

Enhancing long-term memory with stimulation tunes visual attention in one trial

Scientists have long proposed that memory representations control the mechanisms of attention that focus processing on the task-relevant objects in our visual field. Modern theories specifically propose that we rely on working memory to store the object representations that provide top-down control over attentional selection. Here, we show that the tuning of perceptual attention can be sharply accelerated after 20 min of noninvasive brain stimulation over medial-frontal cortex. Contrary to prevailing theories of attention, these improvements did not appear to be caused by changes in the nature of the working memory representations of the search targets. Instead, improvements in attentional tuning were accompanied by changes in an electrophysiological signal hypothesized to index long-term memory. We found that this pattern of effects was reliably observed when we stimulated medial-frontal cortex, but when we stimulated posterior parietal cortex, we found that stimulation directly affected the perceptual processing of the search array elements, not the memory representations providing top-down control. Our findings appear to challenge dominant theories of attention by demonstrating that changes in the storage of target representations in long-term memory may underlie rapid changes in the efficiency with which humans can find targets in arrays of objects.

Causal control of medial-frontal cortex governs electrophysiological and behavioral indices of performance monitoring and learning

Adaptive human behavior depends on the capacity to adjust cognitive processing after an error. Here we show that transcranial direct current stimulation of medial-frontal cortex provides causal control over the electrophysiological responses of the human brain to errors and feedback. Using one direction of current flow, we eliminated performance-monitoring activity, reduced behavioral adjustments after an error, and slowed learning. By reversing the current flow in the same subjects, we enhanced performance-monitoring activity, increased behavioral adjustments after an error, and sped learning. These beneficial effects fundamentally improved cognition for nearly 5 h after 20 min of noninvasive stimulation. The stimulation selectively influenced the potentials indexing error and feedback processing without changing potentials indexing mechanisms of perceptual or response processing. Our findings demonstrate that the functioning of mechanisms of cognitive control and learning can be up- or down-regulated using noninvasive stimulation of medial-frontal cortex in the human brain.

Modulation of human corticospinal excitability by paired associative stimulation

Paired Associative Stimulation (PAS) has come to prominence as a potential therapeutic intervention for the treatment of brain injury/disease, and as an experimental method with which to investigate Hebbian principles of neural plasticity in humans. Prototypically, a single electrical stimulus is directed to a peripheral nerve in advance of transcranial magnetic stimulation (TMS) delivered to the contralateral primary motor cortex (M1). Repeated pairing of the stimuli (i.e., association) over an extended period may increase or decrease the excitability of corticospinal projections from M1, in manner that depends on the interstimulus interval (ISI). It has been suggested that these effects represent a form of associative long-term potentiation (LTP) and depression (LTD) that bears resemblance to spike-timing dependent plasticity (STDP) as it has been elaborated in animal models. With a large body of empirical evidence having emerged since the cardinal features of PAS were first described, and in light of the variations from the original protocols that have been implemented, it is opportune to consider whether the phenomenology of PAS remains consistent with the characteristic features that were initially disclosed. This assessment necessarily has bearing upon interpretation of the effects of PAS in relation to the specific cellular pathways that are putatively engaged, including those that adhere to the rules of STDP. The balance of evidence suggests that the mechanisms that contribute to the LTP- and LTD-type responses to PAS differ depending on the precise nature of the induction protocol that is used. In addition to emphasizing the requirement for additional explanatory models, in the present analysis we highlight the key features of the PAS phenomenology that require interpretation.

A neurocomputational model of the mismatch negativity

The mismatch negativity (MMN) is an event related potential evoked by violations of regularity. Here, we present a model of the underlying neuronal dynamics based upon the idea that auditory cortex continuously updates a generative model to predict its sensory inputs. The MMN is then modelled as the superposition of the electric fields evoked by neuronal activity reporting prediction errors. The process by which auditory cortex generates predictions and resolves prediction errors was simulated using generalised (Bayesian) filtering--a biologically plausible scheme for probabilistic inference on the hidden states of hierarchical dynamical models. The resulting scheme generates realistic MMN waveforms, explains the qualitative effects of deviant probability and magnitude on the MMN - in terms of latency and amplitude--and makes quantitative predictions about the interactions between deviant probability and magnitude. This work advances a formal understanding of the MMN and--more generally--illustrates the potential for developing computationally informed dynamic causal models of empirical electromagnetic responses.

Pupil dilation in the Simon task as a marker of conflict processing

Cognitive demands in response conflict paradigms trigger negative affect and avoidance behavior. However, not all response conflict studies show increases in physiological indices of emotional arousal, such as pupil diameter. In contrast to earlier null-results, this study shows for the first time that small (about 0.02 mm) conflict-related pupil dilation can be observed in a Simon task when stimuli do not introduce a light reflex. Results show that response-conflict in Simon trials induces both pupil dilation and reaction-time costs. Moreover, sequential analyses reveal that pupil dilation mirrors the conflict-adaptation pattern observed in reaction time (RT). Although single-trial regression analyses indicated that pupil dilation is likely to reflect more than one process at the same time, in general our findings imply that pupil dilation can be used as an indirect marker of conflict processing.

High stakes trigger the use of multiple memories to enhance the control of attention

We can more precisely tune attention to highly rewarding objects than other objects in our environment, but how our brains do this is unknown. After a few trials of searching for the same object, subjects' electrical brain activity indicated that they handed off the memory representations used to control attention from working memory to long-term memory. However, when a large reward was possible, the neural signature of working memory returned as subjects recruited working memory to supplement the cognitive control afforded by the representations accumulated in long-term memory. The amplitude of this neural signature of working memory predicted the magnitude of the subsequent behavioral reward-based attention effects across tasks and individuals, showing the ubiquity of this cognitive reaction to high-stakes situations.

Where do we store the memory representations that guide attention?

During the last decade one of the most contentious and heavily studied topics in the attention literature has been the role that working memory representations play in controlling perceptual selection. The hypothesis has been advanced that to have attention select a certain perceptual input from the environment, we only need to represent that item in working memory. Here we summarize the work indicating that the relationship between what representations are maintained in working memory and what perceptual inputs are selected is not so simple. First, it appears that attentional selection is also determined by high-level task goals that mediate the relationship between working memory storage and attentional selection. Second, much of the recent work from our laboratory has focused on the role of long-term memory in controlling attentional selection. We review recent evidence supporting the proposal that working memory representations are critical during the initial configuration of attentional control settings, but that after those settings are established long-term memory representations play an important role in controlling which perceptual inputs are selected by mechanisms of attention.

Viewing the dynamics and control of visual attention through the lens of electrophysiology

How we find what we are looking for in complex visual scenes is a seemingly simple ability that has taken half a century to unravel. The first study to use the term visual search showed that as the number of objects in a complex scene increases, observers' reaction times increase proportionally (Green & Anderson, 1956). This observation suggests that our ability to process the objects in the scenes is limited in capacity. However, if it is known that the target will have a certain feature attribute, for example, that it will be red, then only an increase in the number of red items increases reaction time. This observation suggests that we can control which visual inputs receive the benefit of our limited capacity to recognize the objects, such as those defined by the color red, as the items we seek. The nature of the mechanisms that underlie these basic phenomena in the literature on visual search have been more difficult to definitively determine. In this paper, I discuss how electrophysiological methods have provided us with the necessary tools to understand the nature of the mechanisms that give rise to the effects observed in the first visual search paper. I begin by describing how recordings of event-related potentials from humans and nonhuman primates have shown us how attention is deployed to possible target items in complex visual scenes. Then, I will discuss how event-related potential experiments have allowed us to directly measure the memory representations that are used to guide these deployments of attention to items with target-defining features.

Reduced Frontal P3a Amplitude in Migraine Patients during the Pain-Free Period

BACKGROUND AND PURPOSE

Neuropsychological and neuroimaging studies both suggest that frontal lobe dysfunction is present in migraineurs. Since P3a abnormalities manifest in other diseases associated with attention problems, such as attention deficit hyperactivity disorder, we hypothesized that migraine patients have P3a abnormalities, particularly in the frontal region.

METHODS

Event-related potentials were measured using a passive auditory oddball paradigm in 16 female migraineurs (aged 22.9±2.0 years, mean±SD) during the interictal period and in 16 age-matched healthy females (22.6±2.0 years). The amplitudes and latencies were analyzed independently using repeated-measures analysis of variance. Nonparametric statistical testing using a cluster-level randomization method was performed to localize the abnormalities.

RESULTS

The mean P3a amplitude at frontal areas during the third trials was significantly lower in migraineurs (1.06 µV) than in controls (1.69 µV, p=0.026). P3a amplitudes were negatively correlated with the duration of the migraine history (r=-0.618, p=0.014). Cluster-based nonparametric statistical analysis showed that the amplitudes over left frontal areas were significantly lower in migraine patients than in controls.

CONCLUSIONS

A reduced P3a amplitude of migraineurs reflects attentional deficits and frontal dysfunction. The negative correlation between P3a amplitude and the duration of the migraine history suggests that attentional deficits and frontal dysfunction are either the cause or the result of headache.

Unleashing potential: transcranial direct current stimulation over the right posterior parietal cortex improves change detection in low-performing individuals

The limits of human visual short-term memory (VSTM) have been well documented, and recent neuroscientific studies suggest that VSTM performance is associated with activity in the posterior parietal cortex. Here we show that artificially elevating parietal activity via positively charged electric current through the skull can rapidly and effortlessly improve people's VSTM performance. This artificial improvement, however, comes with an interesting twist: it interacts with people's natural VSTM capability such that low performers who tend to remember less information benefitted from the stimulation, whereas high performers did not. This behavioral dichotomy is explained by event-related potentials around the parietal regions: low performers showed increased waveforms in N2pc and contralateral delay activity (CDA), which implies improvement in attention deployment and memory access in the current paradigm, respectively. Interestingly, these components are found during the presentation of the test array instead of the retention interval, from the parietal sites ipsilateral to the target location, thus suggesting that transcranial direct current stimulation (tDCS) was mainly improving one's ability to suppress no-change distractors located on the irrelevant side of the display during the comparison stage. The high performers, however, did not benefit from tDCS as they showed equally large waveforms in N2pc and CDA, or SPCN (sustained parietal contralateral negativity), before and after the stimulation such that electrical stimulation could not help any further, which also accurately accounts for our behavioral observations. Together, these results suggest that there is indeed a fixed upper limit in VSTM, but the low performers can benefit from neurostimulation to reach that maximum via enhanced comparison processes, and such behavioral improvement can be directly quantified and visualized by the magnitude of its associated electrophysiological waveforms.

Directed forgetting and directed remembering in visual working memory

A defining characteristic of visual working memory is its limited capacity. This means that it is crucial to maintain only the most relevant information in visual working memory. However, empirical research is mixed as to whether it is possible to selectively maintain a subset of the information previously encoded into visual working memory. Here we examined the ability of participants to use cues to either forget or remember a subset of the information already stored in visual working memory. In Experiment 1, participants were cued to either forget or remember 1 of 2 groups of colored squares during a change-detection task. We found that both types of cues aided performance in the visual working memory task but that observers benefited more from a cue to remember than a cue to forget a subset of the objects. In Experiment 2, we show that the previous findings, which indicated that directed-forgetting cues are ineffective, were likely due to the presence of invalid cues that appeared to cause observers to disregard such cues as unreliable. In Experiment 3, we recorded event-related potentials and show that an electrophysiological index of focused maintenance is elicited by cues that indicate which subset of information in visual working memory needs to be remembered, ruling out alternative explanations of the behavioral effects of retention-interval cues. The present findings demonstrate that observers can focus maintenance mechanisms on specific objects in visual working memory based on cues indicating future task relevance.

Homologous mechanisms of visuospatial working memory maintenance in macaque and human: properties and sources

Although areas of frontal cortex are thought to be critical for maintaining information in visuospatial working memory, the event-related potential (ERP) index of maintenance is found over posterior cortex in humans. In the present study, we reconcile these seemingly contradictory findings. Here, we show that macaque monkeys and humans exhibit the same posterior ERP signature of working memory maintenance that predicts the precision of the memory-based behavioral responses. In addition, we show that the specific pattern of rhythmic oscillations in the alpha band, recently demonstrated to underlie the human visual working memory ERP component, is also present in monkeys. Next, we concurrently recorded intracranial local field potentials from two prefrontal and another frontal cortical area to determine their contribution to the surface potential indexing maintenance. The local fields in the two prefrontal areas, but not the cortex immediately posterior, exhibited amplitude modulations, timing, and relationships to behavior indicating that they contribute to the generation of the surface ERP component measured from the distal posterior electrodes. Rhythmic neural activity in the theta and gamma bands during maintenance provided converging support for the engagement of the same brain regions. These findings demonstrate that nonhuman primates have homologous electrophysiological signatures of visuospatial working memory to those of humans and that a distributed neural network, including frontal areas, underlies the posterior ERP index of visuospatial working memory maintenance.

Event-related potentials elicited by errors during the stop-signal task. II: human effector-specific error responses

Although previous research with human and nonhuman primates has examined the neural correlates of performance monitoring, discrepancies in methodology have limited our ability to make cross-species generalizations. One major obstacle arises from the use of different behavioral responses and tasks across different primate species. Specifically, it is unknown whether performance-monitoring mechanisms rely on different neural circuitry in tasks requiring oculomotor vs. skeletomotor responses. Here, we show that the human error-related negativity (ERN) elicited by a saccadic eye-movement response relative to a manual response differs in several critical ways. The human saccadic ERN exhibits a prolonged duration, a broader frontomedial voltage distribution, and different neural source estimates than the manual ERN in exactly the same stop-signal task. The human saccadic error positivity (Pe) exhibited a frontomedial voltage distribution with estimated electrical sources in supplementary motor area and rostral anterior cingulate cortex for saccadic responses, whereas the manual Pe showed a posterior scalp distribution and potential origins in the superior parietal lobule. These findings constrain models of the cognitive mechanisms indexed by the ERN/Pe complex. Moreover, by paralleling work with nonhuman primates performing the same saccadic stop-signal task (Godlove et al. 2011), we demonstrate a cross-species homology of error event-related potentials (ERPs) and lay the groundwork for definitively localizing the neural sources of performance-monitoring ERPs.

Semantic analysis does not occur in the absence of awareness induced by interocular suppression

It has been intensely debated whether visual stimuli are processed to the point of semantic analysis in the absence of awareness. In the present study, we measured the extent to which the meaning of a stimulus was registered using the N400 component of human event-related potentials (ERPs), a highly sensitive index of the semantic mismatch between a stimulus and the context in which it is presented. Observers judged the semantic relatedness of a context and target word while ERPs were recorded under continuous flash suppression (Experiments 1 and 2) and binocular rivalry (Experiment 3). Finally, we parametrically manipulated the visibility of the target word by increasing the contrast between the target word and the suppressive stimulus presented to the other eye (Experiment 4). We found that the amplitude of the N400 was attenuated with increasing suppression depth and was absent whenever the observers could not discriminate the meaning of suppressed words. We discuss these findings in the context of single-process models of consciousness, which can account for a large body of empirical evidence obtained from visual masking, attentional manipulations, and, now, interocular suppression paradigms.

Attentional templates in visual working memory

Most theories of attention propose that we maintain attentional templates in visual working memory to control what information is selected. In the present study, we directly tested this proposal by measuring the contralateral-delay activity (CDA) of human event-related potentials during visual search tasks in which the target is cued on each trial. Here we show that the CDA can be used to measure the maintenance of attentional templates in visual working memory while processing complex visual scenes. In addition, this method allowed us to directly observe the shift from working memory to long-term memory representations controlling attention as learning occurred and experience accrued searching for the same target object. Our findings provide definitive support for several critical proposals made in theories of attention, learning, and automaticity.