Multiple visuospatial working memory buffers: evidence from spatiotemporal patterns of brain activity

Manual action re-planning interferes with the maintenance process of working memory: an ERP investigation

The current study investigated the re-planning of the grasping movements, its functional interactions with working memory (WM), and underlying neurophysiological activity. Mainly, the current study investigated the movement re-planning interference with WM domains (verbal, visuospatial) and processes (maintenance, retrieval). We combined a cognitive-motor dual-task paradigm with an EEG setting. Thirty-six participants completed the verbal and visuospatial versions of a WM task concurrently with a manual task which required performing a grasp-and-place movement by keeping the initial movement plan (prepared movement condition) or changing it for reversing the movement direction (re-planned movement condition). ERPs were extracted for the prepared and re-planned conditions in the verbal and visuospatial tasks separately during the maintenance and retrieval processes. ERP analyses showed that during the maintenance process of both the verbal and visuospatial tasks, the re-planned movements compared to the prepared movements generated a larger positive slow wave with a centroparietal maximum between 200 and 700. We interpreted this ERP effect as a P300 component for the re-planned movements. There was no ERP difference between the planned and re-planned movements during the retrieval process. Accordingly, we suggest that re-planning the grasp-and-place movement interfered at least with the maintenance of the verbal and visuospatial domains, resulting in the re-planning costs. More generally, the current study provides the initial neurophysiological investigations of the movement re-planning–WM interactions during grasping movements, and contributes to a better understanding of the neurocognitive mechanisms underlying manual action flexibility.

Spatial Recognition Memory: Differential Brain Strategic Activation According to Sex

Human spatial memory research has significantly progressed since the development of computerized tasks, with many studies examining sex-related performances. However, few studies explore the underlying electrophysiological correlates according to sex. In this study event-related potentials were compared between male and female participants during the performance of an allocentric spatial recognition task. Twenty-nine university students took part in the research. Results showed that while general performance was similar in both sexes, the brain of males and females displayed a differential activation. Males showed increased N200 modulation than females in the three phases of memory process (encoding, maintenance, and retrieval). Meanwhile females showed increased activation of P300 in the three phases of memory process compared to males. In addition, females exhibited more negative slow wave (NSW) activity during the encoding phase. These differences are discussed in terms of attentional control and the allocation of attentional resources during spatial processing. Our findings demonstrate that sex modulates the resources recruited to performed this spatial task.

Altered event-related potentials and theta oscillations index auditory working memory deficits in healthy aging

Speech comprehension deficits constitute a major issue for an increasingly aged population, as they may lead older individuals to social isolation. Since conversation requires constant monitoring, updating and selecting information, auditory working memory decline, rather than impoverished hearing acuity, has been suggested a core factor. However, in stark contrast to the visual domain, the neurophysiological mechanisms underlying auditory working memory deficits in healthy aging remain poorly understood, especially those related to on-the-fly information processing under increasing load. Therefore, we investigated the behavioral costs and electrophysiological differences associated with healthy aging and working memory load during continuous auditory processing. We recorded EEG activity from 27 younger (∼25 years) and 29 older (∼70 years) participants during their performance on an auditory version of the n-back task with speech syllables and 2 workload levels (1-back; 2-back). Behavioral measures were analyzed as indices of function; event-related potentials as proxies for sensory and cognitive processes; and theta oscillatory power as a reflection of memory and central executive function. Our results show age-related differences in auditory information processing within a latency range that is consistent with a series of impaired functions, from sensory gating to cognitive resource allocation during constant information updating, especially under high load.

Neural measures of working memory in a bilateral change detection task

The change detection task is a widely used paradigm to examine visual working memory processes. Participants memorize a set of items and then, try to detect changes in the set after a retention period. The negative slow wave (NSW) and contralateral delay activity (CDA) are event-related potentials in the EEG signal that are commonly used in change detection tasks to track working memory load, as both increase with the number of items maintained in working memory (set size). While the CDA was argued to more purely reflect the memory-specific neural activity than the NSW, it also requires a lateralized design and attention shifts prior to memoranda onset, imposing more restrictions on the task than the NSW. The present study proposes a novel change detection task in which both CDA and NSW can be measured at the same time. Memory items were presented bilaterally, but their distribution in the left and right hemifield varied, inducing a target imbalance or "net load." NSW increased with set size, whereas CDA increased with net load. In addition, a multivariate linear classifier was able to decode the set size and net load from the EEG signal. CDA, NSW, and decoding accuracy predicted an individual's working memory capacity. In line with the notion of a bilateral advantage in working memory, accuracy, and CDA data suggest that participants tended to encode items relatively balanced. In sum, this novel change detection task offers a basis to make use of converging neural measures of working memory in a comprehensive paradigm.

Neural Processing of Repeated Search Targets Depends Upon the Stimuli: Real World Stimuli Engage Semantic Processing and Recognition Memory

Recent evidence has suggested that visual working memory (VWM) plays an important role in representing the target prior to initiating a visual search. The more familiar we are with the search target, the more refined the representation of the target (or "target template") becomes. This sharpening of the target template is thought to underlie the reduced response time (RT) and increased accuracy associated with repeatedly searching for the same target. Perhaps target representations transition from limited-capacity VWM to Long-Term Memory (LTM) as targets repeat. In prior work, amplitude of an event-related potential (ERP) component associated with VWM representation decreased with target repetition, broadly supporting this notion. However, previous research has focused on artificial stimuli (Landolt Cs) that are far removed from search targets in the real world. The current study extends this work by directly comparing target representations for artificial stimuli and common object images. We found VWM representation follows the same pattern for real and artificial stimuli. However, the initial selection of the real world objects follows a much different pattern than more typical artificial stimuli. Further, the morphology of nonlateralized waveforms was substantially different for the two stimulus categories. This suggests that the two types of stimuli were processed in fundamentally different ways. We conclude that object type strongly influences how we deploy attentional and mnemonic resources prior to search. Early attentional selection of familiar objects may facilitate additional LTM processes that lead to behavioral benefits not seen with more simplistic stimuli.

The neurophysiology of working memory development: from childhood to adolescence and young adulthood

Working memory (WM) is an important cognitive function that is necessary to perform our daily activities. The present review briefly describes the most accepted models underlying WM and the neural networks involved in its processing. The review focuses on how the neurophysiological mechanisms develop with age in the periods from childhood to adolescence and young adulthood. Studies using behavioral, neuroimaging, and electrophysiological techniques showed the progress of WM throughout the development. The present review focuses on the neurophysiology of the basic processes underlying WM operations, as indicated by electroencephalogram-derived signals, in order to take advantage of the excellent time resolution of this technique. Children and adults use similar cerebral mechanisms and areas to encode, recognize, and keep the stimuli in memory and update the WM contents, although adults rely more on anterior sites. The possibility that a functional reorganization of WM brain processing occurs around the adolescent period is suggested, and would partly justify the high prevalence of the emergence of mental pathology in the adolescent period.

Movement Interferes with Visuospatial Working Memory during the Encoding: An ERP Study

The present study focuses on the functional interactions of cognition and manual action control. Particularly, we investigated the neurophysiological correlates of the dual-task costs of a manual-motor task (requiring grasping an object, holding it, and subsequently placing it on a target) for working memory (WM) domains (verbal and visuospatial) and processes (encoding and retrieval). Thirty participants were tested in a cognitive-motor dual-task paradigm, in which a single block (a verbal or visuospatial WM task) was compared with a dual block (concurrent performance of a WM task and a motor task). Event-related potentials (ERPs) were analyzed separately for the encoding and retrieval processes of verbal and visuospatial WM domains both in single and dual blocks. The behavioral analyses show that the motor task interfered with WM and decreased the memory performance. The performance decrease was larger for the visuospatial task compared with the verbal task, i.e., domain-specific memory costs were obtained. The ERP analyses show the domain-specific interference also at the neurophysiological level, which is further process-specific to encoding. That is, comparing the patterns of WM-related ERPs in the single block and dual block, we showed that visuospatial ERPs changed only for the encoding process when a motor task was performed at the same time. Generally, the present study provides evidence for domain- and process-specific interactions of a prepared manual-motor movement with WM (visuospatial domain during the encoding process). This study, therefore, provides an initial neurophysiological characterization of functional interactions of WM and manual actions in a cognitive-motor dual-task setting, and contributes to a better understanding of the neuro-cognitive mechanisms of motor action control.

Neural correlates of judgments of learning - An ERP study on metacognition

Metacognitive assessment of performance has been revealed to be one of the most powerful predictors of human learning success and academic achievement. Yet, little is known about the functional nature of cognitive processes supporting judgments of learning (JOLs). The present study investigated the neural underpinnings of JOLs, using event-related brain potentials. Participants were presented with picture pairs and instructed to learn these pairs. After each pair, participants received a task cue, which instructed them to make a JOL (the likelihood of remembering the target when only presented with the cue) or to make a control judgment. Results revealed that JOLs were accompanied by a positive slow wave over medial frontal areas and a bilateral negative slow wave over occipital areas between 350ms and 700ms following the task cue. The results are discussed with respect to recent accounts on the neural correlates of judgments of learning.

Sequential effects in continued visual search: using fixation-related potentials to compare distractor processing before and after target detection

To search for a target in a complex environment is an everyday behavior that ends with finding the target. When we search for two identical targets, however, we must continue the search after finding the first target and memorize its location. We used fixation-related potentials to investigate the neural correlates of different stages of the search, that is, before and after finding the first target. Having found the first target influenced subsequent distractor processing. Compared to distractor fixations before the first target fixation, a negative shift was observed for three subsequent distractor fixations. These results suggest that processing a target in continued search modulates the brain's response, either transiently by reflecting temporary working memory processes or permanently by reflecting working memory retention.

Visual image retention does not contribute to modulation of event-related potentials by mental rotation

Rotation of a visual image in mind is associated with a slow posterior negative deflection of the event-related potential (ERP), termed rotation-related negativity (RRN). Retention of a visual image in short-term memory is also associated with a slow posterior negative ERP, termed negative slow wave (NSW). We tested whether short-term memory retention, indexed by the NSW, contributes to the RRN. ERPs were recorded in the same subjects in two tasks, a mental rotation task, eliciting the RRN, and a visual short-term memory task, eliciting the NSW. Over both right and left parietal scalp, no association was found between the NSW and the RRN amplitudes. Furthermore, adjusting for the effect of the NSW had no influence on a significant association between the RRN amplitude and response time, an index of mental rotation performance. Our data indicate that the RRN reflects manipulation of a visual image but not its retention in short-term memory.

Beta EEG band: a measure of functional brain damage and language reorganization in aphasic patients after recovery

Functional reorganization of language was investigated in a group of eleven non-fluent aphasic patients after linguistic recovery and in a group of matched healthy adults. The ElectroEncephaloGram (EEG) was recorded from 38 scalp electrodes and high-beta band (21-28 Hz), an index of cognitive cortical arousal, was computed as normalized percentage across 0-100 Hz spectral range in six electrode clusters during three linguistic tasks: Phonological, Semantic and Orthographic/visuo-perceptual. During the Phonological task, controls showed greater beta activation on left versus right central cluster, whereas aphasic patients exhibited an inverted pattern of lateralization. In addition, patients' left central cluster, located over the core lesion, showed reduced beta activity with respect to controls. A similar inhibited activation was found in aphasics' left posterior cluster located over undamaged areas. At left anterior locations, aphasics, unlike controls, exhibited larger left versus right beta activity during both Phonological and Orthographic/visuo-perceptual tasks. Results point to substantial reorganization of language in recovered non-fluent aphasics at left prefrontal sites located anterior to the damaged Broca's area and inhibited language-related activation in left posterior undamaged, but disconnected, regions.

Neurophysiological correlates of motor and working memory performance following subthalamic nucleus stimulation

Subthalamic nucleus (STN) deep brain stimulation (DBS) has become an accepted treatment for the motor manifestations of Parkinson disease (PD). The beneficial motor effects of STN DBS are likely due to modulation of BG output to frontal cortical regions associated with motor control, but the underlying neurophysiology of STN DBS effects, especially at the level of the cortex, is not well understood. In this study, we examined the effects of STN DBS on motor disability and visual working memory, a cognitive process supported by pFC. We tested 10 PD participants off medications, ON and OFF stimulation, along with 20 normal controls on a visual working memory task while simultaneously recording cortical EEG. In the OFF state, PD patients had poor motor function, were slower and less accurate in performing the working memory task, and had greater amplitudes and shorter latencies of the N200 ERP response. DBS improved clinical motor function, reduced N200 amplitudes, and increased N200 latencies but had little effect on working memory performance. We conclude that STN DBS normalizes neurophysiological activity in fronto striatal circuits and this may independently affect motor and cognitive function.

Delta EEG band as a marker of left hypofrontality for language in schizophrenia patients

Frontal hypoactivation has consistently been demonstrated in schizophrenia patients. We hypothesized that this well-known deficit is asymmetrical, ie, centered over left frontal locations and, in-line with Crow's theory, associated with both loss of linguistic asymmetry and correlated with positive symptoms. Electroencephalography delta band was used as a quantitative index of cortical inhibition in 17 paranoid schizophrenia patients with prevailing positive symptoms and 17 matched control subjects. Delta amplitude was measured by 38 electrodes, while participants performed 3 linguistic tasks, visuoperceptual, rhyming, and semantic judgment. Compared with control subjects, patients did not show overall delta band differences, revealing no detrimental effects of pharmacological treatment. In healthy participants, analysis of 4 quadrants/regions of interest revealed higher delta amplitude in right vs left anterior sites, indicating significant left anterior disinhibition during linguistic processing. Instead, patients showed bilateral delta band distribution and, compared with control subjects, significant greater delta amplitude (ie, brain inhibition) in linguistic left anterior centers. Patients' left hypofrontality was functionally related to their lack of hemispheric specialization for language and was positively correlated with higher levels of delusions (P1) and conceptual disorganization (P2) Positive and Negative Syndrome Scale subscales. Results suggest, in schizophrenia patients, a functional deficit of Broca's area, a region playing a fundamental hierarchical role between and within hemispheres by integrating many basic processes in linguistic and conceptual organization. The significant correlation between lack of anterior asymmetry and increased positive symptoms is in-line with Crow's hypothesis postulating the etiological role of disrupted linguistic frontal asymmetry on the onset of the key symptoms of schizophrenia.

Feature binding in visual short-term memory is unaffected by task-irrelevant changes of location, shape, and color

Three experiments used a change detection paradigm across a range of study-test intervals to address the respective contributions of location, shape, and color to the formation of bindings of features in sensory memory and visual short-term memory (VSTM). In Experiment 1, location was designated task irrelevant and was randomized between study and test displays. The task was to detect changes in the bindings between shape and color. In Experiments 2 and 3, shape and color, respectively, were task irrelevant and randomized, with bindings tested between location and color (Experiment 2) and location and shape (Experiment 3). At shorter study-test intervals, randomizing location was most disruptive, followed by shape and then color. At longer intervals, randomizing any task-irrelevant feature had no impact on change detection for bindings between features, and location had no special role. Results suggest that location is crucial for initial perceptual binding but loses that special status once representations are formed in VSTM, which operates according to different principles, than do visual attention and perception.

After the P3: late executive processes in stimulus categorization

Two experiments examined the hypothesis that dual systems of stimulus evaluation for categorization can be observed in event-related potentials: one whose duration is indexed by the latency of the P3 component, and a second evident in a later frontal potential. Subjects categorized artificial animals by a "two out of three" rule. Stimuli with two visual features of their own category and one feature of a different category (i.e., near the boundary between categories) elicited very prolonged reaction times as compared to stimuli with three features from a single category. This response time (RT) delay was not accompanied by a delayed P3, suggesting that the P3 indexed only a first pass of stimulus evaluation. The near-boundary stimuli elicited more positive potentials than far-boundary stimuli at prefrontal and frontotemporal sites, suggesting that a secondary stage of stimulus evaluation was triggered when detection of single features or simple conjunctions was insufficient to support a correct decision. The frontal potential that was sensitive to categorization difficulty was of opposite polarity to frontal potentials previously observed in manipulations of working memory. The roles of frontal executive processes in categorization and memory tasks are discussed.

Cortical mechanisms for trans-saccadic memory and integration of multiple object features

Constructing an internal representation of the world from successive visual fixations, i.e. separated by saccadic eye movements, is known as trans-saccadic perception. Research on trans-saccadic perception (TSP) has been traditionally aimed at resolving the problems of memory capacity and visual integration across saccades. In this paper, we review this literature on TSP with a focus on research showing that egocentric measures of the saccadic eye movement can be used to integrate simple object features across saccades, and that the memory capacity for items retained across saccades, like visual working memory, is restricted to about three to four items. We also review recent transcranial magnetic stimulation experiments which suggest that the right parietal eye field and frontal eye fields play a key functional role in spatial updating of objects in TSP. We conclude by speculating on possible cortical mechanisms for governing egocentric spatial updating of multiple objects in TSP.

Planning: fixed-foreperiod event-related potentials during the Tower of London task

Slow wave ERPs were recorded from 28 young adults as they generated plans for various difficulty levels of a fixed-foreperiod version of the Tower of London task. The resulting waveform included three segments: (1) a left-lateralized negative early-interval wave, which was frontally maximal but not sensitive to difficulty, (2) a right-lateralized frontally maximal mid-interval wave, which was more positive for more difficult problems, and (3) a left lateralized centrally maximal negative-ramping contingent negative variation (CNV) late wave, which was more negative for more difficult problems. The current study adds to the current literature in that it finds that the frontal and central neural utilization with difficulty changes across plan generation. This suggests that plan generation should be considered in terms of when component processes of planning are differentially utilized as plan generation unfolds.

Schizophrenia as failure of left hemispheric dominance for the phonological component of language

Background

T. J. Crow suggested that the genetic variance associated with the evolution in Homo sapiens of hemispheric dominance for language carries with it the hazard of the symptoms of schizophrenia. Individuals lacking the typical left hemisphere advantage for language, in particular for phonological components, would be at increased risk of the typical symptoms such as auditory hallucinations and delusions.

Methodology/Principal Findings

Twelve schizophrenic patients treated with low levels of neuroleptics and twelve matched healthy controls participated in an event-related potential experiment. Subjects matched word-pairs in three tasks: rhyming/phonological, semantic judgment and word recognition. Slow evoked potentials were recorded from 26 scalp electrodes, and a laterality index was computed for anterior and posterior regions during the inter stimulus interval. During phonological processing individuals with schizophrenia failed to achieve the left hemispheric dominance consistently observed in healthy controls. The effect involved anterior (fronto-temporal) brain regions and was specific for the Phonological task; group differences were small or absent when subjects processed the same stimulus material in a Semantic task or during Word Recognition, i.e. during tasks that typically activate more widespread areas in both hemispheres.

Conclusions/Significance

We show for the first time how the deficit of lateralization in the schizophrenic brain is specific for the phonological component of language. This loss of hemispheric dominance would explain typical symptoms, e.g. when an individual's own thoughts are perceived as an external intruding voice. The change can be interpreted as a consequence of “hemispheric indecision”, a failure to segregate phonological engrams in one hemisphere.

Early neural signatures of visual short-term memory

Visual short-term memory (VSTM) relies on a distributed network including sensory-related, posterior regions of the brain and frontal areas associated with attention and cognitive control. To characterize the fine temporal details of processing within this network, we recorded event-related potentials (ERPs) while human subjects performed a recognition-memory task. The task's difficulty was graded by varying the perceptual similarity between the items held in memory and the probe used to access memory. The evaluation of VSTM's contents against a test stimulus produced clear similarity-dependent differences in ERPs as early as 156 ms after probe onset. Posterior recording sites were the first to reflect the difficulty of the analysis, preceding their frontal counterparts by about 50 ms. Our results suggest an initial feed-forward interaction underlying stimulus-memory comparisons, consistent with the idea that visual areas contribute to temporary storage of visual information for use in ongoing tasks. This study provides a first look into early neural activity underlying the processing of visual information in short-term memory.

Delta EEG activity as a marker of dysfunctional linguistic processing in developmental dyslexia

The present study used delta EEG band to test the hypothesis of a cerebral maturational delay and a functional altered cerebral asymmetry for phonological processing in dyslexic children. A group of 14 children with dyslexia and 28 matched controls participated in a linguistic paradigm in which the same words were processed in three tasks: phonological, semantic, and orthographic. Delta amplitude was computed as an index of cortical inhibition in four different phases of word processing. In anterior sites, controls showed left activation (reduced delta) during the phonological task and bilateral activation in the other two tasks. Conversely, children with dyslexia showed greater overall delta amplitude, indexing a cerebral maturation delay and an altered language laterality pattern. In the phonological task they had larger left anterior delta (inhibition of left frontal linguistic locations) and smaller left posterior delta amplitude (activation of left posterior sites silent in controls). Results support the phonological deficit hypothesis of developmental dyslexia and the validity of EEG delta band as functional and clinical measure of language laterality.

Transcranial magnetic stimulation over posterior parietal cortex disrupts transsaccadic memory of multiple objects

The posterior parietal cortex (PPC) plays a role in spatial updating of goals for eye and arm movements across saccades, but less is known about its role in updating perceptual memory. We reported previously that transsaccadic memory has a capacity for storing the orientations of three to four Gabor patches either within a single fixation (fixation task) or between separate fixations (saccade task). Here, we tested the role of the PPC in transsaccadic memory in eight subjects by simultaneously applying single-pulse transcranial magnetic stimulation (TMS) over the right and left PPC, over several control sites, and comparing these to behavioral controls with no TMS. In TMS trials, we randomly delivered pulses at one of three different time intervals around the time of the saccade, or at an equivalent time in the fixation task. Controls confirmed that subjects could normally retain at least three visual features. TMS over the left PPC and a control site had no significant effect on this performance. However, TMS over the right PPC disrupted memory performance in both tasks. This TMS-induced effect was most disruptive in the saccade task, in particular when stimulation coincided more closely with saccade timing. Here, the capacity to compare presaccadic and postsaccadic features was reduced to one object, as expected if the spatial aspect of memory was disrupted. This finding suggests that right PPC plays a role in the spatial processing involved in transsaccadic memory of visual features. We propose that this process uses saccade-related feedback signals similar to those observed in spatial updating.

Common coding of auditory and visual spatial information in working memory

We compared spatial short-term memory for visual and auditory stimuli in an event-related slow potentials study. Subjects encoded object locations of either four or six sequentially presented auditory or visual stimuli and maintained them during a retention period of 6 s. Slow potentials recorded during encoding were modulated by the modality of the stimuli. Stimulus related activity was stronger for auditory items at frontal and for visual items at posterior sites. At frontal electrodes, negative potentials incrementally increased with the sequential presentation of visual items, whereas a strong transient component occurred during encoding of each auditory item without the cumulative increment. During maintenance, frontal slow potentials were affected by modality and memory load according to task difficulty. In contrast, at posterior recording sites, slow potential activity was only modulated by memory load independent of modality. We interpret the frontal effects as correlates of different encoding strategies and the posterior effects as a correlate of common coding of visual and auditory object locations.

Linking performance with brain potentials: mental rotation-related negativity revisited

It has been suggested that the amplitude of parietal event-related potentials (ERPs) provides a neural signature of imaginary object rotation. Here, we evaluated the relationship between the so-called rotation-related negativity and individual performance in the mental rotation of alphanumeric characters. The signals were averaged with respect to two time events, stimulus onset (ERP(ONSET)) and response time (ERP(RT)) indexing, respectively, an early and a late phase of the mental rotation. The amplitude of a slow parietal negativity varied with the rotation angle in both ERP(ONSET) and ERP(RT). The amplitude of this potential correlated negatively with task performance, indexed by response time. This was the case in ERP(RT) but not in ERP(ONSET). We further show that variations of the ERP(ONSET) amplitude with the rotation angle might at least partially result from increased duration/latency jitter among single trials. These results suggest that late rather than early processing supports task solution in mental rotation.

Modality and domain specific components in auditory and visual working memory tasks

In the tripartite model of working memory (WM) it is postulated that a unique part system-the visuo-spatial sketchpad (VSSP)-processes non-verbal content. Due to behavioral and neurophysiological findings, the VSSP was later subdivided into visual object and visual spatial processing, the former representing objects' appearance and the latter spatial information. This distinction is well supported. However, a challenge to this model is the question how spatial information from non-visual sensory modalities, for example the auditory one, is processed. Only a few studies so far have directly compared visual and auditory spatial WM. They suggest that the distinction of two processing domains--one for object and one for spatial information--also holds true for auditory WM, but that only a part of the processes is modality specific. We propose that processing in the object domain (the item's appearance) is modality specific, while spatial WM as well as object-location binding relies on modality general processes.

Design and evaluation of tiled parallel coordinate visualization of multichannel EEG data

The field of visualization assists data interpretation in many areas, but does not manage all types of data equally well. This holds, in particular, for time-varying multichannel EEG data. No existing method can successfully visualize simultaneous information from all channels in use at all time steps. To address this problem, a new visualization method is presented based on the parallel coordinate method and making use of a tiled organization. This tiled organization employs a two-dimensional row-column representation, rather than a one-dimensional arrangement in columns as used for classical parallel coordinates. The usefulness of the new method, referred to as tiled parallel coordinates (TPC), is demonstrated by a particular type of EEG data. It can be applied to an arbitrary number of time steps, handling the maximum number of channels currently in use. An extensive user evaluation shows that, for a typical EEG assessment task, data evaluation by the TPC method is faster than by an existing clinical EEG visualization method, without loss of information. The generality of the TPC method makes it widely applicable to other time-varying multivariate data types.

Electrophysiological Measures of Maintaining Representations in Visual Working Memory

Visual working memory (WM) is a limited capacity system which maintains information about objects in the immediate visual environment. Recent neurophysiological and neuroimaging studies have identified sustained memory-item specific activity during the retention period of WM tasks, and this activity may be a physiological substrate of maintaining representations in WM. In the present study, we present an electrophysiological measure of delay activity using event-related potentials (ERPs). Subjects were asked to remember the items in a single hemifield presented within a bilateral display. Approximately 200 msec following the onset of the memory array, we observed a large negative wave at electrode sites that were contralateral with respect to the position of the memory items. This activity persisted throughout the retention period and appears to be an analog to delay activity observed in monkey single-unit and functional magnetic resonance imaging (fMRI) WM studies. The contralateral delay activity is modulated by the number of items in the memory array but reaches asymptote for arrays of 3 to 4 items. This activity is similar across different classes of simple objects and the amplitude is smaller on incorrect response trials relative to correct trials, suggesting that this activity is necessary for correct performance on a given trial. Together, these results appear to indicate an electrophysiological index of the maintained representations in visual WM.

Language lateralization in phonological, semantic and orthographic tasks: A slow evoked potential study

Most of literature on language has shown how different word-classes activate distinct neural networks within linguistic cortical areas. The present investigation aimed to demonstrate that, by means of slow evoked potentials and using the same set of words in different tasks, it is possible to activate cortical networks that are spatially and temporally distinguished. Twenty healthy subjects had to evaluate, in a word pair matching session, whether two words rhymed (phonological task), were semantically related (semantic task) or were written in the same letter case (orthographic task). Slow wave amplitude was computed in three relevant time windows: the last 0.5 s of first word presentation (W1), the initial contingent negative variation (iCNV) and the terminal CNV (tCNV). During W1 and iCNV intervals, both the orthographic and the phonological tasks were left lateralized. Furthermore, the phonological task was more lateralized than the orthographic because of a greater inhibition of the right hemisphere, whereas the orthographic task was characterized by a greater bilateral posterior activation. During the tCNV, only the phonological task remained left lateralized while orthographic and semantic were bilaterally distributed. Although the use of the same set of words tends to activate widely overlapped networks, in the present research task manipulation was effective in demonstrating task dependent differences in brain lateralization. Thus, the present paradigm and the adopted tasks are especially suited for studying deficit and recovery of language in patients affected by linguistic disorders such as developmental dyslexia and aphasia.

Event-related potential measures of visual working memory

Visual working memory is a limited capacity system that temporarily maintains information about objects in the immediate visual environment. Psychophysical experiments have shown that most people are able to actively maintain 3 or 4 items in visual working memory at any point in time. To better understand how this process works and why our working memory capacity is so limited, a variety of neurophysiological approaches have been employed. In recent years, there has been a surge of interest in understanding how visual information is maintained in working memory at the neural level. Single-cell research with nonhuman primates has shown that neuronal firing during the retention period reflects the information that is currently held in working memory. In humans, event-related potentials (ERPs) have been used to examine the maintenance of information in working memory. An event-related potential component, known as the negative slow wave (NSW), has been used to measure the maintenance of information in working memory "online" during a given trial. More recently, another ERP component, the contralateral delay activity (CDA) has been shown to be a fairly specific correlate of the current contents of working memory. This component is sensitive to an individual's working memory capacity and may provide a window into the operations of this central cognitive construct.

Inverted EEG theta lateralization in dyslexic children during phonological processing

The phonological deficit hypothesis of dyslexia has been investigated in the present research by analysing language-related lateralization of the EEG theta band in a sample of dyslexic children. To this aim, a paradigm based on word-pair visual presentation was used in which the same words were processed in Semantic and Phonological tasks. Theta band amplitude, a cortical index that has been related to working memory processing, was analysed during four different phases of word elaboration, thus allowing to measure also the temporal dynamics of word reading/encoding in the verbal working memory. Control subjects showed a specific (and therefore efficient) task-related and time-dependent cortical activation: a peak of theta activity during word reading was found that decayed during the next inter stimulus interval. Furthermore, during word presentation in the Phonological task, theta amplitude was greater on the left hemisphere. Dyslexics evidenced an altered pattern of theta activation both in the temporal dimension and in the cortical space: their peak of activity was delayed to the first inter stimulus interval after word offset and was shifted to the right hemisphere throughout the whole epoch of Phonological task and in two phases of the Semantic task. Analysis of alpha band failed to replicate the complex pattern of lateralization found for theta band in the two groups, a result that suggests a specific functional role of theta band, which cannot be interpreted as a simple marker of cortical inhibition. Results point to a deficit, in dyslexic children, to recruit left hemisphere structures for the elaboration of the phonological component of the verbal working memory. This deficit was marked by a different, unspecific and dysfunctional hemispherical asymmetry of theta activation to language, a deficit that involved also the time course of phonological linguistic elaboration.

Electrophysiological support for strategic processing of spatial sentences

The aims of the present EEG study were to distinguish between the various representation options of spatial sentences and to gain insight into the moment at which differences in the processing of spatial sentences arise. To examine the possible existence of different strategies, we used sentence-sentence and sentence-picture verification trials in mixed blocks, whereby the probability of a specific second stimulus was fixed within a block but varied between blocks. Brain activation (slow wave, 550-1100 ms after stimulus onset) linked to parsing spatial sentences (and not nonspatial sentences) occurred at parieto-occipital regions associated with mental image processing, and only when participants were expecting to compare verbal information to a picture. Therefore, this study provides neuroimaging evidence that different representational formats of spatial sentences arise almost directly when people are reading a spatial sentence.

Genetic covariation between event-related potential (ERP) and behavioral non-ERP measures of working-memory, processing speed, and IQ

The aim of this study was to identify genetic covariants for fundamental measures of brain function (event-related potentials (ERPs): P300 latency and slow wave amplitude recorded in a working-memory task) and more complex cognitive measures (behavioral non-ERP measures: working-memory performance, information processing speed, IQ). Data were collected from 252 monozygotic and 297 dizygotic twin pairs aged 16. Multivariate modeling identified two independent genetic factors associated with processing speed that also influenced working-memory performance (one reflected the duration of neural activity required to evaluate target information, the other reflected more general cognitive and speed-related abilities). However, the allocation of neural resources, as assessed by ERP slow wave amplitude measures, was not associated with the other cognitive measures investigated. Thus, of the ERP measures examined, P300 latency, but not slow wave amplitude, may be an informative measure to include (i.e., with working-memory performance) in future multivariate linkage and association analyses of cognitive function.

Divergence of categorical and coordinate spatial processing assessed with ERPs

The spatial relation between two objects may be described either precisely or more coarsely in abstract terms, denoted as coordinate and categorical descriptions, respectively. These descriptions may reflect the outcomes of two spatial coding processes, which are realized in the left- and right-hemisphere. Support for this account comes from visual field effects in categorical and coordinate judgment tasks and from patient studies. In the current study, this hypothesis was tested by using event-related potentials (ERPs) and source localization. ERPs yield information about the processing stage at which the hypothesized categorical and coordinate processing diverge due to different task demands, especially in our S1-S2 version of the Bar Dot task. A centrally presented Bar Dot (S1) was followed after 2.5s by a second one (S2) in the left or right visual field; participants had to judge whether S2 matched S1 at the categorical, or, in a second task, at the coordinate level. Behavioral measures revealed a left-field advantage in the coordinate task that was absent in the categorical task. S1s elicited stronger early and late bilateral posterior responses in the coordinate than in the categorical task, possibly related to a compensatory strategy at the level of encoding and spatial memory. S2s elicited only stronger early contralateral responses, and stronger late right-hemisphere responses in the categorical task. It is proposed that the left-field advantage in the coordinate task may be due to differences in spatial resolution in perceptual encoding of the left- and right-hemispheres that are largely unaffected by the task at hand.

Biasing the brain's attentional set: I. cue driven deployments of intersensory selective attention

Brain activity associated with directing attention to one of two possible sensory modalities was examined using high-density mapping of human event-related potentials. The deployment of selective attention was based on visually presented symbolic cue-words instructing subjects on a trial-by-trial basis, which sensory modality to attend. We measured the spatio-temporal pattern of activation in the approximately 1 second period between the cue-instruction and a subsequent compound auditory-visual imperative stimulus. This allowed us to assess the flow of processing across brain regions involved in deploying and sustaining inter-sensory selective attention, prior to the actual selective processing of the compound audio-visual target stimulus. Activity over frontal and parietal areas showed sensory specific increases in activation during the early part of the anticipatory period (~230 ms), probably representing the activation of fronto-parietal attentional deployment systems for top-down control of attention. In the later period preceding the arrival of the "to-be-attended" stimulus, sustained differential activity was seen over fronto-central regions and parieto-occipital regions, suggesting the maintenance of sensory-specific biased attentional states that would allow for subsequent selective processing. Although there was clear sensory biasing in this late sustained period, it was also clear that both sensory systems were being prepared during the cue-target period. These late sensory-specific biasing effects were also accompanied by sustained activations over frontal cortices that also showed both common and sensory specific activation patterns, suggesting that maintenance of the biased state includes top-down inputs from generators in frontal cortices, some of which are sensory-specific regions. These data support extensive interactions between sensory, parietal and frontal regions during processing of cue information, deployment of attention, and maintenance of the focus of attention in anticipation of impending attentionally relevant input.

Dynamics of parietofrontal networks underlying visuospatial short-term memory encoding

Brain imaging studies in TEP, functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) have shown that visuospatial short-term memory tasks depend on dorsal parietofrontal networks. Knowing the spatiotemporal dynamics of this network would provide further understanding of the neural bases of the encoding process. We combined magnetoencephalography (MEG) with EEG and fMRI techniques to study this network in a task, in which participants had to judge the symmetry in position of two dots, presented either simultaneously ("immediate comparison") or successively ("memorization" of a first dot and "delayed comparison", after 3 s, with a second dot). With EEG, larger amplitude was observed in the parietocentral P3b component (350-500 ms) in the immediate and "delayed comparisons" than in "memorization" condition, where topography at this time was more anterior and right lateralized. MEG provided a more accurate localization and temporal variations of sources, revealing a strong M4 component at 450 ms in the "memorization" condition, with two sources localized in parietal and right premotor regions. These localizations are consistent with both fMRI foci and EEG cortical current source densities (CSD), but only MEG revealed the strong increase in premotor region at 450 ms related to "memorization". These combined results suggest that EEG P3B and MEG M4 components reflect two different dynamics in parietofrontal networks: the parietocentral P3b indexes a decision mechanism during the immediate and "delayed comparisons", whereas the MEG M4 component, with a larger right premotor source, reflects the encoding process in visuospatial short-term memory.

Multidimensional rule, unidimensional rule, and similarity strategies in categorization: event-related brain potential correlates

Forty participants assigned artificial creatures to categories after explicit rule instruction or feedback alone. Stimuli were typical and atypical exemplars of 2 categories with independent prototypes, conflicting exemplars sharing features of both categories, and "Others" with only 1 or 2 features of the well-defined categories. Ten feedback-only participants spontaneously adopted a unidimensional rule; 10 used a multidimensional similarity strategy. Event-related potentials (ERPs) recorded during the transfer phase showed a commonality between multidimensional rule and similarity strategies in late frontal brain activity that differentiated both from unidimensional rule use. Multidimensional rule users alone showed an earlier prefrontal ERP effect that may reflect inhibition of responses based on similarity. The authors also discuss the role of declarative memory for features and exemplars.

Neural activity predicts individual differences in visual working memory capacity

Contrary to our rich phenomenological visual experience, our visual short-term memory system can maintain representations of only three to four objects at any given moment. For over a century, the capacity of visual memory has been shown to vary substantially across individuals, ranging from 1.5 to about 5 objects. Although numerous studies have recently begun to characterize the neural substrates of visual memory processes, a neurophysiological index of storage capacity limitations has not yet been established. Here, we provide electrophysiological evidence for lateralized activity in humans that reflects the encoding and maintenance of items in visual memory. The amplitude of this activity is strongly modulated by the number of objects being held in the memory at the time, but approaches a limit asymptotically for arrays that meet or exceed storage capacity. Indeed, the precise limit is determined by each individual's memory capacity, such that the activity from low-capacity individuals reaches this plateau much sooner than that from high-capacity individuals. Consequently, this measure provides a strong neurophysiological predictor of an individual's capacity, allowing the demonstration of a direct relationship between neural activity and memory capacity.

Modality effects in verbal working memory: differential prefrontal and parietal responses to auditory and visual stimuli

The neural bases of verbal (nonspatial) working memory (VWM) have been primarily examined using visual stimuli. Few studies have investigated the neural bases of VWM using auditory stimuli, and fewer have explored modality differences in VWM. In this study, we used functional magnetic resonance imaging (fMRI) to examine similarities and differences between visual VWM (vis-VWM) and auditory VWM (aud-VWM) utilizing identical stimuli and a within-subjects design. Performance levels were similar in the two modalities and there was extensive overlap of activation bilaterally in the dorsolateral and ventrolateral prefrontal cortex (DLPFC and VLPFC), intraparietal sulcus, supramarginal gyrus and the basal ganglia. However, a direct statistical comparison revealed significant modality differences: the left posterior parietal cortex, primarily along the intraparietal sulcus, showed greater responses during vis-VWM whereas the left dorsolateral prefrontal cortex showed greater responses during aud-VWM. No such differences were observed in the right hemisphere. Other modality differences in VWM were also observed, but they were associated with relative decreases in activation. In particular, we detected bilateral suppression of the superior and middle temporal (auditory) cortex during vis-VWM, and of the occipital (visual) cortex during aud-VWM, thus suggesting that cross-modal inhibitory processes may help to provide preferential access to high-order heteromodal association areas. Taken together, our findings suggest that although similar prefrontal and parietal regions are involved in aud-VWM and vis-VWM, there are important modality differences in the way neural signals are generated, processed and routed during VWM.