ERP characterization of sustained attention effects in visual lexical categorization

Augmenting locomotor perception by remapping tactile foot sensation to the back

BACKGROUND

Sensory reafferents are crucial to correct our posture and movements, both reflexively and in a cognitively driven manner. They are also integral to developing and maintaining a sense of agency for our actions. In cases of compromised reafferents, such as for persons with amputated or congenitally missing limbs, or diseases of the peripheral and central nervous systems, augmented sensory feedback therefore has the potential for a strong, neurorehabilitative impact. We here developed an untethered vibrotactile garment that provides walking-related sensory feedback remapped non-invasively to the wearer's back. Using the so-called FeetBack system, we investigated if healthy individuals perceive synchronous remapped feedback as corresponding to their own movement (motor awareness) and how temporal delays in tactile locomotor feedback affect both motor awareness and walking characteristics (adaptation).

METHODS

We designed the system to remap somatosensory information from the foot-soles of healthy participants (N = 29), using vibrotactile apparent movement, to two linear arrays of vibrators mounted ipsilaterally on the back. This mimics the translation of the centre-of-mass over each foot during stance-phase. The intervention included trials with real-time or delayed feedback, resulting in a total of 120 trials and approximately 750 step-cycles, i.e. 1500 steps, per participant. Based on previous work, experimental delays ranged from 0ms to 1500ms to include up to a full step-cycle (baseline stride-time: µ = 1144 ± 9ms, range 986-1379ms). After each trial participants were asked to report their motor awareness.

RESULTS

Participants reported high correspondence between their movement and the remapped feedback for real-time trials (85 ± 3%, µ ± σ), and lowest correspondence for trials with left-right reversed feedback (22 ± 6% at 600ms delay). Participants further reported high correspondence of trials delayed by a full gait-cycle (78 ± 4% at 1200ms delay), such that the modulation of motor awareness is best expressed as a sinusoidal relationship reflecting the phase-shifts between actual and remapped tactile feedback (cos model: 38% reduction of residual sum of squares (RSS) compared to linear fit, p < 0.001). The temporal delay systematically but only moderately modulated participant stride-time in a sinusoidal fashion (3% reduction of RSS compared a linear fit, p < 0.01).

CONCLUSIONS

We here demonstrate that lateralized, remapped haptic feedback modulates motor awareness in a systematic, gait-cycle dependent manner. Based on this approach, the FeetBack system was used to provide augmented sensory information pertinent to the user's on-going movement such that they reported high motor awareness for (re)synchronized feedback of their movements. While motor adaptation was limited in the current cohort of healthy participants, the next step will be to evaluate if individuals with a compromised peripheral nervous system, as well as those with conditions of the central nervous system such as Parkinson's Disease, may benefit from the FeetBack system, both for maintaining a sense of agency over their movements as well as for systematic gait-adaptation in response to the remapped, self-paced, rhythmic feedback.

MEG data representing a gamma oscillatory response during the hold/release paradigm

The article presents magnetoencephalography (MEG) data from healthy participants while undergoing the Hold/Release paradigm. During the paradigm, participants visually perceived a sequence of two letter strings which either assembled into real words (Hold condition) or pseudowords (Release condition). If the first letter string was morphologically valid, they held their attention (and/or held the item in working-memory) to wait for the second string, whereas if it were invalid, they could release it, respectively. We present data on high-frequency neuronal oscillations of the Hold condition compared to the Release condition. Making this information publicly available could allow other researchers to perform analyses and contribute to understanding the cognitive processes such as language, mnemonic or attentional processes.

Visual perception affected by motivation and alertness controlled by a noninvasive brain-computer interface

The influence of motivation and alertness on brain activity associated with visual perception was studied experimentally using the Necker cube, which ambiguity was controlled by the contrast of its ribs. The wavelet analysis of recorded multichannel electroencephalograms (EEG) allowed us to distinguish two different scenarios while the brain processed the ambiguous stimulus. The first scenario is characterized by a particular destruction of alpha rhythm (8–12 Hz) with a simultaneous increase in beta-wave activity (20–30 Hz), whereas in the second scenario, the beta rhythm is not well pronounced while the alpha-wave energy remains unchanged. The experiments were carried out with a group of financially motivated subjects and another group of unpaid volunteers. It was found that the first scenario occurred mainly in the motivated group. This can be explained by the increased alertness of the motivated subjects. The prevalence of the first scenario was also observed in a group of subjects to whom images with higher ambiguity were presented. We believe that the revealed scenarios can occur not only during the perception of bistable images, but also in other perceptual tasks requiring decision making. The obtained results may have important applications for monitoring and controlling human alertness in situations which need substantial attention. On the base of the obtained results we built a brain-computer interface to estimate and control the degree of alertness in real time.

An ERP investigation of vertical reading fluency in Scrabble® experts

Previous studies have found that competitive Scrabble expertise is associated with enhanced performance on visual lexical decision tasks (LDT), particularly for vertically presented stimuli. In the current study, we investigated the underlying mechanisms responsible for this vertical fluency. We examined behaviour and neural activity during LDT in 19 competitive Scrabble players and 18 matched controls. Using event related potentials (ERP), we investigated whether Scrabble expertise modulates the N170, P300, and late positive component (LPC), associated with visual-orthographic processing, working memory, and stimulus classification, respectively. Behavioural results replicated those from previous studies: Scrabble experts were significantly faster than controls to respond to vertical stimuli in LDT. ERP results showed Scrabble experts had larger P300 amplitudes in right parietal electrodes compared to controls, as well as greater differentiation in LPC amplitudes between vertical words and nonwords. These findings suggest that the mechanism underlying vertical fluency in Scrabble experts involves enhanced domain-specific working memory and stimulus classification processes. The results have implications for understanding the flexibility of the adult visual word recognition system, as well as the behavioural and neural consequences of training within this system.

Electrophysiological Correlates of Error Monitoring and Feedback Processing in Second Language Learning

Humans monitor their behavior to optimize performance, which presumably relies on stable representations of correct responses. During second language (L2) learning, however, stable representations have yet to be formed while knowledge of the first language (L1) can interfere with learning, which in some cases results in persistent errors. In order to examine how correct L2 representations are stabilized, this study examined performance monitoring in the learning process of second language learners for a feature that conflicts with their first language. Using EEG, we investigated if L2 learners in a feedback-guided word gender assignment task showed signs of error detection in the form of an error-related negativity (ERN) before and after receiving feedback, and how feedback is processed. The results indicated that initially, response-locked negativities for correct (CRN) and incorrect (ERN) responses were of similar size, showing a lack of internal error detection when L2 representations are unstable. As behavioral performance improved following feedback, the ERN became larger than the CRN, pointing to the first signs of successful error detection. Additionally, we observed a second negativity following the ERN/CRN components, the amplitude of which followed a similar pattern as the previous negativities. Feedback-locked data indicated robust FRN and P300 effects in response to negative feedback across different rounds, demonstrating that feedback remained important in order to update memory representations during learning. We thus show that initially, L2 representations may often not be stable enough to warrant successful error monitoring, but can be stabilized through repeated feedback, which means that the brain is able to overcome L1 interference, and can learn to detect errors internally after a short training session. The results contribute a different perspective to the discussion on changes in ERN and FRN components in relation to learning, by extending the investigation of these effects to the language learning domain. Furthermore, these findings provide a further characterization of the online learning process of L2 learners.

A neuronal gamma oscillatory signature during morphological unification in the left occipitotemporal junction

Morphology is the aspect of language concerned with the internal structure of words. In the past decades, a large body of masked priming (behavioral and neuroimaging) data has suggested that the visual word recognition system automatically decomposes any morphologically complex word into a stem and its constituent morphemes. Yet the reliance of morphology on other reading processes (e.g., orthography and semantics), as well as its underlying neuronal mechanisms are yet to be determined. In the current magnetoencephalography study, we addressed morphology from the perspective of the unification framework, that is, by applying the Hold/Release paradigm, morphological unification was simulated via the assembly of internal morphemic units into a whole word. Trials representing real words were divided into words with a transparent (true) or a nontransparent (pseudo) morphological relationship. Morphological unification of truly suffixed words was faster and more accurate and additionally enhanced induced oscillations in the narrow gamma band (60-85 Hz, 260-440 ms) in the left posterior occipitotemporal junction. This neural signature could not be explained by a mere automatic lexical processing (i.e., stem perception), but more likely it related to a semantic access step during the morphological unification process. By demonstrating the validity of unification at the morphological level, this study contributes to the vast empirical evidence on unification across other language processes. Furthermore, we point out that morphological unification relies on the retrieval of lexical semantic associations via induced gamma band oscillations in a cerebral hub region for visual word form processing.

Orthographic recognition in late adolescents: an assessment through event-related brain potentials

Reading speed and efficiency are achieved through the automatic recognition of written words. Difficulties in learning and recognizing the orthography of words can arise despite reiterative exposure to texts. This study aimed to investigate, in native Spanish-speaking late adolescents, how different levels of orthographic knowledge might result in behavioral and event-related brain potential differences during the recognition of orthographic errors. Forty-five healthy high school students were selected and divided into 3 equal groups (High, Medium, Low) according to their performance on a 5-test battery of orthographic knowledge. All participants performed an orthographic recognition task consisting of the sequential presentation of a picture (object, fruit, or animal) followed by a correctly, or incorrectly, written word (orthographic mismatch) that named the picture just shown. Electroencephalogram (EEG) recording took place simultaneously. Behavioral results showed that the Low group had a significantly lower number of correct responses and increased reaction times while processing orthographical errors. Tests showed significant positive correlations between higher performance on the experimental task and faster and more accurate reading. The P150 and P450 components showed higher voltages in the High group when processing orthographic errors, whereas N170 seemed less lateralized to the left hemisphere in the lower orthographic performers. Also, trials with orthographic errors elicited a frontal P450 component that was only evident in the High group. The present results show that higher levels of orthographic knowledge correlate with high reading performance, likely because of faster and more accurate perceptual processing, better visual orthographic representations, and top-down supervision, as the event-related brain potential findings seem to suggest.

Multichannel linear descriptors analysis for sustained attention-related electroencephalography

This study investigated the differences in brain functional state between sustained attention and ignoring task conditions using the electroencephalography in association with sustained attention to response task (SART) performance. Multichannel electroencephalography data were obtained from 10 male healthy volunteers while performing the SART. Three multichannel linear descriptors, that is spatial complexity (Ω), field strength (Σ), and frequency of field changes (Φ), were applied to analyze three frequency bands (θ, α, and β) for sustained attention and ignoring task conditions. The experimental results showed that participants had a significantly lower Ω value in the θ and α band in the SART state. The Σ value was significantly higher in each frequency band of interest in almost all region of interest areas during SART performance. In addition, the Φ value was significantly lower in the θ band and significantly higher in the β band during the sustained attention condition. The results indicated that multichannel linear descriptors could show the differences in brain functions between sustained attention and ignoring task conditions, and might be used to evaluate disorders with an attentional dysfunction.

The time course of activation of object shape and shape+colour representations during memory retrieval

Little is known about the timing of activating memory for objects and their associated perceptual properties, such as colour, and yet this is important for theories of human cognition. We investigated the time course associated with early cognitive processes related to the activation of object shape and object shape+colour representations respectively, during memory retrieval as assessed by repetition priming in an event-related potential (ERP) study. The main findings were as follows: (1) we identified a unique early modulation of mean ERP amplitude during the N1 that was associated with the activation of object shape independently of colour; (2) we also found a subsequent early P2 modulation of mean amplitude over the same electrode clusters associated with the activation of object shape+colour representations; (3) these findings were apparent across both familiar (i.e., correctly coloured – yellow banana) and novel (i.e., incorrectly coloured - blue strawberry) objects; and (4) neither of the modulations of mean ERP amplitude were evident during the P3. Together the findings delineate the timing of object shape and colour memory systems and support the notion that perceptual representations of object shape mediate the retrieval of temporary shape+colour representations for familiar and novel objects.

Do Spanish-English Bilinguals have Their Fingers in Two Pies - or is It Their Toes? An Electrophysiological Investigation of Semantic Access in Bilinguals

We examined the time course of cross-language activation during word recognition in the context of semantic priming with interlingual homographs. Spanish–English bilinguals were presented pairs of English words visually one word at a time and judged whether the two words were related in meaning while recording event-related potentials. Interlingual homographs (e.g., “pie”: “Pie” in Spanish is a foot.) appeared in the target position and were preceded by primes that were either related to the English meaning (e.g., “apple”), related to the Spanish meaning of interlingual homographs (e.g., “toe”) or totally unrelated (e.g., “floor”/“bed”). Spanish–English bilinguals showed semantic priming not only when interlingual homographs were related to the English meaning but also to the Spanish meaning of the prime. These priming effects were detectable in the mean amplitude of the N400 (350–500 ms) even when the target word was related to the prime in Spanish and the context of the experiment was English. However, the relatedness effect was found in the window of a late positive component (LPC; 550–700 ms) only for stimulus pairs related in English. To verify that the observed pattern of the results was due to participants’ bilingualism, we also tested a group of English monolinguals. The monolinguals showed a semantic priming effect for the N400 and LPC time windows only when interlingual homographs were related to the English meaning. These results suggest that both languages are activated in the classical time frame of semantic activation indexed by N400 modulations, but that semantic activation in the non-target language failed to be explicitly processed.

Effects of speed of word processing on semantic access: the case of bilingualism

Bilingual speakers generally manifest slower word recognition than monolinguals. We investigated the consequences of the word processing speed on semantic access in bilinguals. The paradigm involved a stream of English words and pseudowords presented in succession at a constant rate. English-Welsh bilinguals and English monolinguals were asked to count the number of letters in pseudowords and actively disregard words. They were not explicitly told that pairs of words in immediate succession were embedded and could either be semantically related or not. We expected that slower word processing in bilinguals would result in semantic access indexed by semantic priming. As expected, bilinguals showed significant semantic priming, indexed by an N400 modulation, whilst monolinguals did not. Moreover, bilinguals were slower in performing the task. The results suggest that bilinguals cannot discriminate between pseudowords and words without accessing semantic information whereas monolinguals can dismiss English words on the basis of subsemantic information.