Pseudohomophone effects provide evidence of early lexico-phonological processing in visual word recognition

The role of valence and arousal for phonological iconicity in the lexicon of German: a cross-validation study using pseudoword ratings

The notion of sound symbolism receives increasing interest in psycholinguistics. Recent research - including empirical effects of affective phonological iconicity on language processing (Adelman et al., 2018; Conrad et al., 2022) - suggested language codes affective meaning at a basic phonological level using specific phonemes as sublexical markers of emotion. Here, in a series of 8 rating-experiments, we investigate the sensitivity of language users to assumed affectively-iconic systematic distribution patterns of phonemes across the German vocabulary:After computing sublexical-affective-values (SAV) concerning valence and arousal for the entire German phoneme inventory according to occurrences of syllabic onsets, nuclei and codas in a large-scale affective normative lexical database, we constructed pseudoword material differing in SAV to test for subjective affective impressions.Results support affective iconicity as affective ratings mirrored sound-to-meaning correspondences in the lexical database. Varying SAV of otherwise semantically meaningless pseudowords altered affective impressions: Higher arousal was consistently assigned to pseudowords made of syllabic constituents more often used in high-arousal words - contrasted by less straightforward effects of valence SAV. Further disentangling specific differential effects of the two highly-related affective dimensions valence and arousal, our data clearly suggest arousal, rather than valence, as the relevant dimension driving affective iconicity effects.

Electrophysiological signatures of spelling sensitivity development from primary school age to adulthood

Recognizing spelling errors is important for correct writing and reading, and develops over an extended period. The neural bases of the development of orthographic sensitivity remain poorly understood. We investigated event-related potentials (ERPs) associated with spelling error recognition when performing the orthographic decision task with correctly spelled and misspelled words in children aged 8-10 years old, early adolescents aged 11-14 years old, and adults. Spelling processing in adults included an early stage associated with the initial recognition of conflict between orthography and phonology (reflected in the N400 time window) and a later stage (reflected in the P600 time window) related to re-checking the spelling. In children 8-10 years old, there were no differences in ERPs to correct and misspelled words; in addition, their behavioral scores were worse than those of early adolescents, implying that the ability to quickly recognize the correct spelling is just beginning to develop at this age. In early adolescents, spelling recognition was reflected only at the later stage, corresponding to the P600 component. At the behavioral level, they were worse than adults at recognizing misspelled words. Our data suggest that orthographic sensitivity can develop beyond 14 years.

Top-down modulation of brain responses in spelling error recognition

The task being undertaken can influence orthographic, phonological and semantic processes. In linguistic research, two tasks are most often used: a task requiring a decision in relation to the presented word and a passive reading task which does not require a decision regarding the presented word. The results of studies using these different tasks are not always consistent. This study aimed to explore brain responses associated with the process of recognition of spelling errors, as well as the influence of the task on this process. Event-related potentials (ERPs) were recorded in 40 adults during an orthographic decision task to determine correctly spelled words and words written with errors that did not change the phonology and during the passive reading. During spelling recognition, the early stages up to 100 ms after the stimulus were automatic and did not depend on the requirements of the task. The amplitude of the N1 component (90-160 ms) was greater in the orthographic decision task, but did not depend on the correct spelling of the word. Late word recognition after 350-500 ms was task dependent, but spelling effects were similar across the two tasks: misspelled words evoked an increase in the amplitude of the N400 component related to lexical and semantic processing regardless of the task. In addition, the orthographic decision task modulated spelling effects, this was reflected in an increase in the amplitude of the P2 component (180-260 ms) for correctly spelled words compared with misspelled words. Thus, our results show that spelling recognition involves general lexico-semantic processes independent of the task. Simultaneously, the orthographic decision task modulates the spelling-specific processes necessary to quickly detect conflicts between orthographic and phonological representations of words in memory.

Using Network Science and Psycholinguistic Megastudies to Examine the Dimensions of Phonological Similarity

Network science was used to examine different dimensions of phonological similarity in English. Data from a phonological associate task and an identification of words in noise task were used to create a phonological association network and a misperception network. These networks were compared to a network formed by a computational metric widely used to assess phonological similarity (i.e., one-phoneme metric). The phonological association network and the misperception network were topographically more similar to each other than either were to the one-phoneme metric network, but there were several network features in common between the one-phoneme metric network and the phonological association network. To assess the influence of network structure on processing, we compared the influence of degree (i.e., neighborhood density) from each of the networks on visual and auditory lexical decision reaction times obtained from two psycholinguistic megastudies. The effect of degree differed across network types and tasks. We discuss the use of each approach to determine phonological similarity and a possible direction forward for language research through the use of multiplex networks.

Behavioral and electrophysiological analyses of written word processing in spoken and literary Arabic: New insights into the diglossia question

Diglossia in Arabic describes the existence and the use of two varieties of the same language: spoken Arabic (SA) and literary Arabic (LA). SA, the dialect first spoken by Arabic native speakers, is used in non‐formal situations for everyday conversations, and varies from one region to another in the Arabic world. LA, acquired later in life when the children learn to read and write at school, is used for formal purposes such as media, speeches in public and religious sermons. Previous research showed that, in the auditory modality, SA words are processed faster than LA ones. In the visual modality, written LA words are processed faster than SA ones, the latter comparing with low‐frequency words. This study analysed event‐related potentials (ERPs) during the processing of high‐frequency (LAHF), LA low‐frequency (LALF) and SA high‐frequency words (SAHF) in a visual lexical decision task. Faster reaction times were observed for LAHF, followed by SAHF and then by LALF. ERPs showed a modulation of the early components starting from the P100 component and of the late P600 component, supposedly related to memory processes. These findings, indicating that processing written SAHF words was largely comparable with processing of LALF, are discussed in the context of Arabic diglossia.

Frequency Effects on Spelling Error Recognition: An ERP Study

Spelling errors are ubiquitous in all writing systems. Most studies exploring spelling errors focused on the phonological plausibility of errors. However, unlike typical pseudohomophones, spelling errors occur in naturally produced written language. We investigated the time course of recognition of the most frequent orthographic errors in Russian (error in an unstressed vowel in the root) and the effect of word frequency on this process. During event-related potentials (ERP) recording, 26 native Russian speakers silently read high-frequency correctly spelled words, low-frequency correctly spelled words, high-frequency words with errors, and low-frequency words with errors. The amplitude of P200 was more positive for correctly spelled words than for misspelled words and did not depend on the frequency of the words. In addition, in the 350–500-ms time window, we found a more negative response for misspelled words than for correctly spelled words in parietal–temporal-occipital regions regardless of word frequency. Considering our results in the context of a dual-route model, we concluded that recognizing misspelled high-frequency and low-frequency words involves common orthographic and phonological processes associated with P200 and N400 components such as whole word orthography processing and activation of phonological representations correspondingly. However, at the 500–700 ms stage (associated with lexical-semantic access in our study), error recognition depends on the word frequency. One possible explanation for these differences could be that at the 500–700 ms stage recognition of high-frequency misspelled and correctly spelled words shifts from phonological to orthographic processes, while low-frequency misspelled words are accompanied by more prolonged phonological activation. We believe these processes may be associated with different ERP components P300 and N400, reflecting a temporal overlap between categorization processes based on orthographic properties for high-frequency words and phonological processes for low-frequency words. Therefore, our results complement existing reading models and demonstrate that the neuronal underpinnings of spelling error recognition during reading may depend on word frequency.

Influences of First and Second Language Phonology on Spanish Children Learning to Read in English

Children learning to read in two different orthographic systems are exposed to cross-linguistic interferences. We explored the effects of school (Monolingual, Bilingual) and grade (2nd, 4th, and 6th) on phonological activation during a visual word recognition task. Elementary school children from Spain completed a lexical decision task in English. The task included real words and pseudohomophones following Spanish or English phonological rules. Using the mouse-tracking paradigm, we analyzed errors, reaction times, and computer mouse movements. Children in the bilingual school performed better than children in the monolingual school. Children in higher grades performed better than children in lower grades. The interference effect of Spanish phonology was weak and became weaker in higher grades. Spanish children differentiate between first and second language grapheme-to-phoneme correspondences since early on in the educational process. In 6th grade, children from the bilingual school responded better to words and Spanish pseudohomophones, while children from the monolingual school were less distracted by the English pseudohomophones. Children in the bilingual school had stronger inhibition of Spanish (L1) phonology and stronger activation of English (L2) phonology. Instructional method plays an important role on the processing strategies Spanish children rely on when reading in English. School and grade influence the link between orthographic and phonological representations.

Costs and Benefits of Native Language Similarity for Non-native Word Learning

The present study examined the costs and benefits of native language similarity for non-native vocabulary learning. Because learning a second language (L2) is difficult, many learners start with easy words that look like their native language (L1) to jumpstart their vocabulary. However, this approach may not be the most effective strategy in the long-term, compared to introducing difficult L2 vocabulary early on. We examined how L1 orthographic typicality affects pattern learning of novel vocabulary by teaching English monolinguals either Englishlike or Non-Englishlike pseudowords that contained repeated orthographic patterns. We found that overall, the first words that individuals learned during initial acquisition influenced which words they acquired later. Specifically, learning a new word in one session made it easier to acquire an orthographically similar word in the next session. Similarity among non-native words interacted with native language similarity, so that words that looked more like English were easier to learn at first, but they were less effective at influencing later word learning. This demonstrates that although native language similarity has a beneficial effect early on, it may reduce learners' ability to benefit from non-native word patterns during continued acquisition. This surprising finding demonstrates that making learning easier may not be the most effective long-term strategy. Learning difficult vocabulary teaches the learner what makes non-native words unique, and this general wordform knowledge may be more valuable than the words themselves. We conclude that native language similarity modulates new vocabulary acquisition and that difficulties during learning are not always to be avoided, as additional effort early on can pay later dividends.

Right visual field advantage for lexical decision dependent on stimulus size and visibility: Evidence for an early processing account of hemispheric asymmetry

Previous research suggests that the right visual field advantage on the lexical decision task occurs independent of the visual quality of stimuli [Chiarello, C., Senehi, J., & Soulier, M. (1986). Viewing conditions and hemisphere asymmetry for the lexical decision. Neuropsychologia, 24(4), 521-529]. However, previous studies examining these effects have had methodological limitations that were addressed and controlled for in the present study. Participants performed a divided visual field, lexical decision task for words that varied in size (Experiment 1) and visibility (Experiment 2). Results showed a quality by visual field interaction effect. In both experiments, response times were faster for targets presented to the right visual field in the high quality (i.e., large font, high visibility) conditions; however, visual quality resulted in no differences for targets presented to the left visual field. Furthermore, this quality by visual field interaction effect was only observed when the target was a word. These results suggest that the left hemisphere advantage for lexical decision depends on the perceptual quality of targets, consistent with an early stage of processing account of hemispheric asymmetry during lexical decision. Findings are discussed within the context of word recognition and decision-based models.

Event-related brain potentials related to the identification of different types of signs

The present study examined the electrophysiological activity during the processing in the identification of signs. Participants performed a sign identification task, in which real, pseudo, and fake signs were adopted as stimuli. Common mathematical operation signs (e.g. +, -, ×, and ÷), which were known to the participants were adopted as the real signs. The pseudo signs had a similar appearance to the real signs (e.g. (Equation is included in full-text article.), (Equation is included in full-text article.), ×, and ÷). The fake signs were also unknown, but had an entirely different shape from the real signs (e.g. (Equation is included in full-text article.), (Equation is included in full-text article.), (Equation is included in full-text article.), and (Equation is included in full-text article.)). The behavioral results showed inferior recognition performance for pseudo signs relative to real or fake signs. Event-related potential results showed that (a) pseudo signs evoked a more positive P200 component than did real or fake signs, suggesting that more attentional resources might be allocated to the pseudo signs relative to the real or fake signs and (b) fake signs evoked a more negative N300 component than real or pseudo signs, suggesting that more cognitive resources might be recruited in processing the visual aspects for fake signs relative to real or pseudo signs. These results suggested that the P200 component, which is associated with attentional resource allocation, and the N300, which is sensitive to visual aspects, were evoked in processing the signs.

Is holistic processing of written words modulated by phonology?

Holistic processing, a hallmark of face processing, has been shown for written words, signaled by the word composite effect. Fluent readers find it harder to focus on one half of a written word (e.g., the first syllable of a CV.CV word) while ignoring the other half (e.g., the second syllable), especially when the two halves are aligned rather than misaligned. Given the linguistic nature of written words, in the present study, we examined whether the word composite effect is modulated by phonology. In Experiment 1, participants saw two sequentially presented CV.CV words and had to decide if the left half (first syllable) was the same or not, regardless of the right half. The word pairs were either phonologically consistent (univocal orthography to phonology mapping; e.g., TI is always /ti/ in Portuguese) or inconsistent (orthography can map into different phonological representations; e.g., CA can correspond to /ka/ or /kɐ/). The word composite effect was found for phonologically consistent words but not for phonologically inconsistent words. In Experiment 2, timing of trial events was reduced to test whether the influence of phonology was fast and automatic. Similar to what was found in Experiment 1, the word composite effect was found only for phonologically consistent words. The faster trial events in Experiment 2 rendered it less likely that the influence of phonology in word composite effect is merely a result of strategic processing. These findings suggest that holistic processing of visual words is modulated by fast and automatic activation of lexical phonological representations.

ERP effects of masked orthographic neighbour priming in deaf readers

In masked priming studies with hearing readers, neighbouring words (e.g., wine, vine) compete through lateral inhibition. Here, we asked whether lateral inhibition also characterizes visual word recognition in deaf readers and whether the neural signature of this competition is the same as for hearing readers. Only real words have lexical representations that engage in lateral inhibition. Therefore, we compared processing of target words following neighbouring prime words (e.g., wine-VINE) and pseudowords (e.g., bine-VINE). Targets following words elicited larger amplitude N400s and slower lexical decision responses than those following pseudowords, indicating more effortful processing due to lateral inhibition. Although these effects went in the same direction for hearing and deaf readers, the distribution of the N400 effect differed. We associate the more anterior effect in hearing readers with stronger co-activation of, and competition among, phonological representations. Thus, deaf readers use lexical competition to recognize visual words, but it is primarily restricted to orthographic representations.

Steady state visual evoked potentials in reading aloud: Effects of lexicality, frequency and orthographic familiarity

The present study explored the possibility to use Steady-State Visual Evoked Potentials (SSVEPs) as a tool to investigate the core mechanisms in visual word recognition. In particular, we investigated three benchmark effects of reading aloud: lexicality (words vs. pseudowords), frequency (high-frequency vs. low-frequency words), and orthographic familiarity ('familiar' versus 'unfamiliar' pseudowords). We found that words and pseudowords elicited robust SSVEPs. Words showed larger SSVEPs than pseudowords and high-frequency words showed larger SSVEPs than low-frequency words. SSVEPs were not sensitive to orthographic familiarity. We further localized the neural generators of the SSVEP effects. The lexicality effect was located in areas associated with early level of visual processing, i.e. in the right occipital lobe and in the right precuneus. Pseudowords produced more activation than words in left sensorimotor areas, rolandic operculum, insula, supramarginal gyrus and in the right temporal gyrus. These areas are devoted to speech processing and/or spelling-to-sound conversion. The frequency effect involved the left temporal pole and orbitofrontal cortex, areas previously implicated in semantic processing and stimulus-response associations respectively, and the right postcentral and parietal inferior gyri, possibly indicating the involvement of the right attentional network.

Reading Shakespeare Sonnets: Combining Quantitative Narrative Analysis and Predictive Modeling -an Eye Tracking Study

As a part of a larger interdisciplinary project on Shakespeare sonnets' reception (1, 2), the present study analyzed the eye movement behavior of participants reading three of the 154 sonnets as a function of seven lexical features extracted via Quantitative Narrative Analysis (QNA). Using a machine learning-based predictive modeling approach five 'surface' features (word length, orthographic neighborhood density, word frequency, orthographic dissimilarity and sonority score) were detected as important predictors of total reading time and fixation probability in poetry reading. The fact that one phonological feature, i.e., sonority score, also played a role is in line with current theorizing on poetry reading. Our approach opens new ways for future eye movement research on reading poetic texts and other complex literary materials(3).

Investigating pseudohomophone interference effects in young second-language learners

This study aimed to investigate phonological activation during silent word reading in French adolescents learning English as a second language (L2) at secondary school. Grade 6 and Grade 8 adolescents performed lexical decision tasks in English, where we compared processing of nonwords that were homophonic to real L2 words (i.e., pseudohomophones [PsHs]; e.g., grean) with that of orthographic control pseudowords (OCs; e.g., greun). In Experiment 1, PsHs were constructed so that they sounded like L2 words when using cross-language (L1) grapheme-to-phoneme correspondences (GPCs) only (e.g., grine), whereas PsHs were constructed with within-language (L2) GPCs (e.g., grean) in Experiment 2. Results showed a PsH interference effect as reflected by higher error rates and/or longer rejection times for PsHs compared with OCs whether using within-language or cross-language GPCs and at both grade levels. Evidence of this PsH interference effect was also observed in Experiment 3, which used PsHs that sounded like real L1 words when using L2 GPCs (e.g., droal for the French word drôle [funny in English]). We suggest that young L2 learners automatically activate both L1 and L2 GPCs during L2 silent reading in favor of strong cross-language interactions at the orthography-to-phonology interface. The results are discussed in relation to bilingual and developmental models on visual word recognition.

Individual Differences in the Neural and Cognitive Mechanisms of Single Word Reading

Written language is a human invention that our brains did not evolve for. Yet, most research has focused on finding a single theory of reading, identifying the common set of cognitive and neural processes shared across individuals, neglecting individual differences. In contrast, we investigated variation in single word reading. Using a novel statistical method for analyzing heterogeneity in multi-subject task-based functional magnetic resonance imaging (fMRI), we clustered readers based on their brain's response to written stimuli. Separate behavioral testing and neuroimaging analysis shows that these clusters differed in the role of the sublexical pathway in processing written language, but not in reading skill. Taken together, these results suggest that individuals vary in the cognitive and neural mechanisms involved in word reading. In general, neurocognitive theories need to account not only for what tends to be true of the population, but also the types of variation that exist, even within a neurotypical population.

Why 'piss' is ruder than 'pee'? The role of sound in affective meaning making

Most language users agree that some words sound harsh (e.g. grotesque) whereas others sound soft and pleasing (e.g. lagoon). While this prominent feature of human language has always been creatively deployed in art and poetry, it is still largely unknown whether the sound of a word in itself makes any contribution to the word's meaning as perceived and interpreted by the listener. In a large-scale lexicon analysis, we focused on the affective substrates of words' meaning (i.e. affective meaning) and words' sound (i.e. affective sound); both being measured on a two-dimensional space of valence (ranging from pleasant to unpleasant) and arousal (ranging from calm to excited). We tested the hypothesis that the sound of a word possesses affective iconic characteristics that can implicitly influence listeners when evaluating the affective meaning of that word. The results show that a significant portion of the variance in affective meaning ratings of printed words depends on a number of spectral and temporal acoustic features extracted from these words after converting them to their spoken form (study1). In order to test the affective nature of this effect, we independently assessed the affective sound of these words using two different methods: through direct rating (study2a), and through acoustic models that we implemented based on pseudoword materials (study2b). In line with our hypothesis, the estimated contribution of words' sound to ratings of words' affective meaning was indeed associated with the affective sound of these words; with a stronger effect for arousal than for valence. Further analyses revealed crucial phonetic features potentially causing the effect of sound on meaning: For instance, words with short vowels, voiceless consonants, and hissing sibilants (as in 'piss') feel more arousing and negative. Our findings suggest that the process of meaning making is not solely determined by arbitrary mappings between formal aspects of words and concepts they refer to. Rather, even in silent reading, words' acoustic profiles provide affective perceptual cues that language users may implicitly use to construct words' overall meaning.

Affective Congruence between Sound and Meaning of Words Facilitates Semantic Decision

A similarity between the form and meaning of a word (i.e., iconicity) may help language users to more readily access its meaning through direct form-meaning mapping. Previous work has supported this view by providing empirical evidence for this facilitatory effect in sign language, as well as for onomatopoetic words (e.g., cuckoo) and ideophones (e.g., zigzag). Thus, it remains largely unknown whether the beneficial role of iconicity in making semantic decisions can be considered a general feature in spoken language applying also to “ordinary” words in the lexicon. By capitalizing on the affective domain, and in particular arousal, we organized words in two distinctive groups of iconic vs. non-iconic based on the congruence vs. incongruence of their lexical (meaning) and sublexical (sound) arousal. In a two-alternative forced choice task, we asked participants to evaluate the arousal of printed words that were lexically either high or low arousing. In line with our hypothesis, iconic words were evaluated more quickly and more accurately than their non-iconic counterparts. These results indicate a processing advantage for iconic words, suggesting that language users are sensitive to sound-meaning mappings even when words are presented visually and read silently.

Quantifying the Beauty of Words: A Neurocognitive Poetics Perspective

In this paper I would like to pave the ground for future studies in Computational Stylistics and (Neuro-)Cognitive Poetics by describing procedures for predicting the subjective beauty of words. A set of eight tentative word features is computed via Quantitative Narrative Analysis (QNA) and a novel metric for quantifying word beauty, the aesthetic potential is proposed. Application of machine learning algorithms fed with this QNA data shows that a classifier of the decision tree family excellently learns to split words into beautiful vs. ugly ones. The results shed light on surface and semantic features theoretically relevant for affective-aesthetic processes in literary reading and generate quantitative predictions for neuroaesthetic studies of verbal materials.

Neurofunctionally dissecting the reading system in children

The reading system can be broken down into four basic subcomponents in charge of prelexical, orthographic, phonological, and lexico-semantic processes. These processes need to jointly work together to become a fluent and efficient reader. Using functional magnetic resonance imaging (fMRI), we systematically analyzed differences in neural activation patterns of these four basic subcomponents in children (N=41, 9-13 years) using tasks specifically tapping each component (letter identification, orthographic decision, phonological decision, and semantic categorization). Regions of interest (ROI) were selected based on a meta-analysis of child reading and included the left ventral occipito-temporal cortex (vOT), left posterior parietal cortex (PPC), left inferior frontal gyrus (IFG), and bilateral supplementary motor area (SMA). Compared to a visual baseline task, enhanced activation in vOT and IFG was observed for all tasks with very little differences between tasks. Activity in the dorsal PPC system was confined to prelexical and phonological processing. Activity in the SMA was found in orthographic, phonological, and lexico-semantic tasks. Our results are consistent with the idea of an early engagement of the vOT accompanied by executive control functions in the frontal system, including the bilateral SMA.

Faster phonological processing and right occipito-temporal coupling in deaf adults signal poor cochlear implant outcome

The outcome of adult cochlear implantation is predicted positively by the involvement of visual cortex in speech processing, and negatively by the cross-modal recruitment of the right temporal cortex during and after deafness. How these two neurofunctional predictors concur to modulate cochlear implant (CI) performance remains unclear. In this fMRI study, we explore the joint involvement of occipital and right hemisphere regions in a visual-based phonological task in post-lingual deafness. Intriguingly, we show that some deaf subjects perform faster than controls. This behavioural effect is associated with reorganized connectivity across bilateral visual, right temporal and left inferior frontal cortices, but with poor CI outcome. Conversely, preserved normal-range reaction times are associated with left-lateralized phonological processing and good CI outcome. These results suggest that following deafness, involvement of visual cortex in the context of reorganized right-lateralized phonological processing compromises its availability for audio-visual synergy during adaptation to CI.

Cochlear implants have variable outcomes for adult deafness. Here the authors show that fast responses and specific recruitment of right temporal cortex on a simple visual rhyming task strongly predicts poor implant performance.

Drifting through Basic Subprocesses of Reading: A Hierarchical Diffusion Model Analysis of Age Effects on Visual Word Recognition

Reading is one of the most popular leisure activities and it is routinely performed by most individuals even in old age. Successful reading enables older people to master and actively participate in everyday life and maintain functional independence. Yet, reading comprises a multitude of subprocesses and it is undoubtedly one of the most complex accomplishments of the human brain. Not surprisingly, findings of age-related effects on word recognition and reading have been partly contradictory and are often confined to only one of four central reading subprocesses, i.e., sublexical, orthographic, phonological and lexico-semantic processing. The aim of the present study was therefore to systematically investigate the impact of age on each of these subprocesses. A total of 1,807 participants (young, N = 384; old, N = 1,423) performed four decision tasks specifically designed to tap one of the subprocesses. To account for the behavioral heterogeneity in older adults, this subsample was split into high and low performing readers. Data were analyzed using a hierarchical diffusion modeling approach, which provides more information than standard response time/accuracy analyses. Taking into account incorrect and correct response times, their distributions and accuracy data, hierarchical diffusion modeling allowed us to differentiate between age-related changes in decision threshold, non-decision time and the speed of information uptake. We observed longer non-decision times for older adults and a more conservative decision threshold. More importantly, high-performing older readers outperformed younger adults at the speed of information uptake in orthographic and lexico-semantic processing, whereas a general age-disadvantage was observed at the sublexical and phonological levels. Low-performing older readers were slowest in information uptake in all four subprocesses. Discussing these results in terms of computational models of word recognition, we propose age-related disadvantages for older readers to be caused by inefficiencies in temporal sampling and activation and/or inhibition processes.

Phonological Iconicity Electrifies: An ERP Study on Affective Sound-to-Meaning Correspondences in German

While linguistic theory posits an arbitrary relation between signifiers and the signified (de Saussure, 1916), our analysis of a large-scale German database containing affective ratings of words revealed that certain phoneme clusters occur more often in words denoting concepts with negative and arousing meaning. Here, we investigate how such phoneme clusters that potentially serve as sublexical markers of affect can influence language processing. We registered the EEG signal during a lexical decision task with a novel manipulation of the words' putative sublexical affective potential: the means of valence and arousal values for single phoneme clusters, each computed as a function of respective values of words from the database these phoneme clusters occur in. Our experimental manipulations also investigate potential contributions of formal salience to the sublexical affective potential: Typically, negative high-arousing phonological segments-based on our calculations-tend to be less frequent and more structurally complex than neutral ones. We thus constructed two experimental sets, one involving this natural confound, while controlling for it in the other. A negative high-arousing sublexical affective potential in the strictly controlled stimulus set yielded an early posterior negativity (EPN), in similar ways as an independent manipulation of lexical affective content did. When other potentially salient formal features at the sublexical level were not controlled for, the effect of the sublexical affective potential was strengthened and prolonged (250-650 ms), presumably because formal salience helps making specific phoneme clusters efficient sublexical markers of negative high-arousing affective meaning. These neurophysiological data support the assumption that the organization of a language's vocabulary involves systematic sound-to-meaning correspondences at the phonemic level that influence the way we process language.

Differential Phonological and Semantic Modulation of Neurophysiological Responses to Visual Word Recognition

BACKGROUND

Reading words for meaning relies on orthographic, phonological and semantic processing. The triangle model implicates a direct orthography-to-semantics pathway and a phonologically mediated orthography-to-semantics pathway, which interact with each other. The temporal evolution of processing in these routes is not well understood, although theoretical evidence predicts early phonological processing followed by interactive phonological and semantic processing.

METHOD

This study used electroencephalography-event-related potential (ERP) analysis and magnetoencephalography (MEG) source localisation to identify temporal markers and the corresponding neural generators of these processes in early (∼200 ms) and late (∼400 ms) neurophysiological responses to visual words, pseudowords and consonant strings.

RESULTS

ERP showed an effect of phonology but not semantics in both time windows, although at ∼400 ms there was an effect of stimulus familiarity. Phonological processing at ~200 ms was localised to the left occipitotemporal cortex and the inferior frontal gyrus. At 400 ms, there was continued phonological processing in the inferior frontal gyrus and additional semantic processing in the anterior temporal cortex. There was also an area in the left temporoparietal junction which was implicated in both phonological and semantic processing. In ERP, the semantic response at ∼400 ms appeared to be masked by concurrent processes relating to familiarity, while MEG successfully differentiated these processes.

DISCUSSION

The results support the prediction of early phonological processing followed by an interaction of phonological and semantic processing during word recognition. Neuroanatomical loci of these processes are consistent with previous neuropsychological and functional magnetic resonance imaging studies. The results also have implications for the classical interpretation of N400-like responses as markers for semantic processing.

Rapid modulation of spoken word recognition by visual primes

In a masked cross-modal priming experiment with ERP recordings, spoken Japanese words were primed with words written in one of the two syllabary scripts of Japanese. An early priming effect, peaking at around 200ms after onset of the spoken word target, was seen in left lateral electrode sites for Katakana primes, and later effects were seen for both Hiragana and Katakana primes on the N400 ERP component. The early effect is thought to reflect the efficiency with which words in Katakana script make contact with sublexical phonological representations involved in spoken language comprehension, due to the particular way this script is used by Japanese readers. This demonstrates fast-acting influences of visual primes on the processing of auditory target words, and suggests that briefly presented visual primes can influence sublexical processing of auditory target words. The later N400 priming effects, on the other hand, most likely reflect cross-modal influences on activity at the level of whole-word phonology and semantics.

Many neighbors are not silent. fMRI evidence for global lexical activity in visual word recognition

Many neurocognitive studies investigated the neural correlates of visual word recognition, some of which manipulated the orthographic neighborhood density of words and nonwords believed to influence the activation of orthographically similar representations in a hypothetical mental lexicon. Previous neuroimaging research failed to find evidence for such global lexical activity associated with neighborhood density. Rather, effects were interpreted to reflect semantic or domain general processing. The present fMRI study revealed effects of lexicality, orthographic neighborhood density and a lexicality by orthographic neighborhood density interaction in a silent reading task. For the first time we found greater activity for words and nonwords with a high number of neighbors. We propose that this activity in the dorsomedial prefrontal cortex reflects activation of orthographically similar codes in verbal working memory thus providing evidence for global lexical activity as the basis of the neighborhood density effect. The interaction of lexicality by neighborhood density in the ventromedial prefrontal cortex showed lower activity in response to words with a high number compared to nonwords with a high number of neighbors. In the light of these results the facilitatory effect for words and inhibitory effect for nonwords with many neighbors observed in previous studies can be understood as being due to the operation of a fast-guess mechanism for words and a temporal deadline mechanism for nonwords as predicted by models of visual word recognition. Furthermore, we propose that the lexicality effect with higher activity for words compared to nonwords in inferior parietal and middle temporal cortex reflects the operation of an identification mechanism based on local lexico-semantic activity.

The neural bases of the pseudohomophone effect: Phonological constraints on lexico-semantic access in reading

We investigated phonological processing in normal readers to answer the question to what extent phonological recoding is active during silent reading and if or how it guides lexico-semantic access. We addressed this issue by looking at pseudohomophone and baseword frequency effects in lexical decisions with event-related functional magnetic resonance imaging (fMRI). The results revealed greater activation in response to pseudohomophones than for well-controlled pseudowords in the left inferior/superior frontal and middle temporal cortex, left insula, and left superior parietal lobule. Furthermore, we observed a baseword frequency effect for pseudohomophones (e.g., FEAL) but not for pseudowords (e.g., FEEP). This baseword frequency effect was qualified by activation differences in bilateral angular and left supramarginal, and bilateral middle temporal gyri for pseudohomophones with low- compared to high-frequency basewords. We propose that lexical decisions to pseudohomophones involves phonology-driven lexico-semantic activation of their basewords and that this is converging neuroimaging evidence for automatically activated phonological representations during silent reading in experienced readers.

Subliminal repetition primes help detection of phonemes in a picture: Evidence for a phonological level of the priming effects

In this research, we combine a cross-form word-picture visual masked priming procedure with an internal phoneme monitoring task to examine repetition priming effects. In this paradigm, participants have to respond to pictures whose names begin with a prespecified target phoneme. This task unambiguously requires retrieving the word-form of the target picture's name and implicitly orients participants' attention towards a phonological level of representation. The experiments were conducted within Spanish, whose highly transparent orthography presumably promotes fast and automatic phonological recoding of subliminal, masked visual word primes. Experiments 1 and 2 show that repetition primes speed up internal phoneme monitoring in the target, compared to primes beginning with a different phoneme from the target, or sharing only their first phoneme with the target. This suggests that repetition primes preactivate the phonological code of the entire target picture's name, hereby speeding up internal monitoring, which is necessarily based on such a code. To further qualify the nature of the phonological code underlying internal phoneme monitoring, a concurrent articulation task was used in Experiment 3. This task did not affect the repetition priming effect. We propose that internal phoneme monitoring is based on an abstract phonological code, prior to its translation into articulation.

Lexical and sublexical orthographic processing: an ERP study with skilled and dyslexic adult readers

This ERP study investigated the cognitive nature of the P1-N1 components during orthographic processing. We used an implicit reading task with various types of stimuli involving different amounts of sublexical or lexical orthographic processing (words, pseudohomophones, pseudowords, nonwords, and symbols), and tested average and dyslexic readers. An orthographic regularity effect (pseudowords-nonwords contrast) was observed in the average but not in the dyslexic group. This suggests an early sensitivity to the dependencies among letters in word-forms that reflect orthographic structure, while the dyslexic brain apparently fails to be appropriately sensitive to these complex features. Moreover, in the adults the N1-response may already reflect lexical access: (i) the N1 was sensitive to the familiar vs. less familiar orthographic sequence contrast; (ii) and early effects of the phonological form (words-pseudohomophones contrast) were also found. Finally, the later N320 component was attenuated in the dyslexics, suggesting suboptimal processing in later stages of phonological analysis.

Time course analyses of orthographic and phonological priming effects during word recognition in a transparent orthography

In opaque orthographies, the activation of orthographic and phonological codes follows distinct time courses during visual word recognition. However, it is unclear how orthography and phonology are accessed in more transparent orthographies. Therefore, we conducted time course analyses of masked priming effects in the transparent Dutch orthography. The first study used targets with small phonological differences between phonological and orthographic primes, which are typical in transparent orthographies. Results showed consistent orthographic priming effects, yet phonological priming effects were absent. The second study explicitly manipulated the strength of the phonological difference and revealed that both orthographic and phonological priming effects became identifiable when phonological differences were strong enough. This suggests that, similar to opaque orthographies, strong phonological differences are a prerequisite to separate orthographic and phonological priming effects in transparent orthographies. Orthographic and phonological priming appeared to follow distinct time courses, with orthographic codes being quickly translated into phonological codes and phonology dominating the remainder of the lexical access phase.

Resolving the orthographic ambiguity during visual word recognition in Arabic: an event-related potential investigation

The Arabic alphabetical orthographic system has various unique features that include the existence of emphatic phonemic letters. These represent several pairs of letters that share a phonological similarity and use the same parts of the articulation system. The phonological and articulatory similarities between these letters lead to spelling errors where the subject tends to produce a pseudohomophone (PHw) instead of the correct word. Here, we investigated whether or not the unique orthographic features of the written Arabic words modulate early orthographic processes. For this purpose, we analyzed event-related potentials (ERPs) collected from adult skilled readers during an orthographic decision task on real words and their corresponding PHw. The subjects' reaction times (RTs) were faster in words than in PHw. ERPs analysis revealed significant response differences between words and the PHw starting during the N170 and extending to the P2 component, with no difference during processing steps devoted to phonological and lexico-semantic processing. Amplitude and latency differences were found also during the P6 component which peaked earlier for words and where source localization indicated the involvement of the classical left language areas. Our findings replicate some of the previous findings on PHw processing and extend them to involve early orthographical processes.

Early effects of neighborhood density and phonotactic probability of spoken words on event-related potentials

All current models of spoken word recognition propose that sound-based representations of spoken words compete with, or inhibit, one another during recognition. In addition, certain models propose that higher probability sublexical units facilitate recognition under certain circumstances. Two experiments were conducted examining ERPs to spoken words and nonwords simultaneously varying in phonotactic probability and neighborhood density. Results showed that the amplitude of the P2 potential was greater for high probability-density words and nonwords, suggesting an early inhibitory effect of neighborhood density. In order to closely examine the role of phonotactic probability, effects of initial phoneme frequency were also examined. The latency of the P2 potential was shorter for words with high initial-consonant probability, suggesting a facilitative effect of phonotactic probability. The current results are consistent with findings from previous studies using reaction time and eye-tracking paradigms and provide new insights into the time-course of lexical and sublexical activation and competition.

Speech-specific tuning of neurons in human superior temporal gyrus

How the brain extracts words from auditory signals is an unanswered question. We recorded approximately 150 single and multi-units from the left anterior superior temporal gyrus of a patient during multiple auditory experiments. Against low background activity, 45% of units robustly fired to particular spoken words with little or no response to pure tones, noise-vocoded speech, or environmental sounds. Many units were tuned to complex but specific sets of phonemes, which were influenced by local context but invariant to speaker, and suppressed during self-produced speech. The firing of several units to specific visual letters was correlated with their response to the corresponding auditory phonemes, providing the first direct neural evidence for phonological recoding during reading. Maximal decoding of individual phonemes and words identities was attained using firing rates from approximately 5 neurons within 200 ms after word onset. Thus, neurons in human superior temporal gyrus use sparse spatially organized population encoding of complex acoustic-phonetic features to help recognize auditory and visual words.

Evidence for multiple routes in learning to read

We describe a multiple-route model of reading development in which coarse-grained orthographic processing plays a key role in optimizing access to semantics via whole-word orthographic representations. This forms part of the direct orthographic route that gradually replaces phonological recoding during the initial phases of reading acquisition. The model predicts distinct developmental trajectories for pseudo-homophone and transposed-letter effects - two benchmark phenomena associated with phonological recoding and coarse-grained orthographic processing, respectively. Pseudo-homophone effects should decrease over the first years of reading acquisition, whereas transposed-letter effects should initially increase. These predictions were tested in a lexical decision task with 334 children in grades 1-5, and 29 skilled adult readers. In line with the predictions, we found that the pseudo-homophone effect diminished as reading level increased, whereas the transposed-letter effect first increased and then diminished.

A dual-route cascaded model of reading by deaf adults: evidence for grapheme to viseme conversion

There is an ongoing debate whether deaf individuals access phonology when reading, and if so, what impact the ability to access phonology might have on reading achievement. However, the debate so far has been theoretically unspecific on two accounts: (a) the phonological units deaf individuals may have of oral language have not been specified and (b) there seem to be no explicit cognitive models specifying how phonology and other factors operate in reading by deaf individuals. We propose that deaf individuals have representations of the sublexical structure of oral-aural language which are based on mouth shapes and that these sublexical units are activated during reading by deaf individuals. We specify the sublexical units of deaf German readers as 11 "visemes" and incorporate the viseme set into a working model of single-word reading by deaf adults based on the dual-route cascaded model of reading aloud by Coltheart, Rastle, Perry, Langdon, and Ziegler (2001. DRC: A dual route cascaded model of visual word recognition and reading aloud. Psychological Review, 108, 204-256. doi: 10.1037//0033-295x.108.1.204). We assessed the indirect route of this model by investigating the "pseudo-homoviseme" effect using a lexical decision task in deaf German reading adults. We found a main effect of pseudo-homovisemy, suggesting that at least some deaf individuals do automatically access sublexical structure during single-word reading.

Evidence for the modulation of sub-lexical processing in go no-go naming: the elimination of the frequency × regularity interaction

The Frequency (high vs. low) × Regularity (regular vs. exception) interaction found on naming response times is often taken as evidence for parallel processing of sub-lexical and lexical systems. Using a Go/No-go naming task, we investigated the effect of nonword versus pseudohomophone foils on sub-lexical processing and the subsequent Frequency × Regularity interaction. We ran two experiments: (1) a Go/No-go naming task with nonword foils (e.g., bint) and (2) a Go/No-go naming task with pseudohomophone foils (e.g., pynt). Experiment 1 replicated the Frequency × Regularity interaction on naming response times supporting the notion of parallel sub-lexical and lexical processing. Experiment 2 eliminated the Frequency × Regularity interaction providing evidence for the modulation of sub-lexical information. These results indicate that using pseudohomophones in the Go/No-go naming task minimized information provided from sub-lexical processing and maximized information provided from the lexical system.

Electrophysiological evidence for impaired attentional engagement with phonologically acceptable misspellings in developmental dyslexia

Event-related potential (ERP) studies of word recognition have provided fundamental insights into the time-course and stages of visual and auditory word form processing in reading. Here, we used ERPs to track the time-course of phonological processing in dyslexic adults and matched controls. Participants engaged in semantic judgments of visually presented high-cloze probability sentences ending either with (a) their best completion word, (b) a homophone of the best completion, (c) a pseudohomophone of the best completion, or (d) an unrelated word, to examine the interplay of phonological and orthographic processing in reading and the stage(s) of processing affected in developmental dyslexia. Early ERP peaks (N1, P2, N2) were modulated in amplitude similarly in the two groups of participants. However, dyslexic readers failed to show the P3a modulation seen in control participants for unexpected homophones and pseudohomophones (i.e., sentence completions that are acceptable phonologically but are misspelt). Furthermore, P3a amplitudes significantly correlated with reaction times in each experimental condition. Our results showed no sign of a deficit in accessing phonological representations during reading, since sentence primes yielded phonological priming effects that did not differ between participant groups in the early phases of processing. On the other hand, we report new evidence for a deficient attentional engagement with orthographically unexpected but phonologically expected words in dyslexia, irrespective of task focus on orthography or phonology. In our view, this result is consistent with deficiency in reading occurring from the point at which attention is oriented to phonological analysis, which may underlie broader difficulties in sublexical decoding.

A dual-route approach to orthographic processing

In the present theoretical note we examine how different learning constraints, thought to be involved in optimizing the mapping of print to meaning during reading acquisition, might shape the nature of the orthographic code involved in skilled reading. On the one hand, optimization is hypothesized to involve selecting combinations of letters that are the most informative with respect to word identity (diagnosticity constraint), and on the other hand to involve the detection of letter combinations that correspond to pre-existing sublexical phonological and morphological representations (chunking constraint). These two constraints give rise to two different kinds of prelexical orthographic code, a coarse-grained and a fine-grained code, associated with the two routes of a dual-route architecture. Processing along the coarse-grained route optimizes fast access to semantics by using minimal subsets of letters that maximize information with respect to word identity, while coding for approximate within-word letter position independently of letter contiguity. Processing along the fined-grained route, on the other hand, is sensitive to the precise ordering of letters, as well as to position with respect to word beginnings and endings. This enables the chunking of frequently co-occurring contiguous letter combinations that form relevant units for morpho-orthographic processing (prefixes and suffixes) and for the sublexical translation of print to sound (multi-letter graphemes).

Implicit phonological priming during visual word recognition

Phonology is a lower-level structural aspect of language involving the sounds of a language and their organization in that language. Numerous behavioral studies utilizing priming, which refers to an increased sensitivity to a stimulus following prior experience with that or a related stimulus, have provided evidence for the role of phonology in visual word recognition. However, most language studies utilizing priming in conjunction with functional magnetic resonance imaging (fMRI) have focused on lexical-semantic aspects of language processing. The aim of the present study was to investigate the neurobiological substrates of the automatic, implicit stages of phonological processing. While undergoing fMRI, eighteen individuals performed a lexical decision task (LDT) on prime-target pairs including word-word homophone and pseudoword-word pseudohomophone pairs with a prime presentation below perceptual threshold. Whole-brain analyses revealed several cortical regions exhibiting hemodynamic response suppression due to phonological priming including bilateral superior temporal gyri (STG), middle temporal gyri (MTG), and angular gyri (AG) with additional region of interest (ROI) analyses revealing response suppression in the left lateralized supramarginal gyrus (SMG). Homophone and pseudohomophone priming also resulted in different patterns of hemodynamic responses relative to one another. These results suggest that phonological processing plays a key role in visual word recognition. Furthermore, enhanced hemodynamic responses for unrelated stimuli relative to primed stimuli were observed in midline cortical regions corresponding to the default-mode network (DMN) suggesting that DMN activity can be modulated by task requirements within the context of an implicit task.