Neural correlates of visual versus abstract letter processing in Roman and Arabic scripts

One more trip to Barcetona: on the special status of visual similarity effects in city names

Previous research has shown that, unlike misspelled common words, misspelled brand names are sensitive to visual letter similarity effects (e.g., amazom is often recognized as a legitimate brand name, but not amazot). This pattern poses problems for those models that assume that word identification is exclusively based on abstract codes. Here, we investigated the role of visual letter similarity using another type of word often presented in a more homogenous format than common words: city names. We found a visual letter similarity effect for misspelled city names (e.g., Barcetona was often recognized as a word, but not Barcesona) for relatively short durations of the stimuli (200 ms; Experiment 2), but not when the stimuli were presented until response (Experiment 1). Notably, misspelled common words did not show a visual letter similarity effect for brief 200- and 150-ms durations (e.g., votume was not as often recognized as a word than vosume; Experiments 3-4). These findings provide further evidence that the consistency in the format of presentations may shape the representation of words in the mental lexicon, which may be more salient in scenarios where processing resources are limited (e.g., brief exposure presentations).

Neural Specialization for English and Arabic Print in Early Readers

Learning to read requires the specialization of a region in the left fusiform gyrus known as the visual word form area (VWFA). This region, which initially responds to faces and objects, develops specificity for print over a long trajectory of instruction and practice. VWFA neurons may be primed for print because of their pre-literate tuning properties, becoming specialized through top-down feedback mechanisms during learning. However, much of what is known about the VWFA comes from studies of Western orthographies, whose alphabets share common visual characteristics. Far less is known about the development of the VWFA for Arabic, which is a complex orthography and is significantly more difficult to achieve fluency in in reading. In the current study, electroencephalography responses were collected from first grade children in the United Arab Emirates learning to read in both English and Arabic. Children viewed words and false font strings in English and Arabic while performing a vigilance task. The P1 and N1 responses to all stimulus categories were quantified in two occipital and two parietal electrodes as well as the alpha band signal across all four electrodes of interest. Analysis revealed a significantly stronger N1 response to English compared to Arabic and decreased alpha power to Arabic compared to English. These findings suggest a fundamental difference in neural plasticity for these two distinct orthographies, even when instruction is concurrent. Future work is needed to determine whether VWFA specialization for Arabic takes longer than more well-studied orthographies and if differences in reading instruction approaches help accelerate this process.

Font disfluency and reading performance in children: An event-related potential study

Expert adult readers process fluent and disfluent fonts differently, at both early perceptual and late higher-order processing stages. This finding has been interpreted as reflecting the more difficult to read disfluent fonts requiring greater neural resources. We aimed to investigate whether neural activity is affected by font disfluency in pre-adolescent readers, and to determine if neural responses are related to reading performance. Thirty-three participants between 8 and 12 years old completed two one-back tasks using letter and word stimuli, where font was manipulated (fluent versus disfluent stimuli), during which electroencephalography was recorded. Event related potentials (ERPs) were calculated relative to non-target stimuli for both tasks. The Woodcock Johnson III Tests of Achievement reading specific tests, and the Castles and Coltheart Test 2 were also collected. Font (fluent versus disfluent stimuli) did not consistently affect neural activity during both the letter and word tasks. Fluent stimuli elicited greater late activity (450-600 ms) than disfluent stimuli during the word task, suggesting easy-to-read fonts may enhance the maintenance of words in visual working memory and facilitate the retrieval of semantic information. However, reading performance was not associated with neural disfluency effects, suggesting that pre-adolescents are still at an early developmental reading period. Font manipulation may be a useful way to track developmental reading trajectories in the brain.

Asymetric Event-Related Potential Priming Effects Between English Letters and American Sign Language Fingerspelling Fonts

Letter recognition plays an important role in reading and follows different phases of processing, from early visual feature detection to the access of abstract letter representations. Deaf ASL-English bilinguals experience orthography in two forms: English letters and fingerspelling. However, the neurobiological nature of fingerspelling representations, and the relationship between the two orthographies, remains unexplored. We examined the temporal dynamics of single English letter and ASL fingerspelling font processing in an unmasked priming paradigm with centrally presented targets for 200 ms preceded by 100 ms primes. Event-related brain potentials were recorded while participants performed a probe detection task. Experiment 1 examined English letter-to-letter priming in deaf signers and hearing non-signers. We found that English letter recognition is similar for deaf and hearing readers, extending previous findings with hearing readers to unmasked presentations. Experiment 2 examined priming effects between English letters and ASL fingerspelling fonts in deaf signers only. We found that fingerspelling fonts primed both fingerspelling fonts and English letters, but English letters did not prime fingerspelling fonts, indicating a priming asymmetry between letters and fingerspelling fonts. We also found an N400-like priming effect when the primes were fingerspelling fonts which might reflect strategic access to the lexical names of letters. The studies suggest that deaf ASL-English bilinguals process English letters and ASL fingerspelling differently and that the two systems may have distinct neural representations. However, the fact that fingerspelling fonts can prime English letters suggests that the two orthographies may share abstract representations to some extent.

From Hand to Eye With the Devil In-Between: Which Cognitive Mechanisms Underpin the Benefit From Handwriting Training When Learning Visual Graphs?

Cognitive science has recently shown a renewed interest on the benefit from training in handwriting (HW) when learning visual graphs, given that this learning experience improves more subsequent visual graph recognition than other forms of training. However, the underlying cognitive mechanism of this HW benefit has been elusive. Building on the 50 years of research on this topic, the present work outlines a theoretical approach to study this mechanism, specifying testable hypotheses that will allow distinguishing between confronting perspectives, i.e., symbolic accounts that hold that perceptual learning and visual analysis underpin the benefit from HW training vs. embodied sensorimotor accounts that argue for motoric representations as inner part of orthographic representations acquired via HW training. From the evidence critically revisited, we concluded that symbolic accounts are parsimonious and could better explain the benefit from HW training when learning visual graphs. The future challenge will be to put at test the detailed predictions presented here, so that the devil has no longer room in this equation.

Matrices of the frequency and similarity of Arabic letters and allographs

Indicators of letter frequency and similarity have long been available for Indo-European languages. They have not only been pivotal in controlling the design of experimental psycholinguistic studies seeking to determine the factors that underlie reading ability and literacy acquisition, but have also been useful for studies examining the more general aspects of human cognition. Despite their importance, however, such indicators are still not available for Modern Standard Arabic (MSA), a language that, by virtue of its orthographic system, presents an invaluable environment for the experimental investigation of visual word processing. This paper presents for the first time the frequencies of Arabic letters and their allographs based on a 40-million-word corpus, along with their similarity/confusability indicators in three domains: (1) the visual domain, based on human ratings; (2) the auditory domain, based on an analysis of the phonetic features of letter sounds; and (3) the motoric domain, based on an analysis of the stroke features used to write letters and their allographs. Taken together, the frequency and similarity of Arabic letters and their allographs in the visual and motoric domains, as well as the similarities among the letter sounds, will be useful for researchers interested in the processes underpinning orthographic processing, visual word recognition, reading, and literacy acquisition.

The role of letter features on the consonant-bias effect: Evidence from masked priming

Recent research has shown an advantage of consonants at early stages of visual word recognition (C-bias), although the locus of this effect remains elusive. Here we examine whether the C-bias is affected by the consonant letters' features. Skilled readers performed a masked priming lexical decision task in which target words containing only either consonants without any ascending/descending features (flat words, canino[canine]) or consonants with ascending/descending features (non-flat words, palito[toothpick]) were preceded by briefly (50 ms) presented primes that could preserve the same consonants of the targets (cenune-CANINO, pelute-PALITO), the same vowels of the targets (raxizo-CANINO, fajibo-PALITO), or, as controls, unrelated (ruxuze-CANINO, fejube-PALITO) and identity primes (canino-CANINO, palito-PALITO). The case in which prime-target pairs were presented was also manipulated (lower-upper vs. upper-lower). Results showed that in both case conditions flat words were recognized faster than non-flat words. Evidence for the C-bias was observed both for flat and non-flat words in the lower-upper condition, in which a vowel inhibitory priming effect was also observed for non-flat words. In the upper-lower condition, however, the C-bias was restricted to flat words. These findings suggest that letter features play a role in the C-bias and ask for amendments in current models of visual word recognition.

Letter connectedness and Arabic visual word recognition

This study investigates the processing consequences of letter connectedness during Arabic visual word recognition. Specifically, this study examined (a) whether there is a processing cost associated with letter connectedness during word-level reading and (b) whether this factor modulates form-level activation among words during lexical access. Experiment 1 tested one-, two-, and three-chunk Arabic words and nonwords in a lexical decision task with masked identity priming. Experiment 2 tested the same stimuli in a lexical decision task with masked form priming, in which prime-target pairs differed by a letter associated with the morphological root. In both experiments, there was a clear processing cost for letter connectedness-one-chunk words had longer processing times than two-chunk words, which had longer processing times than three-chunk words. Comparable processing time differences were also found for nonwords, suggesting that letter connectedness influences Arabic word recognition at a prelexical orthographic processing stage. Furthermore, although reliable priming was found in both the experiments, there was a suggestion that letter connectedness modulated form priming effects (Experiment 2), with the strongest effect for three-chunk word targets. These findings are taken to indicate that letter connectedness is an important factor that should be considered-and controlled for-in examinations of Arabic visual word recognition.

Transposed letter priming effects and allographic variation in Arabic: Insights from lexical decision and the same-different task

Reading is resilient to distortion of letter order within a word. This is evidenced in the “transposed-letter (TL) priming effect,” the finding that a prime generated by transposing adjacent letters in a word (e.g., jugde) facilitates recognition of the base word (e.g., JUDGE), more than a “substituted-letter” control prime in which the transposed letters are replaced by unrelated letters (e.g., junpe -JUDGE). The TL priming effect is well documented for European languages that are written using the Roman alphabet. Unlike these languages, Arabic has a unique position-dependent allography whereby some letters change shape according to their position within a word. We investigate the TL priming effect using a lexical decision (Experiment 1) and a same–different match task with Arabic words (Experiment 2) and nonwords (Experiment 3). No TL priming effects were found in Experiment 1, suggesting that the lexical-decision task engages lexical access processes that are sensitive to the Semitic nonlinear morphological structure. Experiments 2 and 3 revealed a robust TL priming effect overall. Nonallographic TL primes produced significantly larger facilitation than allographic TL primes, indicating that Arabic readers use allographic variation to resolve the uncertainty in letter order during the early stages of orthographic processing. The implication of these results for current letter position coding models is discussed.

Transposed-letter (TL) priming effects are popularly interpreted as reflecting noisy perception of letter order. The Arabic writing system has a unique allographic feature whereby a letter’s shape and letter spacing depend on its position within a word. We show that TL priming effects for Arabic words and nonwords are modulated by allography in the same–different task. It is important to consider which unique property of the language/writing system produces the cross-language variation, and how it does so.

Orthographic and phonological priming effects in the same-different task

Masked priming tasks have been used widely to study early orthographic processes-the coding of letter position and letter identity. Recently, using masked priming in the same-different task Lupker, Nakayama, and Perea (2015a) reported finding a phonological priming effect with primes presented in Japanese Katakana, and English target words presented in the Roman alphabet, and based on this finding, suggested that previously reported effects in the same-different task in the literature could be based on phonology rather than orthography. In this article, the authors explain why the design of Lupker et al.'s experiment does not address this question; they then report 2 new experiments that do. The results indicate that the priming produced by orthographically similar primes in the same-different task for letter strings presented in the Roman alphabet is almost exclusively orthographic in origin, and phonology makes little contribution. The authors offer an explanation for why phonological priming was observed when the prime and target are presented in different scripts but not when they are presented in the same script. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Does visual letter similarity modulate masked form priming in young readers of Arabic?

We carried out a masked priming lexical decision experiment to study whether visual letter similarity plays a role during the initial phases of word processing in young readers of Arabic (fifth graders). Arabic is ideally suited to test these effects because most Arabic letters share their basic shape with at least one other letter and differ only in the number/position of diacritical points (e.g., ض - ص ;ظ - ط ;غ - ع ;ث - ت - ن ب ;ذ - د ;خ - ح - ج ;ق - ف ;ش - س ;ز - ر). We created two one-letter-different priming conditions for each target word, in which a letter from the consonantal root was substituted by another letter that did or did not keep the same shape (e.g., خدمة - حدمة vs. خدمة - فدمة). Another goal of the current experiment was to test the presence of masked orthographic priming effects, which are thought to be unreliable in Semitic languages. To that end, we included an unrelated priming condition. We found a sizable masked orthographic priming effect relative to the unrelated condition regardless of visual letter similarity, thereby revealing that young readers are able to quickly process the diacritical points of Arabic letters. Furthermore, the presence of masked orthographic priming effects in Arabic suggests that the word identification stream in Indo-European and Semitic languages is more similar than previously thought.

Does Top-Down Feedback Modulate the Encoding of Orthographic Representations During Visual-Word Recognition?

In masked priming lexical decision experiments, there is a matched-case identity advantage for nonwords, but not for words (e.g., ERTAR-ERTAR <  ertar-ERTAR; ALTAR-ALTAR = altar-ALTAR). This dissociation has been interpreted in terms of feedback from higher levels of processing during orthographic encoding. Here, we examined whether a matched-case identity advantage also occurs for words when top-down feedback is minimized. We employed a task that taps prelexical orthographic processes: the masked prime same-different task. For "same" trials, results showed faster response times for targets when preceded by a briefly presented matched-case identity prime than when preceded by a mismatched-case identity prime. Importantly, this advantage was similar in magnitude for nonwords and words. This finding constrains the interplay of bottom-up versus top-down mechanisms in models of visual-word identification.

Do Diacritical Marks Play a Role at the Early Stages of Word Recognition in Arabic?

A crucial question in the domain of visual word recognition is whether letter similarity plays a role in the early stages of visual word processing. Here we focused on Arabic because in this language there are various groups of letters that share the same basic shape and only differ in the number/location of diacritical points. We conducted a masked priming lexical decision experiment in which a target word was preceded by: (i) an identity prime; (ii) a prime in which the critical letter was replaced by a letter with the same shape that differed in the number of diacritics (e.g., ); or (iii) a prime in which the critical letter was replaced by a letter with different shape (e.g., ). Results showed a sizable advantage of the identity condition over the two substituted-letter priming conditions (i.e., diacritical information is rapidly processed). Thus, diacritical marks play an essential role in the “feature letter” level of models of visual word recognition in Arabic.

Visual Experience Shapes Orthographic Representations in the Visual Word Form Area

Current neurocognitive research suggests that the efficiency of visual word recognition rests on abstract memory representations of written letters and words stored in the visual word form area (VWFA) in the left ventral occipitotemporal cortex. These representations are assumed to be invariant to visual characteristics such as font and case. In the present functional MRI study, we tested this assumption by presenting written words and varying the case format of the initial letter of German nouns (which are always capitalized) as well as German adjectives and adverbs (both usually in lowercase). As evident from a Word Type × Case Format interaction, activation in the VWFA was greater to words presented in unfamiliar case formats relative to familiar case formats. Our results suggest that neural representations of written words in the VWFA are not fully abstract and still contain information about the visual format in which words are most frequently perceived.

Cross-Language Modulation of Visual Attention Span: An Arabic-French-Spanish Comparison in Skilled Adult Readers

In delineating the amount of orthographic information that can be processed in parallel during a single fixation, the visual attention (VA) span acts as a key component of the reading system. Previous studies focused on the contribution of VA span to normal and pathological reading in monolingual and bilingual children from different European languages, without direct cross-language comparison. In the current paper, we explored modulations of VA span abilities in three languages –French, Spanish, and Arabic– that differ in transparency, reading direction and writing systems. The participants were skilled adult readers who were native speakers of French, Spanish or Arabic. They were administered tasks of global and partial letter report, single letter identification and text reading. Their VA span abilities were assessed using tasks that require the processing of briefly presented five consonant strings (e.g., R S H F T). All five consonants had to be reported in global report but a single cued letter in partial report. Results showed that VA span was reduced in Arabic readers as compared to French or Spanish readers who otherwise show a similar high performance in the two report tasks. The analysis of VA span response patterns in global report showed a left-right asymmetry in all three languages. A leftward letter advantage was found in French and Spanish but a rightward advantage in Arabic. The response patterns were symmetric in partial report, regardless of the language. Last, a significant relationship was found between VA span abilities and reading speed but only for French. The overall findings suggest that the size of VA span, the shape of VA span response patterns and the VA Span-reading relationship are modulated by language-specific features.

Lexical enhancement during prime-target integration: ERP evidence from matched-case identity priming

A number of experiments have revealed that matched-case identity PRIME-TARGET pairs are responded to faster than mismatched-case identity prime-TARGET pairs for pseudowords (e.g., JUDPE-JUDPE < judpe-JUDPE), but not for words (JUDGE-JUDGE = judge-JUDGE). These findings suggest that prime-target integration processes are enhanced when the stimuli tap onto lexical representations, overriding physical differences between the stimuli (e.g., case). To track the time course of this phenomenon, we conducted an event-related potential (ERP) masked-priming lexical decision experiment that manipulated matched versus mismatched case identity in words and pseudowords. The behavioral results replicated previous research. The ERP waves revealed that matched-case identity-priming effects were found at a very early time epoch (N/P150 effects) for words and pseudowords. Importantly, around 200 ms after target onset (N250), these differences disappeared for words but not for pseudowords. These findings suggest that different-case word forms (lower- and uppercase) tap into the same abstract representation, leading to prime-target integration very early in processing. In contrast, different-case pseudoword forms are processed as two different representations. This word-pseudoword dissociation has important implications for neural accounts of visual-word recognition.

The time course of visual influences in letter recognition

This study builds on a specific characteristic of letters of the Roman alphabet-namely, that each letter name is associated with two visual formats, corresponding to their uppercase and lowercase versions. Participants had to read aloud the names of single letters, and event-related potentials (ERPs) for six pairs of visually dissimilar upper- and lowercase letters were recorded. Assuming that the end product of processing is the same for upper- and lowercase letters sharing the same vocal response, ERPs were compared backward, starting from the onset of articulatory responses, and the first significant divergence was observed 120 ms before response onset. Given that naming responses were produced at around 414 ms, on average, these results suggest that letter processing is influenced by visual information until 294 ms after stimulus onset. This therefore provides new empirical evidence regarding the time course and interactive nature of visual letter perception processes.