Unattentive speech processing is influenced by orthographic knowledge: evidence from mismatch negativity

Do letters matter? The influence of spelling on acoustic duration

The present article describes a modified and extended replication of a corpus study by Brewer (2008. Phonetic reflexes of orthographic characteristics in lexical representation. Tucson, AZ: University of Arizona PhD thesis) which reports differences in the acoustic duration of homophonous but heterographic sounds. The original findings point to a quantity effect of spelling on acoustic duration, i.e., the more letters are used to spell a sound, the longer the sound's duration. Such a finding would have extensive theoretical implications and necessitate more research on how exactly spelling would come to influence speech production. However, the effects found by Brewer (2008) did not consistently reach statistical significance and the analysis did not include many of the covariates which are known by now to influence segment duration, rendering the robustness of the results at least questionable. Employing a more nuanced operationalization of graphemic units and a more advanced statistical analysis, the current replication fails to find the reported effect of letter quantity. Instead, we find an effect of graphemic complexity. Speakers realize consonants that do not have a visible graphemic correlate with shorter durations: the /s/ in tux is shorter that the /s/ in fuss. The effect presumably resembles orthographic visibility effects found in perception. In addition, our results highlight the need for a more rigorous approach to replicability in linguistics.

How are visemes and graphemes integrated with speech sounds during spoken word recognition? ERP evidence for supra-additive responses during audiovisual compared to auditory speech processing

Both visual articulatory gestures and orthography provide information on the phonological content of speech. This EEG study investigated the integration between speech and these two visual inputs. A comparison of skilled readers' brain responses elicited by a spoken word presented alone versus synchronously with a static image of a viseme or a grapheme of the spoken word's onset showed that while neither visual input induced audiovisual integration on N1 acoustic component, both led to a supra-additive integration on P2, with a stronger integration between speech and graphemes on left-anterior electrodes. This pattern persisted in P350 time-window and generalized to all electrodes. The finding suggests a strong impact of spelling knowledge on phonetic processing and lexical access. It also indirectly indicates that the dynamic and predictive value present in natural lip movements but not in static visemes is particularly critical to the contribution of visual articulatory gestures to speech processing.

The Effect of Orthographic Transparency on Auditory Word Recognition Across the Development of Reading Proficiency

A question under debate in psycholinguistics is the nature of the relationship between spoken and written languages. Although it has been extensively shown that orthographic transparency, which varies across writing systems, strongly affects reading performance, its role in speech processing is much less investigated. The present study addressed this issue in Persian, whose writing system provides a possibility to assess the impact of orthographic transparency on spoken word recognition in young children at different stages of reading acquisition. In Persian, the long vowels are systematically present in the script, whereas the spelling correspondence of short vowels is progressively omitted from the script in the course of reading acquisition, thus, turning transparent into opaque spelling. Based on this unique characteristic, we tested 144 monolingual Persian-speaking nonreaders (i.e., preschoolers) and readers (second graders to fifth graders and young adults) in an auditory lexical decision task using transparent and opaque words. Overall, the results showed that, in accordance with the fact that the diacritics of short vowels are progressively omitted during the second year of schooling, the stimuli containing short vowels (opaque words) were recognized more slowly than transparent ones in third graders. Interestingly, there is a hint that the emergence of the transparency effect in the third graders was associated with an overall slower recognition speed in this group compared to their younger peers. These findings indicate that learning opaque spelling-sound correspondence might not only generate interference between the two language codes but also induce a general processing cost in the entire spoken language system.

Phonemic Training Modulates Early Speech Processing in Pre-reading Children

Phonemic awareness and rudimentary grapheme knowledge concurrently develop in pre-school age. In a training study, we tried to disentangle the role of both precursor functions of reading for spoken word recognition. Two groups of children exercised with phonemic materials, but only one of both groups learnt corresponding letters to trained phonemes. A control group exercised finger-number associations (non-linguistic training). After the training, we tested how sensitive children were to prime-target variation in word onset priming. A group of young adults took part in the same experiment to provide data from experienced readers. While decision latencies to the targets suggested fine-grained spoken word processing in all groups, event-related potentials (ERPs) indicated that both phonemic training groups processed phonemic variation in more detail than the non-linguistic training group and young adults at early stages of speech processing. Our results indicate temporal plasticity of implicit speech processing in pre-school age as a function of explicit phonemic training.

Seeing thought: a cultural cognitive tool

The present paper, which is the first of two twin opinion papers, offers a theoretical approach of literacy and critical literacy in relation to language, thought, and reasoning. Literacy acquisition and practice proceed through two stages, which partially overlap in terms of processing abilities: the first is achieved when the learner becomes a skilled reader and writer, characterized by automatic word processing; the second, when reading comprehension and written production become expert instruments in the communication of progressively more abstract and sophisticated, but always linguistically-mediated, knowledge and ideas. The destiny of literacy, depending on educational and social factors, is thus to be to fused with language, thought and reasoning. Oral language becomes literate language; and our cognitive activity becomes—as indicated in the title—“seeing thought”, which paves the way, we will argue, for reasoning skills. Making of literacy an epistemic and social tool of our own collective history requires a critical stance that raises itself and ourselves to a stage called critical literacy. In this paper we focus on some of the favorable and unfavorable factors influencing this achievement. The main challenge is to bring literate cognition up to the capacity of choosing between accept and verify, between belief and disbelief, by weighting evidence and reasoning, by arguing and debunking errors and falsities. Accordingly, our objective is essentially to narrate how literacy gives birth to critical literacy and explain why, at the end of this process, critical literacy becomes hard to distinguish from thinking and reasoning.

The role of orthography in second-language spoken word production: Evidence from Tibetan Chinese bilinguals

Evidence suggests that spoken language production involves involuntary access to orthographic representations, both in languages with alphabetic and non-alphabetic scripts. An unexplored question is whether the role of orthography varies as a function of the language being native or non-native to the individual. Native (L1) and non-native (L2) languages differ in important aspects, that is, lexical representations in L2 might be less well established, but acquired at least partly via reading, and these unique features of non-native languages may contribute to a fundamental difference in how spelling and sound interact in production. We investigated an orthographic impact on spoken production with Tibetan Chinese bilinguals who named coloured line drawings of objects with Chinese adjective–noun phrases. Colour and object names were orthographically related or unrelated. Even though none of the participants were aware of the orthographic manipulation, orthographic overlap generated a facilitatory effect. In conjunction with earlier findings from native speakers on the identical task, we conclude that orthographic information is activated in spoken word production regardless of whether the response language is native or non-native.

Writing Before Speaking Modifies Speech Production

We investigated whether orthographic information influences speech production. We used a non-color-word version of the Stroop task in which participants had to ignore the presented words but name their ink color instead. In two experiments, we manipulated the phonological and orthographic relationships between the words and their ink color and the tasks' context by preactivating or not orthographic information. The relation between the first letter of the prime word and the first phoneme of the color name was phonological or orthographic and phonological or unrelated. In Experiment 1, only phonological information carried out by the prime word affected spoken naming; orthographic information did not help. In Experiment 2, speech production was influenced by orthographic information only after an initial writing task. This confirms that orthographic information can support speaking and that speech is sensitive to properties of the task's context, suggesting that orthographic information is coactivated online with phonological information.

How much does orthography influence the processing of reduced word forms? Evidence from novel-word learning about French schwa deletion

This study examines the influence of orthography on the processing of reduced word forms. For this purpose, we compared the impact of phonological variation with the impact of spelling-sound consistency on the processing of words that may be produced with or without the vowel schwa. Participants learnt novel French words in which the vowel schwa was present or absent in the first syllable. In Experiment 1, the words were consistently produced without schwa or produced in a variable manner (i.e., sometimes produced with and sometimes produced without schwa). In Experiment 2, words were always produced in a consistent manner, but an orthographic exposure phase was included in which words that were produced without schwa were either spelled with or without the letter <e>. Results from naming and eye-tracking tasks suggest that both phonological variation and spelling-sound consistency influence the processing of spoken novel words. However, the influence of phonological variation outweighs the effect of spelling-sound consistency. Our findings therefore suggest that the influence of orthography on the processing of reduced word forms is relatively small.

A Picture Is Worth… Both Spelling and Sound

In an event-related potential (ERP) study using picture stimuli, we explored whether spelling information is co-activated with sound information even when neither type of information is explicitly provided. Pairs of picture stimuli presented in a rhyming paradigm were varied by both phonology (the two images in a pair had either rhyming, e.g., boat and goat, or non-rhyming, e.g., boat and cane, labels) and orthography (rhyming image pairs had labels that were either spelled the same, e.g., boat and goat, or not spelled the same, e.g., brain and cane). Electrophysiological picture rhyming (sound) effects were evident in terms of both N400/N450 and late effect amplitude: Non-rhyming images elicited more negative waves than rhyming images. Remarkably, the magnitude of the late ERP rhyming effect was modulated by spelling - even though words were neither explicitly seen nor heard during the task. Moreover, both the N400/N450 and late rhyming effects in the spelled-the-same (orthographically matched) condition were larger in the group with higher scores (by median split) on a standardized measure of sound awareness. Overall, the findings show concomitant meaning (semantic), sound (phonological), and spelling (orthographic) activation for picture processing in a rhyming paradigm, especially in young adults with better reading skills. Not outwardly lexical but nonetheless modulated by reading skill, electrophysiological picture rhyming effects may be useful for exploring co-activation in children with dyslexia.

Orthographic influence on spoken word identification: Behavioral and fMRI evidence

The current study investigated behavioral and neuroimaging evidence for orthographic influences on auditory word identification. To assess such influences, the proportion of similar sounding words (i.e. phonological neighbors) that were also spelled similarly (i.e., orthographic neighbors) was computed for each auditorily presented word as the Orthographic-to-Phonological Overlap Ratio (OPOR). Speech intelligibility was manipulated by presenting monosyllabic words in multi-talker babble at two signal-to-noise ratios: + 3 and + 10 dB SNR. Identification rates were lower for high overlap words in the challenging + 3 dB SNR condition. In addition, BOLD contrast increased with OPOR at the more difficult SNR, and decreased with OPOR under more favorable SNR conditions. Both voxel-based and region of interest analyses demonstrated robust effects of OPOR in several cingulo-opercular regions. However, contrary to prior theoretical accounts, no task-related activity was observed in posterior regions associated with phonological or orthographic processing. We suggest that, when processing is difficult, orthographic-to-phonological feature overlap increases the availability of competing responses, which then requires additional support from domain general performance systems in order to produce a single response.

Orthographic effects in spoken word recognition: Evidence from Chinese

Extensive evidence from alphabetic languages demonstrates a role of orthography in the processing of spoken words. Because alphabetic systems explicitly code speech sounds, such effects are perhaps not surprising. However, it is less clear whether orthographic codes are involuntarily accessed from spoken words in languages with non-alphabetic systems, in which the sound-spelling correspondence is largely arbitrary. We investigated the role of orthography via a semantic relatedness judgment task: native Mandarin speakers judged whether or not spoken word pairs were related in meaning. Word pairs were either semantically related, orthographically related, or unrelated. Results showed that relatedness judgments were made faster for word pairs that were semantically related than for unrelated word pairs. Critically, orthographic overlap on semantically unrelated word pairs induced a significant increase in response latencies. These findings indicate that orthographic information is involuntarily accessed in spoken-word recognition, even in a non-alphabetic language such as Chinese.

Does learning to read shape verbal working memory?

Many experimental studies have investigated the relationship between the acquisition of reading and working memory in a unidirectional way, attempting to determine to what extent individual differences in working memory can predict reading achievement. In contrast, very little attention has been dedicated to the converse possibility that learning to read shapes the development of verbal memory processes. In this paper, we present available evidence that advocates a more prominent role for reading acquisition on verbal working memory and then discuss the potential mechanisms of such literacy effects. First, the early decoding activities might bolster the development of subvocal rehearsal, which, in turn, would enhance serial order performance in immediate memory tasks. In addition, learning to read and write in an alphabetical system allows the emergence of phonemic awareness and finely tuned phonological representations, as well as of orthographic representations. This could improve the quality, strength, and precision of lexical representations, and hence offer better support for the temporary encoding of memory items and/or for their retrieval.