Phonological similarity effects in memory for serial order of cued speech

Phonological store and speechreading performance of Chinese students with hearing impairment

This study presents three experiments to examine the role of the phonological store component of working memory in the speechreading performance of students with hearing impairment (HI) in China. In Experiment 1, 86 high school students with HI completed an immediate serial recall task with four lists of monosyllabic words that differed in phonological and visual similarities. In Experiment 2 and Experiment 3, 40 participants divided into high or low phonological store capacity (PS) and 40 participants divided into high or low visual phonological story capacity (VPS) completed a speechreading test at the word, phrase and sentence levels. Results revealed that (1) immediate serial recall showed effects of phonological and visual similarity and their interaction; (2) there was no significant effect of phonological store capacities on speechreading; and (3) there was a significant effect of visual phonological store capacities on accuracy but not speed of speechreading. These findings point to a general phonological store system for visual orthographic coding and phonological coding that students with HI engage in speechreading in Chinese. It provides evidence for the contention that the visual-based coding has a more direct impact on speechreading performance of Chinese students with HI than the speech-based coding.

Reading and reading-related skills in children using cochlear implants: prospects for the influence of cued speech

We assessed the reading and reading-related skills (phonemic awareness and phonological short-term memory) of deaf children fitted with cochlear implants (CI), either exposed to cued speech early (before 2 years old) (CS+) or never (CS-). Their performance was compared to that of 2 hearing control groups, 1 matched for reading level (RL), and 1 matched for chronological age (CA). Phonemic awareness and phonological short-term memory were assessed respectively through a phonemic similarity judgment task and through a word span task measuring phonological similarity effects. To assess the use of sublexical and lexical reading procedures, children read pseudowords and irregular words aloud. Results showed that cued speech improved performance on both the phonemic awareness and the reading tasks but not on the phonological short-term memory task. In phonemic awareness and reading, CS+ children obtained accuracy and rapidity scores similar to CA controls, whereas CS- children obtained lower scores than hearing controls. Nevertheless, in phonological short-term memory task, the phonological similarity effect of both CI groups was similar. Overall, these results support the use of cued speech to improve phonemic awareness and reading skills in CI children.

A Method for Transcribing the Manual Components of Cued Speech

Designed to allow visual communication of speech signals, Cued Speech consists of discrete hand signals that are produced in synchrony with the visual mouth movements of speech. The purpose of this paper is to describe a method for transcribing these hand signals. Procedures are presented for identifying 1) the steady-state portion of the cue to be analyzed, 2) the cue's handshape, and 3) the cue's placement. Reliability is evaluated, using materials from 12 cuers that were transcribed on two separate occasions (either by the original rater or a second rater). Results show very good intra-rater and inter-rater reliability on average, which remained good across a variety of individual cuers, even when the cuer's hand gestures were heavily coarticulated. Given its high reliability, this transcription method may be of benefit to applications that require systematic and quantitative analysis of Cued Speech production in various populations. In addition, some of the transcription principles from this method may be helpful in improving accuracy of automatic Cued Speech recognition systems.

The phonological store of working memory: is it phonological and is it a store?

The phonological store construct of the working memory model is critically evaluated. Three experiments test the prediction that the effect of irrelevant sound and the effect of phonological similarity each survive the action of articulatory suppression but only when presentation of to-be-remembered lists is auditory, not visual. No evidence was found to support the interaction predicted among irrelevant speech, modality, and articulatory suppression. Although evidence for an interaction among modality, phonological similarity, and articulatory suppression was found, its presence could be diminished by a suffix, which is an acoustic, not a phonological factor. Coupled with other evidence--from the irrelevant sound effect and errors in natural speech--the action attributed to the phonological store seems better described in terms of a combination of auditory-perceptual and output planning mechanisms.

Lateralization effects during semantic and rhyme judgement tasks in deaf and hearing subjects

A visual hemifield experiment investigated hemispheric specialization among hearing children and adults and prelingually, profoundly deaf youngsters who were exposed intensively to Cued Speech (CS). Of interest was whether deaf CS users, who undergo a development of phonology and grammar of the spoken language similar to that of hearing youngsters, would display similar laterality patterns in the processing of written language. Semantic, rhyme, and visual judgement tasks were used. In the visual task no VF advantage was observed. A RVF (left hemisphere) advantage was obtained for both the deaf and the hearing subjects for the semantic task, supporting Neville's claim that the acquisition of competence in the grammar of language is critical in establishing the specialization of the left hemisphere for language. For the rhyme task, however, a RVF advantage was obtained for the hearing subjects, but not for the deaf ones, suggesting that different neural resources are recruited by deaf and hearing subjects. Hearing the sounds of language may be necessary to develop left lateralised processing of rhymes.

Cognition in the hearing impaired and deaf as a bridge between signal and dialogue: a framework and a model

This paper focuses on the role of cognition in visual language processing in the deaf and hard of hearing. Although there are modality-specific cognitive findings in the literature on comparisons across speech communication modes and language (sign and speech), there is an impressive bulk of evidence that supports the notion of general modality-free cognitive functions in speech and sign processing. A working-memory framework is proposed for the cognitive involvement in language understanding (sign and speech). On the basis of multiple sources of behavioural and neuroscience data, four important parameters for language understanding are described in some detail: quality and precision of phonology, long-term memory access speed, degree of explicit processing, and general processing and storage capacity. Their interaction forms an important parameter space, and general predictions and applications can be derived for both spoken and signed language conditions. The model is mathematically formulated at a general level, hypothetical ease-of-language-understanding (ELU) functions are presented, and similarities and differences from current working-memory and speech perception formulations are pointed out.