Processing orthographic structure: associations between print and fingerspelling

Fingerspelling Used in Classrooms by Teachers of the Deaf and Hard-of-Hearing

Studies have shown the benefits of fingerspelling on literacy skills in school-age deaf and hard-of-hearing students. This study is an observation of 20 first- and second-grade classrooms. The classroom observations were coded for fingerspelling event frequency, type, length, and whether it was chained to print. The observations showed that teachers used an average of 54 fingerspelled events during 40-min lessons. Teachers' frequency of fingerspelling was positively related to students' frequency of fingerspelling. The types of words fingerspelled included Vocabulary (nouns, verbs, adjectives, and adverbs), Function (prepositions, articles, and conjunctions), Abbreviations, and Single Letter Names (i.e., manual alphabet). Teachers most frequently fingerspelled Vocabulary words (57.9%, SD = 22.1%) followed by Function words (15%, SD = 11.2%). The average length of Vocabulary and Function words were 4.2 (SD = 0.7) and 2.9 (SD = 1.1) letters, respectively. Teachers chained fingerspelling to print 20% (SD = 10%) of the time. We suggest that teachers could increase and more systematically use fingerspelling in early-elementary classrooms, explicitly bridging the connection between fingerspelling and print given its association with reading.

Asymetric Event-Related Potential Priming Effects Between English Letters and American Sign Language Fingerspelling Fonts

Letter recognition plays an important role in reading and follows different phases of processing, from early visual feature detection to the access of abstract letter representations. Deaf ASL-English bilinguals experience orthography in two forms: English letters and fingerspelling. However, the neurobiological nature of fingerspelling representations, and the relationship between the two orthographies, remains unexplored. We examined the temporal dynamics of single English letter and ASL fingerspelling font processing in an unmasked priming paradigm with centrally presented targets for 200 ms preceded by 100 ms primes. Event-related brain potentials were recorded while participants performed a probe detection task. Experiment 1 examined English letter-to-letter priming in deaf signers and hearing non-signers. We found that English letter recognition is similar for deaf and hearing readers, extending previous findings with hearing readers to unmasked presentations. Experiment 2 examined priming effects between English letters and ASL fingerspelling fonts in deaf signers only. We found that fingerspelling fonts primed both fingerspelling fonts and English letters, but English letters did not prime fingerspelling fonts, indicating a priming asymmetry between letters and fingerspelling fonts. We also found an N400-like priming effect when the primes were fingerspelling fonts which might reflect strategic access to the lexical names of letters. The studies suggest that deaf ASL-English bilinguals process English letters and ASL fingerspelling differently and that the two systems may have distinct neural representations. However, the fact that fingerspelling fonts can prime English letters suggests that the two orthographies may share abstract representations to some extent.

Fingerspelling and Its Role in Translanguaging

Fingerspelling is a critical component of many sign languages. This manual representation of orthographic code is one key way in which signers engage in translanguaging, drawing from all of their linguistic and semiotic resources to support communication. Translanguaging in bimodal bilinguals is unique because it involves drawing from languages in different modalities, namely a signed language like American Sign Language and a spoken language like English (or its written form). Fingerspelling can be seen as a unique product of the unified linguistic system that translanguaging theories purport, as it blends features of both sign and print. The goals of this paper are twofold: to integrate existing research on fingerspelling in order to characterize it as a cognitive-linguistic phenomenon and to discuss the role of fingerspelling in translanguaging and communication. We will first review and synthesize research from linguistics and cognitive neuroscience to summarize our current understanding of fingerspelling, its production, comprehension, and acquisition. We will then discuss how fingerspelling relates to translanguaging theories and how it can be incorporated into translanguaging practices to support literacy and other communication goals.

Contribution of Lexical Quality and Sign Language Variables to Reading Comprehension

The lexical quality hypothesis proposes that the quality of phonological, orthographic, and semantic representations impacts reading comprehension. In Study 1, we evaluated the contributions of lexical quality to reading comprehension in 97 deaf and 98 hearing adults matched for reading ability. While phonological awareness was a strong predictor for hearing readers, for deaf readers, orthographic precision and semantic knowledge, not phonology, predicted reading comprehension (assessed by two different tests). For deaf readers, the architecture of the reading system adapts by shifting reliance from (coarse-grained) phonological representations to high-quality orthographic and semantic representations. In Study 2, we examined the contribution of American Sign Language (ASL) variables to reading comprehension in 83 deaf adults. Fingerspelling (FS) and ASL comprehension skills predicted reading comprehension. We suggest that FS might reinforce orthographic-to-semantic mappings and that sign language comprehension may serve as a linguistic basis for the development of skilled reading in deaf signers.

Perceiving fingerspelling via point-light displays: The stimulus and the perceiver both matter

Signed languages such as American Sign Language (ASL) rely on visuospatial information that combines hand and bodily movements, facial expressions, and fingerspelling. Signers communicate in a wide array of sub-optimal environments, such as in dim lighting or from a distance. While fingerspelling is a common and essential part of signed languages, the perception of fingerspelling in difficult visual environments is not well understood. The movement and spatial patterns of ASL are well-suited to representation by dynamic Point Light Display (PLD) stimuli in which human movement is shown as an array of moving dots affixed to joints on the body. We created PLD videos of fingerspelled location names. The location names were either Real (e.g., KUWAIT) or Pseudo-names (e.g., CLARTAND), and the PLDs showed either a High or a Low number of markers. In an online study, Deaf and Hearing ASL users (total N = 283) watched 27 PLD stimulus videos that varied by Word Type and Number of Markers. Participants watched the videos and typed the names they saw, along with how confident they were in their response. We predicted that when signers see ASL fingerspelling PLDs, language experience in ASL will be positively correlated with accuracy and self-rated confidence scores. We also predicted that Real location names would be understood better than Pseudo names. Our findings supported those predictions. We also discovered a significant interaction between Age and Word Type, which suggests that as people age, they use outside world knowledge to inform their fingerspelling success. Finally, we examined the accuracy and confidence in fingerspelling perception in early ASL users. Studying the relationship between language experience with PLD fingerspelling perception allows us to explore how hearing status, ASL fluency levels, and age of language acquisition affect the core abilities of understanding fingerspelling.

Contribution of Linguistic Skills to Word Reading in DHH Students

This study aims to examine the relative contributions of phonological awareness (PA), orthographical awareness (OA), morphological awareness (MA) and rapid automatized naming (RAN) to word reading accuracy and fluency in Chinese deaf and hard of hearing (DHH) students. Measures of PA, OA, MA, RAN, word reading accuracy, and word reading fluency were administered to 133 DHH and 127 hearing students in Grades 4-6. After controlling for chronological age, hierarchical regression analysis showed that PA made an independent contribution to word reading accuracy and fluency among the DHH students. The unique effect of OA was significant on word reading accuracy in DHH students; whereas, its predictive role was played on word reading fluency in hearing students. RAN accounted for additional variance only in word reading accuracy in DHH students. MA significantly explained the variance in both reading abilities and in both groups. This suggests that for DHH students, they use nonphonological clues (MA and OA) to learn to read. To a lesser degree, however, they do rely on PA to reading words. For hearing students, they mainly rely on MA to their word reading. There are some similarities and differences in the mechanisms underlying word reading in DHH and hearing children.

Developing Reading Skills in Prelingually Deaf Preschool Children: Fingerspelling as a Strategy to Promote Orthographic Learning

The aim of this study was to clarify whether fingerspelling provides a sophisticated mechanism that promotes the development of detailed orthographic knowledge for deaf individuals even in the absence of paralleling phonological knowledge. An intervention program comprised of various procedures chaining between fingerspelled sequences; their written correlates and meaning were administered in a multiple probe single-subject research design across semantic categories to four children with severe to profound prelingual hearing loss (age 4.2-6 years). Results demonstrate the occurrence of rapid orthographic learning during intervention and reliable retention of it in maintenance checks, despite the participants' insufficiently developed phonological skills. Observations of the participants' behavior further suggest fingerspelling to function as an effective mediator in the initial development of robust detailed orthographic lexicon. Analyzes also indicate that "learning through action" and "relevance to the task" provide two key factors in relation to the promotion of orthographic learning, with their absence creating an obvious vacuum in this regard. Insights from the study are discussed with reference to their implication for the development of learning materials and learning environments for prelingually deaf and other novice learners.

Language and Reading Comprehension Abilities of Elementary School-Aged Deaf Children

Bilingual education programs for deaf children have long asserted that American Sign Language (ASL) is a better language of instruction English-like signing because ASL is a natural language. However, English-like signing may be a useful bridge to reading English. In the present study, we tested 32 deaf children between third and sixth grade to assess their capacity to use ASL or English-like signing in nine different languages and reading tasks. Our results found that there was no significant difference in the deaf children's ability to comprehend narratives in ASL compared to when they are told in English-like signing. Additionally, language abilities in ASL and English-like signing were strongly related to each other and to reading. Reading was also strongly related to fingerspelling. Our results suggest that there may be a role in literacy instruction for English-like signing as a supplement to ASL in deaf bilingual schools.

An ERP investigation of orthographic precision in deaf and hearing readers

Phonology is often assumed to play a role in the tuning of orthographic representations, but it is unknown whether deaf readers' reduced access to spoken phonology reduces orthographic precision. To index how precisely deaf and hearing readers encode orthographic information, we used a masked transposed-letter (TL) priming paradigm. Word targets were preceded by TL primes formed by reversing two letters in the word and substitution primes in which the same two letters were replaced. The two letters that were manipulated were either in adjacent or non-adjacent positions, yielding four prime conditions: adjacent TL (e.g., chikcen-CHICKEN), adjacent substitution (e.g., chidven- CHICKEN), non-adjacent TL (e.g., ckichen-CHICKEN), and non-adjacent substitution (e.g., cticfen-CHICKEN). Replicating the standard TL priming effects, targets preceded by TL primes elicited smaller amplitude negativities and faster responses than those preceded by substitution primes overall. This indicates some degree of flexibility in the associations between letters and their positions within words. More flexible (i.e., less precise) representations are thought to be more susceptible to activation by TL primes, resulting in larger TL priming effects. However, the size of the TL priming effects was virtually identical between groups. Moreover, the ERP effects were shifted in time such that the adjacent TL priming effect arose earlier than the non-adjacent TL priming effect in both groups. These results suggest that phonological tuning is not required to represent orthographic information in a precise manner.

What Do Spelling Errors Tell Us about Deaf Learners of French?

For deaf students, spelling acquisition is a considerable challenge, especially because the spelling code is based on an oral language to which most of them have limited access. Most studies conducted with deaf students have reported that they lag behind their hearing peers. However, few studies have used a fine-grained error classification grid. The use of such a grid makes it possible to draw a precise portrait of writers' orthographic knowledge. The purpose of this study was to describe the spelling skills of 19 deaf students (Mage = 10.9 years) and to compare their errors with those of 20 hearing students of the same age and 17 younger hearing students at the same reading level. The results indicate that deaf students are not quantitatively different from hearing students but that their errors are qualitatively different from those of hearing students.

Modality and Interrelations Among Language, Reading, Spoken Phonological Awareness, and Fingerspelling

Better understanding of the mechanisms underlying early reading skills can lead to improved interventions. Hence, the purpose of this study was to examine multivariate associations among reading, language, spoken phonological awareness, and fingerspelling abilities for three groups of deaf and hard-of-hearing (DHH) beginning readers: those who were acquiring only spoken English (n = 101), those who were visual learners and acquiring sign (n = 131), and those who were acquiring both (n = 104). Children were enrolled in kindergarten, first, or second grade. Within-group and between-group confirmatory factor analysis showed that there were both similarities and differences in the abilities that underlie reading in these three groups. For all groups, reading abilities related to both language and the ability to manipulate the sublexical features of words. However, the groups differed on whether these constructs were based on visual or spoken language. Our results suggest that there are alternative means to learning to read. Whereas all DHH children learning to read rely on the same fundamental abilities of language and phonological processing, the modality, levels, and relations among these abilities differ.

The N170 ERP component differs in laterality, distribution, and association with continuous reading measures for deaf and hearing readers

The temporo-occipitally distributed N170 ERP component is hypothesized to reflect print-tuning in skilled readers. This study investigated whether skilled deaf and hearing readers (matched on reading ability, but not phonological awareness) exhibit similar N170 patterns, given their distinct experiences learning to read. Thirty-two deaf and 32 hearing adults viewed words and symbol strings in a familiarity judgment task. In the N170 epoch (120-240ms) hearing readers produced greater negativity for words than symbols at left hemisphere (LH) temporo-parietal and occipital sites, while deaf readers only showed this asymmetry at occipital sites. Linear mixed effects regression was used to examine the influence of continuous measures of reading, spelling, and phonological skills on the N170 (120-240ms). For deaf readers, better reading ability was associated with a larger N170 over the right hemisphere (RH), but for hearing readers better reading ability was associated with a smaller RH N170. Better spelling ability was related to larger occipital N170s in deaf readers, but this relationship was weak in hearing readers. Better phonological awareness was associated with smaller N170s in the LH for hearing readers, but this association was weaker and in the RH for deaf readers. The results support the phonological mapping hypothesis for a left-lateralized temporo-parietal N170 in hearing readers and indicate that skilled reading is characterized by distinct patterns of neural tuning to print in deaf and hearing adults.

A Case of Specific Language Impairment in a Deaf Signer of American Sign Language

This article describes the case of a deaf native signer of American Sign Language (ASL) with a specific language impairment (SLI). School records documented normal cognitive development but atypical language development. Data include school records; interviews with the child, his mother, and school professionals; ASL and English evaluations; and a comprehensive neuropsychological and psychoeducational evaluation, and they span an approximate period of 7.5 years (11;10-19;6) including scores from school records (11;10-16;5) and a 3.5-year period (15;10-19;6) during which we collected linguistic and neuropsychological data. Results revealed that this student has average intelligence, intact visual perceptual skills, visuospatial skills, and motor skills but demonstrates challenges with some memory and sequential processing tasks. Scores from ASL testing signaled language impairment and marked difficulty with fingerspelling. The student also had significant deficits in English vocabulary, spelling, reading comprehension, reading fluency, and writing. Accepted SLI diagnostic criteria exclude deaf individuals from an SLI diagnosis, but the authors propose modified criteria in this work. The results of this study have practical implications for professionals including school psychologists, speech language pathologists, and ASL specialists. The results also support the theoretical argument that SLI can be evident regardless of the modality in which it is communicated.

Fingerspelled and Printed Words Are Recoded into a Speech-based Code in Short-term Memory

We conducted three immediate serial recall experiments that manipulated type of stimulus presentation (printed or fingerspelled words) and word similarity (speech-based or manual). Matched deaf American Sign Language signers and hearing non-signers participated (mean reading age = 14-15 years). Speech-based similarity effects were found for both stimulus types indicating that deaf signers recoded both printed and fingerspelled words into a speech-based phonological code. A manual similarity effect was not observed for printed words indicating that print was not recoded into fingerspelling (FS). A manual similarity effect was observed for fingerspelled words when similarity was based on joint angles rather than on handshape compactness. However, a follow-up experiment suggested that the manual similarity effect was due to perceptual confusion at encoding. Overall, these findings suggest that FS is strongly linked to English phonology for deaf adult signers who are relatively skilled readers. This link between fingerspelled words and English phonology allows for the use of a more efficient speech-based code for retaining fingerspelled words in short-term memory and may strengthen the representation of English vocabulary.

Visual sign phonology: insights into human reading and language from a natural soundless phonology

Among the most prevailing assumptions in science and society about the human reading process is that sound and sound-based phonology are critical to young readers. The child's sound-to-letter decoding is viewed as universal and vital to deriving meaning from print. We offer a different view. The crucial link for early reading success is not between segmental sounds and print. Instead the human brain's capacity to segment, categorize, and discern linguistic patterning makes possible the capacity to segment all languages. This biological process includes the segmentation of languages on the hands in signed languages. Exposure to natural sign language in early life equally affords the child's discovery of silent segmental units in visual sign phonology (VSP) that can also facilitate segmental decoding of print. We consider powerful biological evidence about the brain, how it builds sound and sign phonology, and why sound and sign phonology are equally important in language learning and reading. We offer a testable theoretical account, reading model, and predictions about how VSP can facilitate segmentation and mapping between print and meaning. We explain how VSP can be a powerful facilitator of all children's reading success (deaf and hearing)-an account with profound transformative impact on learning to read in deaf children with different language backgrounds. The existence of VSP has important implications for understanding core properties of all human language and reading, challenges assumptions about language and reading as being tied to sound, and provides novel insight into a remarkable biological equivalence in signed and spoken languages. WIREs Cogn Sci 2016, 7:366-381. doi: 10.1002/wcs.1404 For further resources related to this article, please visit the WIREs website.

Fingerspelling as a Novel Gateway into Reading Fluency in Deaf Bilinguals

Studies have shown that American Sign Language (ASL) fluency has a positive impact on deaf individuals’ English reading, but the cognitive and cross-linguistic mechanisms permitting the mapping of a visual-manual language onto a sound-based language have yet to be elucidated. Fingerspelling, which represents English orthography with 26 distinct hand configurations, is an integral part of ASL and has been suggested to provide deaf bilinguals with important cross-linguistic links between sign language and orthography. Using a hierarchical multiple regression analysis, this study examined the relationship of age of ASL exposure, ASL fluency, and fingerspelling skill on reading fluency in deaf college-age bilinguals. After controlling for ASL fluency, fingerspelling skill significantly predicted reading fluency, revealing for the first-time that fingerspelling, above and beyond ASL skills, contributes to reading fluency in deaf bilinguals. We suggest that both fingerspelling—in the visual-manual modality—and reading—in the visual-orthographic modality—are mutually facilitating because they share common underlying cognitive capacities of word decoding accuracy and automaticity of word recognition. The findings provide support for the hypothesis that the development of English reading proficiency may be facilitated through strengthening of the relationship among fingerspelling, sign language, and orthographic decoding en route to reading mastery, and may also reveal optimal approaches for reading instruction for deaf and hard of hearing children.

Teachers' perceptions of promoting sign language phonological awareness in an ASL/English bilingual program

The National Reading Panel emphasizes that spoken language phonological awareness (PA) developed at home and school can lead to improvements in reading performance in young children. However, research indicates that many deaf children are good readers even though they have limited spoken language PA. Is it possible that some deaf students benefit from teachers who promote sign language PA instead? The purpose of this qualitative study is to examine teachers' beliefs and instructional practices related to sign language PA. A thematic analysis is conducted on 10 participant interviews at an ASL/English bilingual school for the deaf to understand their views and instructional practices. The findings reveal that the participants had strong beliefs in developing students' structural knowledge of signs and used a variety of instructional strategies to build students' knowledge of sign structures in order to promote their language and literacy skills.