Audiovisual perception of natural speech is impaired in adult dyslexics: An ERP study

Children with developmental dyslexia have equivalent audiovisual speech perception performance but their perceptual weights differ

As reading is inherently a multisensory, audiovisual (AV) process where visual symbols (i.e., letters) are connected to speech sounds, the question has been raised whether individuals with reading difficulties, like children with developmental dyslexia (DD), have broader impairments in multisensory processing. This question has been posed before, yet it remains unanswered due to (a) the complexity and contentious etiology of DD along with (b) lack of consensus on developmentally appropriate AV processing tasks. We created an ecologically valid task for measuring multisensory AV processing by leveraging the natural phenomenon that speech perception improves when listeners are provided visual information from mouth movements (particularly when the auditory signal is degraded). We designed this AV processing task with low cognitive and linguistic demands such that children with and without DD would have equal unimodal (auditory and visual) performance. We then collected data in a group of 135 children (age 6.5-15) with an AV speech perception task to answer the following questions: (1) How do AV speech perception benefits manifest in children, with and without DD? (2) Do children all use the same perceptual weights to create AV speech perception benefits, and (3) what is the role of phonological processing in AV speech perception? We show that children with and without DD have equal AV speech perception benefits on this task, but that children with DD rely less on auditory processing in more difficult listening situations to create these benefits and weigh both incoming information streams differently. Lastly, any reported differences in speech perception in children with DD might be better explained by differences in phonological processing than differences in reading skills. RESEARCH HIGHLIGHTS: Children with versus without developmental dyslexia have equal audiovisual speech perception benefits, regardless of their phonological awareness or reading skills. Children with developmental dyslexia rely less on auditory performance to create audiovisual speech perception benefits. Individual differences in speech perception in children might be better explained by differences in phonological processing than differences in reading skills.

Audiovisual multisensory integration in individuals with reading and language impairments: A systematic review and meta-analysis

Differences in sensory function have been documented for a number of neurodevelopmental conditions, including reading and language impairments. Prior studies have measured audiovisual multisensory integration (i.e., the ability to combine inputs from the auditory and visual modalities) in these populations. The present study sought to systematically review and quantitatively synthesize the extant literature on audiovisual multisensory integration in individuals with reading and language impairments. A comprehensive search strategy yielded 56 reports, of which 38 were used to extract 109 group difference and 68 correlational effect sizes. There was an overall difference between individuals with reading and language impairments and comparisons on audiovisual integration. There was a nonsignificant trend towards moderation according to sample type (i.e., reading versus language) and publication/small study bias for this model. Overall, there was a small but non-significant correlation between metrics of audiovisual integration and reading or language ability; this model was not moderated by sample or study characteristics, nor was there evidence of publication/small study bias. Limitations and future directions for primary and meta-analytic research are discussed.

Face Processing in School Children with Dyslexia: Neuropsychological and Eye-tracking Findings

Dyslexia is a neurodevelopmental difficulty affecting reading, but recent data in adults suggest that difficulties also extend to face processing. Here, we tested face processing in school children with and without dyslexia, using eye-tracking and neuropsychological tests. Children with dyslexia didn't differ significantly from controls in face gaze patterns, face memory, or face identification accuracy. However, they were slower and more heterogeneous, with larger within-group variance than controls. Increased gaze patterns toward the eyes were associated with better face memory in controls. We discuss the possible role of experiential factors in prior research linking dyslexia and face processing differences.

Words as Visual Objects: Neural and Behavioral Evidence for High-Level Visual Impairments in Dyslexia

Developmental dyslexia is defined by reading impairments that are disproportionate to intelligence, motivation, and the educational opportunities considered necessary for reading. Its cause has traditionally been considered to be a phonological deficit, where people have difficulties with differentiating the sounds of spoken language. However, reading is a multidimensional skill and relies on various cognitive abilities. These may include high-level vision—the processes that support visual recognition despite innumerable image variations, such as in viewpoint, position, or size. According to our high-level visual dysfunction hypothesis, reading problems of some people with dyslexia can be a salient manifestation of a more general deficit of high-level vision. This paper provides a perspective on how such non-phonological impairments could, in some cases, cause dyslexia. To argue in favor of this hypothesis, we will discuss work on functional neuroimaging, structural imaging, electrophysiology, and behavior that provides evidence for a link between high-level visual impairment and dyslexia.

Orthographic depth and developmental dyslexia: a meta-analytic study

Cross-cultural studies have suggested that reading deficits in developmental dyslexia (DD) can be moderated by orthographic depth. To further explore this issue and assess the moderating role of orthographic depth in the developmental cognitive trajectories of dyslexic and typical readers, we systematically reviewed 113 studies on DD that were published from 2013 to 2018 and selected 79 in which participants received an official DD diagnosis. Each study was classified according to orthographic depth (deep vs. shallow) and participant age (children vs. adults). We assessed the difference between DD and control groups' performance in reading tasks and in a wide range of cognitive domains associated with reading (phonological awareness (PA), rapid automatized naming (RAN), short-term working memory (WM), and nonverbal reasoning), including age and orthographies as moderators. We found an age-by-orthography interaction effect in word reading accuracy and a significant effect of age in pseudoword reading accuracy, but we found no effect of age and orthographic depth on the fluency parameters. These results suggest that reading speed is a reliable index for discriminating between DD and control groups across European orthographies from childhood to adulthood. A similar pattern of results emerged for PA, RAN, and short-term/WM. Our findings are discussed in relation to their impact on clinical practice while considering the orthographic depth and developmental level.

Facial speech processing in children with and without dyslexia

What role does the presence of facial speech play for children with dyslexia? Current literature proposes two distinctive claims. One claim states that children with dyslexia make less use of visual information from the mouth during speech processing due to a deficit in recruitment of audiovisual areas. An opposing claim suggests that children with dyslexia are in fact reliant on such information in order to compensate for auditory/phonological impairments. The current paper aims at directly testing these contrasting hypotheses (here referred to as "mouth insensitivity" versus "mouth reliance") in school-age children with and without dyslexia, matched on age and listening comprehension. Using eye tracking, in Study 1, we examined how children look at the mouth across conditions varying in speech processing demands. The results did not indicate significant group differences in looking at the mouth. However, correlation analyses suggest potentially important distinctions within the dyslexia group: those children with dyslexia who are better readers attended more to the mouth while presented with a person's face in a phonologically demanding condition. In Study 2, we examined whether the presence of facial speech cues is functionally beneficial when a child is encoding written words. The results indicated lack of overall group differences on the task, although those with less severe reading problems in the dyslexia group were more accurate when reading words that were presented with articulatory facial speech cues. Collectively, our results suggest that children with dyslexia differ in their "mouth reliance" versus "mouth insensitivity," a profile that seems to be related to the severity of their reading problems.

Audiovisual processing and selective attention in adult dyslexic readers: An event-related potential study

Developmental dyslexia is a specific reading disability characterized by decoding and spelling deficits that continue into adulthood. Because reading involves both attentional functions and audiovisual (AV) processing, the aim of this study was to explore the associations between the two factors in adult dyslexic readers. Adult non-impaired and dyslexic readers undertook alphabetic and non-alphabetic tasks, each composed of three experimental blocks. Two experimental blocks contained left and right spatial selective attention manipulations, and another block included central presentations of the stimuli. Event-related potential (ERP) and behavioural parameters were collected and analysed, particularly with respect to the N1-P2 ERP complex. The dyslexic readers showed deviant patterns of amplitudes when it came to alphabetic stimuli processing. However, there was no difference between the two groups with regard to the non-alphabetic stimuli. These results imply that adult dyslexic readers allocate altered attentional resources when it comes to the processing of AV alphabetic stimuli.

Speech-Brain Frequency Entrainment of Dyslexia with and without Phonological Deficits

Developmental dyslexia is a cognitive disorder characterized by difficulties in linguistic processing. Our purpose is to distinguish subtypes of developmental dyslexia by the level of speech–EEG frequency entrainment (δ: 1–4; β: 12.5–22.5; γ1: 25–35; and γ2: 35–80 Hz) in word/pseudoword auditory discrimination. Depending on the type of disabilities, dyslexics can divide into two subtypes—with less pronounced phonological deficits (NoPhoDys—visual dyslexia) and with more pronounced ones (PhoDys—phonological dyslexia). For correctly recognized stimuli, the δ-entrainment is significantly worse in dyslexic children compared to controls at a level of speech prosody and syllabic analysis. Controls and NoPhoDys show a stronger δ-entrainment in the left-hemispheric auditory cortex (AC), anterior temporal lobe (ATL), frontal, and motor cortices than PhoDys. Dyslexic subgroups concerning normolexics have a deficit of δ-entrainment in the left ATL, inferior frontal gyrus (IFG), and the right AC. PhoDys has higher δ-entrainment in the posterior part of adjacent STS regions than NoPhoDys. Insufficient low-frequency β changes over the IFG, the inferior parietal lobe of PhoDys compared to NoPhoDys correspond to their worse phonological short-term memory. Left-dominant 30 Hz-entrainment for normolexics to phonemic frequencies characterizes the right AC, adjacent regions to superior temporal sulcus of dyslexics. The pronounced 40 Hz-entrainment in PhoDys than the other groups suggest a hearing “reassembly” and a poor phonological working memory. Shifting up to higher-frequency γ-entrainment in the AC of NoPhoDys can lead to verbal memory deficits. Different patterns of cortical reorganization based on the left or right hemisphere lead to differential dyslexic profiles.

Cortical tracking of speech in noise accounts for reading strategies in children

Humans' propensity to acquire literacy relates to several factors, including the ability to understand speech in noise (SiN). Still, the nature of the relation between reading and SiN perception abilities remains poorly understood. Here, we dissect the interplay between (1) reading abilities, (2) classical behavioral predictors of reading (phonological awareness, phonological memory, and rapid automatized naming), and (3) electrophysiological markers of SiN perception in 99 elementary school children (26 with dyslexia). We demonstrate that, in typical readers, cortical representation of the phrasal content of SiN relates to the degree of development of the lexical (but not sublexical) reading strategy. In contrast, classical behavioral predictors of reading abilities and the ability to benefit from visual speech to represent the syllabic content of SiN account for global reading performance (i.e., speed and accuracy of lexical and sublexical reading). In individuals with dyslexia, we found preserved integration of visual speech information to optimize processing of syntactic information but not to sustain acoustic/phonemic processing. Finally, within children with dyslexia, measures of cortical representation of the phrasal content of SiN were negatively related to reading speed and positively related to the compromise between reading precision and reading speed, potentially owing to compensatory attentional mechanisms. These results clarify the nature of the relation between SiN perception and reading abilities in typical child readers and children with dyslexia and identify novel electrophysiological markers of emergent literacy.

Auditory Deficits in Audiovisual Speech Perception in Adult Asperger's Syndrome: fMRI Study

Audiovisual (AV) integration deficits have been proposed to underlie difficulties in speech perception in Asperger’s syndrome (AS). It is not known, if the AV deficits are related to alterations in sensory processing at the level of unisensory processing or at levels of conjoint multisensory processing. Functional Magnetic-resonance images (MRI) was performed in 16 adult subjects with AS and 16 healthy controls (HC) matched for age, gender, and verbal IQ as they were exposed to disyllabic AV congruent and AV incongruent nouns. A simple semantic categorization task was used to ensure subjects’ attention to the stimuli. The left auditory cortex (BA41) showed stronger activation in HC than in subjects with AS with no interaction regarding AV congruency. This suggests that alterations in auditory processing in unimodal low-level areas underlie AV speech perception deficits in AS. Whether this is signaling a difficulty in the deployment of attention remains to be demonstrated.