Visual and Verbal Narrative Comprehension in Children and Adolescents with Autism Spectrum Disorders: An ERP Study

Semantic processing of verbal narratives compared to semantic processing of visual narratives: an ERP study of school-aged children

There is a misconception that pictures are easy to comprehend, which is problematic in pedagogical practices that include pictures. For example, if a child has difficulties with verbal narration to picture sequences, it may be interpreted as specific to spoken language even though the child may have additional difficulties with comprehension of visual narratives in the form of picture sequences. The purpose of the present study was therefore to increase our understanding of semantic processing in the pictorial domain in relation to semantic processing in the verbal domain, focusing on 9-13 years-old children with typical language development. To this end, we measured electrical brain responses (event related potentials, ERPs) in 17 children to (i) pictures (panels) that were predicted versus unpredicted in sequences of panels that conveyed visual narratives and (ii) words that were predicted versus unpredicted in sentences that conveyed verbal narratives. Results demonstrated similarities as there were no significant difference in the magnitude of the N400 effect across domains. The only difference between domains was the predicted difference in distribution, that is, a more posterior N400 effect in the verbal domain than in the pictorial domain. The study contributes to an increased understanding of the complexity of processing of visual narratives and its shared features with processing of verbal narratives, which should be considered in pedagogical practices.

Sequences in harmony: Cognitive interactions between musical and visual narrative structure

From film and television to graphic storytelling, tonal music can accompany visual narratives in a variety of contexts. The apprehension of both musical and narrative sequences involves temporal categories in ordered patterning, which raises an interesting question: Do musical progressions and visual narratives rely on shared sequence processing mechanisms? If this is the case, then cues from music and sequential static images, when presented simultaneously, should interact during audiovisual online processing. We tested this question by measuring reaction times to target picture panels appearing in visual narrative (comic strip) sequences, which were presented panel by panel and synchronized with musical chord progressions. Image sequences were either coherent narratives or incoherent (random) panels, and they were aligned with musical accompaniment consisting of coherent tonal chord progressions or non-tonal (unrelated) chords. Reaction times were faster for target images in coherent sequences than incoherent sequences, and even faster for coherent images with tonal accompaniment than non-tonal chords. This indicated an interaction between sequential structures across domains. We take these results as evidence for a shared, domain-general sequence processing mechanism operating across music and visual narrative.

Hearing Assistive Technology Facilitates Sentence-in-Noise Recognition in Chinese Children With Autism Spectrum Disorder

PURPOSE

Hearing assistive technology (HAT) has been shown to be a viable solution to the speech-in-noise perception (SPIN) issue in children with autism spectrum disorder (ASD); however, little is known about its efficacy in tonal language speakers. This study compared sentence-level SPIN performance between Chinese children with ASD and neurotypical (NT) children and evaluated HAT use in improving SPIN performance and easing SPIN difficulty.

METHOD

Children with ASD (n = 26) and NT children (n = 19) aged 6-12 years performed two adaptive tests in steady-state noise and three fixed-level tests in quiet and steady-state noise with and without using HAT. Speech recognition thresholds (SRTs) and accuracy rates were assessed using adaptive and fixed-level tests, respectively. Parents or teachers of the ASD group completed a questionnaire regarding children's listening difficulty under six circumstances before and after a 10-day trial period of HAT use.

RESULTS

Although the two groups of children had comparable SRTs, the ASD group showed a significantly lower SPIN accuracy rate than the NT group. Also, a significant impact of noise was found in the ASD group's accuracy rate but not in that of the NT group. There was a general improvement in the ASD group's SPIN performance with HAT and a decrease in their listening difficulty ratings across all conditions after the device trial.

CONCLUSIONS

The findings indicated inadequate SPIN in the ASD group using a relatively sensitive measure to gauge SPIN performance among children. The markedly increased accuracy rate in noise during HAT-on sessions for the ASD group confirmed the feasibility of HAT for improving SPIN performance in controlled laboratory settings, and the reduced post-use ratings of listening difficulty further confirmed the benefits of HAT use in daily scenarios.

Mapping access to meaning in adolescents with autism: Atypical lateralization and spatiotemporal patterns as a function of language ability

Individuals with autism spectrum disorders (ASD) vary in their language abilities, associated with atypical patterns of brain activity. However, few studies have examined the spatiotemporal profiles of lexico-semantic processing in ASD, particularly as a function of language heterogeneity. Thirty-nine high-functioning adolescents with ASD and 21 typically developing (TD) peers took part in a lexical decision task that combined semantic access with demands on cognitive control. Spatiotemporal characteristics of the processing stages were examined with a multimodal anatomically-constrained magnetoencephalography (aMEG) approach, which integrates MEG with structural MRI. Additional EEG data were acquired from a limited montage simultaneously with MEG. TD adolescents showed the canonical left-dominant activity in frontotemporal regions during both early (N250m) and late (N400m) stages of lexical access and semantic integration. In contrast, the ASD participants showed bilateral engagement of the frontotemporal language network, indicative of compensatory recruitment of the right hemisphere. The left temporal N400m was prominent in both groups, confirming preserved attempts to access meaning. In contrast, the left prefrontal N400m was reduced in ASD participants, consistent with impaired semantic/contextual integration and inhibitory control. To further investigate the impact of language proficiency, the ASD sample was stratified into high- and low-performing (H-ASD and L-ASD) subgroups based on their task accuracy. The H-ASD subgroup performed on par with the TD group and showed greater activity in the right prefrontal and bilateral temporal cortices relative to the L-ASD subgroup, suggesting compensatory engagement. The L-ASD subgroup additionally showed reduced and delayed left prefrontal N400m, consistent with more profound semantic and executive impairments in this subgroup. These distinct spatiotemporal activity profiles reveal the neural underpinnings of the ASD-specific access to meaning and provide insight into the phenotypic heterogeneity of language in ASD, which may be a result of different neurodevelopmental trajectories and adoption of compensatory strategies.

Story Comprehension Monitoring Across Visual, Listening, and Written Modalities in Children with and Without Autism Spectrum Disorder

Visual, as compared to verbal, tasks are often assumed to be easier for individuals with autism spectrum disorder (ASD), but is this true for story comprehension? This study evaluated story comprehension monitoring across visual, listening, and written modalities and assessed predictors in two closely matched groups (age, socioeconomic status, language, nonverbal cognition, and word reading) of children and adolescents (8-14 years) with ASD (n = 20) and typical development (typically developing [TD]; n = 20). The results of mixed-effects models indicated that story comprehension monitoring was low overall, and performance was comparable across visual, listening, and written modalities for participants with ASD. Age, vocabulary, nonverbal working memory, response and distractor inhibition, and social communication significantly predicted comprehension monitoring.

Children with autism spectrum disorder show atypical electroencephalographic response to processing contextual incongruencies

Children with autism spectrum disorder (ASD) experience difficulties with social communication, making it challenging to interpret contextual information that aids in accurately interpreting language. To investigate how the brain processes the contextual information and how this is different in ASD, we compared event-related potentials (ERPs) in response to processing visual and auditory congruent and incongruent information. Two groups of children participated in the study: 37 typically developing children and 15 children with ASD (age range = 6 to 12). We applied a language task involving auditory sentences describing congruent or incongruent images. We investigated two ERP components associated with language processing: the N400 and P600. Our results showed how children with ASD present significant differences in their neural responses in comparison with the TD group, even when their reaction times and correct trials are not significantly different from the TD group.

The time-locked neurodynamics of semantic processing in autism spectrum disorder: an EEG study

Language processing is often an area of difficulty in Autism Spectrum Disorder (ASD). Semantic processing-the ability to add meaning to a stimulus-is thought to be especially affected in ASD. However, the neurological origin of these deficits, both structurally and temporally, have yet to be discovered. To further previous behavioral findings on language differences in ASD, the present study used an implicit semantic priming paradigm and electroencephalography (EEG) to compare the level of theta coherence throughout semantic processing, between typically developing (TD) and ASD participants. Theta coherence is an indication of synchronous EEG oscillations and was of particular interest due to its previous links with semantic processing. Theta coherence was analyzed in response to semantically related or unrelated pairs of words and pictures across bilateral short, medium, and long electrode connections. We found significant results across a variety of conditions, but most notably, we observed reduced coherence for language stimuli in the ASD group at a left fronto-parietal connection from 100 to 300 ms. This replicates previous findings of underconnectivity in left fronto-parietal language networks in ASD. Critically, the early time window of this underconnectivity, from 100 to 300 ms, suggests that impaired semantic processing of language in ASD may arise during pre-semantic processing, during the initial communication between lower-level linguistic processing and higher-level semantic processing. Our results suggest that language processing functions are unique in ASD compared to TD, and that subjects with ASD might rely on a temporally different language processing loop altogether.

Speech Processing in Autism Spectrum Disorder: An Integrative Review of Auditory Neurophysiology Findings

Purpose Investigations into the nature of communication disorders in autistic individuals increasingly evaluate neural responses to speech stimuli. This integrative review aimed to consolidate the available data related to speech and language processing across levels of stimulus complexity (from single speech sounds to sentences) and to relate it to the current theories of autism. Method An electronic database search identified peer-reviewed articles using event-related potentials or magnetoencephalography to investigate auditory processing from single speech sounds to sentences in autistic children and adults varying in language and cognitive abilities. Results Atypical neural responses in autistic persons became more prominent with increasing stimulus and task complexity. Compared with their typically developing peers, autistic individuals demonstrated mostly intact sensory responses to single speech sounds, diminished spontaneous attentional orienting to spoken stimuli, specific difficulties with categorical speech sound discrimination, and reduced processing of semantic content. Atypical neural responses were more often observed in younger autistic participants and in those with concomitant language disorders. Conclusions The observed differences in neural responses to speech stimuli suggest that communication difficulties in autistic individuals are more consistent with the reduced social interest than the auditory dysfunction explanation. Current limitations and future directions for research are also discussed.

Neural correlates of sex differences in communicative gestures and speech comprehension: A preliminary study

The goal of this study was to investigate whether the semantic processing of the audiovisual combination of communicative gestures with speech differs between men and women. We recorded event-related brain potentials in women and men during the presentation of communicative gestures that were either congruent or incongruent with the speech.Our results showed that incongruent gestures elicited an N400 effect over frontal sites compared to congruent ones in both groups. Moreover, the females showed an earlier N2 response to incongruent stimuli than congruent ones, while larger sustained negativity and late positivity in response to incongruent stimuli was observed only in males. These results suggest that women rapidly recognize and process audiovisual combinations of communicative gestures and speech (as early as 300 ms) whereas men analyze them at the later stages of the process.

Crossmodal processing of environmental sounds and everyday life actions: An ERP study

To investigate the processing of environmental sounds, previous researchers have compared the semantic processing of words and sounds, yielding mixed results. This study aimed to specifically investigate the electrophysiological mechanism underlying the semantic processing of environmental sounds presented in a naturalistic visual scene. We recorded event-related brain potentials in a group of young adults over the presentation of everyday life actions that were either congruent or incongruent with environmental sounds. Our results showed that incongruent environmental sounds evoked both a P400 and an N400 effect, reflecting sensitivity to physical and semantic violations of environmental sounds’ properties, respectively. In addition, our findings showed an enhanced late positivity in response to incongruous environmental sounds, probably reflecting additional reanalysis costs. In conclusion, these results indicate that the crossmodal processing of the environmental sounds might require the simultaneous involvement of different cognitive processes.

Narrative Skills in Primary School Children with Autism in Relation to Language and Nonverbal Temporal Sequencing

Recent research has suggested that temporal sequencing of narrative events might be a domain-general ability that underlies oral narrative capacities. The current study investigated this issue in a group of children with known pragmatic and narrative difficulties, namely Autism Spectrum Disorder (ASD). We hypothesized (1) that children with ASD (n = 45) would retell narratives of poorer quality than both chronological age-matched (CAM) children and younger children matched on sentence-level language skills (LM), and (2) that nonverbal temporal sequencing skills would uniquely predict individual differences in oral narrative performance in children with ASD. The results show that children with ASD performed poorer on all measures of oral narrative quality compared with the CAM group, and on eight of ten measures compared with the LM group. Thus, our first hypothesis was confirmed, suggesting that narrative difficulties in ASD cannot be fully explained by impaired language. The second hypothesis was only partly confirmed: nonverbal temporal sequencing explained significant or marginally significant variance in some, but not all, aspects of oral narrative performance of children with ASD. These results are discussed from theoretical and clinical/educational perspectives, in relation to the heterogeneity of language skills in ASD and to domain-general features of narrative processing.

Electrophysiological indexes of ToM and non-ToM humor in healthy adults

The cognitive processes involved in humor comprehension were analyzed by directly comparing the time course of brain activity associated with the perception of slapstick humor and that associated with the comprehension of humor requiring theory of mind (ToM). Four different comic strips (strips containing humorous scenes that required ToM, non-ToM humorous strips, non-humorous semantically coherent strips and non-humorous semantically incoherent strips) were presented to participants, while their EEG response was recorded. Results showed that both of the humorous comic strips and the semantically incongruent strip elicited an N400 effect, suggesting similar cognitive mechanisms underlying the processing of incongruent and humorous comic strips. The results also showed that the humorous ToM strips elicited a frontal late positive (LP) response, possibly reflecting the active deployment of ToM abilities such as perspective-taking and empathy that allow for the resolution and interpretation of apparently incongruent situations. In addition, the LP response was positively correlated with ratings of perceived amusement as well as individual empathy scores, suggesting that the increased LP response to ToM humorous strips reflects the combined activation of neural mechanisms involved in the experience of amusement and ToM abilities. Overall, humor comprehension appears to demand distinct cognitive steps such as the detection of incongruent semantic components, the construction of semantic coherence, and the appreciation of humoristic elements such as maladaptive emotional reactions. Our results show that the deployment of these distinct cognitive steps is at least partially dependent on individual empathic abilities.