Audiovisual multisensory integration in individuals with autism spectrum disorder: A systematic review and meta-analysis

Auditory Challenges and Listening Effort in School-Age Children With Autism: Insights From Pupillary Dynamics During Speech-in-Noise Perception

PURPOSE

This study aimed to investigate challenges in speech-in-noise (SiN) processing faced by school-age children with autism spectrum conditions (ASCs) and their impact on listening effort.

METHOD

Participants, including 23 Mandarin-speaking children with ASCs and 19 age-matched neurotypical (NT) peers, underwent sentence recognition tests in both quiet and noisy conditions, with a speech-shaped steady-state noise masker presented at 0-dB signal-to-noise ratio in the noisy condition. Recognition accuracy rates and task-evoked pupil responses were compared to assess behavioral performance and listening effort during auditory tasks.

RESULTS

No main effect of group was found on accuracy rates. Instead, significant effects emerged for autistic trait scores, listening conditions, and their interaction, indicating that higher trait scores were associated with poorer performance in noise. Pupillometric data revealed significantly larger and earlier peak dilations, along with more varied pupillary dynamics in the ASC group relative to the NT group, especially under noisy conditions. Importantly, the ASC group's peak dilation in quiet mirrored that of the NT group in noise. However, the ASC group consistently exhibited reduced mean dilations than the NT group.

CONCLUSIONS

Pupillary responses suggest a different resource allocation pattern in ASCs: An initial sharper and larger dilation may signal an intense, narrowed resource allocation, likely linked to heightened arousal, engagement, and cognitive load, whereas a subsequent faster tail-off may indicate a greater decrease in resource availability and engagement, or a quicker release of arousal and cognitive load. The presence of noise further accentuates this pattern. This highlights the unique SiN processing challenges children with ASCs may face, underscoring the importance of a nuanced, individual-centric approach for interventions and support.

The impact of premature birth on auditory-visual processes in very preterm schoolchildren

Interactions between stimuli from different sensory modalities and their integration are central to daily life, contributing to improved perception. Being born prematurely and the subsequent hospitalization can have an impact not only on sensory processes, but also on the manner in which information from different senses is combined-i.e., multisensory processes. Very preterm (VPT) children (<32 weeks gestational age) present impaired multisensory processes in early childhood persisting at least through the age of five. However, it remains largely unknown whether and how these consequences persist into later childhood. Here, we evaluated the integrity of auditory-visual multisensory processes in VPT schoolchildren. VPT children (N = 28; aged 8-10 years) received a standardized cognitive assessment and performed a simple detection task at their routine follow-up appointment. The simple detection task involved pressing a button as quickly as possible upon presentation of an auditory, visual, or simultaneous audio-visual stimulus. Compared to full-term (FT) children (N = 23; aged 6-11 years), reaction times of VPT children were generally slower and more variable, regardless of sensory modality. Nonetheless, both groups exhibited multisensory facilitation on mean reaction times and inter-quartile ranges. There was no evidence that standardized cognitive or clinical measures correlated with multisensory gains of VPT children. However, while gains in FT children exceeded predictions based on probability summation and thus forcibly invoked integrative processes, this was not the case for VPT children. Our findings provide evidence of atypical multisensory profiles in VPT children persisting into school-age. These results could help in targeting supportive interventions for this vulnerable population.

Synchrony perception across senses: A systematic review of temporal binding window changes from infancy to adolescence in typical and atypical development

Sensory integration is increasingly acknowledged as being crucial for the development of cognitive and social abilities. However, its developmental trajectory is still little understood. This systematic review delves into the topic by investigating the literature about the developmental changes from infancy through adolescence of the Temporal Binding Window (TBW) - the epoch of time within which sensory inputs are perceived as simultaneous and therefore integrated. Following comprehensive searches across PubMed, Elsevier, and PsycInfo databases, only experimental, behavioral, English-language, peer-reviewed studies on multisensory temporal processing in 0-17-year-olds have been included. Non-behavioral, non-multisensory, and non-human studies have been excluded as those that did not directly focus on the TBW. The selection process was independently performed by two Authors. The 39 selected studies involved 2859 participants in total. Findings indicate a predisposition towards cross-modal asynchrony sensitivity and a composite, still unclear, developmental trajectory, with atypical development associated to increased asynchrony tolerance. These results highlight the need for consistent and thorough research into TBW development to inform potential interventions.

Differences Between Autistic and Non-Autistic Individuals in Audiovisual Speech Integration: A Systematic Review and Meta-analysis

Research has indicated unique challenges in audiovisual integration of speech among autistic individuals, although methodological differences have led to divergent findings. We conducted a systematic literature search to identify studies that measured audiovisual speech integration among both autistic and non-autistic individuals. Across the 18 identified studies (combined N = 952), autistic individuals showed impaired audiovisual integration compared to their non-autistic peers (g = 0.69, 95% CI [0.53, 0.85], p <.001). This difference was not found to be influenced by participants' mean ages, studies' sample sizes, risk-of-bias scores, or paradigms investigated. However, a subgroup analysis suggested that child studies may show larger between-group differences than adult ones. The prevailing pattern of impaired audiovisual speech integration in autism may have cascading effects on communicative and social behavior. However, small samples and inconsistency in design/analysis translated into considerable heterogeneity in findings and opacity regarding the influence of underlying unisensory and attentional factors. We recommend three key directions for future research: larger samples, more research with adults, and standardization of methodology and analytical approaches.

Sensitivity to temporal synchrony and selective attention in audiovisual speech in infants at elevated likelihood for autism: A preliminary longitudinal study

Autism Spectrum Disorder is a highly heritable condition characterized by sociocommunicative difficulties, frequently entailing language atypicalities that extend to infants with a familial history of autism. The developmental mechanisms underlying these difficulties remain unknown. Detecting temporal synchrony between the lip movements and the auditory speech of a talking face and selectively attending to the mouth support typical early language acquisition. This preliminary eye-tracking study investigated whether these two fundamental mechanisms atypically function in infant siblings. We longitudinally tracked the trajectories of infants at elevated and low-likelihood for autism in these two abilities at 4, 8, and 12 months (n = 29). We presented two talking faces (synchronous and asynchronous) while recording infants' gaze to the talker's eyes and mouth. We found that infants detected temporal asynchronies in talking faces at 12 months regardless of group. However, compared to their typically developing peers, infants with an elevated likelihood of autism showed reduced attention to the mouth at the end of the first year and no variations in their interest to this area across time. Our findings provide preliminary evidence on a potentially atypical trajectory of reduced mouth-looking in audiovisual speech during the first year in infant siblings, with potential cascading consequences for language development, thus contributing to domain-general accounts of emerging autism.

Age, not autism, influences multisensory integration of speech stimuli among adults in a McGurk/MacDonald paradigm

Differences between autistic and non-autistic individuals in perception of the temporal relationships between sights and sounds are theorized to underlie difficulties in integrating relevant sensory information. These, in turn, are thought to contribute to problems with speech perception and higher level social behaviour. However, the literature establishing this connection often involves limited sample sizes and focuses almost entirely on children. To determine whether these differences persist into adulthood, we compared 496 autistic and 373 non-autistic adults (aged 17 to 75 years). Participants completed an online version of the McGurk/MacDonald paradigm, a multisensory illusion indicative of the ability to integrate audiovisual speech stimuli. Audiovisual asynchrony was manipulated, and participants responded both to the syllable they perceived (revealing their susceptibility to the illusion) and to whether or not the audio and video were synchronized (allowing insight into temporal processing). In contrast with prior research with smaller, younger samples, we detected no evidence of impaired temporal or multisensory processing in autistic adults. Instead, we found that in both groups, multisensory integration correlated strongly with age. This contradicts prior presumptions that differences in multisensory perception persist and even increase in magnitude over the lifespan of autistic individuals. It also suggests that the compensatory role multisensory integration may play as the individual senses decline with age is intact. These findings challenge existing theories and provide an optimistic perspective on autistic development. They also underline the importance of expanding autism research to better reflect the age range of the autistic population.

Differences in audiovisual temporal processing in autistic adults are specific to simultaneity judgments

Research has shown that children on the autism spectrum and adults with high levels of autistic traits are less sensitive to audiovisual asynchrony compared to their neurotypical peers. However, this evidence has been limited to simultaneity judgments (SJ) which require participants to consider the timing of two cues together. Given evidence of partly divergent perceptual and neural mechanisms involved in making temporal order judgments (TOJ) and SJ, and given that SJ require a more global type of processing which may be impaired in autistic individuals, here we ask whether the observed differences in audiovisual temporal processing are task and stimulus specific. We examined the ability to detect audiovisual asynchrony in a group of 26 autistic adult males and a group of age and IQ-matched neurotypical males. Participants were presented with beep-flash, point-light drumming, and face-voice displays with varying degrees of asynchrony and asked to make SJ and TOJ. The results indicated that autistic participants were less able to detect audiovisual asynchrony compared to the control group, but this effect was specific to SJ and more complex social stimuli (e.g., face-voice) with stronger semantic correspondence between the cues, requiring a more global type of processing. This indicates that audiovisual temporal processing is not generally different in autistic individuals and that a similar level of performance could be achieved by using a more local type of processing, thus informing multisensory integration theory as well as multisensory training aimed to aid perceptual abilities in this population.

Empowering Persons with Autism Through Cross-Reality and Conversational Agents

Autism Spectrum Disorder is a neurodevelopmental condition that can affect autonomy and independence. Our research explores the integration of Cross-Reality and Conversational Agents for Autistic persons to improve ability and confidence in everyday life situations. We combine two technologies of the Virtual-Real continuum. User experiences unfold from the simulation of tasks in VR to the execution of similar tasks supported by AR in the real world. A speech-based Conversational Agent is integrated with both VR and AR. It provides contextualized help, promotes generalization, and stimulates users to apply what they learned in the virtual space. The paper presents the approach and describes an empirical study involving 17 young Autistic persons.

Atypical Time to Contact Estimation in Young Adults with Autism Spectrum Disorder

Individuals with Autism Spectrum Disorder (ASD) present atypical sensory processing in the perception of moving stimuli and biological motion. The present study aims to explore the performance of young adults with ASD in a time to contact (TTC) estimation task involving social and non-social stimuli. TTC estimation involves extrapolating the trajectory of a moving target concealed by an occluder, based on the visible portion of its path, to predict the target's arrival time at a specific position. Sixteen participants with a diagnosis of level-1 ASD (M = 19.2 years, SE = 0.54 years; 3 F, 13 M) and sixteen participants with TD (M = 22.3 years, SE = 0.44 years; 3 F, 13 M) took part in the study and underwent a TTC estimation task. The task presented two object types (a car and a point-light walker), different object speeds, occluder lengths, motion directions and motion congruency. For the car object, a larger overestimation of TTC emerged for ASDs than for TDs, whereas no difference between ASDs and TDs emerged for the point-light walker. ASDs exhibited a larger TTC overestimation for the car object than for the point-light walker, whereas no difference between object types emerged for TDs. Our results indicated an atypical TTC estimation process in young adults with ASD. Given its importance in daily life, future studies should further explore this skill. Significant effects that emerged from the analysis are discussed.

Müller-Lyer Illusion susceptibility is conditionally predicted by autistic trait expression

Müller-Lyer (ML) figures bias size estimation consistently, yet different methods can lead to different degrees of illusory bias. Autistic individuals may also be less likely to perceive illusory biases with varying levels of autistic trait expression proposed to modulate reported illusory biases. The Autism-Spectrum Quotient (AQ) and Systemizing Quotient (SQ) are self-report measures that quantify autistic trait expression and systemizing ability in neurotypical individuals. The current study sought to determine if perceptions of illusory size bias negatively correlate with autistic trait expression and the extent to which varying methods of illusion presentation change the magnitude of illusory bias. Thirty neurotypical adults completed both questionnaires as well as four size estimation tasks. Two tasks involved perceptual discrimination of ML figures by concurrent and successive presentation, where participants selected the longer figure by keypress. For Tasks 3 and 4, participants adjusted the size of a non-illusory line (Task 3) or complementary illusory figure (Task 4) to match the perceived length. Overall, task performance was not correlated with autistic trait expression. One exception was a negative correlation with AQ when adjusting a complementary illusory ML figure in Task 4. Illusory biases were also stronger when two illusory figures were presented concurrently. Given these results, illusion susceptibility to the ML is suggested to be reduced with increases in AQ, but only when the method of illusion measurement is adjustment of concurrent illusory figures. Taken together the results provide evidence that traits associated with autism in a neurotypical population may systematically modulate perception.

Audio-visual multisensory integration and haptic perception are altered in adults with developmental coordination disorder

Developmental Coordination Disorder (DCD) is a movement disorder in which atypical sensory processing may underly movement atypicality. However, whether altered sensory processing is domain-specific or global in nature, are unanswered questions. Here, we measured for the first time, different aspects of sensory processing and spatiotemporal integration in the same cohort of adult participants with DCD (N = 16), possible DCD (pDCD, N = 12) and neurotypical adults (NT, N = 28). Haptic perception was reduced in both DCD and the extended DCD + pDCD groups when compared to NT adults. Audio-visual integration, measured using the sound-induced double flash illusion, was reduced only in DCD participants, and not the DCD + pDCD extended group. While low-level sensory processing was altered in DCD, the more cognitive, higher-level ability to infer temporal dimensions from spatial information, and vice-versa, as assessed with Tau-Kappa effects, was intact in DCD (and extended DCD + pDCD) participants. Both audio-visual integration and haptic perception difficulties correlated with the degree of self-reported DCD symptoms and were most apparent when comparing DCD and NT groups directly, instead of the expanded DCD + pDCD group. The association of sensory difficulties with DCD symptoms suggests that perceptual differences play a role in motor difficulties in DCD via an underlying internal modelling mechanism.

Neural correlates of audiovisual narrative speech perception in children and adults on the autism spectrum: A functional magnetic resonance imaging study

Autistic individuals show substantially reduced benefit from observing visual articulations during audiovisual speech perception, a multisensory integration deficit that is particularly relevant to social communication. This has mostly been studied using simple syllabic or word-level stimuli and it remains unclear how altered lower-level multisensory integration translates to the processing of more complex natural multisensory stimulus environments in autism. Here, functional neuroimaging was used to examine neural correlates of audiovisual gain (AV-gain) in 41 autistic individuals to those of 41 age-matched non-autistic controls when presented with a complex audiovisual narrative. Participants were presented with continuous narration of a story in auditory-alone, visual-alone, and both synchronous and asynchronous audiovisual speech conditions. We hypothesized that previously identified differences in audiovisual speech processing in autism would be characterized by activation differences in brain regions well known to be associated with audiovisual enhancement in neurotypicals. However, our results did not provide evidence for altered processing of auditory alone, visual alone, audiovisual conditions or AV- gain in regions associated with the respective task when comparing activation patterns between groups. Instead, we found that autistic individuals responded with higher activations in mostly frontal regions where the activation to the experimental conditions was below baseline (de-activations) in the control group. These frontal effects were observed in both unisensory and audiovisual conditions, suggesting that these altered activations were not specific to multisensory processing but reflective of more general mechanisms such as an altered disengagement of Default Mode Network processes during the observation of the language stimulus across conditions.

Multisensory Integration and Causal Inference in Typical and Atypical Populations

Multisensory perception is critical for effective interaction with the environment, but human responses to multisensory stimuli vary across the lifespan and appear changed in some atypical populations. In this review chapter, we consider multisensory integration within a normative Bayesian framework. We begin by outlining the complex computational challenges of multisensory causal inference and reliability-weighted cue integration, and discuss whether healthy young adults behave in accordance with normative Bayesian models. We then compare their behaviour with various other human populations (children, older adults, and those with neurological or neuropsychiatric disorders). In particular, we consider whether the differences seen in these groups are due only to changes in their computational parameters (such as sensory noise or perceptual priors), or whether the fundamental computational principles (such as reliability weighting) underlying multisensory perception may also be altered. We conclude by arguing that future research should aim explicitly to differentiate between these possibilities.

A Comparison of Listening Skills of Autistic and Non-Autistic Youth While Using and Not Using Remote Microphone Systems

OBJECTIVES

The purposes of this study were to compare (a) listening-in-noise (accuracy and effort) and (b) remote microphone (RM) system benefits between autistic and non-autistic youth.

DESIGN

Groups of autistic and non-autistic youth that were matched on chronological age and biological sex completed listening-in-noise testing when wearing and not wearing an RM system. Listening-in-noise accuracy and listening effort were evaluated simultaneously using a dual-task paradigm for stimuli varying in type (syllables, words, sentences, and passages). Several putative moderators of RM system effects on outcomes of interest were also evaluated.

RESULTS

Autistic youth outperformed non-autistic youth in some conditions on listening-in-noise accuracy; listening effort between the two groups was not significantly different. RM system use resulted in listening-in-noise accuracy improvements that were nonsignificantly different across groups. Benefits of listening-in-noise accuracy were all large in magnitude. RM system use did not have an effect on listening effort for either group. None of the putative moderators yielded effects of the RM system on listening-in-noise accuracy or effort for non-autistic youth that were significant and interpretable, indicating that RM system benefits did not vary according to any of the participant characteristics assessed.

CONCLUSIONS

Contrary to expectations, autistic youth did not demonstrate listening-in-noise deficits compared to non-autistic youth. Both autistic and non-autistic youth appear to experience RM system benefits marked by large gains in listening-in-noise performance. Thus, the use of this technology in educational and other noisy settings where speech perception needs enhancement might be beneficial for both groups of children.

A Randomized Controlled Trial for Audiovisual Multisensory Perception in Autistic Youth

Differences in audiovisual integration are commonly observed in autism. Temporal binding windows (TBWs) of audiovisual speech can be trained (i.e., narrowed) in non-autistic adults; this study evaluated a computer-based perceptual training in autistic youth and assessed whether treatment outcomes varied according to individual characteristics. Thirty autistic youth aged 8-21 were randomly assigned to a brief perceptual training (n = 15) or a control condition (n = 15). At post-test, the perceptual training group did not differ, on average, on TBWs for trained and untrained stimuli and perception of the McGurk illusion compared to the control group. The training benefited youth with higher language and nonverbal IQ scores; the training caused widened TBWs in youth with co-occurring cognitive and language impairments.

The Impact of Audio-Visual, Visual and Auditory Cues on Multiple Object Tracking Performance in Children with Autism

Previous studies have documented differences in processing multisensory information by children with autism compared to typically developing children. Furthermore, children with autism have been found to track fewer multiple objects on a screen than those without autism, suggesting reduced attentional control. In the present study, we investigated whether children with autism (n = 33) and children without autism (n = 33) were able to track four target objects moving amongst four indistinguishable distractor objects while sensory cues were presented. During tracking, we presented various types of cues - auditory, visual, or audio-visual or no cues while target objects bounced off the inner boundary of a centralized circle. We found that children with autism tracked fewer targets than children without autism. Furthermore, children without autism showed improved tracking performance in the presence of visual cues, whereas children with autism did not benefit from sensory cues. Whereas multiple object tracking performance improved with increasing age in children without autism, especially when using audio-visual cues, children with autism did not show age-related improvement in tracking. These results are in line with the hypothesis that attention and the ability to integrate sensory cues during tracking are reduced in children with autism. Our findings could contribute valuable insights for designing interventions that incorporate multisensory information.

Interactionally Embedded Gestalt Principles of Multimodal Human Communication

Natural human interaction requires us to produce and process many different signals, including speech, hand and head gestures, and facial expressions. These communicative signals, which occur in a variety of temporal relations with each other (e.g., parallel or temporally misaligned), must be rapidly processed as a coherent message by the receiver. In this contribution, we introduce the notion of interactionally embedded, affordance-driven gestalt perception as a framework that can explain how this rapid processing of multimodal signals is achieved as efficiently as it is. We discuss empirical evidence showing how basic principles of gestalt perception can explain some aspects of unimodal phenomena such as verbal language processing and visual scene perception but require additional features to explain multimodal human communication. We propose a framework in which high-level gestalt predictions are continuously updated by incoming sensory input, such as unfolding speech and visual signals. We outline the constituent processes that shape high-level gestalt perception and their role in perceiving relevance and prägnanz. Finally, we provide testable predictions that arise from this multimodal interactionally embedded gestalt-perception framework. This review and framework therefore provide a theoretically motivated account of how we may understand the highly complex, multimodal behaviors inherent in natural social interaction.

Examining the latent structure and correlates of sensory reactivity in autism: a multi-site integrative data analysis by the autism sensory research consortium

BACKGROUND

Differences in responding to sensory stimuli, including sensory hyperreactivity (HYPER), hyporeactivity (HYPO), and sensory seeking (SEEK) have been observed in autistic individuals across sensory modalities, but few studies have examined the structure of these "supra-modal" traits in the autistic population.

METHODS

Leveraging a combined sample of 3868 autistic youth drawn from 12 distinct data sources (ages 3-18 years and representing the full range of cognitive ability), the current study used modern psychometric and meta-analytic techniques to interrogate the latent structure and correlates of caregiver-reported HYPER, HYPO, and SEEK within and across sensory modalities. Bifactor statistical indices were used to both evaluate the strength of a "general response pattern" factor for each supra-modal construct and determine the added value of "modality-specific response pattern" scores (e.g., Visual HYPER). Bayesian random-effects integrative data analysis models were used to examine the clinical and demographic correlates of all interpretable HYPER, HYPO, and SEEK (sub)constructs.

RESULTS

All modality-specific HYPER subconstructs could be reliably and validly measured, whereas certain modality-specific HYPO and SEEK subconstructs were psychometrically inadequate when measured using existing items. Bifactor analyses supported the validity of a supra-modal HYPER construct (ωH = .800) but not a supra-modal HYPO construct (ωH = .653), and supra-modal SEEK models suggested a more limited version of the construct that excluded some sensory modalities (ωH = .800; 4/7 modalities). Modality-specific subscales demonstrated significant added value for all response patterns. Meta-analytic correlations varied by construct, although sensory features tended to correlate most with other domains of core autism features and co-occurring psychiatric symptoms (with general HYPER and speech HYPO demonstrating the largest numbers of practically significant correlations).

LIMITATIONS

Conclusions may not be generalizable beyond the specific pool of items used in the current study, which was limited to caregiver report of observable behaviors and excluded multisensory items that reflect many "real-world" sensory experiences.

CONCLUSION

Of the three sensory response patterns, only HYPER demonstrated sufficient evidence for valid interpretation at the supra-modal level, whereas supra-modal HYPO/SEEK constructs demonstrated substantial psychometric limitations. For clinicians and researchers seeking to characterize sensory reactivity in autism, modality-specific response pattern scores may represent viable alternatives that overcome many of these limitations.

Altered brain network organization in adults with Asperger's syndrome: decreased connectome transitivity and assortativity with increased global efficiency

Introduction

Autism spectrum disorder (ASD) is a neurodevelopmental disorder that persists into adulthood with both social and cognitive disturbances. Asperger's syndrome (AS) was a distinguished subcategory of autism in the DSM-IV-TR defined by specific symptoms including difficulties in social interactions, inflexible thinking patterns, and repetitive behaviour without any delay in language or cognitive development. Studying the functional brain organization of individuals with these specific symptoms may help to better understand Autism spectrum symptoms.

Methods

The aim of this study is therefore to investigate functional connectivity as well as functional network organization characteristics using graph-theory measures of the whole brain in male adults with AS compared to healthy controls (HC) (AS: n = 15, age range 21-55 (mean ± sd: 39.5 ± 11.6), HC: n = 15, age range 22-57 [mean ± sd: 33.5 ± 8.5]).

Results

No significant differences were found when comparing the region-by-region connectivity at the whole-brain level between the AS group and HC. However, measures of "transitivity," which reflect local information processing and functional segregation, and "assortativity," indicating network resilience, were reduced in the AS group compared to HC. On the other hand, global efficiency, which represents the overall effectiveness and speed of information transfer across the entire brain network, was increased in the AS group.

Discussion

Our findings suggest that individuals with AS may have alterations in the organization and functioning of brain networks, which could contribute to the distinctive cognitive and behavioural features associated with this condition. We suggest further research to explore the association between these altered functional patterns in brain networks and specific behavioral traits observed in individuals with AS, which could provide valuable insights into the underlying mechanisms of its symptomatology.

The Processing of Audiovisual Speech Is Linked with Vocabulary in Autistic and Nonautistic Children: An ERP Study

Explaining individual differences in vocabulary in autism is critical, as understanding and using words to communicate are key predictors of long-term outcomes for autistic individuals. Differences in audiovisual speech processing may explain variability in vocabulary in autism. The efficiency of audiovisual speech processing can be indexed via amplitude suppression, wherein the amplitude of the event-related potential (ERP) is reduced at the P2 component in response to audiovisual speech compared to auditory-only speech. This study used electroencephalography (EEG) to measure P2 amplitudes in response to auditory-only and audiovisual speech and norm-referenced, standardized assessments to measure vocabulary in 25 autistic and 25 nonautistic children to determine whether amplitude suppression (a) differs or (b) explains variability in vocabulary in autistic and nonautistic children. A series of regression analyses evaluated associations between amplitude suppression and vocabulary scores. Both groups demonstrated P2 amplitude suppression, on average, in response to audiovisual speech relative to auditory-only speech. Between-group differences in mean amplitude suppression were nonsignificant. Individual differences in amplitude suppression were positively associated with expressive vocabulary through receptive vocabulary, as evidenced by a significant indirect effect observed across groups. The results suggest that efficiency of audiovisual speech processing may explain variance in vocabulary in autism.

A theory of autism bridging across levels of description

Autism impacts a wide range of behaviors and neural functions. As such, theories of autism spectrum disorder (ASD) are numerous and span different levels of description, from neurocognitive to molecular. We propose how existent behavioral, computational, algorithmic, and neural accounts of ASD may relate to one another. Specifically, we argue that ASD may be cast as a disorder of causal inference (computational level). This computation relies on marginalization, which is thought to be subserved by divisive normalization (algorithmic level). In turn, divisive normalization may be impaired by excitatory-to-inhibitory imbalances (neural implementation level). We also discuss ASD within similar frameworks, those of predictive coding and circular inference. Together, we hope to motivate work unifying the different accounts of ASD.

Audiovisual multisensory integration in individuals with reading and language impairments: A systematic review and meta-analysis

Differences in sensory function have been documented for a number of neurodevelopmental conditions, including reading and language impairments. Prior studies have measured audiovisual multisensory integration (i.e., the ability to combine inputs from the auditory and visual modalities) in these populations. The present study sought to systematically review and quantitatively synthesize the extant literature on audiovisual multisensory integration in individuals with reading and language impairments. A comprehensive search strategy yielded 56 reports, of which 38 were used to extract 109 group difference and 68 correlational effect sizes. There was an overall difference between individuals with reading and language impairments and comparisons on audiovisual integration. There was a nonsignificant trend towards moderation according to sample type (i.e., reading versus language) and publication/small study bias for this model. Overall, there was a small but non-significant correlation between metrics of audiovisual integration and reading or language ability; this model was not moderated by sample or study characteristics, nor was there evidence of publication/small study bias. Limitations and future directions for primary and meta-analytic research are discussed.

Forwarding the Science of Sensory Features in Autism and Related Conditions

This editorial accompanies the JADD Special Issue on Sensory Features in Autism and Related Conditions: Developmental Approaches, Mechanisms and Targeted Interventions. The editorial is a commentary on the state of the science in sensory features in autism and related conditions and provides a synopsis of the information contained in the special issue including provocative thoughts about moving the field forward in this area.

Multisensory processing of emotional cues predicts intrusive memories after virtual reality trauma

Research has shown that high trait anxiety can alter multisensory processing of threat cues (by amplifying integration of angry faces and voices); however, it remains unknown whether differences in multisensory processing play a role in the psychological response to trauma. This study examined the relationship between multisensory emotion processing and intrusive memories over seven days following exposure to an analogue trauma in a sample of 55 healthy young adults. We used an adapted version of the trauma film paradigm, where scenes showing a car accident trauma were presented using virtual reality, rather than a conventional 2D film. Multisensory processing was assessed prior to the trauma simulation using a forced choice emotion recognition paradigm with happy, sad and angry voice-only, face-only, audiovisual congruent (face and voice expressed matching emotions) and audiovisual incongruent expressions (face and voice expressed different emotions). We found that increased accuracy in recognising anger (but not happiness and sadness) in the audiovisual condition relative to the voice- and face-only conditions was associated with more intrusions following VR trauma. Despite previous results linking trait anxiety and intrusion development, no significant influence of trait anxiety on intrusion frequency was observed. Enhanced integration of threat-related information (i.e. angry faces and voices) could lead to overly threatening appraisals of stressful life events and result in greater intrusion development after trauma.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10055-023-00784-1.

Effects of different types of visual music on the prefrontal hemodynamics of children with autism spectrum disorder based on functional near-infrared spectroscopy

BACKGROUND

Music therapy has been shown to improve communication in children with autism spectrum disorders (ASD), but little is known about how different types of music and images affect hemodynamic changes in the frontal lobe of the brain in children with ASD. This study aims to use functional near infrared spectroscopy (fNIRS) to explore the effects of different types of visual music on different brain regions of oxyhemoglobin (HbO) in the prefrontal lobe of children with ASD and children with typical development (TD), so as to provide evidence for better application of different types of visual music in the treatment of children with ASD.

METHODS

Seven children with ASD and nine matched children with TD were selected. Changes in HbO in their prefrontal lobes were determined by fNIRS after resting states and 12 different types of visual music tasks.

RESULTS

(I) Intra-group comparison: the influence of different types of light and music on ∆HbO in ROI (zone F) of ASD children is different, the activation degree shows that red light & positive music is less than green light & neutral music, red light & positive music is less than blue light & negative music, and there is no difference between green light & neutral music and blue light & negative music. (II) Comparison between groups: Visual musical tasks 1, 2, 3, 4, and 8 positively activated HbO in the prefrontal B and E regions of the brain in children with ASD and negatively activated HbO in TD children. Visual musical tasks 5, 9, 10, and 12 negatively activated HbO in the prefrontal F regions of the brain in children with ASD and positively activated HbO in TD children.

CONCLUSIONS

When the two groups of children received the same visual music task, the changes of HbO in different regions of the prefrontal lobe were different; The effects of different types of visual music on the frontal lobe of the brain in children with ASD are inconsistent.

Neural correlates of multisensory integration in the human brain: an ALE meta-analysis

Previous fMRI research identified superior temporal sulcus as central integration area for audiovisual stimuli. However, less is known about a general multisensory integration network across senses. Therefore, we conducted activation likelihood estimation meta-analysis with multiple sensory modalities to identify a common brain network. We included 49 studies covering all Aristotelian senses i.e., auditory, visual, tactile, gustatory, and olfactory stimuli. Analysis revealed significant activation in bilateral superior temporal gyrus, middle temporal gyrus, thalamus, right insula, and left inferior frontal gyrus. We assume these regions to be part of a general multisensory integration network comprising different functional roles. Here, thalamus operate as first subcortical relay projecting sensory information to higher cortical integration centers in superior temporal gyrus/sulcus while conflict-processing brain regions as insula and inferior frontal gyrus facilitate integration of incongruent information. We additionally performed meta-analytic connectivity modelling and found each brain region showed co-activations within the identified multisensory integration network. Therefore, by including multiple sensory modalities in our meta-analysis the results may provide evidence for a common brain network that supports different functional roles for multisensory integration.

Effect of anticipatory multisensory integration on sensory-motor performance

Multisensory integration (MSI) is a phenomenon that occurs in sensory areas after the presentation of multimodal stimuli. Nowadays, little is known about the anticipatory top-down processes taking place in the preparation stage of processing before the stimulus onset. Considering that the top-down modulation of modality-specific inputs might affect the MSI process, this study attempts to understand whether the direct modulation of the MSI process, beyond the well-known sensory effects, may lead to additional changes in multisensory processing also in non-sensory areas (i.e., those related to task preparation and anticipation). To this aim, event-related potentials (ERPs) were analyzed both before and after auditory and visual unisensory and multisensory stimuli during a discriminative response task (Go/No-go type). Results showed that MSI did not affect motor preparation in premotor areas, while cognitive preparation in the prefrontal cortex was increased and correlated with response accuracy. Early post-stimulus ERP activities were also affected by MSI and correlated with response time. Collectively, the present results point to the plasticity accommodating nature of the MSI processes, which are not limited to perception and extend to anticipatory cognitive preparation for task execution. Further, the enhanced cognitive control emerging during MSI is discussed in the context of Bayesian accounts of augmented predictive processing related to increased perceptual uncertainty.

Audiovisual temporal binding window narrows with age in autistic individuals

Atypical sensory perception has been recognized in autistic individuals since its earliest descriptions and is now considered a key characteristic of autism. Although the integration of sensory information (multisensory integration; MSI) has been demonstrated to be altered in autism, less is known about how this perceptual process differs with age. This study aimed to assess the integration of audiovisual information across autistic children and adolescents. MSI was measured using a non-social, simultaneity judgment task. Variation in temporal sensitivity was evaluated via Gaussian curve fitting procedures, allowing us to compare the width of temporal binding windows (TBWs), where wider TBWs indicate less sensitivity to temporal alignment. We compared TBWs in age and IQ matched groups of autistic (n = 32) and neurotypical (NT; n = 73) children and adolescents. The sensory profile of all participants was also measured. Across all ages assessed (i.e., 6 through 18 years), TBWs were negatively correlated with age in the autistic group. A significant correlation was not found in the NT group. When compared as a function of child (6-12 years) and adolescent (13-18 years) age groups, a significant interaction of group (autism vs NT) by age group was found, whereby TBWs became narrower with age in the autistic, but not neurotypical group. We also found a significant main effect of age and no significant main effect of group. Results suggest that TBW differences between autistic and neurotypical groups diminishes with increasing age, indicating an atypical developmental profile of MSI in autism which ameliorates across development.

Neural Correlates of Audiovisual Speech Processing in Autistic and Non-Autistic Youth

Autistic youth demonstrate differences in processing multisensory information, particularly in temporal processing of multisensory speech. Extensive research has identified several key brain regions for multisensory speech processing in non-autistic adults, including the superior temporal sulcus (STS) and insula, but it is unclear to what extent these regions are involved in temporal processing of multisensory speech in autistic youth. As a first step in exploring the neural substrates of multisensory temporal processing in this clinical population, we employed functional magnetic resonance imaging (fMRI) with a simultaneity-judgment audiovisual speech task. Eighteen autistic youth and a comparison group of 20 non-autistic youth matched on chronological age, biological sex, and gender participated. Results extend prior findings from studies of non-autistic adults, with non-autistic youth demonstrating responses in several similar regions as previously implicated in adult temporal processing of multisensory speech. Autistic youth demonstrated responses in fewer of the multisensory regions identified in adult studies; responses were limited to visual and motor cortices. Group responses in the middle temporal gyrus significantly interacted with age; younger autistic individuals showed reduced MTG responses whereas older individuals showed comparable MTG responses relative to non-autistic controls. Across groups, responses in the precuneus covaried with task accuracy, and anterior temporal and insula responses covaried with nonverbal IQ. These preliminary findings suggest possible differences in neural mechanisms of audiovisual processing in autistic youth while highlighting the need to consider participant characteristics in future, larger-scale studies exploring the neural basis of multisensory function in autism.

An auditory processing advantage enables communication in less complex social settings: Signs of an extreme female brain in children and adolescents being assessed for Autism Spectrum Disorders

Background

The underlying factors of the male predominance in Autism Spectrum Disorders (ASD) are largely unknown, although a female advantage in social communication has been pointed out as a potential factor. Recently, attention has been given to ASD as a sensory processing disorder, focusing on the audio-visual temporal processing paramount for the development of communication. In ASD, a deviant audio-visual processing has been noted, resulting in difficulties interpreting multisensory information. Typically Developed (TD) females have shown an enhanced language processing in unisensory situations compared to multisensory situations. We aim to find out whether such an advantage also can be seen in girls within the ASD population, and if so, is it related to social communication skills?

Method

Forty children (IQ > 85), 20 females (mean age = 13.90 years, SD = 2.34) and 20 males (mean age = 12.15 years, SD = 2.83) triaged for an ASD assessment were recruited from a child and youth psychiatric clinic in Sweden. Using The Social Responsiveness Scale (SRS) we looked at associations with child performance on the Integrated Visual and Auditory Continuous Performance Test (IVA-2).

Results

An auditory advantage in the female group was associated with less rated problems in social communications in unisensory processing whereas in multisensory processing an auditory dominance was associated with more rated problems in Social Awareness. In the male group, a visual dominance was associated with more rated problems in Social Rigidity.

Conclusion

A female unisensory processing advantage in ASD could very well be explaining the male domination in ASD. However, the social difficulties related to multisensory processing indicate that ASD females might be struggling as hard as males in more complex settings. Implications on the assessment procedure are discussed.

Examining the Latent Structure and Correlates of Sensory Reactivity in Autism: A Multi-site Integrative Data Analysis by the Autism Sensory Research Consortium

Background Differences in responding to sensory stimuli, including sensory hyperreactivity (HYPER), hyporeactivity (HYPO), and sensory seeking (SEEK) have been observed in autistic individuals across sensory modalities, but few studies have examined the structure of these "supra-modal" traits in the autistic population. Methods Leveraging a combined sample of 3,868 autistic youth drawn from 12 distinct data sources (ages 3-18 years and representing the full range of cognitive ability), the current study used modern psychometric and meta-analytic techniques to interrogate the latent structure and correlates of caregiver-reported HYPER, HYPO, and SEEK within and across sensory modalities. Bifactor statistical indices were used to both evaluate the strength of a "general response pattern" factor for each supra-modal construct and determine the added value of "modality-specific response pattern" scores (e.g., Visual HYPER). Bayesian random-effects integrative data analysis models were used to examine the clinical and demographic correlates of all interpretable HYPER, HYPO and SEEK (sub)constructs. Results All modality-specific HYPER subconstructs could be reliably and validly measured, whereas certain modality-specific HYPO and SEEK subconstructs were psychometrically inadequate when measured using existing items. Bifactor analyses unambiguously supported the validity of a supra-modal HYPER construct (ω H  = .800), whereas a coherent supra-modal HYPO construct was not supported (ω H  = .611), and supra-modal SEEK models suggested a more limited version of the construct that excluded some sensory modalities (ω H  = .799; 4/7 modalities). Within each sensory construct, modality-specific subscales demonstrated substantial added value beyond the supra-modal score. Meta-analytic correlations varied by construct, although sensory features tended to correlate most strongly with other domains of core autism features and co-occurring psychiatric symptoms. Certain subconstructs within the HYPO and SEEK domains were also associated with lower adaptive behavior scores. Limitations: Conclusions may not be generalizable beyond the specific pool of items used in the current study, which was limited to parent-report of observable behaviors and excluded multisensory items that reflect many "real-world" sensory experiences. Conclusion Psychometric issues may limit the degree to which some measures of supra-modal HYPO/SEEK can be interpreted. Depending on the research question at hand, modality-specific response pattern scores may represent a valid alternative method of characterizing sensory reactivity in autism.

Neural dynamics driving audio-visual integration in autism

Audio-visual (AV) integration plays a crucial role in supporting social functions and communication in autism spectrum disorder (ASD). However, behavioral findings remain mixed and, importantly, little is known about the underlying neurophysiological bases. Studies in neurotypical adults indicate that oscillatory brain activity in different frequencies subserves AV integration, pointing to a central role of (i) individual alpha frequency (IAF), which would determine the width of the cross-modal binding window; (ii) pre-/peri-stimulus theta oscillations, which would reflect the expectation of AV co-occurrence; (iii) post-stimulus oscillatory phase reset, which would temporally align the different unisensory signals. Here, we investigate the neural correlates of AV integration in children with ASD and typically developing (TD) peers, measuring electroencephalography during resting state and in an AV integration paradigm. As for neurotypical adults, AV integration dynamics in TD children could be predicted by the IAF measured at rest and by a modulation of anticipatory theta oscillations at single-trial level. Conversely, in ASD participants, AV integration/segregation was driven exclusively by the neural processing of the auditory stimulus and the consequent auditory-induced phase reset in visual regions, suggesting that a disproportionate elaboration of the auditory input could be the main factor characterizing atypical AV integration in autism.

Impairments in recognition of emotional facial expressions, affective prosody, and multisensory facilitation of response time in high-functioning autism

Introduction

Deficits in emotional perception are common in autistic people, but it remains unclear to which extent these perceptual impairments are linked to specific sensory modalities, specific emotions or multisensory facilitation.

Methods

This study aimed to investigate uni- and bimodal perception of emotional cues as well as multisensory facilitation in autistic (n = 18, mean age: 36.72 years, SD: 11.36) compared to non-autistic (n = 18, mean age: 36.41 years, SD: 12.18) people using auditory, visual and audiovisual stimuli.

Results

Lower identification accuracy and longer response time were revealed in high-functioning autistic people. These differences were independent of modality and emotion and showed large effect sizes (Cohen's d 0.8-1.2). Furthermore, multisensory facilitation of response time was observed in non-autistic people that was absent in autistic people, whereas no differences were found in multisensory facilitation of accuracy between the two groups.

Discussion

These findings suggest that processing of auditory and visual components of audiovisual stimuli is carried out more separately in autistic individuals (with equivalent temporal demands required for processing of the respective unimodal cues), but still with similar relative improvement in accuracy, whereas earlier integrative multimodal merging of stimulus properties seems to occur in non-autistic individuals.

The Impact of Singing on Visual and Multisensory Speech Perception in Children on the Autism Spectrum

Autistic children show reduced multisensory integration of audiovisual speech stimuli in response to the McGurk illusion. Previously, it has been shown that adults can integrate sung McGurk tokens. These sung speech tokens offer more salient visual and auditory cues, in comparison to the spoken tokens, which may increase the identification and integration of visual speech cues in autistic children. Forty participants (20 autism, 20 non-autistic peers) aged 7-14 completed the study. Participants were presented with speech tokens in four modalities: auditory-only, visual-only, congruent audiovisual, and incongruent audiovisual (i.e., McGurk; auditory 'ba' and visual 'ga'). Tokens were also presented in two formats: spoken and sung. Participants indicated what they perceived via a four-button response box (i.e., 'ba', 'ga', 'da', or 'tha'). Accuracies and perception of the McGurk illusion were calculated for each modality and format. Analysis of visual-only identification indicated a significant main effect of format, whereby participants were more accurate in sung versus spoken trials, but no significant main effect of group or interaction effect. Analysis of the McGurk trials indicated no significant main effect of format or group and no significant interaction effect. Sung speech tokens improved identification of visual speech cues, but did not boost the integration of visual cues with heard speech across groups. Additional work is needed to determine what properties of spoken speech contributed to the observed improvement in visual accuracy and to evaluate whether more prolonged exposure to sung speech may yield effects on multisensory integration.

Multisensory integration in humans with spinal cord injury

Although multisensory integration (MSI) has been extensively studied, the underlying mechanisms remain a topic of ongoing debate. Here we investigate these mechanisms by comparing MSI in healthy controls to a clinical population with spinal cord injury (SCI). Deafferentation following SCI induces sensorimotor impairment, which may alter the ability to synthesize cross-modal information. We applied mathematical and computational modeling to reaction time data recorded in response to temporally congruent cross-modal stimuli. We found that MSI in both SCI and healthy controls is best explained by cross-modal perceptual competition, highlighting a common competition mechanism. Relative to controls, MSI impairments in SCI participants were better explained by reduced stimulus salience leading to increased cross-modal competition. By combining traditional analyses with model-based approaches, we examine how MSI is realized during normal function, and how it is compromised in a clinical population. Our findings support future investigations identifying and rehabilitating MSI deficits in clinical disorders.

Attention to audiovisual speech does not facilitate language acquisition in infants with familial history of autism

BACKGROUND

Due to familial liability, siblings of children with ASD exhibit elevated risk for language delays. The processes contributing to language delays in this population remain unclear.

METHODS

Considering well-established links between attention to dynamic audiovisual cues inherent in a speaker's face and speech processing, we investigated if attention to a speaker's face and mouth differs in 12-month-old infants at high familial risk for ASD but without ASD diagnosis (hr-sib; n = 91) and in infants at low familial risk (lr-sib; n = 62) for ASD and whether attention at 12 months predicts language outcomes at 18 months.

RESULTS

At 12 months, hr-sib and lr-sib infants did not differ in attention to face (p = .14), mouth preference (p = .30), or in receptive and expressive language scores (p = .36, p = .33). At 18 months, the hr-sib infants had lower receptive (p = .01) but not expressive (p = .84) language scores than the lr-sib infants. In the lr-sib infants, greater attention to the face (p = .022) and a mouth preference (p = .025) contributed to better language outcomes at 18 months. In the hr-sib infants, neither attention to the face nor a mouth preference was associated with language outcomes at 18 months.

CONCLUSIONS

Unlike low-risk infants, high-risk infants do not appear to benefit from audiovisual prosodic and speech cues in the service of language acquisition despite intact attention to these cues. We propose that impaired processing of audiovisual cues may constitute the link between genetic risk factors and poor language outcomes observed across the autism risk spectrum and may represent a promising endophenotype in autism.

Juvenile Shank3 KO Mice Adopt Distinct Hunting Strategies during Prey Capture Learning

Mice are opportunistic omnivores that readily learn to hunt and eat insects such as crickets. The details of how mice learn these behaviors and how these behaviors may differ in strains with altered neuroplasticity are unclear. We quantified the behavior of juvenile wild-type (WT) and Shank3 knock-out (KO) mice as they learned to hunt crickets during the critical period for ocular dominance plasticity. This stage involves heightened cortical plasticity including homeostatic synaptic scaling, which requires Shank3, a glutamatergic synaptic protein that, when mutated, produces Phelan-McDermid syndrome and is often comorbid with autism spectrum disorder (ASD). Both strains showed interest in examining live and dead crickets and learned to hunt. Shank3 knock-out mice took longer to become proficient, and, after 5 d, did not achieve the efficiency of wild-type mice in either time-to-capture or distance-to-capture. Shank3 knock-out mice also exhibited different characteristics when pursuing crickets that could not be explained by a simple motor deficit. Although both genotypes moved at the same average speed when approaching a cricket, Shank3 KO mice paused more often, did not begin final accelerations toward crickets as early, and did not close the distance gap to the cricket as quickly as wild-type mice. These differences in Shank3 KO mice are reminiscent of some behavioral characteristics of individuals with ASD as they perform complex tasks, such as slower action initiation and completion. This paradigm will be useful for exploring the neural circuit mechanisms that underlie these learning and performance differences in monogenic ASD rodent models.

Changing the Tendency to Integrate the Senses

Integration of sensory signals that emanate from the same source, such as the visual of lip articulations and the sound of the voice of a speaking individual, can improve perception of the source signal (e.g., speech). Because momentary sensory inputs are typically corrupted with internal and external noise, there is almost always a discrepancy between the inputs, facing the perceptual system with the problem of determining whether the two signals were caused by the same source or different sources. Thus, whether or not multisensory stimuli are integrated and the degree to which they are bound is influenced by factors such as the prior expectation of a common source. We refer to this factor as the tendency to bind stimuli, or for short, binding tendency. In theory, the tendency to bind sensory stimuli can be learned by experience through the acquisition of the probabilities of the co-occurrence of the stimuli. It can also be influenced by cognitive knowledge of the environment. The binding tendency varies across individuals and can also vary within an individual over time. Here, we review the studies that have investigated the plasticity of binding tendency. We discuss the protocols that have been reported to produce changes in binding tendency, the candidate learning mechanisms involved in this process, the possible neural correlates of binding tendency, and outstanding questions pertaining to binding tendency and its plasticity. We conclude by proposing directions for future research and argue that understanding mechanisms and recipes for increasing binding tendency can have important clinical and translational applications for populations or individuals with a deficiency in multisensory integration.

Audiovisual temporal processing in adult patients with first-episode schizophrenia and high-functioning autism

Schizophrenia and autism spectrum disorder (ASD) are both neurodevelopmental disorders with altered sensory processing. Widened temporal binding window (TBW) signifies reduced sensitivity to detect stimulus asynchrony, and may be a shared feature in schizophrenia and ASD. Few studies directly compared audiovisual temporal processing ability in the two disorders. We recruited 43 adult patients with first-episode schizophrenia (FES), 35 average intelligent and verbally-fluent adult patients with high-functioning ASD and 48 controls. We employed two unisensory Temporal Order Judgement (TOJ) tasks within visual or auditory modalities, and two audiovisual Simultaneity Judgement (SJ) tasks with flash-beeps and videos of syllable utterance as stimuli. Participants with FES exhibited widened TBW affecting both speech and non-speech processing, which were not attributable to altered unisensory sensory acuity because they had normal visual and auditory TOJ thresholds. However, adults with ASD exhibited intact unisensory and audiovisual temporal processing. Lower non-verbal IQ was correlated with larger TBW width across the three groups. Taking our findings with earlier evidence in chronic samples, widened TBW is associated with schizophrenia regardless illness stage. The altered audiovisual temporal processing in ASD may ameliorate after reaching adulthood.

No differences between adults with and without autism in audiovisual synchrony perception

LAY ABSTRACT

It has been known for a long time that individuals diagnosed with autism spectrum disorder perceive the world differently. In this study, we investigated how people with or without autism perceive visual and auditory information. We know that an auditory and a visual stimulus do not have to be perfectly synchronous for us to perceive them as synchronous: first, when the two are within a certain time window (temporal binding window), the brain will tell us that they are synchronous. Second, the brain can also adapt quickly to audiovisual asynchronies (rapid recalibration). Although previous studies have shown that people with autism spectrum disorder have different temporal binding windows, and less rapid recalibration, we did not find these differences in our study. However, we did find that both processes develop over age, and since previous studies tested only young people (children, adolescents, and young adults), and we tested adults from 18 to 55 years, this might explain the different findings. In the end, there might be quite a complex story, where people with and without autism spectrum disorder perceive the world differently, even dependent on how old they are.

Multisensory integration and interactions across vision, hearing, and somatosensation in autism spectrum development and typical development

Most prior studies of multisensory integration (MSI) in autism have measured MSI in only a single combination of modalities - typically audiovisual integration. The present study used onset reaction times (RTs) and 125-channel electroencephalography (EEG) to examine different forms of bimodal and trimodal MSI based on combinations of auditory (noise burst), somatosensory (finger tap), and visual (flash) stimuli presented in a spatially-aligned manner using a custom desktop apparatus. A total of 36 autistic and 19 non-autistic adolescents between the ages of 11-14 participated. Significant RT multisensory facilitation relative to summed unisensory RT was observed in both groups, as were significant differences between summed unisensory and multisensory ERPs. Although the present study's statistical approach was not intended to test effect latencies, these interactions may have begun as early as ∼45 ms, constituting "early" (<100 ms) MSI. RT and ERP measurements of MSI appeared independent of one another. Groups did not significantly differ in multisensory RT facilitation, but we found exploratory evidence of group differences in the magnitude of audiovisual interactions in ERPs. Future research should make greater efforts to explore MSI in under-represented populations, especially autistic people with intellectual disabilities and nonspeaking/minimally-verbal autistic people.

Abnormal sensory perception masks behavioral performance of Grin1 knockdown mice

The development and function of sensory systems require intact glutamatergic neurotransmission. Changes in touch sensation and vision are common symptoms in autism spectrum disorders, where altered glutamatergic neurotransmission is strongly implicated. Further, cortical visual impairment is a frequent symptom of GRIN disorder, a rare genetic neurodevelopmental disorder caused by pathogenic variants of GRIN genes that encode NMDA receptors. We asked if Grin1 knockdown mice (Grin1KD), as a model of GRIN disorder, had visual impairments resulting from NMDA receptor deficiency. We discovered that Grin1KD mice had deficient visual depth perception in the visual cliff test. Since Grin1KD mice are known to display robust changes in measures of learning, memory, and emotionality, we asked whether deficits in these higher-level processes could be partly explained by their visual impairment. By changing the experimental conditions to improve visual signals, we observed significant improvements in the performance of Grin1KD mice in tests that measure spatial memory, executive function, and anxiety. We went further and found destabilization of the outer segment of retina together with the deficient number and size of Meissner corpuscles (mechanical sensor) in the hind paw of Grin1KD mice. Overall, our findings suggest that abnormal sensory perception can mask the expression of emotional, motivational and cognitive behavior of Grin1KD mice. This study demonstrates new methods to adapt routine behavioral paradigms to reveal the contribution of vision and other sensory modalities in cognitive performance.

Relationships between autistic traits, taste preference, taste perception, and eating behaviour

Individuals with autism spectrum disorder exhibit atypical taste perception and eating behaviours. However, little is known about the effect of autistic traits on eating behaviours in the general population. This study explored the relationships between autistic traits, taste preferences, taste perceptions, and eating behaviours among Japanese population using an online questionnaire survey. The results showed significant effect of autistic traits on eating behaviours, that people with higher autistic traits tended to have higher selective eating behaviours, such as increased sensitivity to food texture and mixed flavours. Moreover, selective eating behaviours were correlated with the preference for sour taste and aftertaste sensitivity. Those results suggest that eating behaviours can be influenced by the relationship between autistic traits, taste perceptions, and taste preferences. We discuss these results in the context of previous findings, and future investigations into the possibility of solving selective eating problems in individuals with autism.

Autistic traits were significantly correlated with eating behaviours.

People with higher autistic traits tended to have higher selective eating behaviours, such as increased sensitivity to food texture and mixed flavours.

People who like sour tastes tended to have less selective eating behaviours.

People who are sensitive to aftertaste perception tended to have greater selective eating behaviours.

Autistic traits, taste perceptions, and taste preferences play a role in the development of a number of selective eating behaviours.

The Components of Interpersonal Synchrony in the Typical Population and in Autism: A Conceptual Analysis

Interpersonal synchrony – the tendency for social partners to temporally co-ordinate their behaviour when interacting – is a ubiquitous feature of social interactions. Synchronous interactions play a key role in development, and promote social bonding and a range of pro-social behavioural outcomes across the lifespan. The process of achieving and maintaining interpersonal synchrony is highly complex, with inputs required from across perceptual, temporal, motor, and socio-cognitive domains. In this conceptual analysis, we synthesise evidence from across these domains to establish the key components underpinning successful non-verbal interpersonal synchrony, how such processes interact, and factors that may moderate their operation. We also consider emerging evidence that interpersonal synchrony is reduced in autistic populations. We use our account of the components contributing to interpersonal synchrony in the typical population to identify potential points of divergence in interpersonal synchrony in autism. The relationship between interpersonal synchrony and broader aspects of social communication in autism are also considered, together with implications for future research.

Children with autism spectrum disorder show atypical electroencephalographic response to processing contextual incongruencies

Children with autism spectrum disorder (ASD) experience difficulties with social communication, making it challenging to interpret contextual information that aids in accurately interpreting language. To investigate how the brain processes the contextual information and how this is different in ASD, we compared event-related potentials (ERPs) in response to processing visual and auditory congruent and incongruent information. Two groups of children participated in the study: 37 typically developing children and 15 children with ASD (age range = 6 to 12). We applied a language task involving auditory sentences describing congruent or incongruent images. We investigated two ERP components associated with language processing: the N400 and P600. Our results showed how children with ASD present significant differences in their neural responses in comparison with the TD group, even when their reaction times and correct trials are not significantly different from the TD group.

Aberrant causal inference and presence of a compensatory mechanism in autism spectrum disorder

Autism spectrum disorder (ASD) is characterized by a panoply of social, communicative, and sensory anomalies. As such, a central goal of computational psychiatry is to ascribe the heterogenous phenotypes observed in ASD to a limited set of canonical computations that may have gone awry in the disorder. Here, we posit causal inference - the process of inferring a causal structure linking sensory signals to hidden world causes - as one such computation. We show that audio-visual integration is intact in ASD and in line with optimal models of cue combination, yet multisensory behavior is anomalous in ASD because this group operates under an internal model favoring integration (vs. segregation). Paradoxically, during explicit reports of common cause across spatial or temporal disparities, individuals with ASD were less and not more likely to report common cause, particularly at small cue disparities. Formal model fitting revealed differences in both the prior probability for common cause (p-common) and choice biases, which are dissociable in implicit but not explicit causal inference tasks. Together, this pattern of results suggests (i) different internal models in attributing world causes to sensory signals in ASD relative to neurotypical individuals given identical sensory cues, and (ii) the presence of an explicit compensatory mechanism in ASD, with these individuals putatively having learned to compensate for their bias to integrate in explicit reports.

Multichannel Perception of Emotion in Speech, Voice, Facial Expression, and Gesture in Individuals With Autism: A Scoping Review

PURPOSE

Numerous studies have identified individuals with autism spectrum disorder (ASD) with deficits in unichannel emotion perception and multisensory integration. However, only limited research is available on multichannel emotion perception in ASD. The purpose of this review was to seek conceptual clarification, identify knowledge gaps, and suggest directions for future research.

METHOD

We conducted a scoping review of the literature published between 1989 and 2021, following the 2005 framework of Arksey and O'Malley. Data relating to study characteristics, task characteristics, participant information, and key findings on multichannel processing of emotion in ASD were extracted for the review.

RESULTS

Discrepancies were identified regarding multichannel emotion perception deficits, which are related to participant age, developmental level, and task demand. Findings are largely consistent regarding the facilitation and compensation of congruent multichannel emotional cues and the interference and disruption of incongruent signals. Unlike controls, ASD individuals demonstrate an overreliance on semantics rather than prosody to decode multichannel emotion.

CONCLUSIONS

The existing literature on multichannel emotion perception in ASD is limited, dispersed, and disassociated, focusing on a variety of topics with a wide range of methodologies. Further research is necessary to quantitatively examine the impact of methodological choice on performance outcomes. An integrated framework of emotion, language, and cognition is needed to examine the mutual influences between emotion and language as well as the cross-linguistic and cross-cultural differences.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.19386176.