Altered auditory and multisensory temporal processing in autism spectrum disorders

Toward a Best-Practice Protocol for Assessment of Sensory Features in ASD

Sensory difficulties are a commonly occurring feature of autism spectrum disorders and are now included as one manifestation of the 'restricted, repetitive patterns of behavior, interests, or activities' diagnostic criteria of the DSM5 necessitating guidelines for comprehensive assessment of these features. To facilitate the development of such guidelines, this paper provides an overview of the literature on sensory features in autism spectrum disorder. We summarize the literature pertaining to: terminology, current assessment practices, sensory development, and the relationship of sensory features to core symptoms of autism. The paper concludes with recommendations for clinical assessment of sensory features in Autism.

Behavioral, perceptual, and neural alterations in sensory and multisensory function in autism spectrum disorder

Although sensory processing challenges have been noted since the first clinical descriptions of autism, it has taken until the release of the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) in 2013 for sensory problems to be included as part of the core symptoms of autism spectrum disorder (ASD) in the diagnostic profile. Because sensory information forms the building blocks for higher-order social and cognitive functions, we argue that sensory processing is not only an additional piece of the puzzle, but rather a critical cornerstone for characterizing and understanding ASD. In this review we discuss what is currently known about sensory processing in ASD, how sensory function fits within contemporary models of ASD, and what is understood about the differences in the underlying neural processing of sensory and social communication observed between individuals with and without ASD. In addition to highlighting the sensory features associated with ASD, we also emphasize the importance of multisensory processing in building perceptual and cognitive representations, and how deficits in multisensory integration may also be a core characteristic of ASD.

Keeping time in the brain: Autism spectrum disorder and audiovisual temporal processing

A growing area of interest and relevance in the study of autism spectrum disorder (ASD) focuses on the relationship between multisensory temporal function and the behavioral, perceptual, and cognitive impairments observed in ASD. Atypical sensory processing is becoming increasingly recognized as a core component of autism, with evidence of atypical processing across a number of sensory modalities. These deviations from typical processing underscore the value of interpreting ASD within a multisensory framework. Furthermore, converging evidence illustrates that these differences in audiovisual processing may be specifically related to temporal processing. This review seeks to bridge the connection between temporal processing and audiovisual perception, and to elaborate on emerging data showing differences in audiovisual temporal function in autism. We also discuss the consequence of such changes, the specific impact on the processing of different classes of audiovisual stimuli (e.g. speech vs. nonspeech, etc.), and the presumptive brain processes and networks underlying audiovisual temporal integration. Finally, possible downstream behavioral implications, and possible remediation strategies are outlined. Autism Res 2016, 9: 720-738. © 2015 International Society for Autism Research, Wiley Periodicals, Inc.

Anatomic and Functional Connectivity Relationship in Autistic Children During Three Different Experimental Conditions

A group of 21 autistic children were studied for determining the relationship between the anatomic (AC) versus functional (FC) connectivity, considering short-range and long-range brain networks. AC was assessed by the DW-MRI technique and FC by EEG coherence calculation, in three experimental conditions: basal, watching a popular cartoon with audio (V-A), and with muted audio track (VwA). For short-range connections, basal records, statistical significant correlations were found for all EEG bands in the left hemisphere, but no significant correlations were found for fast EEG frequencies in the right hemisphere. For the V-A condition, significant correlations were mainly diminished for the left hemisphere; for the right hemisphere, no significant correlations were found for the fast EEG frequency bands. For the VwA condition, significant correlations for the rapid EEG frequencies mainly disappeared for the right hemisphere. For long-range connections, basal records showed similar correlations for both hemispheres. For the right hemisphere, significant correlations incremented to all EEG bands for the V-A condition, but these significant correlations disappeared for the fast EEG frequencies in the VwA condition. It appears that in a resting-state condition, AC is better associated with functional connectivity for short-range connections in the left hemisphere. The V-A experimental condition enriches the AC and FC association for long-range connections in the right hemisphere. This might be related to an effective connectivity improvement due to full video stimulation (visual and auditory). An impaired audiovisual interaction in the right hemisphere might explain why significant correlations disappeared for the fast EEG frequencies in the VwA experimental condition.

Visuo-tactile integration in autism: atypical temporal binding may underlie greater reliance on proprioceptive information

BACKGROUND

Evidence indicates that social functioning deficits and sensory sensitivities in autism spectrum disorder (ASD) are related to atypical sensory integration. The exact mechanisms underlying these integration difficulties are unknown; however, two leading accounts are (1) an over-reliance on proprioception and (2) atypical visuo-tactile temporal binding. We directly tested these theories by selectively manipulating proprioceptive alignment and visuo-tactile synchrony to assess the extent that these impact upon body ownership.

METHODS

Children with ASD and typically developing controls placed their hand into a multisensory illusion apparatus, which presented two, identical live video images of their own hand in the same plane as their actual hand. One virtual hand was aligned proprioceptively with the actual hand (the veridical hand), and the other was displaced to the left or right. While a brushstroke was applied to the participants' actual (hidden) hand, they observed the two virtual images of their hand also being stroked and were asked to identify their real hand. During brushing, one of three different temporal delays was applied to either the displaced hand or the veridical hand. Thus, only one virtual hand had synchronous visuo-tactile inputs.

RESULTS

Results showed that visuo-tactile synchrony overrides incongruent proprioceptive inputs in typically developing children but not in autistic children. Evidence for both temporally extended visuo-tactile binding and a greater reliance on proprioception are discussed.

CONCLUSIONS

This is the first study to provide definitive evidence for temporally extended visuo-tactile binding in ASD. This may result in reduced processing of amodal inputs (i.e. temporal synchrony) over modal-specific information (i.e. proprioception). This would likely lead to failures in appropriately binding information from related events, which would impact upon sensitivity to sensory stimuli, body representation and social processes such as empathy and imitation.

The relationship between auditory processing and restricted, repetitive behaviors in adults with autism spectrum disorders

Current views suggest that autism spectrum disorders (ASDs) are characterised by enhanced low-level auditory discrimination abilities. Little is known, however, about whether enhanced abilities are universal in ASD and how they relate to symptomatology. We tested auditory discrimination for intensity, frequency and duration in 21 adults with ASD and 21 IQ and age-matched controls. Contrary to predictions, there were significant deficits in ASD on all acoustic parameters. The findings suggest that low-level auditory discrimination ability varies widely within ASD and this variability relates to IQ level, and influences the severity of restricted and repetitive behaviours (RRBs). We suggest that it is essential to further our understanding of the potential contributing role of sensory perception ability on the emergence of RRBs.

QEEG spectral and coherence assessment of autistic children in three different experimental conditions

We studied autistics by quantitative EEG spectral and coherence analysis during three experimental conditions: basal, watching a cartoon with audio (V–A), and with muted audio band (VwA). Significant reductions were found for the absolute power spectral density (PSD) in the central region for delta and theta, and in the posterior region for sigma and beta bands, lateralized to the right hemisphere. When comparing VwA versus the V–A in the midline regions, we found significant decrements of absolute PSD for delta, theta and alpha, and increments for the beta and gamma bands. In autistics, VwA versus V–A tended to show lower coherence values in the right hemisphere. An impairment of visual and auditory sensory integration in autistics might explain our results.

Evidence for diminished multisensory integration in autism spectrum disorders

Individuals with autism spectrum disorders (ASD) exhibit alterations in sensory processing, including changes in the integration of information across the different sensory modalities. In the current study, we used the sound-induced flash illusion to assess multisensory integration in children with ASD and typically-developing (TD) controls. Thirty-one children with ASD and 31 age and IQ matched TD children (average age = 12 years) were presented with simple visual (i.e., flash) and auditory (i.e., beep) stimuli of varying number. In illusory conditions, a single flash was presented with 2-4 beeps. In TD children, these conditions generally result in the perception of multiple flashes, implying a perceptual fusion across vision and audition. In the present study, children with ASD were significantly less likely to perceive the illusion relative to TD controls, suggesting that multisensory integration and cross-modal binding may be weaker in some children with ASD. These results are discussed in the context of previous findings for multisensory integration in ASD and future directions for research.

Environmental enrichment as a therapy for autism: A clinical trial replication and extension

Based on work done in animal models showing that autism-like symptoms are ameliorated following exposure to an enriched sensorimotor environment, we attempted to develop a comparable therapy for children with autism. In an initial randomized controlled trial, children with autism who received sensorimotor enrichment at home for 6 months had significant improvements in both their cognitive ability and the severity of their autism symptoms (Woo & Leon, 2013). We now report the outcomes of a similar randomized controlled trial in which children with autism, 3 to 6 years old, were randomly assigned to groups that received either daily sensorimotor enrichment, administered by their parents, along with standard care, or they received standard care alone. After 6 months, enriched children showed statistically significant gains in their IQ scores, a decline in their atypical sensory responses, and an improvement in their receptive language performance, compared to controls. Furthermore, after 6 months of enrichment therapy, 21% of the children who initially had been given an autism classification, using the Autism Diagnostic Observation Schedule, improved to the point that, although they remained on the autism spectrum, they no longer met the criteria for classic autism. None of the standard care controls reached an equivalent level of improvement. Finally, the outcome measures for children who received only a subset of sensory stimuli were similar to those receiving the full complement of enrichment exercises. Sensorimotor enrichment therapy therefore appears to be a cost-effective means of treating a range of symptoms for children with autism.

Percept of the duration of a vibrotactile stimulus is altered by changing its amplitude

There have been numerous studies conducted on time perception. However, very few of these have involved tactile stimuli to assess a subject’s capacity for duration discrimination. Previous optical imaging studies in non-human primates demonstrated that increasing the duration of a vibrotactile stimulus resulted in a consistently longer and more well defined evoked SI cortical response. Additionally, and perhaps more interestingly, increasing the amplitude of a vibrotactile stimulus not only evoked a larger magnitude optical intrinsic signal (OIS), but the return to baseline of the evoked response was much longer in duration for larger amplitude stimuli. This led the authors to hypothesize that the magnitude of a vibrotactile stimulus could influence the perception of its duration. In order to test this hypothesis, subjects were asked to compare two sets of vibrotactile stimuli. When vibrotactile stimuli differed only in duration, subjects typically had a difference limen (DL) of approximately 13%, and this followed Weber’s Law for standards between 500 and 1500 ms, as increasing the value of the standard yielded a proportional increase in DL. However, the percept of duration was impacted by variations in amplitude of the vibrotactile stimuli. Specifically, increasing the amplitude of the standard stimulus had the effect of increasing the DL, while increasing the amplitude of the test stimulus had the effect of decreasing the DL. A pilot study, conducted on individuals who were concussed, found that increasing the amplitude of the standard did not have an impact on the DL of this group of individuals. Since this effect did not parallel what was predicted from the optical imaging findings in somatosensory cortex of non-human primates, the authors suggest that this particular measure or observation could be sensitive to neuroinflammation and that neuron-glial interactions, impacted by concussion, could have the effect of ignoring, or not integrating, the increased amplitude.

Self-motion perception in autism is compromised by visual noise but integrated optimally across multiple senses

Perceptual processing in autism spectrum disorder (ASD) is marked by superior low-level task performance and inferior complex-task performance. This observation has led to theories of defective integration in ASD of local parts into a global percept. Despite mixed experimental results, this notion maintains widespread influence and has also motivated recent theories of defective multisensory integration in ASD. Impaired ASD performance in tasks involving classic random dot visual motion stimuli, corrupted by noise as a means to manipulate task difficulty, is frequently interpreted to support this notion of global integration deficits. By manipulating task difficulty independently of visual stimulus noise, here we test the hypothesis that heightened sensitivity to noise, rather than integration deficits, may characterize ASD. We found that although perception of visual motion through a cloud of dots was unimpaired without noise, the addition of stimulus noise significantly affected adolescents with ASD, more than controls. Strikingly, individuals with ASD demonstrated intact multisensory (visual-vestibular) integration, even in the presence of noise. Additionally, when vestibular motion was paired with pure visual noise, individuals with ASD demonstrated a different strategy than controls, marked by reduced flexibility. This result could be simulated by using attenuated (less reliable) and inflexible (not experience-dependent) Bayesian priors in ASD. These findings question widespread theories of impaired global and multisensory integration in ASD. Rather, they implicate increased sensitivity to sensory noise and less use of prior knowledge in ASD, suggesting increased reliance on incoming sensory information.

Testing sensory and multisensory function in children with autism spectrum disorder

In addition to impairments in social communication and the presence of restricted interests and repetitive behaviors, deficits in sensory processing are now recognized as a core symptom in autism spectrum disorder (ASD). Our ability to perceive and interact with the external world is rooted in sensory processing. For example, listening to a conversation entails processing the auditory cues coming from the speaker (speech content, prosody, syntax) as well as the associated visual information (facial expressions, gestures). Collectively, the "integration" of these multisensory (i.e., combined audiovisual) pieces of information results in better comprehension. Such multisensory integration has been shown to be strongly dependent upon the temporal relationship of the paired stimuli. Thus, stimuli that occur in close temporal proximity are highly likely to result in behavioral and perceptual benefits--gains believed to be reflective of the perceptual system's judgment of the likelihood that these two stimuli came from the same source. Changes in this temporal integration are expected to strongly alter perceptual processes, and are likely to diminish the ability to accurately perceive and interact with our world. Here, a battery of tasks designed to characterize various aspects of sensory and multisensory temporal processing in children with ASD is described. In addition to its utility in autism, this battery has great potential for characterizing changes in sensory function in other clinical populations, as well as being used to examine changes in these processes across the lifespan.

"Look who's talking!" Gaze Patterns for Implicit and Explicit Audio-Visual Speech Synchrony Detection in Children With High-Functioning Autism

Conversation requires integration of information from faces and voices to fully understand the speaker's message. To detect auditory-visual asynchrony of speech, listeners must integrate visual movements of the face, particularly the mouth, with auditory speech information. Individuals with autism spectrum disorder may be less successful at such multisensory integration, despite their demonstrated preference for looking at the mouth region of a speaker. We showed participants (individuals with and without high-functioning autism (HFA) aged 8-19) a split-screen video of two identical individuals speaking side by side. Only one of the speakers was in synchrony with the corresponding audio track and synchrony switched between the two speakers every few seconds. Participants were asked to watch the video without further instructions (implicit condition) or to specifically watch the in-synch speaker (explicit condition). We recorded which part of the screen and face their eyes targeted. Both groups looked at the in-synch video significantly more with explicit instructions. However, participants with HFA looked at the in-synch video less than typically developing (TD) peers and did not increase their gaze time as much as TD participants in the explicit task. Importantly, the HFA group looked significantly less at the mouth than their TD peers, and significantly more at non-face regions of the image. There were no between-group differences for eye-directed gaze. Overall, individuals with HFA spend less time looking at the crucially important mouth region of the face during auditory-visual speech integration, which is maladaptive gaze behavior for this type of task.

A novel behavioral paradigm to assess multisensory processing in mice

Human psychophysical and animal behavioral studies have illustrated the benefits that can be conferred from having information available from multiple senses. Given the central role of multisensory integration for perceptual and cognitive function, it is important to design behavioral paradigms for animal models to provide mechanistic insights into the neural bases of these multisensory processes. Prior studies have focused on large mammals, yet the mouse offers a host of advantages, most importantly the wealth of available genetic manipulations relevant to human disease. To begin to employ this model species for multisensory research it is necessary to first establish and validate a robust behavioral assay for the mouse. Two common mouse strains (C57BL/6J and 129S6/SvEv) were first trained to respond to unisensory (visual and auditory) stimuli separately. Once trained, performance with paired audiovisual stimuli was then examined with a focus on response accuracy and behavioral gain. Stimulus durations varied from 50 ms to 1 s in order to modulate the effectiveness of the stimuli and to determine if the well-established "principle of inverse effectiveness" held in this model. Response accuracy in the multisensory condition was greater than for either unisensory condition for all stimulus durations, with significant gains observed at the 300 ms and 100 ms durations. Main effects of stimulus duration, stimulus modality and a significant interaction between these factors were observed. The greatest behavioral gain was seen for the 100 ms duration condition, with a trend observed that as the stimuli became less effective, larger behavioral gains were observed upon their pairing (i.e., inverse effectiveness). These results are the first to validate the mouse as a species that shows demonstrable behavioral facilitations under multisensory conditions and provides a platform for future mechanistically directed studies to examine the neural bases of multisensory integration.

Neurophysiological indices of atypical auditory processing and multisensory integration are associated with symptom severity in autism

Atypical processing and integration of sensory inputs are hypothesized to play a role in unusual sensory reactions and social-cognitive deficits in autism spectrum disorder (ASD). Reports on the relationship between objective metrics of sensory processing and clinical symptoms, however, are surprisingly sparse. Here we examined the relationship between neurophysiological assays of sensory processing and (1) autism severity and (2) sensory sensitivities, in individuals with ASD aged 6-17. Multiple linear regression indicated significant associations between neural markers of auditory processing and multisensory integration, and autism severity. No such relationships were apparent for clinical measures of visual/auditory sensitivities. These data support that aberrant early sensory processing contributes to autism symptoms, and reveal the potential of electrophysiology to objectively subtype autism.

Neurobiological foundations of multisensory integration in people with autism spectrum disorders: the role of the medial prefrontal cortex

This review aims to relate the sensory processing problems in people with autism spectrum disorders (ASD), especially multisensory integration (MSI), to the role of the medial prefrontal cortex (mPFC) by exploring neuroanatomical findings; brain connectivity and Default Network (DN); global or locally directed attention; and temporal multisensory binding. The mPFC is part of the brain's DN, which is deactivated when attention is focused on a particular task and activated on rest when spontaneous cognition emerges. In those with ASD, it is hypoactive and the higher the social impairment the greater the atypical activity. With an immature DN, cross-modal integration is impaired, resulting in a collection of disconnected fragments instead of a coherent global perception. The deficit in MSI may lie in the temporal synchronization of neural networks. The time interval in which the stimulation of one sensory channel could influence another would be higher, preventing integration in the typical shorter time range. Thus, the underconnectivity between distant brain areas would be involved in top-down information processes (relying on global integration of data from different sources) and would enhance low level perception processes such as over focused attention to sensory details.

Evidence for diminished multisensory integration in autism spectrum disorders

Individuals with autism spectrum disorders (ASD) exhibit alterations in sensory processing, including changes in the integration of information across the different sensory modalities. In the current study, we used the sound-induced flash illusion to assess multisensory integration in children with ASD and typically-developing (TD) controls. Thirty-one children with ASD and 31 age and IQ matched TD children (average age = 12 years) were presented with simple visual (i.e., flash) and auditory (i.e., beep) stimuli of varying number. In illusory conditions, a single flash was presented with 2-4 beeps. In TD children, these conditions generally result in the perception of multiple flashes, implying a perceptual fusion across vision and audition. In the present study, children with ASD were significantly less likely to perceive the illusion relative to TD controls, suggesting that multisensory integration and cross-modal binding may be weaker in some children with ASD. These results are discussed in the context of previous findings for multisensory integration in ASD and future directions for research.

The construct of the multisensory temporal binding window and its dysregulation in developmental disabilities

Behavior, perception and cognition are strongly shaped by the synthesis of information across the different sensory modalities. Such multisensory integration often results in performance and perceptual benefits that reflect the additional information conferred by having cues from multiple senses providing redundant or complementary information. The spatial and temporal relationships of these cues provide powerful statistical information about how these cues should be integrated or "bound" in order to create a unified perceptual representation. Much recent work has examined the temporal factors that are integral in multisensory processing, with many focused on the construct of the multisensory temporal binding window - the epoch of time within which stimuli from different modalities is likely to be integrated and perceptually bound. Emerging evidence suggests that this temporal window is altered in a series of neurodevelopmental disorders, including autism, dyslexia and schizophrenia. In addition to their role in sensory processing, these deficits in multisensory temporal function may play an important role in the perceptual and cognitive weaknesses that characterize these clinical disorders. Within this context, focus on improving the acuity of multisensory temporal function may have important implications for the amelioration of the "higher-order" deficits that serve as the defining features of these disorders.

Multisensory speech perception in children with autism spectrum disorders

This study examined unisensory and multisensory speech perception in 8-17 year old children with autism spectrum disorders (ASD) and typically developing controls matched on chronological age, sex, and IQ. Consonant-vowel syllables were presented in visual only, auditory only, matched audiovisual, and mismatched audiovisual ("McGurk") conditions. Participants with ASD displayed deficits in visual only and matched audiovisual speech perception. Additionally, children with ASD reported a visual influence on heard speech in response to mismatched audiovisual syllables over a wider window of time relative to controls. Correlational analyses revealed associations between multisensory speech perception, communicative characteristics, and responses to sensory stimuli in ASD. Results suggest atypical speech perception is linked to broader behavioral characteristics of ASD.

The neural bases of crossmodal object recognition in non-human primates and rodents: a review

The ability to integrate information from different sensory modalities to form unique multisensory object representations is a highly adaptive cognitive function. Surprisingly, non-human animal studies of the neural substrates of this form of multisensory integration have been somewhat sparse until very recently, and this may be due in part to a relative paucity of viable testing methods. Here we review the historical development and use of various "crossmodal" cognition tasks for non-human primates and rodents, focusing on tests of "crossmodal object recognition", the ability to recognize an object across sensory modalities. Such procedures have great potential to elucidate the cognitive and neural bases of object representation as it pertains to perception and memory. Indeed, these studies have revealed roles in crossmodal cognition for various brain regions (e.g., prefrontal and temporal cortices) and neurochemical systems (e.g., acetylcholine). A recent increase in behavioral and physiological studies of crossmodal cognition in rodents augurs well for the future of this research area, which should provide essential information about the basic mechanisms of object representation in the brain, in addition to fostering a better understanding of the causes of, and potential treatments for, cognitive deficits in human diseases characterized by atypical multisensory integration.

Spatio-temporal processing of tactile stimuli in autistic children

Altered multisensory integration has been reported in autism; however, little is known concerning how the autistic brain processes spatio-temporal information concerning tactile stimuli. We report a study in which a crossed-hands illusion was investigated in autistic children. Neurotypical individuals often experience a subjective reversal of temporal order judgments when their hands are stimulated while crossed, and the illusion is known to be acquired in early childhood. However, under those conditions where the somatotopic representation is given priority over the actual spatial location of the hands, such reversals may not occur. Here, we showed that a significantly smaller illusory reversal was demonstrated in autistic children than in neurotypical children. Furthermore, in an additional experiment, the young boys who had higher Autism Spectrum Quotient (AQ) scores generally showed a smaller crossed hands deficit. These results suggest that rudimentary spatio-temporal processing of tactile stimuli exists in autistic children, and the altered processing may interfere with the development of an external frame of reference in real-life situations.

Speech sound discrimination training improves auditory cortex responses in a rat model of autism

Children with autism often have language impairments and degraded cortical responses to speech. Extensive behavioral interventions can improve language outcomes and cortical responses. Prenatal exposure to the antiepileptic drug valproic acid (VPA) increases the risk for autism and language impairment. Prenatal exposure to VPA also causes weaker and delayed auditory cortex responses in rats. In this study, we document speech sound discrimination ability in VPA exposed rats and document the effect of extensive speech training on auditory cortex responses. VPA exposed rats were significantly impaired at consonant, but not vowel, discrimination. Extensive speech training resulted in both stronger and faster anterior auditory field (AAF) responses compared to untrained VPA exposed rats, and restored responses to control levels. This neural response improvement generalized to non-trained sounds. The rodent VPA model of autism may be used to improve the understanding of speech processing in autism and contribute to improving language outcomes.

Children with a history of SLI show reduced sensitivity to audiovisual temporal asynchrony: an ERP study

PURPOSE

The authors examined whether school-age children with a history of specific language impairment (H-SLI), their peers with typical development (TD), and adults differ in sensitivity to audiovisual temporal asynchrony and whether such difference stems from the sensory encoding of audiovisual information.

METHOD

Fifteen H-SLI children, 15 TD children, and 15 adults judged whether a flashed explosion-shaped figure and a 2-kHz pure tone occurred simultaneously. The stimuli were presented at 0-, 100-, 200-, 300-, 400-, and 500-ms temporal offsets. This task was combined with EEG recordings.

RESULTS

H-SLI children were profoundly less sensitive to temporal separations between auditory and visual modalities compared with their TD peers. Those H-SLI children who performed better at simultaneity judgment also had higher language aptitude. TD children were less accurate than adults, revealing a remarkably prolonged developmental course of the audiovisual temporal discrimination. Analysis of early event-related potential components suggested that poor sensory encoding was not a key factor in H-SLI children's reduced sensitivity to audiovisual asynchrony.

CONCLUSIONS

Audiovisual temporal discrimination is impaired in H-SLI children and is still immature during mid-childhood in TD children. The present findings highlight the need for further evaluation of the role of atypical audiovisual processing in the development of SLI.

Brief report: Arrested development of audiovisual speech perception in autism spectrum disorders

Atypical communicative abilities are a core marker of Autism Spectrum Disorders (ASD). A number of studies have shown that, in addition to auditory comprehension differences, individuals with autism frequently show atypical responses to audiovisual speech, suggesting a multisensory contribution to these communicative differences from their typically developing peers. To shed light on possible differences in the maturation of audiovisual speech integration, we tested younger (ages 6-12) and older (ages 13-18) children with and without ASD on a task indexing such multisensory integration. To do this, we used the McGurk effect, in which the pairing of incongruent auditory and visual speech tokens typically results in the perception of a fused percept distinct from the auditory and visual signals, indicative of active integration of the two channels conveying speech information. Whereas little difference was seen in audiovisual speech processing (i.e., reports of McGurk fusion) between the younger ASD and TD groups, there was a significant difference at the older ages. While TD controls exhibited an increased rate of fusion (i.e., integration) with age, children with ASD failed to show this increase. These data suggest arrested development of audiovisual speech integration in ASD. The results are discussed in light of the extant literature and necessary next steps in research.

Minor physical anomalies in adults with autism spectrum disorder and healthy controls

Minor Physical Anomalies (MPAs) are subtle abnormalities of the head, face, and limbs, without significant cosmetic or functional impact to the individual. They are assumed to represent external markers of developmental deviations during foetal life. MPAs have been suggested to indicate severity in mental illness and constitute external markers for atypical brain development. Higher frequencies of MPAs can be found in children with autism. The aims of the present study were to examine the prevalence and patterns of MPAs in adults with autism spectrum disorder (ASD) and to investigate whether MPAs are associated with symptom severity and overall functioning. Fifty adults with ASD and intelligence within the normal range and 53 healthy controls were examined with the Waldrop scale, an instrument for assessing MPAs. Face and feet were photographed enabling blinded assessment. Significant differences between the ASD and the control group were found on the MPA total scores, and also in the craniofacial region scores. Moreover, the shape of the ears was associated with autistic traits, in the ASD group. High MPA total scores were associated with poorer functioning. The findings suggest a link between MPAs, autistic traits, and level of functioning. Assessment of MPAs may assist in the diagnostic procedure of psychiatric disorders.

Sensory symptoms in autism spectrum disorders

The aim of this review is to summarize the recent literature regarding abnormalities in sensory functioning in individuals with autism spectrum disorder (ASD), including evidence regarding the neurobiological basis of these symptoms, their clinical correlates, and their treatment. Abnormalities in responses to sensory stimuli are highly prevalent in individuals with ASD. The underlying neurobiology of these symptoms is unclear, but several theories have been proposed linking possible etiologies of sensory dysfunction with known abnormalities in brain structure and function that are associated with ASD. In addition to the distress that sensory symptoms can cause patients and caregivers, these phenomena have been correlated with several other problematic symptoms and behaviors associated with ASD, including restrictive and repetitive behavior, self-injurious behavior, anxiety, inattention, and gastrointestinal complaints. It is unclear whether these correlations are causative in nature or whether they are due to shared underlying pathophysiology. The best-known treatments for sensory symptoms in ASD involve a program of occupational therapy that is specifically tailored to the needs of the individual and that may include sensory integration therapy, a sensory diet, and environmental modifications. While some empirical evidence supports these treatments, more research is needed to evaluate their efficacy, and other means of alleviating these symptoms, including possible psychopharmacological interventions, need to be explored. Additional research into the sensory symptoms associated with ASD has the potential to shed more light on the nature and pathophysiology of these disorders and to open new avenues of effective treatments.

The audiovisual temporal binding window narrows in early childhood

Binding is key in multisensory perception. This study investigated the audio-visual (A-V) temporal binding window in 4-, 5-, and 6-year-old children (total N = 120). Children watched a person uttering a syllable whose auditory and visual components were either temporally synchronized or desynchronized by 366, 500, or 666 ms. They were asked whether the voice and face went together (Experiment 1) or whether the desynchronized videos differed from the synchronized one (Experiment 2). Four-year-olds detected the 666-ms asynchrony, 5-year-olds detected the 666- and 500-ms asynchrony, and 6-year-olds detected all asynchronies. These results show that the A-V temporal binding window narrows slowly during early childhood and that it is still wider at 6 years of age than in older children and adults.

Multiple object tracking in autism spectrum disorders

Difficulties in visual attention are often implicated in autism spectrum disorders (ASD) but it remains unclear which aspects of attention are affected. Here, we used a multiple object tracking (MOT) task to quantitatively characterize dynamic attentional function in children with ASD aged 5-12. While the ASD group performed significantly worse overall, the group difference did not increase with increased object speed. This finding suggests that decreased MOT performance is not due to deficits in dynamic attention but instead to a diminished capacity to select and maintain attention on multiple targets. Further, MOT performance improved from 5 to 10 years in both typical and ASD groups with similar developmental trajectories. These results argue against a specific deficit in dynamic attention in ASD.

Multisensory temporal integration in autism spectrum disorders

The new DSM-5 diagnostic criteria for autism spectrum disorders (ASDs) include sensory disturbances in addition to the well-established language, communication, and social deficits. One sensory disturbance seen in ASD is an impaired ability to integrate multisensory information into a unified percept. This may arise from an underlying impairment in which individuals with ASD have difficulty perceiving the temporal relationship between cross-modal inputs, an important cue for multisensory integration. Such impairments in multisensory processing may cascade into higher-level deficits, impairing day-to-day functioning on tasks, such as speech perception. To investigate multisensory temporal processing deficits in ASD and their links to speech processing, the current study mapped performance on a number of multisensory temporal tasks (with both simple and complex stimuli) onto the ability of individuals with ASD to perceptually bind audiovisual speech signals. High-functioning children with ASD were compared with a group of typically developing children. Performance on the multisensory temporal tasks varied with stimulus complexity for both groups; less precise temporal processing was observed with increasing stimulus complexity. Notably, individuals with ASD showed a speech-specific deficit in multisensory temporal processing. Most importantly, the strength of perceptual binding of audiovisual speech observed in individuals with ASD was strongly related to their low-level multisensory temporal processing abilities. Collectively, the results represent the first to illustrate links between multisensory temporal function and speech processing in ASD, strongly suggesting that deficits in low-level sensory processing may cascade into higher-order domains, such as language and communication.

Novel Inversions in Auditory Sequences Provide Evidence for Spontaneous Subtraction of Time and Number

Animals, including fish, birds, rodents, non-human primates, and pre-verbal infants are able to discriminate the duration and number of events without the use of language. In this paper, we present the results of six experiments exploring the capability of adult rats to count 2–6 sequentially presented white-noise stimuli. The investigation focuses on the animal’s ability to exhibit spontaneous subtraction following the presentation of novel stimulus inversions in the auditory signals being counted. Results suggest that a subtraction operation between two opposite sensory representations may be a general processing strategy used for the comparison of stimulus magnitudes. These findings are discussed within the context of a mode-control model of timing and counting that relies on an analog temporal-integration process for the addition and subtraction of sequential events.

Multisensory integration compensates loss of sensitivity of visual temporal order in the elderly

Here, we examined sensitivity of visual, auditory, and audiovisual temporal order in five age-groups (20 to 70 years old). We also measured multisensory integration (MSI) using a phenomenon known as "temporal ventriloquism," in which click sounds improve sensitivity of visual temporal order. Results showed that sensitivity of visual, auditory, and audiovisual temporal order declined from 50 years on. However, there was no corresponding decline in MSI as the click sounds actually compensated the loss of sensitivity of visual temporal order in the elderly. Sensitivity of audiovisual temporal order did not correlate with MSI, suggesting that well-preserved explicit judgments about cross-modal temporal order are not required for MSI to occur.

Sensory and motor secondary symptoms as indicators of brain vulnerability

In addition to the primary symptoms that distinguish one disorder from the next, clinicians have identified, yet largely overlooked, another set of symptoms that appear across many disorders, termed secondary symptoms. In the emerging era of systems neuroscience, which highlights that many disorders share common deficits in global network features, the nonspecific nature of secondary symptoms should attract attention. Herein we provide a scholarly review of the literature on a subset of secondary symptoms––sensory and motor. We demonstrate that their pattern of appearance––across a wide range of psychopathologies, much before the full-blown disorder appears, and in healthy individuals who display a variety of negative symptoms––resembles the pattern of appearance of network abnormalities. We propose that sensory and motor secondary symptoms can be important indicators of underlying network aberrations and thus of vulnerable brain states putting individuals at risk for psychopathology following extreme circumstances.

Age and sensory processing abnormalities predict declines in encoding and recall of temporally manipulated speech in high-functioning adults with ASD

While temporal and perceptual processing abnormalities, identified in a number of electrophysiological and brain imaging studies of individuals with (ASD), are likely to impact on speech perception, surprisingly little is known about the behavioral outcomes of such abnormalities. It has been hypothesized that rapid temporal processing deficits may be linked to impaired language development through interference with acoustic information during speech perception. The present study aimed to investigate the impact of temporal changes on encoding and recall of speech, and the associated cognitive, clinical, and behavioral correlates in adults with ASD. Research carried out with typically developing (TD) adults has shown that word recall diminishes as the speed of speech increases, and it was predicted that the magnitude of this effect would be far greater in those with ASD because of a preexisting rapid temporal processing deficit. Nineteen high-functioning adults with ASD, and age- and intelligence-matched TD controls performed verbatim recall of temporally manipulated sentences. Reduced levels of word recall in response to increases in presentation speed were observed, and this effect was greater in the older participants in the ASD group than in the control group. This is the first study to show that both sensory abnormalities and aging impact on speech encoding in ASD. Auditory processing deficits in ASD may be indicative of an association with the sensory abnormalities and social and communication impairments characterizing the disorder.

Severe multisensory speech integration deficits in high-functioning school-aged children with Autism Spectrum Disorder (ASD) and their resolution during early adolescence

Under noisy listening conditions, visualizing a speaker's articulations substantially improves speech intelligibility. This multisensory speech integration ability is crucial to effective communication, and the appropriate development of this capacity greatly impacts a child's ability to successfully navigate educational and social settings. Research shows that multisensory integration abilities continue developing late into childhood. The primary aim here was to track the development of these abilities in children with autism, since multisensory deficits are increasingly recognized as a component of the autism spectrum disorder (ASD) phenotype. The abilities of high-functioning ASD children (n = 84) to integrate seen and heard speech were assessed cross-sectionally, while environmental noise levels were systematically manipulated, comparing them with age-matched neurotypical children (n = 142). Severe integration deficits were uncovered in ASD, which were increasingly pronounced as background noise increased. These deficits were evident in school-aged ASD children (5-12 year olds), but were fully ameliorated in ASD children entering adolescence (13-15 year olds). The severity of multisensory deficits uncovered has important implications for educators and clinicians working in ASD. We consider the observation that the multisensory speech system recovers substantially in adolescence as an indication that it is likely amenable to intervention during earlier childhood, with potentially profound implications for the development of social communication abilities in ASD children.

Recalibration of the multisensory temporal window of integration results from changing task demands

The notion of the temporal window of integration, when applied in a multisensory context, refers to the breadth of the interval across which the brain perceives two stimuli from different sensory modalities as synchronous. It maintains a unitary perception of multisensory events despite physical and biophysical timing differences between the senses. The boundaries of the window can be influenced by attention and past sensory experience. Here we examined whether task demands could also influence the multisensory temporal window of integration. We varied the stimulus onset asynchrony between simple, short-lasting auditory and visual stimuli while participants performed two tasks in separate blocks: a temporal order judgment task that required the discrimination of subtle auditory-visual asynchronies, and a reaction time task to the first incoming stimulus irrespective of its sensory modality. We defined the temporal window of integration as the range of stimulus onset asynchronies where performance was below 75% in the temporal order judgment task, as well as the range of stimulus onset asynchronies where responses showed multisensory facilitation (race model violation) in the reaction time task. In 5 of 11 participants, we observed audio-visual stimulus onset asynchronies where reaction time was significantly accelerated (indicating successful integration in this task) while performance was accurate in the temporal order judgment task (indicating successful segregation in that task). This dissociation suggests that in some participants, the boundaries of the temporal window of integration can adaptively recalibrate in order to optimize performance according to specific task demands.

Experimental and clinical usefulness of crossmodal paradigms in psychiatry: an illustration from emotional processing in alcohol-dependence

Crossmodal processing (i.e., the construction of a unified representation stemming from distinct sensorial modalities inputs) constitutes a crucial ability in humans' everyday life. It has been extensively explored at cognitive and cerebral levels during the last decade among healthy controls. Paradoxically however, and while difficulties to perform this integrative process have been suggested in a large range of psychopathological states (e.g., schizophrenia and autism), these crossmodal paradigms have been very rarely used in the exploration of psychiatric populations. The main aim of the present paper is thus to underline the experimental and clinical usefulness of exploring crossmodal processes in psychiatry. We will illustrate this proposal by means of the recent data obtained in the crossmodal exploration of emotional alterations in alcohol-dependence. Indeed, emotional decoding impairments might have a role in the development and maintenance of alcohol-dependence, and have been extensively investigated by means of experiments using separated visual or auditory stimulations. Besides these unimodal explorations, we have recently conducted several studies using audio-visual crossmodal paradigms, which has allowed us to improve the ecological validity of the unimodal experimental designs and to offer new insights on the emotional alterations among alcohol-dependent individuals. We will show how these preliminary results can be extended to develop a coherent and ambitious research program using crossmodal designs in various psychiatric populations and sensory modalities. We will finally end the paper by underlining the various potential clinical applications and the fundamental implications that can be raised by this emerging project.

Studying autism in rodent models: reconciling endophenotypes with comorbidities

Autism spectrum disorder (ASD) patients commonly exhibit a variety of comorbid traits including seizures, anxiety, aggressive behavior, gastrointestinal problems, motor deficits, abnormal sensory processing, and sleep disturbances for which the cause is unknown. These features impact negatively on daily life and can exaggerate the effects of the core diagnostic traits (social communication deficits and repetitive behaviors). Studying endophenotypes relevant to both core and comorbid features of ASD in rodent models can provide insight into biological mechanisms underlying these disorders. Here we review the characterization of endophenotypes in a selection of environmental, genetic, and behavioral rodent models of ASD. In addition to exhibiting core ASD-like behaviors, each of these animal models display one or more endophenotypes relevant to comorbid features including altered sensory processing, seizure susceptibility, anxiety-like behavior, and disturbed motor functions, suggesting that these traits are indicators of altered biological pathways in ASD. However, the study of behaviors paralleling comorbid traits in animal models of ASD is an emerging field and further research is needed to assess altered gastrointestinal function, aggression, and disorders of sleep onset across models. Future studies should include investigation of these endophenotypes in order to advance our understanding of the etiology of this complex disorder.

Motor abilities in autism: a review using a computational context

Altered motor behaviour is commonly reported in Autism Spectrum Disorder, but the aetiology remains unclear. Here, we have taken a computational approach in order to break down motor control into different components and review the functioning of each process. Our findings suggest abnormalities in two areas--poor integration of information for efficient motor planning, and increased variability in basic sensory inputs and motor outputs. In contrast, motor learning processes are relatively intact and there is inconsistent evidence for deficits in predictive control. We suggest future work on motor abilities in autism should focus on sensorimotor noise and on higher level motor planning, as these seem to have a significant role in causing motor difficulties for autistic individuals.

Multisensory temporal integration: task and stimulus dependencies

The ability of human sensory systems to integrate information across the different modalities provides a wide range of behavioral and perceptual benefits. This integration process is dependent upon the temporal relationship of the different sensory signals, with stimuli occurring close together in time typically resulting in the largest behavior changes. The range of temporal intervals over which such benefits are seen is typically referred to as the temporal binding window (TBW). Given the importance of temporal factors in multisensory integration under both normal and atypical circumstances such as autism and dyslexia, the TBW has been measured with a variety of experimental protocols that differ according to criterion, task, and stimulus type, making comparisons across experiments difficult. In the current study, we attempt to elucidate the role that these various factors play in the measurement of this important construct. The results show a strong effect of stimulus type, with the TBW assessed with speech stimuli being both larger and more symmetrical than that seen using simple and complex non-speech stimuli. These effects are robust across task and statistical criteria and are highly consistent within individuals, suggesting substantial overlap in the neural and cognitive operations that govern multisensory temporal processes.

The development of multisensory integration in high-functioning autism: high-density electrical mapping and psychophysical measures reveal impairments in the processing of audiovisual inputs

Successful integration of auditory and visual inputs is crucial for both basic perceptual functions and for higher-order processes related to social cognition. Autism spectrum disorders (ASD) are characterized by impairments in social cognition and are associated with abnormalities in sensory and perceptual processes. Several groups have reported that individuals with ASD are impaired in their ability to integrate socially relevant audiovisual (AV) information, and it has been suggested that this contributes to the higher-order social and cognitive deficits observed in ASD. However, successful integration of auditory and visual inputs also influences detection and perception of nonsocial stimuli, and integration deficits may impair earlier stages of information processing, with cascading downstream effects. To assess the integrity of basic AV integration, we recorded high-density electrophysiology from a cohort of high-functioning children with ASD (7-16 years) while they performed a simple AV reaction time task. Children with ASD showed considerably less behavioral facilitation to multisensory inputs, deficits that were paralleled by less effective neural integration. Evidence for processing differences relative to typically developing children was seen as early as 100 ms poststimulation, and topographic analysis suggested that children with ASD relied on different cortical networks during this early multisensory processing stage.

The effects of visual training on multisensory temporal processing

The importance of multisensory integration for human behavior and perception is well documented, as is the impact that temporal synchrony has on driving such integration. Thus, the more temporally coincident two sensory inputs from different modalities are, the more likely they will be perceptually bound. This temporal integration process is captured by the construct of the temporal binding window-the range of temporal offsets within which an individual is able to perceptually bind inputs across sensory modalities. Recent work has shown that this window is malleable and can be narrowed via a multisensory perceptual feedback training process. In the current study, we seek to extend this by examining the malleability of the multisensory temporal binding window through changes in unisensory experience. Specifically, we measured the ability of visual perceptual feedback training to induce changes in the multisensory temporal binding window. Visual perceptual training with feedback successfully improved temporal visual processing, and more importantly, this visual training increased the temporal precision across modalities, which manifested as a narrowing of the multisensory temporal binding window. These results are the first to establish the ability of unisensory temporal training to modulate multisensory temporal processes, findings that can provide mechanistic insights into multisensory integration and which may have a host of practical applications.

Two-legged hopping in autism spectrum disorders

Sensory processing deficits are common within autism spectrum disorders (ASD). Deficits have a heterogeneous dispersion across the spectrum and multimodal processing tasks are thought to magnify integration difficulties. Two-legged hopping in place in sync with an auditory cue (2.3, 3.0 Hz) was studied in a group of six individuals with expressive language impaired ASD (ELI-ASD) and an age-matched control group. Vertical ground reaction force data were collected and discrete Fourier transforms were utilized to determine dominant hopping cadence. Effective leg stiffness was computed through a mass-spring model representation. The ELI-ASD group were unsuccessful in matching their hopping cadence (2.21 ± 0.30 hops·s⁻¹, 2.35 ± 0.41 hops·s⁻¹) to either auditory cue with greater deviations at the 3.0 Hz cue. In contrast, the control group was able to match hopping cadence (2.35 ± 0.06 hops·s⁻¹, 3.02 ± 0.10 hops·s⁻¹) to either cue via an adjustment of effective leg stiffness. The ELI-ASD group demonstrated a varied response with an interquartile range (IQR) in excess of 0.5 hops·s⁻¹ as compared to the control group with an IQR < 0.03 hops·s⁻¹. Several sensorimotor mechanisms could explain the inability of participants with ELI-ASD to modulate motor output to match an external auditory cue. These results suggest that a multimodal gross motor task can (1) discriminate performance among a group of individuals with severe autism, and (2) could be a useful quantitative tool for evaluating motor performance in individuals with ASD individuals.

Diminished sensitivity of audiovisual temporal order in autism spectrum disorder

We examined sensitivity of audiovisual temporal order in adolescents with autism spectrum disorder (ASD) using an audiovisual temporal order judgment (TOJ) task. In order to assess domain-specific impairments, the stimuli varied in social complexity from simple flash/beeps to videos of a handclap or a speaking face. Compared to typically-developing controls, individuals with ASD were generally less sensitive in judgments of audiovisual temporal order (larger just noticeable differences, JNDs), but there was no specific impairment with social stimuli. This suggests that people with ASD suffer from a more general impairment in audiovisual temporal processing.