Multisensory temporal function and EEG complexity in patients with epilepsy and psychogenic nonepileptic events

Audiovisual temporal integration: Cognitive processing, neural mechanisms, developmental trajectory and potential interventions

To integrate auditory and visual signals into a unified percept, the paired stimuli must co-occur within a limited time window known as the Temporal Binding Window (TBW). The width of the TBW, a proxy of audiovisual temporal integration ability, has been found to be correlated with higher-order cognitive and social functions. A comprehensive review of studies investigating audiovisual TBW reveals several findings: (1) a wide range of top-down processes and bottom-up features can modulate the width of the TBW, facilitating adaptation to the changing and multisensory external environment; (2) a large-scale brain network works in coordination to ensure successful detection of audiovisual (a)synchrony; (3) developmentally, audiovisual TBW follows a U-shaped pattern across the lifespan, with a protracted developmental course into late adolescence and rebounding in size again in late life; (4) an enlarged TBW is characteristic of a number of neurodevelopmental disorders; and (5) the TBW is highly flexible via perceptual and musical training. Interventions targeting the TBW may be able to improve multisensory function and ameliorate social communicative symptoms in clinical populations.

"Average is good, extremes are bad" - Non-linear inverted U-shaped relationship between neural mechanisms and functionality of mental features

Traditionally, studies emphasize differences in neural measures between pathological and healthy groups, assuming a binary distinction between the groups, and a linear relationship between neural measures and symptoms. Here, we present four examples that show a continuous relation across the divide of normal and pathological states between neural measures and mental functions. This relation can be characterized by a non-linear inverted-U shaped curve. Along this curve, mid-range or average expression of a neural measure is associated with optimal function of a mental feature (in healthy states), whereas extreme expression, either high or low, is associated with sub-optimal function, and occurs in different neural disorders. Neural expression between the optimal or intermediate and pathological or extreme values is associated with sub-optimal function and at-risk mental states. Thus, this model of neuro-mental relationship can be summarized as "average is good, extremes are bad". By focussing on neuro-mental relationships, this model can facilitate the transition of psychiatry from a categorical to a dimensional and individualized approach needed in the era of precision medicine.

Low-Intensity Pulsed Ultrasound Stimulation Modulates the Nonlinear Dynamics of Local Field Potentials in Temporal Lobe Epilepsy

Low-intensity pulsed ultrasound stimulation (LIPUS) can inhibit seizures associated with temporal lobe epilepsy (TLE), which is the most common epileptic syndrome in adults and accounts for more than half of the cases of intractable epilepsy. Electroencephalography (EEG) signal analysis is an important method for studying epilepsy. The nonlinear dynamics of epileptic EEG signals can be used as biomarkers for the prediction and diagnosis of epilepsy. However, how ultrasound modulates the nonlinear dynamic characteristics of EEG signals in TLE is still unclear. Here, we used low-intensity pulsed ultrasound to stimulate the CA3 region of kainite (KA)-induced TLE mice, simultaneously recorded local field potentials (LFP) in the stimulation regions before, during, and after LIPUS. The nonlinear characteristics, including complexity, approximate entropy of different frequency bands, and Lyapunov exponent of the LFP, were calculated. Compared with the control group, the experimental group showed that LIPUS inhibited TLE seizure and the complexity, approximate entropy of the delta (0.5–4 Hz) and theta (4–8 Hz) frequency bands, and Lyapunov exponent of the LFP significantly increased in response to ultrasound stimulation. The values before ultrasound stimulation were higher ∼1.87 (complexity), ∼1.39 (approximate entropy of delta frequency bands), ∼1.13 (approximate entropy of theta frequency bands) and ∼1.46 times (Lyapunov exponent) than that after ultrasound stimulation (p < 0.05). The above results demonstrated that LIPUS can alter nonlinear dynamic characteristics and provide a basis for the application of ultrasound stimulation in the treatment of epilepsy.

From multisensory integration in peripersonal space to bodily self-consciousness: from statistical regularities to statistical inference

Integrating information across sensory systems is a critical step toward building a cohesive representation of the environment and one's body, and as illustrated by numerous illusions, scaffolds subjective experience of the world and self. In the last years, classic principles of multisensory integration elucidated in the subcortex have been translated into the language of statistical inference understood by the neocortical mantle. Most importantly, a mechanistic systems-level description of multisensory computations via probabilistic population coding and divisive normalization is actively being put forward. In parallel, by describing and understanding bodily illusions, researchers have suggested multisensory integration of bodily inputs within the peripersonal space as a key mechanism in bodily self-consciousness. Importantly, certain aspects of bodily self-consciousness, although still very much a minority, have been recently casted under the light of modern computational understandings of multisensory integration. In doing so, we argue, the field of bodily self-consciousness may borrow mechanistic descriptions regarding the neural implementation of inference computations outlined by the multisensory field. This computational approach, leveraged on the understanding of multisensory processes generally, promises to advance scientific comprehension regarding one of the most mysterious questions puzzling humankind, that is, how our brain creates the experience of a self in interaction with the environment.

Atypical audiovisual temporal function in autism and schizophrenia: similar phenotype, different cause

Binding across sensory modalities yields substantial perceptual benefits, including enhanced speech intelligibility. The coincidence of sensory inputs across time is a fundamental cue for this integration process. Recent work has suggested that individuals with diagnoses of schizophrenia (SZ) and autism spectrum disorder (ASD) will characterize auditory and visual events as synchronous over larger temporal disparities than their neurotypical counterparts. Namely, these clinical populations possess an enlarged temporal binding window (TBW). Although patients with SZ and ASD share aspects of their symptomatology, phenotypic similarities may result from distinct etiologies. To examine similarities and variances in audiovisual temporal function in these two populations, individuals diagnosed with ASD (n = 46; controls n = 40) and SZ (n = 16, controls = 16) completed an audiovisual simultaneity judgment task. In addition to standard psychometric analyses, synchrony judgments were assessed using Bayesian causal inference modeling. This approach permits distinguishing between distinct causes of an enlarged TBW: an a priori bias to bind sensory information and poor fidelity in the sensory representation. Findings indicate that both ASD and SZ populations show deficits in multisensory temporal acuity. Importantly, results suggest that while the wider TBWs in ASD most prominently results from atypical priors, the wider TBWs in SZ results from a trend toward changes in prior and weaknesses in the sensory representations. Results are discussed in light of current ASD and SZ theories and highlight that different perceptual training paradigms focused on improving multisensory integration may be most effective in these two clinical populations and emphasize that similar phenotypes may emanate from distinct mechanistic causes.

Audiovisual integration in depth: multisensory binding and gain as a function of distance

The integration of information across sensory modalities is dependent on the spatiotemporal characteristics of the stimuli that are paired. Despite large variation in the distance over which events occur in our environment, relatively little is known regarding how stimulus-observer distance affects multisensory integration. Prior work has suggested that exteroceptive stimuli are integrated over larger temporal intervals in near relative to far space, and that larger multisensory facilitations are evident in far relative to near space. Here, we sought to examine the interrelationship between these previously established distance-related features of multisensory processing. Participants performed an audiovisual simultaneity judgment and redundant target task in near and far space, while audiovisual stimuli were presented at a range of temporal delays (i.e., stimulus onset asynchronies). In line with the previous findings, temporal acuity was poorer in near relative to far space. Furthermore, reaction time to asynchronously presented audiovisual targets suggested a temporal window for fast detection-a range of stimuli asynchronies that was also larger in near as compared to far space. However, the range of reaction times over which multisensory response enhancement was observed was limited to a restricted range of relatively small (i.e., 150 ms) asynchronies, and did not differ significantly between near and far space. Furthermore, for synchronous presentations, these distance-related (i.e., near vs. far) modulations in temporal acuity and multisensory gain correlated negatively at an individual subject level. Thus, the findings support the conclusion that multisensory temporal binding and gain are asymmetrically modulated as a function of distance from the observer, and specifies that this relationship is specific for temporally synchronous audiovisual stimulus presentations.

Disrupted integration of exteroceptive and interoceptive signaling in autism spectrum disorder

In addition to deficits in social communication, individuals diagnosed with Autism Spectrum Disorder (ASD) frequently exhibit changes in sensory and multisensory function. Recent evidence has focused on changes in audiovisual temporal processing, and has sought to relate these sensory-based changes to weaknesses in social communication. These changes in audiovisual temporal function manifest as differences in the temporal epoch or "window" within which paired auditory and visual stimuli are integrated or bound, with those with ASD exhibiting expanded audiovisual temporal binding windows (TBWs). However, it is unknown whether this impairment is unique to audiovisual pairings, perhaps because of their relevance for speech processing, or whether it generalizes across pairings in different sensory modalities. In addition to the exteroceptive senses, there has been growing interest in ASD research in interoception (e.g., the monitoring of respiration, heartbeat, hunger, etc.), as these internally directed sensory processes appear to be altered as well in autism. In the current study, we sought to examine both exteroception and interoception in individuals with ASD and a group of typically developing (TD) matched controls, with an emphasis on temporal perception of audiovisual (exteroceptive) and cardiovisual (interoceptive to exteroceptive) cues. Results replicate prior findings showing expanded audiovisual TBWs in ASD in comparison to TD. In addition, strikingly, cardiovisual TBWs were fourfold larger in ASD than in TD, suggesting a putative complete lack of cardiovisual temporal acuity in ASD individuals. Results are discussed in light of recent evidence indicating a reduced tendency to rely on sensory priors in ASD. Autism Res 2018, 11: 194-205. © 2017 International Society for Autism Research, Wiley Periodicals, Inc.

LAY SUMMARY

Studies have shown that individuals with autism have difficulty in separating auditory and visual events in time. People with autism also weight sensory evidence originating from the external world and from their body differently. We measured simultaneity judgments regarding visual and auditory events and between visual and heartbeat events. Results suggest that while individuals with autism show unusual temporal function across the senses in a general manner, this deficit is greater when pairings bridged between the external world and the internal body.