Common or redundant neural circuits for duration processing across audition and touch

Somatosensory temporal sensitivity in adults on the autism spectrum: A high-density electrophysiological mapping study using the mismatch negativity (MMN) sensory memory paradigm

Atypical reactivity to somatosensory inputs is common in autism spectrum disorder and carries considerable impact on downstream social communication and quality of life. While behavioral and survey work have established differences in the perception of somatosensory information, little has been done to elucidate the underlying neurophysiological processes that drive these characteristics. Here, we implemented a duration-based somatosensory mismatch negativity (MMN) paradigm to examine the role of temporal sensitivity and sensory memory in the processing of vibrotactile information in autistic (n = 30) and neurotypical (n = 30) adults. To capture the variability in responses between groups across a range of duration discrepancies, we compared the electrophysiological responses to frequent standard vibrations (100 ms) and four infrequent deviant vibrations (115, 130, 145, and 160 ms). The same stimuli were used in a follow-up behavioral task to determine active detection of the infrequent vibrations. We found no differences between the two groups with regard to discrimination between standard and deviant vibrations, demonstrating comparable neurologic and behavioral temporal somatosensory perception. However, exploratory analyses yielded subtle differences in amplitude at the N1 and P220 time points. Together, these results indicate that the temporal mechanisms of somatosensory discrimination are conserved in adults on the autism spectrum, though more general somatosensory processing may be affected. We discuss these findings in the broader context of the MMN literature in autism, as well as the potential role of cortical maturity in somatosensory mechanisms.

Intact Somatosensory Temporal Sensitivity in Adults on the Autism Spectrum: A High-Density Electrophysiological Mapping Study Using the Mismatch Negativity (MMN) Sensory Memory Paradigm

Atypical reactivity to somatosensory inputs is common in autism spectrum disorder and carries considerable impact on downstream social communication and quality of life. While behavioral and survey work have established differences in the perception of somatosensory information, little has been done to elucidate the underlying neurophysiological processes that drive these characteristics. Here, we implemented a duration-based somatosensory mismatch negativity paradigm to examine the role of temporal sensitivity and sensory memory in the processing of vibrotactile information in autistic (n=30) and neurotypical (n=30) adults. To capture the variability in responses between groups across a range of duration discrepancies, we compared the electrophysiological responses to frequent standard vibrations (100 ms) and four infrequent deviant vibrations (115, 130, 145, and 160 ms). The same stimuli were used in a follow-up behavioral task to determine active detection of the infrequent vibrations. We found no differences between the two groups with regard to discrimination between standard and deviant vibrations, demonstrating comparable neurologic and behavioral temporal somatosensory perception. However, exploratory analyses yielded subtle differences in amplitude at the N1 and P220 time points. Together, these results indicate that the temporal mechanisms of somatosensory discrimination are conserved in adults on the autism spectrum, though more general somatosensory processing may be affected. We discuss these findings in the broader context of the MMN literature in autism, as well as the potential role of cortical maturity in somatosensory mechanisms.

Probing the Neurophysiology of Temporal Sensitivity in the Somatosensory System Using the Mismatch Negativity (MMN) Sensory Memory Paradigm

Duration is an amodal feature common to all sensory experiences, but low-level processing of the temporal qualities of somatosensation remains poorly understood. The goal of the present study was to evaluate electrophysiological discrimination of parametric somatosensory stimuli to better understand how the brain processes the duration of tactile information. This research used a somatosensory mismatch negativity (sMMN) paradigm to evaluate electrophysiological sensitivity to differences in the duration of vibrotactile stimuli in healthy young adults. Specifically, a 100 ms standard vibration was presented 80% of the time while the remaining 20% of presentations were made up of deviant stimuli with one of the following durations: 115, 130, 145, or 160 ms. When a deviation from the anticipated tactile input is detected, the distinct electrophysiological signature of the sMMN is present. A companion behavioral task assessed individual thresholds for cognizant awareness of the standard and deviant vibrotactile stimuli. The results of the present study demonstrated a sMMN response when deviant stimuli were 130, 145, and 160 ms, but not when they were 115 ms. This suggests that on average the participants did not electrophysiologically discriminate between the 100 and 115 ms. Future work may apply this paradigm to better understand atypical tactile sensitivity in various clinical conditions.

Markov chains as a proxy for the predictive memory representations underlying mismatch negativity

Events not conforming to a regularity inherent to a sequence of events elicit prediction error signals of the brain such as the Mismatch Negativity (MMN) and impair behavioral task performance. Events conforming to a regularity lead to attenuation of brain activity such as stimulus-specific adaptation (SSA) and behavioral benefits. Such findings are usually explained by theories stating that the information processing system predicts the forthcoming event of the sequence via detected sequential regularities. A mathematical model that is widely used to describe, to analyze and to generate event sequences are Markov chains: They contain a set of possible events and a set of probabilities for transitions between these events (transition matrix) that allow to predict the next event on the basis of the current event and the transition probabilities. The accuracy of such a prediction depends on the distribution of the transition probabilities. We argue that Markov chains also have useful applications when studying cognitive brain functions. The transition matrix can be regarded as a proxy for generative memory representations that the brain uses to predict the next event. We assume that detected regularities in a sequence of events correspond to (a subset of) the entries in the transition matrix. We apply this idea to the Mismatch Negativity (MMN) research and examine three types of MMN paradigms: classical oddball paradigms emphasizing sound probabilities, between-sound regularity paradigms manipulating transition probabilities between adjacent sounds, and action-sound coupling paradigms in which sounds are associated with actions and their intended effects. We show that the Markovian view on MMN yields theoretically relevant insights into the brain processes underlying MMN and stimulates experimental designs to study the brain's processing of event sequences.

Neural correlates of perceptual texture change during active touch

Introduction

Texture changes occur frequently during real-world haptic explorations, but the neural processes that encode perceptual texture change remain relatively unknown. The present study examines cortical oscillatory changes during transitions between different surface textures during active touch.

Methods

Participants explored two differing textures whilst oscillatory brain activity and finger position data were recorded using 129-channel electroencephalography and a purpose-built touch sensor. These data streams were fused to calculate epochs relative to the time when the moving finger crossed the textural boundary on a 3D-printed sample. Changes in oscillatory band power in alpha (8-12 Hz), beta (16-24 Hz) and theta (4-7 Hz) frequency bands were investigated.

Results

Alpha-band power reduced over bilateral sensorimotor areas during the transition period relative to ongoing texture processing, indicating that alpha-band activity is modulated by perceptual texture change during complex ongoing tactile exploration. Further, reduced beta-band power was observed in central sensorimotor areas when participants transitioned from rough to smooth relative to transitioning from smooth to rough textures, supporting previous research that beta-band activity is mediated by high-frequency vibrotactile cues.

Discussion

The present findings suggest that perceptual texture change is encoded in the brain in alpha-band oscillatory activity whilst completing continuous naturalistic movements across textures.

The impact of musical training in symbolic and non-symbolic audiovisual judgements of magnitude

Quantity estimation can be represented in either an analog or symbolic manner and recent evidence now suggests that analog and symbolic representation of quantities interact. Nonetheless, those two representational forms of quantities may be enhanced by convergent multisensory information. Here, we elucidate those interactions using high-density electroencephalography (EEG) and an audiovisual oddball paradigm. Participants were presented simultaneous audiovisual tokens in which the co-varying pitch of tones was combined with the embedded cardinality of dot patterns. Incongruencies were elicited independently from symbolic and non-symbolic modality within the audio-visual percept, violating the newly acquired rule that “the higher the pitch of the tone, the larger the cardinality of the figure.” The effect of neural plasticity in symbolic and non-symbolic numerical representations of quantities was investigated through a cross-sectional design, comparing musicians to musically naïve controls. Individual’s cortical activity was reconstructed and statistically modeled for a predefined time-window of the evoked response (130–170 ms). To summarize, we show that symbolic and non-symbolic processing of magnitudes is re-organized in cortical space, with professional musicians showing altered activity in motor and temporal areas. Thus, we argue that the symbolic representation of quantities is altered through musical training.

Somatosensory Deviance Detection ERPs and Their Relationship to Analogous Auditory ERPs and Interoceptive Accuracy

Abstract. Automatic deviance detection has been widely explored in terms of mismatch responses (mismatch negativity or mismatch response) and P3a components of event-related potentials (ERPs) under a predictive coding framework; however, the somatosensory mismatch response has been investigated less often regarding the different types of changes than its auditory counterpart. It is not known whether the deviance detection responses from different modalities correlate, reflecting a general prediction error mechanism of the central nervous system. Furthermore, interoceptive functions have been associated with predictive coding theory, but whether interoceptive accuracy correlates with deviance detection brain responses has rarely been investigated. Here, we measured ERPs to changes in somatosensory stimuli’s location and intensity and in sound intensity in healthy adults ( n = 34). Interoceptive accuracy was measured with a heartbeat discrimination task, where participants indicated whether their heartbeats were simultaneous or non-simultaneous with sound stimuli. We found a mismatch response and a P3a response to somatosensory location and auditory intensity changes, but for somatosensory intensity changes, only a P3a response was found. Unexpectedly, there were neither correlations between the somatosensory location deviance and intensity deviance brain responses nor between auditory and somatosensory brain responses. In addition, the brain responses did not correlate with interoceptive accuracy. The results suggest that although deviance detection in the auditory and somatosensory modalities are likely based on similar neural mechanisms at a cellular level, their ERP indexes do not indicate a linear association in sensitivity for deviance detection between the modalities. Furthermore, although sensory deviance detection and interoceptive detection are both associated with predictive coding functions, under these experimental settings, functional relationships were not observed. These results should be taken into account in the future development of theories related to human sensory functions and in extensions of the predictive coding theory in particular.

Neural surprise in somatosensory Bayesian learning

Tracking statistical regularities of the environment is important for shaping human behavior and perception. Evidence suggests that the brain learns environmental dependencies using Bayesian principles. However, much remains unknown about the employed algorithms, for somesthesis in particular. Here, we describe the cortical dynamics of the somatosensory learning system to investigate both the form of the generative model as well as its neural surprise signatures. Specifically, we recorded EEG data from 40 participants subjected to a somatosensory roving-stimulus paradigm and performed single-trial modeling across peri-stimulus time in both sensor and source space. Our Bayesian model selection procedure indicates that evoked potentials are best described by a non-hierarchical learning model that tracks transitions between observations using leaky integration. From around 70ms post-stimulus onset, secondary somatosensory cortices are found to represent confidence-corrected surprise as a measure of model inadequacy. Indications of Bayesian surprise encoding, reflecting model updating, are found in primary somatosensory cortex from around 140ms. This dissociation is compatible with the idea that early surprise signals may control subsequent model update rates. In sum, our findings support the hypothesis that early somatosensory processing reflects Bayesian perceptual learning and contribute to an understanding of its underlying mechanisms.

Our environment features statistical regularities, such as a drop of rain predicting imminent rainfall. Despite the importance for behavior and survival, much remains unknown about how these dependencies are learned, particularly for somatosensation. As surprise signalling about novel observations indicates a mismatch between one’s beliefs and the world, it has been hypothesized that surprise computation plays an important role in perceptual learning. By analyzing EEG data from human participants receiving sequences of tactile stimulation, we compare different formulations of surprise and investigate the employed underlying learning model. Our results indicate that the brain estimates transitions between observations. Furthermore, we identified different signatures of surprise computation and thereby provide a dissociation of the neural correlates of belief inadequacy and belief updating. Specifically, early surprise responses from around 70ms were found to signal the need for changes to the model, with encoding of its subsequent updating occurring from around 140ms. These results provide insights into how somatosensory surprise signals may contribute to the learning of environmental statistics.

Auditory Frequency Representations in Human Somatosensory Cortex

Recent studies have challenged the traditional notion of modality-dedicated cortical systems by showing that audition and touch evoke responses in the same sensory brain regions. While much of this work has focused on somatosensory responses in auditory regions, fewer studies have investigated sound responses and representations in somatosensory regions. In this functional magnetic resonance imaging (fMRI) study, we measured BOLD signal changes in participants performing an auditory frequency discrimination task and characterized activation patterns related to stimulus frequency using both univariate and multivariate analysis approaches. Outside of bilateral temporal lobe regions, we observed robust and frequency-specific responses to auditory stimulation in classically defined somatosensory areas. Moreover, using representational similarity analysis to define the relationships between multi-voxel activation patterns for all sound pairs, we found clear similarity patterns for auditory responses in the parietal lobe that correlated significantly with perceptual similarity judgments. Our results demonstrate that auditory frequency representations can be distributed over brain regions traditionally considered to be dedicated to somatosensation. The broad distribution of auditory and tactile responses over parietal and temporal regions reveals a number of candidate brain areas that could support general temporal frequency processing and mediate the extensive and robust perceptual interactions between audition and touch.

Body representations as indexed by oscillatory EEG activities in the context of tactile novelty processing

Neural oscillatory activities in different frequency bands are known to reflect different cognitive functions. The current study investigates neural oscillations involved in tactile novelty processing, in particular how physically different digits of the hand may be categorized as being more or less similar to one another. Time-frequency analyses were conducted on EEG responses recorded from a somatosensory mismatch protocol involving stimulation of the 1st, 3rd, and 5th digits. The pattern of tactile stimulation leveraged a functional category boundary between the 1st digit (thumb) and the other fingers. This functional category has been hypothesized to derive, in part, from the way that the hand is used to grasp and haptically explore objects. EEG responses to standard stimuli (the 3rd digit, probability of 80%) and two deviant stimuli (1st digit as across-boundary deviant and 5th digit as within-boundary deviant, probability of 10% each) were examined. Analyses of EEG responses examined changes in power as well as phase information. Deviant tactile stimuli evoked significantly greater theta event-related synchronization and greater phase-locking values compared to the corresponding control stimuli. The increase in theta power evoked by the contrast of the 3rd digit and the 1st digit was significantly larger than for the contrast between the 3rd and 5th digits. Desynchronization in the alpha and beta bands was greater for deviant than control stimuli, which may reflect increased local cortical excitation to novel stimuli, modulated by top-down feedback processes as part of a hierarchical novelty detection mechanism. The results are discussed in the context of the growing literature on neural processes involved in the generation and maintenance of body representations.

Evidence for Linear but Not Helical Automatic Representation of Pitch in the Human Auditory System

The perceptual organization of pitch is frequently described as helical, with a monotonic dimension of pitch height and a circular dimension of pitch chroma, accounting for the repeating structure of the octave. Although the neural representation of pitch height is widely studied, the way in which pitch chroma representation is manifested in neural activity is currently debated. We tested the automaticity of pitch chroma processing using the MMN—an ERP component indexing automatic detection of deviations from auditory regularity. Musicians trained to classify pure or complex tones across four octaves, based on chroma—C versus G (21 participants, Experiment 1) or C versus F# (27, Experiment 2). Next, they were passively exposed to MMN protocols designed to test automatic detection of height and chroma deviations. Finally, in an “attend chroma” block, participants had to detect the chroma deviants in a sequence similar to the passive MMN sequence. The chroma deviant tones were accurately detected in the training and the attend chroma parts both for pure and complex tones, with a slightly better performance for complex tones. However, in the passive blocks, a significant MMN was found only to height deviations and complex tone chroma deviations, but not to pure tone chroma deviations, even for perfect performers in the active tasks. These results indicate that, although height is represented preattentively, chroma is not. Processing the musical dimension of chroma may require higher cognitive processes, such as attention and working memory.

Auditory sensory memory span for duration is severely curtailed in females with Rett syndrome

Rett syndrome (RTT), a rare neurodevelopmental disorder caused by mutations in the MECP2 gene, is typified by profound cognitive impairment and severe language impairment, rendering it very difficult to accurately measure auditory processing capabilities behaviorally in this population. Here we leverage the mismatch negativity (MMN) component of the event-related potential to measure the ability of RTT patients to decode and store occasional duration deviations in a stream of auditory stimuli. Sensory memory for duration, crucial for speech comprehension, has not been studied in RTT.High-density electroencephalography was successfully recorded in 18 females with RTT and 27 age-matched typically developing (TD) controls (aged 6-22 years). Data from seven RTT and three TD participants were excluded for excessive noise. Stimuli were 1 kHz tones with a standard duration of 100 ms and deviant duration of 180 ms. To assess the sustainability of sensory memory, stimulus presentation rate was varied with stimulus onset asynchronies (SOAs) of 450, 900, and 1800 ms. MMNs with maximum negativity over fronto-central scalp and a latency of 220-230 ms were clearly evident for each presentation rate in the TD group, but only for the shortest SOA in the RTT group. Repeated-measures ANOVA revealed a significant group by SOA interaction. MMN amplitude correlated with age in the TD group only. MMN amplitude was not correlated with the Rett Syndrome Severity Scale. This study indicates that while RTT patients can decode deviations in auditory duration, the span of this sensory memory system is severely foreshortened, with likely implications for speech decoding abilities.

Do theta oscillations explain the somatosensory change detection mechanism?

Recent research has indicated that the mismatch negativity (MMN) is elicited in response to a discernible small change of a somatosensory stimulus applied on the hand. However, the neural mechanism for detecting small change of somatosensory stimulus remains unknown. In the present study, we developed a novel pressure stimulation device using air jet applied on the index finger pad, and determined the just noticeable differences (JNDs) of pressure discrimination for each subject. Using the deviant-standard-reversed oddball paradigm, we analyzed the average dynamic changes in MMN amplitude and changes of evoked spectral power. We found a clear MMN component at the frontal and central regions at 100-300 msec after deviant stimulus presentation. Statistical tests showed that theta band activity played pivotal roles in the generation of the MMN elicited by a change in somatosensory pressure stimulation. Our results indicate that the somatosensory discriminatory process reflected on MMN is accompanied by phase-locked oscillation at the theta frequency.

Human posterior parietal cortex responds to visual stimuli as early as peristriate occipital cortex

Much of what is known about the timing of visual processing in the brain is inferred from intracranial studies in monkeys, with human data limited to mainly noninvasive methods with lower spatial resolution. Here, we estimated visual onset latencies from electrocorticographic (ECoG) recordings in a patient who was implanted with 112 subdural electrodes, distributed across the posterior cortex of the right hemisphere, for presurgical evaluation of intractable epilepsy. Functional MRI prior to surgery was used to determine boundaries of visual areas. The patient was presented with images of objects from several categories. Event-related potentials (ERPs) were calculated across all categories excluding targets, and statistically reliable onset latencies were determined, using a bootstrapping procedure over the single trial baseline activity in individual electrodes. The distribution of onset latencies broadly reflected the known hierarchy of visual areas, with the earliest cortical responses in primary visual cortex, and higher areas showing later responses. A clear exception to this pattern was a robust, statistically reliable and spatially localized, very early response, on the bank of the posterior intraparietal sulcus (IPS). The response in the IPS started nearly simultaneously with responses detected in peristriate visual areas, around 60 ms poststimulus onset. Our results support the notion of early visual processing in the posterior parietal lobe, not respecting traditional hierarchies, and give direct evidence for onset times of visual responses across the human cortex.

The somatosensory mismatch negativity as a window into body representations in infancy

How the body is represented in the developing brain is a topic of growing interest. The current study takes a novel approach to investigating neural body representations in infants by recording somatosensory mismatch negativity (sMMN) responses elicited by tactile stimulation of different body locations. Recent research in adults has suggested that sMMN amplitude may be influenced by the relative distance between representations of the stimulated body parts in somatosensory cortex. The current study uses a similar paradigm to explore whether the sMMN can be elicited in infants, and to test whether the infant sMMN response is sensitive to the somatotopic organization of somatosensory cortex. Participants were healthy infants (n = 31) aged 6 and 7 months. The protocol leveraged a discontinuity in cortical somatotopic organization, whereby the representations of the neck and the face are separated by representations of the arms, the hands and the shoulder. In a double-deviant oddball protocol, stimulation of the hand (100 trials, 10% probability) and neck (100 trials, 10% probability) was interspersed among repeated stimulation of the face (800 trials, 80% probability). Waveforms showed evidence of an infant sMMN response that was significantly larger for the face/neck contrast than for the face/hand contrast. These results suggest that, for certain combinations of body parts, early pre-attentive tactile discrimination in infants may be influenced by distance between the corresponding cortical representations. The results provide the first evidence that the sMMN can be elicited in infants, and pave the way for further applications of the sMMN in studying body representations in preverbal infants.

Effect of acceleration of auditory inputs on the primary somatosensory cortex in humans

Cross-modal interaction occurs during the early stages of processing in the sensory cortex; however, its effect on neuronal activity speed remains unclear. We used magnetoencephalography to investigate whether auditory stimulation influences the initial cortical activity in the primary somatosensory cortex. A 25-ms pure tone was randomly presented to the left or right side of healthy volunteers at 1000 ms when electrical pulses were applied to the left or right median nerve at 20 Hz for 1500 ms because we did not observe any cross-modal effect elicited by a single pulse. The latency of N20 m originating from Brodmann's area 3b was measured for each pulse. The auditory stimulation significantly shortened the N20 m latency at 1050 and 1100 ms. This reduction in N20 m latency was identical for the ipsilateral and contralateral sounds for both latency points. Therefore, somatosensory-auditory interaction, such as input to the area 3b from the thalamus, occurred during the early stages of synaptic transmission. Auditory information that converged on the somatosensory system was considered to have arisen from the early stages of the feedforward pathway. Acceleration of information processing through the cross-modal interaction seemed to be partly due to faster processing in the sensory cortex.

Somatosensory and auditory deviance detection for outcome prediction during postanoxic coma

Objective

Prominent research in patients with disorders of consciousness investigated the electrophysiological correlates of auditory deviance detection as a marker of consciousness recovery. Here, we extend previous studies by investigating whether somatosensory deviance detection provides an added value for outcome prediction in postanoxic comatose patients.

Methods

Electroencephalography responses to frequent and rare stimuli were obtained from 66 patients on the first and second day after coma onset.

Results

Multivariate decoding analysis revealed an above chance‐level auditory discrimination in 25 patients on the first day and in 31 patients on the second day. Tactile discrimination was significant in 16 patients on the first day and in 23 patients on the second day. Single‐day sensory discrimination was unrelated to patients’ outcome in both modalities. However, improvement of auditory discrimination from first to the second day was predictive of good outcome with a positive predictive power (PPV) of 0.73 (CI = 0.52–0.88). Analyses considering the improvement of tactile, auditory and tactile, or either auditory or tactile discrimination showed no significant prediction of good outcome (PPVs = 0.58–0.68).

Interpretation

Our results show that in the acute phase of coma deviance detection is largely preserved for both auditory and tactile modalities. However, we found no evidence for an added value of somatosensory to auditory deviance detection function for coma‐outcome prediction.

Neuropsychology of Human Body Parts: Exploring Categorical Boundaries of Tactile Perception Using Somatosensory Mismatch Responses

The focus of the current study is on a particular aspect of tactile perception: categorical segmentation on the body surface into discrete body parts. The MMN has been shown to be sensitive to categorical boundaries and language experience in the auditory modality. Here we recorded the somatosensory MMN (sMMN) using two tactile oddball protocols and compared sMMN amplitudes elicited by within- and across-boundary oddball pairs. Both protocols employed the identity MMN method that controls for responsivity at each body location. In the first protocol, we investigated the categorical segmentation of tactile space at the wrist by presenting pairs of tactile oddball stimuli across equal spatial distances, either across the wrist or within the forearm. Amplitude of the sMMN elicited by stimuli presented across the wrist boundary was significantly greater than for stimuli presented within the forearm, suggesting a categorical effect at an early stage of somatosensory processing. The second protocol was designed to investigate the generality of this MMN effect, and involved three digits on one hand. Amplitude of the sMMN elicited by a contrast of the third digit and the thumb was significantly larger than a contrast between the third and fifth digits, suggesting a functional boundary effect that may derive from the way that objects are typically grasped. These findings demonstrate that the sMMN is a useful index of processing of somatosensory spatial discrimination that can be used to study body part categories.

Cervical dystonia: Normal auditory mismatch negativity and abnormal somatosensory mismatch negativity

OBJECTIVE

Previous electrophysiological and psychophysical tests have suggested that somatosensory integration is abnormal in dystonia. Here, we hypothesised that this abnormality could relate to a more general deficit in pre-attentive error/deviant detection in patients with dystonia. We therefore tested patients with dystonia and healthy subjects using a mismatch negativity paradigm (MMN), where evoked potentials generated in response to a standard repeated stimulus are subtracted from the responses to a rare "odd ball" stimulus.

METHODS

We assessed MMN for somatosensory and auditory stimuli in patients with cervical dystonia and healthy age matched controls.

RESULTS

We found a significant group ∗ oddball type interaction effect (F (1, 34) = 4.5, p = 0.04, ρ_I = 0.63). A follow up independent t-test for sMMN data, showed a smaller sMMN amplitude in dystonic patients compared to controls (mean difference control-dystonia: -1.0 µV ± 0.3, p < 0.00, t = -3.1). However the amplitude of aMMN did not differ between groups (mean difference control-dystonia: -0.2 µV ± 0.2, p = 0.24, t = -1.2). We found a positive correlation between somatosensory MMN and somatosensory temporal discrimination threshold.

CONCLUSION

These results suggest that pre-attentive error/deviant detection, specifically in the somatosensory domain, is abnormal in dystonia. This could underlie some previously reported electrophysiological and psychophysical abnormalities of somatosensory integration in dystonia.

SIGNIFICANCE

One could hypothesize a deficit in pre-conscious orientation towards potentially salient signals might lead to a more conservative threshold for decision-making in dystonia.

Auditory Feedback Assists Post hoc Error Correction of Temporal Reproduction, and Perception of Self-Produced Time Intervals in Subsecond Range

We examined whether auditory feedback assists the post hoc error correction of temporal reproduction, and the perception of self-produced time intervals in the subsecond and suprasecond ranges. Here, we employed a temporal reproduction task with a single motor response at a point in time with and without auditory feedback. This task limits participants to reducing errors by employing auditory feedback in a post hoc manner. Additionally, the participants were asked to judge the self-produced timing in this task. The results showed that, in the presence of auditory feedback, the participants exhibited smaller variability and bias in terms of temporal reproduction and the perception of self-produced time intervals in the subsecond range but not in the suprasecond range. Furthermore, in the presence of auditory feedback, the positive serial dependency of temporal reproduction, which is the tendency of reproduced intervals to be similar to those in adjacent trials, was reduced in the subsecond range but not in the suprasecond range. These results suggest that auditory feedback assists the post hoc error correction of temporal reproduction, and the perception of self-produced time intervals in the subsecond range.

An Examination of the Neural Unreliability Thesis of Autism

An emerging neuropathological theory of Autism, referred to here as “the neural unreliability thesis,” proposes greater variability in moment-to-moment cortical representation of environmental events, such that the system shows general instability in its impulse response function. Leading evidence for this thesis derives from functional neuroimaging, a methodology ill-suited for detailed assessment of sensory transmission dynamics occurring at the millisecond scale. Electrophysiological assessments of this thesis, however, are sparse and unconvincing. We conducted detailed examination of visual and somatosensory evoked activity using high-density electrical mapping in individuals with autism (N = 20) and precisely matched neurotypical controls (N = 20), recording large numbers of trials that allowed for exhaustive time-frequency analyses at the single-trial level. Measures of intertrial coherence and event-related spectral perturbation revealed no convincing evidence for an unreliability account of sensory responsivity in autism. Indeed, results point to robust, highly reproducible response functions marked for their exceedingly close correspondence to those in neurotypical controls

Using somatosensory mismatch responses as a window into somatotopic processing of tactile stimulation

Brain responses to tactile stimulation have often been studied through the examination of ERPs elicited to touch on the body surface. Here, we examined two factors potentially modulating the amplitude of the somatosensory mismatch negativity (sMMN) and P300 responses elicited by touch to pairs of body parts: (a) the distance between the representation of these body parts in somatosensory cortex, and (b) the physical distances between the stimulated points on the body surface. The sMMN and the P300 response were elicited by tactile stimulation in two oddball protocols. One protocol leveraged a discontinuity in cortical somatotopic organization, and involved stimulation of either the neck or the hand in relation to stimulation of the lip. The other protocol involved stimulation to the third or fifth finger in relation to the second finger. The neck-lip pairing resulted in significantly larger sMMN responses (with shorter latencies) than the hand-lip pairing, whereas the reverse was true for the amplitude of the P300. Mean sMMN amplitude and latency did not differ between finger pairings. However, larger P300 responses were elicited to stimulation of the fifth finger than the third finger. These results suggest that, for certain combinations of body parts, early automatic somatosensory mismatch responses may be influenced by distance between the cortical representations of these body parts, whereas the later P300 response may be more influenced by the distance between stimulated body parts on the body surface. Future investigations can shed more light on this novel suggestion.

Cardio-audio synchronization drives neural surprise response

Successful prediction of future events depends on the brain’s capacity to extract temporal regularities from sensory inputs. Neuroimaging studies mainly investigated regularity processing for exteroceptive sensory inputs (i.e. from outside the body). Here we investigated whether interoceptive signals (i.e. from inside the body) can mediate auditory regularity processing. Human participants passively listened to sound sequences presented in synchrony or asynchrony to their heartbeat while concomitant electroencephalography was recorded. We hypothesized that the cardio-audio synchronicity would induce a brain expectation of future sounds. Electrical neuroimaging analysis revealed a surprise response at 158–270 ms upon omission of the expected sounds in the synchronous condition only. Control analyses ruled out that this effect was trivially based on expectation from the auditory temporal structure or on differences in heartbeat physiological signals. Implicit neural monitoring of temporal regularities across interoceptive and exteroceptive signals drives prediction of future events in auditory sequences.

Automatic cortical representation of auditory pitch changes in Rett syndrome

Background

Over the typical course of Rett syndrome, initial language and communication abilities deteriorate dramatically between the ages of 1 and 4 years, and a majority of these children go on to lose all oral communication abilities. It becomes extremely difficult for clinicians and caretakers to accurately assess the level of preserved auditory functioning in these children, an issue of obvious clinical import. Non-invasive electrophysiological techniques allow for the interrogation of auditory cortical processing without the need for overt behavioral responses. In particular, the mismatch negativity (MMN) component of the auditory evoked potential (AEP) provides an excellent and robust dependent measure of change detection and auditory sensory memory. Here, we asked whether females with Rett syndrome would produce the MMN to occasional changes in pitch in a regularly occurring stream of auditory tones.

Methods

Fourteen girls with genetically confirmed Rett syndrome and 22 age-matched neurotypical controls participated (ages 3.9–21.1 years). High-density electrophysiological recordings from 64 scalp electrodes were made while participants passively listened to a regularly occurring stream of 503-Hz auditory tone pips that was occasionally (15 % of presentations) interrupted by a higher-pitched deviant tone of 996 Hz. The MMN was derived by subtracting the AEP to these deviants from the AEP produced to the standard.

Results

Despite clearly anomalous morphology and latency of the AEP to simple pure-tone inputs in Rett syndrome, the MMN response was evident in both neurotypicals and Rett patients. However, we found that the pitch-evoked MMN was both delayed and protracted in duration in Rett, pointing to slowing of auditory responsiveness.

Conclusions

The presence of the MMN in Rett patients suggests preserved abilities to process pitch changes in auditory sensory memory. This work represents a beginning step in an effort to comprehensively map the extent of auditory cortical functioning in Rett syndrome. These easily obtained objective brain measures of auditory processing have promise as biomarkers against which future therapeutic efforts can be assayed.

Evaluation of cortical local field potential diffusion in stereotactic electro-encephalography recordings: A glimpse on white matter signal

While there is a strong interest in meso-scale field potential recording using intracranial electroencephalography with penetrating depth electrodes (i.e. stereotactic EEG or S-EEG) in humans, the signal recorded in the white matter remains ignored. White matter is generally considered electrically neutral and often included in the reference montage. Moreover, re-referencing electrophysiological data is a critical preprocessing choice that could drastically impact signal content and consequently the results of any given analysis. In the present stereotactic electroencephalography study, we first illustrate empirically the consequences of commonly used references (subdermal, white matter, global average, local montage) on inter-electrode signal correlation. Since most of these reference montages incorporate white matter signal, we next consider the difference between signals recorded in cortical gray matter and white matter. Our results reveal that electrode contacts located in the white matter record a mixture of activity, with part arising from the volume conduction (zero time delay) of activity from nearby gray matter. Furthermore, our analysis shows that white matter signal may be correlated with distant gray matter signal. While residual passive electrical spread from nearby matter may account for this relationship, our results suggest the possibility that this long distance correlation arises from the white matter fiber tracts themselves (i.e. activity from distant gray matter traveling along axonal fibers with time lag larger than zero); yet definitive conclusions about the origin of the white matter signal would require further experimental substantiation. By characterizing the properties of signals recorded in white matter and in gray matter, this study illustrates the importance of including anatomical prior knowledge when analyzing S-EEG data.

Multilevel Cortical Processing of Somatosensory Novelty: A Magnetoencephalography Study

Using magnetoencephalography (MEG), this study investigates the spatio-temporal dynamics of the multilevel cortical processing of somatosensory change detection. Neuromagnetic signals of 16 healthy adult subjects (7 females and 9 males, mean age 29 ± 3 years) were recorded using whole-scalp-covering MEG while they underwent an oddball paradigm based on simple standard (right index fingertip tactile stimulation) and deviant (simultaneous right index fingertip and middle phalanx tactile stimulation) stimuli gathered into sequences to create and then deviate from stimulus patterns at multiple (local vs. global) levels of complexity. Five healthy adult subjects (3 females and 2 males, mean age 31, 6 ± 2 years) also underwent a similar oddball paradigm in which standard and deviant stimuli were flipped. Local deviations led to a somatosensory mismatch response peaking at 55-130 ms post-stimulus onset with a cortical generator located at the contralateral secondary somatosensory (cSII) cortex. The mismatch response was independent of the deviant stimuli physical characteristics. Global deviants led to a P300 response with cortical sources located bilaterally at temporo-parietal junction (TPJ) and supplementary motor area (SMA). The posterior parietal cortex (PPC) and the SMA were found to generate a contingent magnetic variation (CMV) attributed to top-down expectations. Amplitude of mismatch responses were modulated by top-down expectations and correlated with both the magnitude of the CMV and the P300 amplitude at the right TPJ. These results provide novel empirical evidence for a unified sensory novelty detection system in the human brain by linking detection of salient sensory stimuli in personal and extra-personal spaces to a common framework of multilevel cortical processing.

Atypical visual and somatosensory adaptation in schizophrenia-spectrum disorders

Neurophysiological investigations in patients with schizophrenia consistently show early sensory processing deficits in the visual system. Importantly, comparable sensory deficits have also been established in healthy first-degree biological relatives of patients with schizophrenia and in first-episode drug-naive patients. The clear implication is that these measures are endophenotypic, related to the underlying genetic liability for schizophrenia. However, there is significant overlap between patient response distributions and those of healthy individuals without affected first-degree relatives. Here we sought to develop more sensitive measures of sensory dysfunction in this population, with an eye to establishing endophenotypic markers with better predictive capabilities. We used a sensory adaptation paradigm in which electrophysiological responses to basic visual and somatosensory stimuli presented at different rates (ranging from 250 to 2550 ms interstimulus intervals, in blocked presentations) were compared. Our main hypothesis was that adaptation would be substantially diminished in schizophrenia, and that this would be especially prevalent in the visual system. High-density event-related potential recordings showed amplitude reductions in sensory adaptation in patients with schizophrenia (N=15 Experiment 1, N=12 Experiment 2) compared with age-matched healthy controls (N=15 Experiment 1, N=12 Experiment 2), and this was seen for both sensory modalities. At the individual participant level, reduced adaptation was more robust for visual compared with somatosensory stimulation. These results point to significant impairments in short-term sensory plasticity across sensory modalities in schizophrenia. These simple-to-execute measures may prove valuable as candidate endophenotypes and will bear follow-up in future work.

Exploring the unknown: electrophysiological and behavioural measures of visuospatial learning

Visuospatial memory describes our ability to temporarily store and manipulate visual and spatial information and is employed for a wide variety of complex cognitive tasks. Here, a visuospatial learning task requiring fine motor control is employed to investigate visuospatial learning in a group of typically developing adults. Electrophysiological and behavioural data are collected during a target location task under two experimental conditions: Target Learning and Target Cued. Movement times (MTs) are employed as a behavioural metric of performance, while dynamic P3b amplitudes and power in the alpha band (approximately 10 Hz) are explored as electrophysiological metrics during visuospatial learning. Results demonstrate that task performance, as measured by MT, is highly correlated with P3b amplitude and alpha power at a consecutive trial level (trials 1-30). The current set of results, in conjunction with the existing literature, suggests that changes in P3b amplitude and alpha power could correspond to different aspects of the learning process. Here it is hypothesized that changes in P3b correspond to a diminishing inter-stimulus interval and reduced stimulus relevance, while the corresponding changes in alpha power represent an automation of response as habituation occurs in participants. The novel analysis presented in the current study demonstrates how gradual electrophysiological changes can be tracked during the visuospatial learning process under the current paradigm.

Neuro-oscillatory phase alignment drives speeded multisensory response times: an electro-corticographic investigation

Even simple tasks rely on information exchange between functionally distinct and often relatively distant neuronal ensembles. Considerable work indicates oscillatory synchronization through phase alignment is a major agent of inter-regional communication. In the brain, different oscillatory phases correspond to low- and high-excitability states. Optimally aligned phases (or high-excitability states) promote inter-regional communication. Studies have also shown that sensory stimulation can modulate or reset the phase of ongoing cortical oscillations. For example, auditory stimuli can reset the phase of oscillations in visual cortex, influencing processing of a simultaneous visual stimulus. Such cross-regional phase reset represents a candidate mechanism for aligning oscillatory phase for inter-regional communication. Here, we explored the role of local and inter-regional phase alignment in driving a well established behavioral correlate of multisensory integration: the redundant target effect (RTE), which refers to the fact that responses to multisensory inputs are substantially faster than to unisensory stimuli. In a speeded detection task, human epileptic patients (N = 3) responded to unisensory (auditory or visual) and multisensory (audiovisual) stimuli with a button press, while electrocorticography was recorded over auditory and motor regions. Visual stimulation significantly modulated auditory activity via phase reset in the delta and theta bands. During the period between stimulation and subsequent motor response, transient synchronization between auditory and motor regions was observed. Phase synchrony to multisensory inputs was faster than to unisensory stimulation. This sensorimotor phase alignment correlated with behavior such that stronger synchrony was associated with faster responses, linking the commonly observed RTE with phase alignment across a sensorimotor network.

Read My Lips: Brain Dynamics Associated with Audiovisual Integration and Deviance Detection

Information from different modalities is initially processed in different brain areas, yet real-world perception often requires the integration of multisensory signals into a single percept. An example is the McGurk effect, in which people viewing a speaker whose lip movements do not match the utterance perceive the spoken sounds incorrectly, hearing them as more similar to those signaled by the visual rather than the auditory input. This indicates that audiovisual integration is important for generating the phoneme percept. Here we asked when and where the audiovisual integration process occurs, providing spatial and temporal boundaries for the processes generating phoneme perception. Specifically, we wanted to separate audiovisual integration from other processes, such as simple deviance detection. Building on previous work employing ERPs, we used an oddball paradigm in which task-irrelevant audiovisually deviant stimuli were embedded in strings of non-deviant stimuli. We also recorded the event-related optical signal, an imaging method combining spatial and temporal resolution, to investigate the time course and neuroanatomical substrate of audiovisual integration. We found that audiovisual deviants elicit a short duration response in the middle/superior temporal gyrus, whereas audiovisual integration elicits a more extended response involving also inferior frontal and occipital regions. Interactions between audiovisual integration and deviance detection processes were observed in the posterior/superior temporal gyrus. These data suggest that dynamic interactions between inferior frontal cortex and sensory regions play a significant role in multimodal integration.

Predictive coding and multisensory integration: an attentional account of the multisensory mind

Multisensory integration involves a host of different cognitive processes, occurring at different stages of sensory processing. Here I argue that, despite recent insights suggesting that multisensory interactions can occur at very early latencies, the actual integration of individual sensory traces into an internally consistent mental representation is dependent on both top–down and bottom–up processes. Moreover, I argue that this integration is not limited to just sensory inputs, but that internal cognitive processes also shape the resulting mental representation. Studies showing that memory recall is affected by the initial multisensory context in which the stimuli were presented will be discussed, as well as several studies showing that mental imagery can affect multisensory illusions. This empirical evidence will be discussed from a predictive coding perspective, in which a central top–down attentional process is proposed to play a central role in coordinating the integration of all these inputs into a coherent mental representation.

Spatio-temporal dynamics of adaptation in the human visual system: a high-density electrical mapping study

When sensory inputs are presented serially, response amplitudes to stimulus repetitions generally decrease as a function of presentation rate, diminishing rapidly as inter-stimulus intervals (ISIs) fall below 1 s. This 'adaptation' is believed to represent mechanisms by which sensory systems reduce responsivity to consistent environmental inputs, freeing resources to respond to potentially more relevant inputs. While auditory adaptation functions have been relatively well characterized, considerably less is known about visual adaptation in humans. Here, high-density visual-evoked potentials (VEPs) were recorded while two paradigms were used to interrogate visual adaptation. The first presented stimulus pairs with varying ISIs, comparing VEP amplitude to the second stimulus with that of the first (paired-presentation). The second involved blocks of stimulation (N = 100) at various ISIs and comparison of VEP amplitude between blocks of differing ISIs (block-presentation). Robust VEP modulations were evident as a function of presentation rate in the block-paradigm, with strongest modulations in the 130-150 ms and 160-180 ms visual processing phases. In paired-presentations, with ISIs of just 200-300 ms, an enhancement of VEP was evident when comparing S2 with S1, with no significant effect of presentation rate. Importantly, in block-presentations, adaptation effects were statistically robust at the individual participant level. These data suggest that a more taxing block-presentation paradigm is better suited to engage visual adaptation mechanisms than a paired-presentation design. The increased sensitivity of the visual processing metric obtained in the block-paradigm has implications for the examination of visual processing deficits in clinical populations.

Electrophysiological and behavioral measures of visuo-motor learning for application in movement disorders

Dystonia is the third most common movement disorder worldwide and drastically reduces the quality of life of those who are affected. Despite its prevalence, very little is known about the underlying pathology of the disorder. Recent literature has suggested that abnormal processing in the superior colliculus (SC) may play a role in Dystonia. The SC is known to be an important hub in the neural network that is used when learning a novel movement and therefore we would postulate that a disorder of SC should result in abnormal movement learning. Here 9 participants completed learning and non-learning movement tasks while behavioural and electrophysiological data were acquired. The results of this study show that there is a significant relationship between the behavioural and electrophysiological data (R(2) = 0.19, F(1, 46) =10.88, p < 0.002) during the learning task but not in the non-learning task (p > 0.05). The developed paradigm is ideally suited for probing the underlying pathology of Dystonia via movement learning.

Somatosensory mismatch response in young and elderly adults

Aging is associated with cognitive decline and alterations in early perceptual processes. Studies in the auditory and visual sensory modalities have shown that the mismatch negativity [or the mismatch response (MMR)], an event-related potential (ERP) elicited by a deviant stimulus in a background of homogenous events, diminishes with aging and cognitive decline. However, the effects of aging on the somatosensory MMR (sMMR) are not known. In the current study, we recorded ERPs to electrical pulses to different fingers of the left hand in a passive oddball experiment in young (22–36 years) and elderly (66–95 years) adults engaged in a visual task. The MMR was found to deviants as compared to standards at two latency ranges: 180–220 ms and 250–290 ms post-stimulus onset. At 180–220 ms, within the young, the MMR was found at medial electrode sites, whereas aged did not show any amplitude difference between the stimulus types at the same latency range. At 250–290 ms, the MMR was evident with attenuated amplitude and narrowed scalp distribution among aged (Fz) compared to young (fronto-centrally and lateral parietal sites). Hence, the results reveal that the somatosensory change detection mechanism is altered in aging. The sMMR can be used as a reliable measure of age-related changes in sensory-cognitive functions.

Mapping phonemic processing zones along human perisylvian cortex: an electro-corticographic investigation

The auditory system is organized such that progressively more complex features are represented across successive cortical hierarchical stages. Just when and where the processing of phonemes, fundamental elements of the speech signal, is achieved in this hierarchy remains a matter of vigorous debate. Non-invasive measures of phonemic representation have been somewhat equivocal. While some studies point to a primary role for middle/anterior regions of the superior temporal gyrus (STG), others implicate the posterior STG. Differences in stimulation, task and inter-individual anatomical/functional variability may account for these discrepant findings. Here, we sought to clarify this issue by mapping phonemic representation across left perisylvian cortex, taking advantage of the excellent sampling density afforded by intracranial recordings in humans. We asked whether one or both major divisions of the STG were sensitive to phonemic transitions. The high signal-to-noise characteristics of direct intracranial recordings allowed for analysis at the individual participant level, circumventing issues of inter-individual anatomic and functional variability that may have obscured previous findings at the group level of analysis. The mismatch negativity (MMN), an electrophysiological response elicited by changes in repetitive streams of stimulation, served as our primary dependent measure. Oddball configurations of pairs of phonemes, spectro-temporally matched non-phonemes, and simple tones were presented. The loci of the MMN clearly differed as a function of stimulus type. Phoneme representation was most robust over middle/anterior STG/STS, but was also observed over posterior STG/SMG. These data point to multiple phonemic processing zones along perisylvian cortex, both anterior and posterior to primary auditory cortex. This finding is considered within the context of a dual stream model of auditory processing in which functionally distinct ventral and dorsal auditory processing pathways may be engaged by speech stimuli.

Mismatch negativity-like potential (MMN-like) in the subthalamic nuclei in Parkinson's disease patients

An infrequent change to an otherwise repetitive sequence of stimuli leads to the generation of mismatch negativity (MMN), even in the absence of attention. This evoked negative response occurs in the scalp-recorded electroencephalogram (EEG) over the temporal and frontal cortices, 100-250 ms after onset of the deviant stimulus. The MMN is used to detect sensory information processing. The aim of our study was to investigate whether MMN can be recorded in the subthalamic nuclei (STN) as evidence of auditory information processing on an unconscious level within this structure. To our knowledge, MMN has never been recorded in the human STN. We recorded intracerebral EEG using a MMN paradigm in five patients with Parkinson's disease (PD) who were implanted with depth electrodes in the subthalamic nuclei (STN). We found far-field MMN when intracerebral contacts were connected to an extracranial reference electrode. In all five PD patients (and nine of ten intracerebral electrodes), we also found near-field MMN-like potentials when intracerebral contacts were referenced to one another, and in some electrodes, we observed phase reversals in these potentials. The mean time-to-peak latency of the intracerebral MMN-like potentials was 214 ± 38 ms (median 219 ms). We reveal MMN-like potentials in bilateral STN. This finding provides evidence that STN receives sensory (auditory) information from other structures. The question for further research is whether STN receives such signals through a previously described hyperdirect pathway between STN and frontal cortex (a known generator of the MMN potential) and if the STN contributes to sensorimotor integration.

Audio-tactile integration and the influence of musical training

Perception of our environment is a multisensory experience; information from different sensory systems like the auditory, visual and tactile is constantly integrated. Complex tasks that require high temporal and spatial precision of multisensory integration put strong demands on the underlying networks but it is largely unknown how task experience shapes multisensory processing. Long-term musical training is an excellent model for brain plasticity because it shapes the human brain at functional and structural levels, affecting a network of brain areas. In the present study we used magnetoencephalography (MEG) to investigate how audio-tactile perception is integrated in the human brain and if musicians show enhancement of the corresponding activation compared to non-musicians. Using a paradigm that allowed the investigation of combined and separate auditory and tactile processing, we found a multisensory incongruency response, generated in frontal, cingulate and cerebellar regions, an auditory mismatch response generated mainly in the auditory cortex and a tactile mismatch response generated in frontal and cerebellar regions. The influence of musical training was seen in the audio-tactile as well as in the auditory condition, indicating enhanced higher-order processing in musicians, while the sources of the tactile MMN were not influenced by long-term musical training. Consistent with the predictive coding model, more basic, bottom-up sensory processing was relatively stable and less affected by expertise, whereas areas for top-down models of multisensory expectancies were modulated by training.

Bi-directional modulation of somatosensory mismatch negativity with transcranial direct current stimulation: an event related potential study

Appropriate orientation towards potentially salient novel environmental stimuli requires a system capable of detecting change in the sensorium. Mismatch negativity (MMN), an evoked potential calculated by subtracting the response to a standard repeated stimulus and a rare 'oddball' stimulus, is proposed as such a change detection mechanism. It is most widely studied in the auditory domain, but here we chose to explore the mechanism of somatosensory MMN, and specifically its dependence on the cerebellum. We recorded event-related potentials (ERPs) evoked in response to auditory and sensory stimuli from 10 healthy subjects before and after anodal, cathodal and sham transcranial direct current stimulation (tDCS) of the right cerebellar hemisphere. There was a significant increase in peak amplitude of somatosensory MMN after anodal tDCS (F(1,9) = 8.98, P < 0.02, mean difference anodal pre-post: -1.02 μV) and a significant reduction in peak amplitude of somatosensory MMN after cathodal tDCS (F(1,9) = 7.15, P < 0.03, mean difference cathodal pre-post: 0.65 μV). The amplitude of auditory MMN was unchanged by tDCS. These results reveal the capability of tDCS to cause bidirectional modulation of somatosensory MMN and the dependence of somatosensory MMN on the cerebellum.

The development of multisensory integration in high-functioning autism: high-density electrical mapping and psychophysical measures reveal impairments in the processing of audiovisual inputs

Successful integration of auditory and visual inputs is crucial for both basic perceptual functions and for higher-order processes related to social cognition. Autism spectrum disorders (ASD) are characterized by impairments in social cognition and are associated with abnormalities in sensory and perceptual processes. Several groups have reported that individuals with ASD are impaired in their ability to integrate socially relevant audiovisual (AV) information, and it has been suggested that this contributes to the higher-order social and cognitive deficits observed in ASD. However, successful integration of auditory and visual inputs also influences detection and perception of nonsocial stimuli, and integration deficits may impair earlier stages of information processing, with cascading downstream effects. To assess the integrity of basic AV integration, we recorded high-density electrophysiology from a cohort of high-functioning children with ASD (7-16 years) while they performed a simple AV reaction time task. Children with ASD showed considerably less behavioral facilitation to multisensory inputs, deficits that were paralleled by less effective neural integration. Evidence for processing differences relative to typically developing children was seen as early as 100 ms poststimulation, and topographic analysis suggested that children with ASD relied on different cortical networks during this early multisensory processing stage.

Auditory-driven phase reset in visual cortex: human electrocorticography reveals mechanisms of early multisensory integration

Findings in animal models demonstrate that activity within hierarchically early sensory cortical regions can be modulated by cross-sensory inputs through resetting of the phase of ongoing intrinsic neural oscillations. Here, subdural recordings evaluated whether phase resetting by auditory inputs would impact multisensory integration processes in human visual cortex. Results clearly showed auditory-driven phase reset in visual cortices and, in some cases, frank auditory event-related potentials (ERP) were also observed over these regions. Further, when audiovisual bisensory stimuli were presented, this led to robust multisensory integration effects which were observed in both the ERP and in measures of phase concentration. These results extend findings from animal models to human visual cortices, and highlight the impact of cross-sensory phase resetting by a non-primary stimulus on multisensory integration in ostensibly unisensory cortices.

Multisensory representation of frequency across audition and touch: high density electrical mapping reveals early sensory-perceptual coupling

The frequency of environmental vibrations is sampled by two of the major sensory systems, audition and touch, notwithstanding that these signals are transduced through very different physical media and entirely separate sensory epithelia. Psychophysical studies have shown that manipulating frequency in audition or touch can have a significant cross-sensory impact on perceived frequency in the other sensory system, pointing to intimate links between these senses during computation of frequency. In this regard, the frequency of a vibratory event can be thought of as a multisensory perceptual construct. In turn, electrophysiological studies point to temporally early multisensory interactions that occur in hierarchically early sensory regions where convergent inputs from the auditory and somatosensory systems are to be found. A key question pertains to the level of processing at which the multisensory integration of featural information, such as frequency, occurs. Do the sensory systems calculate frequency independently before this information is combined, or is this feature calculated in an integrated fashion during preattentive sensory processing? The well characterized mismatch negativity, an electrophysiological response that indexes preattentive detection of a change within the context of a regular pattern of stimulation, served as our dependent measure. High-density electrophysiological recordings were made in humans while they were presented with separate blocks of somatosensory, auditory, and audio-somatosensory "standards" and "deviants," where the deviant differed in frequency. Multisensory effects were identified beginning at ∼200 ms, with the multisensory mismatch negativity (MMN) significantly different from the sum of the unisensory MMNs. This provides compelling evidence for preattentive coupling between the somatosensory and auditory channels in the cortical representation of frequency.