Distinct patterns of local oscillatory activity and functional connectivity underlie intersensory attention and temporal prediction

Characterizing endogenous delta oscillations in human MEG

Rhythmic activity in the delta frequency range (0.5-3 Hz) is a prominent feature of brain dynamics. Here, we examined whether spontaneous delta oscillations, as found in invasive recordings in awake animals, can be observed in non-invasive recordings performed in humans with magnetoencephalography (MEG). In humans, delta activity is commonly reported when processing rhythmic sensory inputs, with direct relationships to behaviour. However, rhythmic brain dynamics observed during rhythmic sensory stimulation cannot be interpreted as an endogenous oscillation. To test for endogenous delta oscillations we analysed human MEG data during rest. For comparison, we additionally analysed two conditions in which participants engaged in spontaneous finger tapping and silent counting, arguing that internally rhythmic behaviours could incite an otherwise silent neural oscillator. A novel set of analysis steps allowed us to show narrow spectral peaks in the delta frequency range in rest, and during overt and covert rhythmic activity. Additional analyses in the time domain revealed that only the resting state condition warranted an interpretation of these peaks as endogenously periodic neural dynamics. In sum, this work shows that using advanced signal processing techniques, it is possible to observe endogenous delta oscillations in non-invasive recordings of human brain dynamics.

Temporal prediction changes motor-related EEG phase synchronization and network centrality in alpha and beta band

Much neurophysiological evidence revealed motor system is involved in temporal prediction. However, It remains unknown how temporal prediction influences motor-related neural representations. Thus, more neural evidence is needed to understand better how temporal prediction influences the motor. This study designed a rhythmic finger-tap task and formed three temporal prediction conditions, i.e., 1000ms temporal prediction, 1500ms temporal prediction, and no temporal prediction. Behavioral and EEG data from 24 healthy subjects were recorded. The weighted phase lag index was calculated to measure the degree of phase synchronization. Eigenvector centrality and betweenness centrality were used to measure brain connectivity. Behavioral results showed that tap-visual asynchronies were decreased when temporal prediction existed. Phase synchronization results showed, compared to no temporal prediction, the alpha-band phase synchronization between the frontal and central area was reduced in 1000ms temporal prediction, and the beta-band phase synchronization between the frontal and parietal area was decreased in 1500ms temporal prediction. As to the brain connectivity, compared to no temporal prediction condition, the eigenvector centrality of the left frontal in 1500ms temporal prediction was decreased in the alpha band, and the betweenness centrality of the right temporal in 1000ms temporal prediction was reduced in the alpha-band. These results can provide new neural evidence for a better understanding of temporal prediction and motor interactions.

Increases in sensory noise predict attentional disruptions to audiovisual speech perception

We receive information about the world around us from multiple senses which combine in a process known as multisensory integration. Multisensory integration has been shown to be dependent on attention; however, the neural mechanisms underlying this effect are poorly understood. The current study investigates whether changes in sensory noise explain the effect of attention on multisensory integration and whether attentional modulations to multisensory integration occur via modality-specific mechanisms. A task based on the McGurk Illusion was used to measure multisensory integration while attention was manipulated via a concurrent auditory or visual task. Sensory noise was measured within modality based on variability in unisensory performance and was used to predict attentional changes to McGurk perception. Consistent with previous studies, reports of the McGurk illusion decreased when accompanied with a secondary task; however, this effect was stronger for the secondary visual (as opposed to auditory) task. While auditory noise was not influenced by either secondary task, visual noise increased with the addition of the secondary visual task specifically. Interestingly, visual noise accounted for significant variability in attentional disruptions to the McGurk illusion. Overall, these results strongly suggest that sensory noise may underlie attentional alterations to multisensory integration in a modality-specific manner. Future studies are needed to determine whether this finding generalizes to other types of multisensory integration and attentional manipulations. This line of research may inform future studies of attentional alterations to sensory processing in neurological disorders, such as Schizophrenia, Autism, and ADHD.

Flexible adjustment of anticipations in human outcome processing

To sense whether thoughts refer to current reality or not, a capacity called orbitofrontal reality filtering, depends on an orbitofrontal signal when anticipated outcomes fail to occur. Here, we explored the flexibility and precision of outcome processing in a deterministic reversal learning task. Healthy subjects decided which one of two colored squares hid a target stimulus. Brain activity was measured with high-density electroencephalography. Stimuli resembling, but not identical with, the target stimuli were initially processed like different stimuli from 210 to 250 ms, irrespective of behavioral relevance. From 250 ms on, they were processed according to behavioral relevance: If they required a subsequent switch, they were processed like different stimuli; if they had been declared potential targets, they were treated like true targets. Stimuli requiring a behavioral switch induced strong theta activity in orbitofrontal, ventromedial, and medial temporal regions. The study indicates flexible adaptation of anticipations but precise processing of outcomes, mainly determined by behavioral relevance.

The Spatiotemporal Neural Dynamics of Intersensory Attention Capture of Salient Stimuli: A Large-Scale Auditory-Visual Modeling Study

The spatiotemporal dynamics of the neural mechanisms underlying endogenous (top-down) and exogenous (bottom-up) attention, and how attention is controlled or allocated in intersensory perception are not fully understood. We investigated these issues using a biologically realistic large-scale neural network model of visual-auditory object processing of short-term memory. We modeled and incorporated into our visual-auditory object-processing model the temporally changing neuronal mechanisms for the control of endogenous and exogenous attention. The model successfully performed various bimodal working memory tasks, and produced simulated behavioral and neural results that are consistent with experimental findings. Simulated fMRI data were generated that constitute predictions that human experiments could test. Furthermore, in our visual-auditory bimodality simulations, we found that increased working memory load in one modality would reduce the distraction from the other modality, and a possible network mediating this effect is proposed based on our model.

General principles of brain electromagnetic rhythmic oscillations and implications for neuroplasticity

Neuro-plasticity describes the ability of the brain in achieving novel functions, either by transforming its internal connectivity, or by changing the elements of which it is made, meaning that, only those changes, that affect both structural and functional aspects of the system, can be defined as "plastic." The concept of plasticity can be applied to molecular as well as to environmental events that can be recognized as the basic mechanism by which our brain reacts to the internal and external stimuli. When considering brain plasticity within a clinical context-that is the process linked with changes of brain functions following a lesion- the term "reorganization" is somewhat synonymous, referring to the specific types of structural/functional modifications observed as axonal sprouting, long-term synaptic potentiation/inhibition or to the plasticity related genomic responses. Furthermore, brain rewires during maturation, and aging thus maintaining a remarkable learning capacity, allowing it to acquire a wide range of skills, from motor actions to complex abstract reasoning, in a lifelong expression. In this review, the contribution on the "neuroplasticity" topic coming from advanced analysis of EEG rhythms is put forward.

Rhythmic Modulation of Visual Perception by Continuous Rhythmic Auditory Stimulation

At any given moment our sensory systems receive multiple, often rhythmic, inputs from the environment. Processing of temporally structured events in one sensory modality can guide both behavioral and neural processing of events in other sensory modalities, but whether this occurs remains unclear. Here, we used human electroencephalography (EEG) to test the cross-modal influences of a continuous auditory frequency-modulated (FM) sound on visual perception and visual cortical activity. We report systematic fluctuations in perceptual discrimination of brief visual stimuli in line with the phase of the FM-sound. We further show that this rhythmic modulation in visual perception is related to an accompanying rhythmic modulation of neural activity recorded over visual areas. Importantly, in our task, perceptual and neural visual modulations occurred without any abrupt and salient onsets in the energy of the auditory stimulation and without any rhythmic structure in the visual stimulus. As such, the results provide a critical validation for the existence and functional role of cross-modal entrainment and demonstrates its utility for organizing the perception of multisensory stimulation in the natural environment.SIGNIFICANCE STATEMENT Our sensory environment is filled with rhythmic structures that are often multi-sensory in nature. Here, we show that the alignment of neural activity to the phase of an auditory frequency-modulated (FM) sound has cross-modal consequences for vision: yielding systematic fluctuations in perceptual discrimination of brief visual stimuli that are mediated by accompanying rhythmic modulation of neural activity recorded over visual areas. These cross-modal effects on visual neural activity and perception occurred without any abrupt and salient onsets in the energy of the auditory stimulation and without any rhythmic structure in the visual stimulus. The current work shows that continuous auditory fluctuations in the natural environment can provide a pacing signal for neural activity and perception across the senses.

Ocular Dominance and Functional Asymmetry in Visual Attention Networks

Purpose

The dorsal attention network (DAN) and the ventral attention network (VAN) are known to support visual attention, but the influences of ocular dominance on the attention networks are unclear. We aimed to explore how visual cortical asymmetry of the attention networks correlate with neurophysiological oscillation and connectivity markers of attentional processes.

Methods

An oddball task with concentric circle stimuli of three different sizes (i.e., spot size of 5°, 20°, or 30° of visual angle) was used to vary task difficulty. Event-related oscillations and interareal communication were tested with an electroencephalogram-based visual evoked components as a function of ocular dominance in 30 healthy subjects.

Results

Accuracy rates were higher in the dominant eyes compared with the nondominant eyes. Compared with the nondominant eyes, the dominant eyes had higher theta, low-alpha, and low-beta powers and lower high-alpha powers within the nodes of VAN and DAN. Furthermore, visual information processed by the dominant and nondominant eye had different fates, that is, the dominant eyes mainly relied on theta and low-alpha connectivity within both the VAN and the DAN, whereas the nondominant eyes mainly relied on theta connectivity within the VAN and high-alpha connectivity within the DAN. The difference in accuracy rate between the two eyes was correlated with the low-alpha oscillations in the anterior DAN area and low-alpha connectivity of the left DAN.

Conclusions

The ocular dominance processing and interareal communication reveal a cortical asymmetry underlying attention, and this reflects a two-way modulatory mechanism within attention networks in the human brain.

Differential attention-dependent adjustment of frequency, power and phase in primary sensory and frontoparietal areas

Continuously prioritizing behaviourally relevant information from the environment for improved stimulus processing is a crucial function of attention. In the current MEG study, we investigated how ongoing oscillatory activity of both sensory and non-sensory brain regions are differentially impacted by attentional focus. Low-frequency phase alignment of neural activity in primary sensory areas, with respect to attended/ignored features has been suggested to support top-down prioritization. However, phase adjustment in frontoparietal regions has not been widely studied, despite general implication of these in top-down selection of information. To investigate this, we let participants perform an established intermodal selective attention task, where low-frequency auditory (1.6 Hz) and visual (1.8 Hz) stimuli were presented simultaneously. We instructed them to either attend to the auditory or to the visual stimuli and to detect targets while ignoring the other stimulus stream. As expected, the strongest phase adjustment was observed in primary sensory regions for auditory and for visual stimulation, independent of attentional focus. We found greater differences in phase locking between attended and ignored stimulation for the visual modality. Interestingly, auditory temporal regions show small but significant attention-dependent neural entrainment even for visual stimulation. Extending findings from invasive recordings in non-human primates, we demonstrate an effect of attentional focus on the phase of the entrained oscillations in auditory and visual cortex which may be driven by phase locked increases of induced power. While sensory areas adjusted the phase of the respective stimulation frequencies, attentional focus adjusted the peak frequencies in nonsensory areas. Spatially these areas show a striking overlap with core regions of the dorsal attention network and the frontoparietal network. This suggests that these areas prioritize the attended modality by optimally exploiting the temporal structure of stimulation. Overall, our study complements and extends previous work by showing a differential effect of attentional focus on entrained oscillations (or phase adjustment) in primary sensory areas and frontoparietal areas.

Mediofrontal theta-band oscillations reflect top-down influence in the ventriloquist illusion

In the ventriloquist illusion, spatially disparate visual signals can influence the perceived location of simultaneous sounds. Previous studies have shown asymmetrical responses in auditory cortical regions following perceived peripheral sound shifts. Moreover, higher-order cortical areas perform inferences on the sources of disparate audiovisual signals. Recent studies have also highlighted top-down influence in the ventriloquist illusion and postulated a governing function of neural oscillations for crossmodal processing. In this EEG study, we analyzed source-reconstructed neural oscillations to address the question of whether perceived sound shifts affect the laterality of auditory responses. Moreover, we investigated the modulation of neural oscillations related to the occurrence of the illusion more generally. With respect to the first question, we did not find evidence for significant changes in the laterality of auditory responses due to perceived sound shifts. However, we found a sustained reduction of mediofrontal theta-band power starting prior to stimulus onset when participants perceived the illusion compared to when they did not perceive the illusion. We suggest that this effect reflects a state of diminished cognitive control, leading to reliance on more readily discriminable visual information and increased crossmodal influence. We conclude that mediofrontal theta-band oscillations serve as a neural mechanism underlying top-down modulation of crossmodal processing in the ventriloquist illusion.

Orienting auditory attention in time: Lateralized alpha power reflects spatio-temporal filtering

The deployment of neural alpha (8–12 Hz) lateralization in service of spatial attention is well-established: Alpha power increases in the cortical hemisphere ipsilateral to the attended hemifield, and decreases in the contralateral hemisphere, respectively. Much less is known about humans’ ability to deploy such alpha lateralization in time, and to thus exploit alpha power as a spatio-temporal filter. Here we show that spatially lateralized alpha power does signify – beyond the direction of spatial attention – the distribution of attention in time and thereby qualifies as a spatio-temporal attentional filter. Participants (N = 20) selectively listened to spoken numbers presented on one side (left vs right), while competing numbers were presented on the other side. Key to our hypothesis, temporal foreknowledge was manipulated via a visual cue, which was either instructive and indicated the to-be-probed number position (70% valid) or neutral. Temporal foreknowledge did guide participants’ attention, as they recognized numbers from the to-be-attended side more accurately following valid cues. In the magnetoencephalogram (MEG), spatial attention to the left versus right side induced lateralization of alpha power in all temporal cueing conditions. Modulation of alpha lateralization at the 0.8 Hz presentation rate of spoken numbers was stronger following instructive compared to neutral temporal cues. Critically, we found stronger modulation of lateralized alpha power specifically at the onsets of temporally cued numbers. These results suggest that the precisely timed hemispheric lateralization of alpha power qualifies as a spatio-temporal attentional filter mechanism susceptible to top-down behavioural goals.

Visual aperiodic temporal prediction increases perceptual sensitivity and reduces response latencies

As a predictive organ, the brain can predict upcoming events to guide perception and action in the process of adaptive behavior. The classical models of oscillatory entrainment explain the facilitating effects that occur after periodic stimulation in behavior but cannot explain aperiodic facilitating effects. In the present study, by comparing the behavior performance of participants in periodic predictable (PP), aperiodic predictable (AP) and aperiodic unpredictable (AU) stimulus streams, we investigated the effect of an aperiodic predictable stream on the perceptual sensitivity and response latencies in the visual modality. The results showed that there was no difference between PP and AP conditions in sensitivity (d') and reaction times (RTs), both of which were significantly different from those in the AU condition. Moreover, a significant correlation between d' and RTs was observed when predictability existed. These results indicate that the aperiodic predictable stimulus streams increases perceptual sensitivity and reduces response latencies in a top-down manner. Individuals proactively and flexibly predict upcoming events based on the temporal structure of visual stimuli in the service of adaptive behavior.

Synchronisation of Neural Oscillations and Cross-modal Influences

At any given moment, we receive multiple signals from our different senses. Prior research has shown that signals in one sensory modality can influence neural activity and behavioural performance associated with another sensory modality. Recent human and nonhuman primate studies suggest that such cross-modal influences in sensory cortices are mediated by the synchronisation of ongoing neural oscillations. In this review, we consider two mechanisms proposed to facilitate cross-modal influences on sensory processing, namely cross-modal phase resetting and neural entrainment. We consider how top-down processes may further influence cross-modal processing in a flexible manner, and we highlight fruitful directions for further research.

Principles of tactile search over the body

Although we routinely experience complex tactile patterns over our entire body, how we selectively experience multisite touch over our bodies remains poorly understood. Here, we characterized tactile search behavior over the full body using a tactile analog of the classic visual search task. On each trial, participants judged whether a target stimulus (e.g., 10-Hz vibration) was present or absent anywhere on the body. When present, the target stimulus could occur alone or simultaneously with distractor stimuli (e.g., 30-Hz vibrations) on other body locations. We systematically varied the number and spatial configurations of the distractors as well as the target and distractor frequencies and measured the impact of these factors on tactile search response times. First, we found that response times were faster on target-present trials compared with target-absent trials. Second, response times increased with the number of stimulated sites, suggesting a serial search process. Third, search performance differed depending on stimulus frequencies. This frequency-dependent behavior may be related to perceptual grouping effects based on timing cues. We constructed linear models to explore how the locations of the target and distractor cues influenced tactile search behavior. Our modeling results reveal that, in isolation, cues on the index fingers make relatively greater contributions to search performance compared with stimulation experienced on other body sites. Additionally, costimulation of sites within the same limb or simply on the same body side preferentially influence search behavior. Our collective findings identify some principles of attentional search that are common to vision and touch, but others that highlight key differences that may be unique to body-based spatial perception.NEW & NOTEWORTHY Little is known about how we selectively experience multisite touch patterns over the body. Using a tactile analog of the classic visual target search paradigm, we show that tactile search behavior for flutter cues is generally consistent with a serial search process. Modeling results reveal the preferential contributions of index finger stimulation and two-site stimulus interactions involving ipsilateral patterns and within-limb patterns. Our results offer initial evidence for spatial and temporal principles underlying tactile search behavior over the body.

Probability-driven and stimulus-driven orienting of attention to time and sensory modality

The timing and the sensory modality of behaviorally relevant events often vary predictably, so that it is beneficial to adapt the sensory system to their statistical regularities. Indeed, statistical information about target timing and/or sensory modality modulates behavioral responses-called expectation effects. Responses are also facilitated by short-term repetitions of target timing and/or sensory modality-called priming effects. We examined how the expectation and priming effects on target timing (short vs. long cue-to-target interval) and target modality (auditory vs. visual) interacted. Temporal expectation was manipulated across blocks, while modality expectation was manipulated across participants. Responses were faster when targets were presented at the expected timing and/or in the expected modality in an additive manner, suggesting that temporal and modality expectation operate relatively independently. Similarly, responses were faster when the timing and/or modality of targets was repeated across trials in an additive manner, suggesting that temporal and modality priming operate relatively independently. Importantly, the interactions between expectation and priming were domain specific. In the temporal domain, temporal-expectation effects were observed only when temporal-priming effects were absent. In the modality domain, modality-priming effects predominated for auditory targets whereas modality-expectation effects predominated for visual targets. Thus, the interactions between probability-driven expectation and stimulus-driven priming processes appear to be controlled separately for the mechanisms that direct attention to specific temporal intervals and for the mechanisms that direct attention to specific sensory modalities. These results may suggest that the sensory system concurrently optimizes attentional priorities within temporal and sensory-modality domains.

Oscillatory Properties of Functional Connections Between Sensory Areas Mediate Cross-Modal Illusory Perception

The presentation of simple auditory stimuli can significantly impact visual processing and even induce visual illusions, such as the auditory-induced double flash illusion (DFI). These cross-modal processes have been shown to be driven by occipital oscillatory activity within the alpha band. Whether this phenomenon is network specific or can be generalized to other sensory interactions remains unknown. The aim of the current study was to test whether cross-modal interactions between somatosensory-to-visual areas leading to the same (but tactile-induced) DFI share similar properties with the auditory DFI. We hypothesized that if the effects are mediated by the oscillatory properties of early visual areas per se, then the two versions of the illusion should be subtended by the same neurophysiological mechanism (i.e., the speed of the alpha frequency). Alternatively, if the oscillatory activity in visual areas predicting this phenomenon is dependent on the specific neural network involved, then it should reflect network-specific oscillatory properties. In line with the latter, results recorded in humans (both sexes) show a network-specific oscillatory profile linking the auditory DFI to occipital alpha oscillations, replicating previous findings, and tactile DFI to occipital beta oscillations, a rhythm typical of somatosensory processes. These frequency-specific effects are observed for visual (but not auditory or somatosensory) areas and account for auditory-visual connectivity in the alpha band and somatosensory-visual connectivity in the beta band. We conclude that task-dependent visual oscillations reflect network-specific oscillatory properties favoring optimal directional neural communication timing for sensory binding.SIGNIFICANCE STATEMENT We investigated the oscillatory correlates of the auditory- and tactile-induced double flash illusion (DFI), a phenomenon where two interleaved beeps (taps) set within 100 ms apart and paired with one visual flash induce the sensation of a second illusory flash. Results confirm previous evidence that the speed of individual occipital alpha oscillations predict the temporal window of the auditory-induced illusion. Importantly, they provide novel evidence that the tactile-induced DFI is instead mediated by the speed of individual occipital beta oscillations. These task-dependent occipital oscillations are shown to be mediated by the oscillatory properties of the neural network engaged in the task to favor optimal temporal integration between the senses.

Neural Oscillations Orchestrate Multisensory Processing

At any given moment, we receive input through our different sensory systems, and this information needs to be processed and integrated. Multisensory processing requires the coordinated activity of distinct cortical areas. Key mechanisms implicated in these processes include local neural oscillations and functional connectivity between distant cortical areas. Evidence is now emerging that neural oscillations in distinct frequency bands reflect different mechanisms of multisensory processing. Moreover, studies suggest that aberrant neural oscillations contribute to multisensory processing deficits in clinical populations, such as schizophrenia. In this article, we review recent literature on the neural mechanisms underlying multisensory processing, focusing on neural oscillations. We derive a framework that summarizes findings on (1) stimulus-driven multisensory processing, (2) the influence of top-down information on multisensory processing, and (3) the role of predictions for the formation of multisensory perception. We propose that different frequency band oscillations subserve complementary mechanisms of multisensory processing. These processes can act in parallel and are essential for multisensory processing.

Dynamic low frequency EEG phase synchronization patterns during proactive control of task switching

Cognitive flexibility is critical for humans living in complex societies with ever-growing multitasking demands. Yet the low-frequency neural dynamics of distinct task-specific and domain-general mechanisms sub-serving mental flexibility are still ill-defined. Here we estimated phase electroencephalogram synchronization by using inter-trial phase coherence (ITPC) at the source space while twenty six young participants were intermittently cued to switch or repeat their perceptual categorization rule of Gabor gratings varying in color and thickness (switch task). Therefore, the aim of this study was to examine whether a proactive control is associated with connectivity only in the frontoparietal theta network, or also involves distinct neural connectivity within the delta band, as distinct neural signatures while preparing to switch or repeat a task set, respectively. To this end, we focused the analysis on late-latencies (from 500 to 800 msec post-cue onset), since they are known to be associated with top-down cognitive control processes. We confirmed that proactive control during a task switch was associated with frontoparietal theta connectivity. But importantly, we also found a distinct role of delta band oscillatory synchronization in proactive control, engaging more posterior frontotemporal regions as opposed to frontoparietal theta connectivity. Additionally, we built a regression model by using the ITPC results in delta and theta bands as predictors, and the behavioral accuracy in the switch task as the criterion, obtaining significant results for both frequency bands. All these findings support the existence of distinct proactive cognitive control processes related to functionally distinct though highly complementary theta and delta frontoparietal and temporoparietal oscillatory networks at late-latency temporal scales.

Neural practice effect during cross-modal selective attention: Supra-modal and modality-specific effects

Practice and experiences gradually shape the central nervous system, from the synaptic level to large-scale neural networks. In natural multisensory environment, even when inundated by streams of information from multiple sensory modalities, our brain does not give equal weight to different modalities. Rather, visual information more frequently receives preferential processing and eventually dominates consciousness and behavior, i.e., visual dominance. It remains unknown, however, the supra-modal and modality-specific practice effect during cross-modal selective attention, and moreover whether the practice effect shows similar modality preferences as the visual dominance effect in the multisensory environment. To answer the above two questions, we adopted a cross-modal selective attention paradigm in conjunction with the hybrid fMRI design. Behaviorally, visual performance significantly improved while auditory performance remained constant with practice, indicating that visual attention more flexibly adapted behavior with practice than auditory attention. At the neural level, the practice effect was associated with decreasing neural activity in the frontoparietal executive network and increasing activity in the default mode network, which occurred independently of the modality attended, i.e., the supra-modal mechanisms. On the other hand, functional decoupling between the auditory and the visual system was observed with the progress of practice, which varied as a function of the modality attended. The auditory system was functionally decoupled with both the dorsal and ventral visual stream during auditory attention while was decoupled only with the ventral visual stream during visual attention. To efficiently suppress the irrelevant visual information with practice, auditory attention needs to additionally decouple the auditory system from the dorsal visual stream. The modality-specific mechanisms, together with the behavioral effect, thus support the visual dominance model in terms of the practice effect during cross-modal selective attention.

Tracking Neuronal Connectivity from Electric Brain Signals to Predict Performance

The human brain is a complex container of interconnected networks. Network neuroscience is a recent venture aiming to explore the connection matrix built from the human brain or human “Connectome.” Network-based algorithms provide parameters that define global organization of the brain; when they are applied to electroencephalographic (EEG) signals network, configuration and excitability can be monitored in millisecond time frames, providing remarkable information on their instantaneous efficacy also for a given task’s performance via online evaluation of the underlying instantaneous networks before, during, and after the task. Here we provide an updated summary on the connectome analysis for the prediction of performance via the study of task-related dynamics of brain network organization from EEG signals.

Cross-modal decoupling in temporal attention between audition and touch

Temporal orienting leads to well-documented behavioural benefits for sensory events occurring at the anticipated moment. However, the consequences of temporal orienting in cross-modal contexts are still unclear. On the one hand, some studies using audio-tactile paradigms suggest that attentional orienting in time and modality are a closely coupled system, in which temporal orienting dominates modality orienting, similar to what happens in cross-modal spatial attention. On the other hand, recent findings using a visuo-tactile paradigm suggest that attentional orienting in time can unfold independently in each modality, leading to cross-modal decoupling. In the present study, we investigated if cross-modal decoupling in time can be extrapolated to audio-tactile contexts. If so, decoupling might represent a general property of cross-modal attention in time. To this end, we used a speeded discrimination task in which we manipulated the probability of target presentation in time and modality. In each trial, a manipulation of time-based expectancy was used to guide participants' attention to task-relevant events, either tactile or auditory, at different points in time. In two experiments, we found that participants generally showed enhanced behavioural performance at the most likely onset time of each modality and no evidence for coupling. This pattern supports the hypothesis that cross-modal decoupling could be a general phenomenon in temporal orienting.

Oscillatory dynamics in the dorsal and ventral attention networks during the reorienting of attention

The ability to reorient attention within the visual field is central to daily functioning, and numerous fMRI studies have shown that the dorsal and ventral attention networks (DAN, VAN) are critical to such processes. However, despite the instantaneous nature of attentional shifts, the dynamics of oscillatory activity serving attentional reorientation remain poorly characterized. In this study, we utilized magnetoencephalography (MEG) and a Posner task to probe the dynamics of attentional reorienting in 29 healthy adults. MEG data were transformed into the time-frequency domain and significant oscillatory responses were imaged using a beamformer. Voxel time series were then extracted from peak voxels in the functional beamformer images. These time series were used to quantify the dynamics of attentional reorienting, and to compute dynamic functional connectivity. Our results indicated strong increases in theta and decreases in alpha and beta activity across many nodes in the DAN and VAN. Interestingly, theta responses were generally stronger during trials that required attentional reorienting relative to those that did not, while alpha and beta oscillations were more dynamic, with many regions exhibiting significantly stronger responses during non-reorienting trials initially, and the opposite pattern during later processing. Finally, stronger functional connectivity was found following target presentation (575-700 ms) between bilateral superior parietal lobules during attentional reorienting. In sum, these data show that visual attention is served by multiple cortical regions within the DAN and VAN, and that attentional reorienting processes are often associated with spectrally-specific oscillations that have largely distinct spatiotemporal dynamics.

On the effects of multimodal information integration in multitasking

There have recently been considerable advances in our understanding of the neuronal mechanisms underlying multitasking, but the role of multimodal integration for this faculty has remained rather unclear. We examined this issue by comparing different modality combinations in a multitasking (stop-change) paradigm. In-depth neurophysiological analyses of event-related potentials (ERPs) were conducted to complement the obtained behavioral data. Specifically, we applied signal decomposition using second order blind identification (SOBI) to the multi-subject ERP data and source localization. We found that both general multimodal information integration and modality-specific aspects (potentially related to task difficulty) modulate behavioral performance and associated neurophysiological correlates. Simultaneous multimodal input generally increased early attentional processing of visual stimuli (i.e. P1 and N1 amplitudes) as well as measures of cognitive effort and conflict (i.e. central P3 amplitudes). Yet, tactile-visual input caused larger impairments in multitasking than audio-visual input. General aspects of multimodal information integration modulated the activity in the premotor cortex (BA 6) as well as different visual association areas concerned with the integration of visual information with input from other modalities (BA 19, BA 21, BA 37). On top of this, differences in the specific combination of modalities also affected performance and measures of conflict/effort originating in prefrontal regions (BA 6).

The impact of visual gaze direction on auditory object tracking

Subjective experience suggests that we are able to direct our auditory attention independent of our visual gaze, e.g when shadowing a nearby conversation at a cocktail party. But what are the consequences at the behavioural and neural level? While numerous studies have investigated both auditory attention and visual gaze independently, little is known about their interaction during selective listening. In the present EEG study, we manipulated visual gaze independently of auditory attention while participants detected targets presented from one of three loudspeakers. We observed increased response times when gaze was directed away from the locus of auditory attention. Further, we found an increase in occipital alpha-band power contralateral to the direction of gaze, indicative of a suppression of distracting input. Finally, this condition also led to stronger central theta-band power, which correlated with the observed effect in response times, indicative of differences in top-down processing. Our data suggest that a misalignment between gaze and auditory attention both reduce behavioural performance and modulate underlying neural processes. The involvement of central theta-band and occipital alpha-band effects are in line with compensatory neural mechanisms such as increased cognitive control and the suppression of task irrelevant inputs.

Visual Distractors Disrupt Audiovisual Integration Regardless of Stimulus Complexity

The intricate relationship between multisensory integration and attention has been extensively researched in the multisensory field; however, the necessity of attention for the binding of multisensory stimuli remains contested. In the current study, we investigated whether diverting attention from well-known multisensory tasks would disrupt integration and whether the complexity of the stimulus and task modulated this interaction. A secondary objective of this study was to investigate individual differences in the interaction of attention and multisensory integration. Participants completed a simple audiovisual speeded detection task and McGurk task under various perceptual load conditions: no load (multisensory task while visual distractors present), low load (multisensory task while detecting the presence of a yellow letter in the visual distractors), and high load (multisensory task while detecting the presence of a number in the visual distractors). Consistent with prior studies, we found that increased perceptual load led to decreased reports of the McGurk illusion, thus confirming the necessity of attention for the integration of speech stimuli. Although increased perceptual load led to longer response times for all stimuli in the speeded detection task, participants responded faster on multisensory trials than unisensory trials. However, the increase in multisensory response times violated the race model for no and low perceptual load conditions only. Additionally, a geometric measure of Miller’s inequality showed a decrease in multisensory integration for the speeded detection task with increasing perceptual load. Surprisingly, we found diverging changes in multisensory integration with increasing load for participants who did not show integration for the no load condition: no changes in integration for the McGurk task with increasing load but increases in integration for the detection task. The results of this study indicate that attention plays a crucial role in multisensory integration for both highly complex and simple multisensory tasks and that attention may interact differently with multisensory processing in individuals who do not strongly integrate multisensory information.

Vibrotactile Discrimination Training Affects Brain Connectivity in Profoundly Deaf Individuals

Early auditory deprivation has serious neurodevelopmental and cognitive repercussions largely derived from impoverished and delayed language acquisition. These conditions may be associated with early changes in brain connectivity. Vibrotactile stimulation is a sensory substitution method that allows perception and discrimination of sound, and even speech. To clarify the efficacy of this approach, a vibrotactile oddball task with 700 and 900 Hz pure-tones as stimuli [counterbalanced as target (T: 20% of the total) and non-target (NT: 80%)] with simultaneous EEG recording was performed by 14 profoundly deaf and 14 normal-hearing (NH) subjects, before and after a short training period (five 1-h sessions; in 2.5–3 weeks). A small device worn on the right index finger delivered sound-wave stimuli. The training included discrimination of pure tone frequency and duration, and more complex natural sounds. A significant P300 amplitude increase and behavioral improvement was observed in both deaf and normal subjects, with no between group differences. However, a P3 with larger scalp distribution over parietal cortical areas and lateralized to the right was observed in the profoundly deaf. A graph theory analysis showed that brief training significantly increased fronto-central brain connectivity in deaf subjects, but not in NH subjects. Together, ERP tools and graph methods depicted the different functional brain dynamic in deaf and NH individuals, underlying the temporary engagement of the cognitive resources demanded by the task. Our findings showed that the index-fingertip somatosensory mechanoreceptors can discriminate sounds. Further studies are necessary to clarify brain connectivity dynamics associated with the performance of vibrotactile language-related discrimination tasks and the effect of lengthier training programs.

Temporal orienting precedes intersensory attention and has opposing effects on early evoked brain activity

Intersensory attention (IA) describes the process of directing attention to a specific modality. Temporal orienting (TO) characterizes directing attention to a specific moment in time. Previously, studies indicated that these two processes could have opposite effects on early evoked brain activity. The exact time-course and processing stages of both processes are still unknown. In this human electroencephalography study, we investigated the effects of IA and TO on visuo-tactile stimulus processing within one paradigm. IA was manipulated by presenting auditory cues to indicate whether participants should detect visual or tactile targets in visuo-tactile stimuli. TO was manipulated by presenting stimuli block-wise at fixed or variable inter-stimulus intervals. We observed that TO affects evoked activity to visuo-tactile stimuli prior to IA. Moreover, we found that TO reduces the amplitude of early evoked brain activity, whereas IA enhances it. Using beamformer source-localization, we observed that IA increases neural responses in sensory areas of the attended modality whereas TO reduces brain activity in widespread cortical areas. Based on these findings we derive an updated working model for the effects of temporal and intersensory attention on early evoked brain activity.

Individual Alpha Frequency Relates to the Sound-Induced Flash Illusion

Ongoing neural oscillations reflect fluctuations of cortical excitability. A growing body of research has underlined the role of neural oscillations for stimulus processing. Neural oscillations in the alpha band have gained special interest in electrophysiological research on perception. Recent studies proposed the idea that neural oscillations provide temporal windows in which sensory stimuli can be perceptually integrated. This also includes multisensory integration. In the current high-density EEG-study we examined the relationship between the individual alpha frequency (IAF) and cross-modal audiovisual integration in the sound-induced flash illusion (SIFI). In 26 human volunteers we found a negative correlation between the IAF and the SIFI illusion rate. Individuals with a lower IAF showed higher audiovisual illusions. Source analysis suggested an involvement of the visual cortex, especially the calcarine sulcus, for this relationship. Our findings corroborate the notion that the IAF affects the cross-modal integration of auditory on visual stimuli in the SIFI. We integrate our findings with recent observations on the relationship between audiovisual integration and neural oscillations and suggest a multifaceted influence of neural oscillations on multisensory processing.

The functional role of human right hippocampal/parahippocampal theta rhythm in environmental encoding during virtual spatial navigation

Low frequency theta band oscillations (4-8 Hz) are thought to provide a timing mechanism for hippocampal place cell firing and to mediate the formation of spatial memory. In rodents, hippocampal theta has been shown to play an important role in encoding a new environment during spatial navigation, but a similar functional role of hippocampal theta in humans has not been firmly established. To investigate this question, we recorded healthy participants' brain responses with a 160-channel whole-head MEG system as they performed two training sets of a virtual Morris water maze task. Environment layouts (except for platform locations) of the two sets were kept constant to measure theta activity during spatial learning in new and familiar environments. In line with previous findings, left hippocampal/parahippocampal theta showed more activation navigating to a hidden platform relative to random swimming. Consistent with our hypothesis, right hippocampal/parahippocampal theta was stronger during the first training set compared to the second one. Notably, theta in this region during the first training set correlated with spatial navigation performance across individuals in both training sets. These results strongly argue for the functional importance of right hippocampal theta in initial encoding of configural properties of an environment during spatial navigation. Our findings provide important evidence that right hippocampal/parahippocampal theta activity is associated with environmental encoding in the human brain. Hum Brain Mapp 38:1347-1361, 2017. © 2016 Wiley Periodicals, Inc.