Characterizing the roles of alpha and theta oscillations in multisensory attention

Prefrontal, Frontal, and Temporal Theta EEG Asymmetries and Self-Reports of Emotional Regulation

Previous studies have shown that right-sided frontal alpha asymmetry (fAA) is an electroencephalography (EEG) marker for negatively valenced emotions and a marker for negative self-perceptions of a person's psychosocial interactions. Alpha activity is affected by the changes in visual stimulation associated with eye-opening and eye-closing; theta activity is not so affected. Therefore, this analysis investigates the relationship between an individual's theta asymmetry and self-perceptions of their psychosocial interactions. We used quantitative electroencephalographic (qEEG) data from eight right-handed male medical students aged between 19 and 38 years, recorded under eyes-open (EO) and eyes-closed (EC) conditions. Significant correlations were found between self-reported measures of psychosocial interactions via the Interactive Self-Report Inventory (ISI). The main finding was that greater left-sided frontal temporal asymmetry (fTA) under both EO and EC conditions was associated with lower "regulated" ISI scores and lower "dependent" ISI scores. Greater left-sided temporal theta asymmetry (tTA), under EC conditions, was associated with higher "anxious" ISI scores. Greater left-sided prefrontal theta symmetry (pfTA), under EO conditions, was associated with lower "relaxed" ISI scores. These findings suggest that theta asymmetries in the frontal, prefrontal, and temporal cortices may be indicative of negative emotional states. The results of this study underscore the potential of pfTA, fTA, and tTA to be used as biomarkers for cognitive-emotional balance. The implications for mental health interventions, particularly personalized therapeutic approaches, are significant.

Perceptual training improves audiovisual integration by enhancing alpha-band oscillations and functional connectivity in older adults

Numerous studies on perceptual training exist, however, most have focused on the precision of temporal audiovisual perception, while fewer have concentrated on ability promotion for audiovisual integration (AVI). To investigate these issues, continuous 5-day audiovisual perceptual training was applied, during which electroencephalography was performed in response to auditory-only (A), visual-only (V) and audiovisual (AV) stimuli before and after training. The results showed that the perceptual sensitivity was greater for training group than for control group and was greater in the posttest than in the pretest. The response to the AV stimulus was significantly faster in the posttest than in the pretest for the older training group but was significantly greater for A and V stimuli for the younger training group. Electroencephalography analysis found higher P3 AVI amplitudes [AV-(A + V)] in the posttest than in the pretest for training group, which were subsequently reflected by an increased alpha (8-12 Hz) oscillatory response and strengthened global functional connectivity (weighted phase lag index). Furthermore, these facilitations were greater for older training groups than for younger training groups. These results confirm the age-related compensatory mechanism for AVI may be strengthened as audiovisual perceptual training progresses, providing an effective candidate for cognitive intervention in older adults.

Task-based default mode network connectivity predicts cognitive impairment and negative symptoms in first-episode schizophrenia

Individuals diagnosed with schizophrenia (SZ) demonstrate difficulty distinguishing between internally and externally generated stimuli. These aberrations in "source monitoring" have been theorized as contributing to symptoms of the disorder, including hallucinations and delusions. Altered connectivity within the default mode network (DMN) of the brain has been proposed as a mechanism through which discrimination between self-generated and externally generated events is disrupted. Source monitoring abnormalities in SZ have additionally been linked to impairments in selective attention and inhibitory processing, which are reliably observed via the N100 component of the event-related brain potential elicited during an auditory paired-stimulus paradigm. Given overlapping constructs associated with DMN connectivity and N100 in SZ, the present investigation evaluated relationships between these measures of disorder-related dysfunction and sought to clarify the nature of task-based DMN function in SZ. DMN connectivity and N100 measures were assessed using EEG recorded from SZ during their first episode of illness (N = 52) and demographically matched healthy comparison participants (N = 25). SZ demonstrated less evoked theta-band connectivity within DMN following presentation of pairs of identical auditory stimuli than HC. Greater DMN connectivity among SZ was associated with better performance on measures of sustained attention (p = .03) and working memory (p = .09), as well as lower severity of negative symptoms, though it was not predictive of N100 measures. Together, present findings provide EEG evidence of lower task-based connectivity among first-episode SZ, reflecting disruptions of DMN functions that support cognitive processes. Attentional processes captured by N100 appear to be supported by different neural mechanisms.

The importance of decomposing periodic and aperiodic EEG signals for assessment of brain function in a global context

Measures of early neuro-cognitive development that are suitable for use in low-resource settings are needed to enable studies of the effects of early adversity on the developing brain in a global context. These measures should have high acquisition rates and good face and construct validity. Here, we investigated the feasibility of a naturalistic electroencephalography (EEG) paradigm in a low-resource context during childhood. Additionally, we examined the sensitivity of periodic and aperiodic EEG metrics to social and non-social stimuli. We recorded simultaneous 20-channel EEG and eye-tracking in 72 children aged 4-12 years (45 females) while they watched videos of women singing nursery rhymes and moving toys, selected to represent familiar childhood experiences. These measures were part of a feasibility study that assessed the feasibility and acceptability of a follow-up data collection of the South African Safe Passage Study, which tracks environmental adversity and brain and cognitive development from before birth up until childhood. We examined whether data quantity and quality varied with child characteristics and the sensitivity of varying EEG metrics (canonical band power in the theta and alpha band and periodic and aperiodic features of the power spectra). We found that children who completed the EEG and eye-tracking assessment were, in general, representative of the full cohort. Data quantity was higher in children with greater visual attention to the stimuli. Out of the tested EEG metrics, periodic measures in the theta frequency range were most sensitive to condition differences, compared to alpha range measures and canonical and aperiodic EEG measures. Our results show that measuring EEG during ecologically valid social and non-social stimuli is feasible in low-resource settings, is feasible for most children, and produces robust indices of social brain function. This work provides preliminary support for testing longitudinal links between social brain function, environmental factors, and emerging behaviors.

Theta and alpha oscillatory signatures of auditory sensory and cognitive loads during complex listening

The neuronal signatures of sensory and cognitive load provide access to brain activities related to complex listening situations. Sensory and cognitive loads are typically reflected in measures like response time (RT) and event-related potentials (ERPs) components. It's, however, strenuous to distinguish the underlying brain processes solely from these measures. In this study, along with RT- and ERP-analysis, we performed time-frequency analysis and source localization of oscillatory activity in participants performing two different auditory tasks with varying degrees of complexity and related them to sensory and cognitive load. We studied neuronal oscillatory activity in both periods before the behavioral response (pre-response) and after it (post-response). Robust oscillatory activities were found in both periods and were differentially affected by sensory and cognitive load. Oscillatory activity under sensory load was characterized by decrease in pre-response (early) theta activity and increased alpha activity. Oscillatory activity under cognitive load was characterized by increased theta activity, mainly in post-response (late) time. Furthermore, source localization revealed specific brain regions responsible for processing these loads, such as temporal and frontal lobe, cingulate cortex and precuneus. The results provide evidence that in complex listening situations, the brain processes sensory and cognitive loads differently. These neural processes have specific oscillatory signatures and are long lasting, extending beyond the behavioral response.

Radio, Podcasts, and Music Streaming-An Electroencephalography and Physiological Analysis of Listeners' Attitude, Attention, Memory, and Engagement

Whilst radio, podcasts, and music streaming are considered unique audio formats that offer brands different opportunities, limited research has explored this notion. This current study analyses how the brain responds to these formats and suggests that they offer different branding opportunities. Participants' engagement, attitude, attention, memory, and physiological arousal were measured while each audio format was consumed. The results revealed that music streaming elicited more positive attitudes, higher attention, greater levels of memory encoding, and increased physiological arousal compared to either radio or podcasts. This study emphasises the importance for brands of utilising diverse audio channels for unique branding and marketing opportunities.

Attention Drives Visual Processing and Audiovisual Integration During Multimodal Communication

During communication in real-life settings, our brain often needs to integrate auditory and visual information and at the same time actively focus on the relevant sources of information, while ignoring interference from irrelevant events. The interaction between integration and attention processes remains poorly understood. Here, we use rapid invisible frequency tagging and magnetoencephalography to investigate how attention affects auditory and visual information processing and integration, during multimodal communication. We presented human participants (male and female) with videos of an actress uttering action verbs (auditory; tagged at 58 Hz) accompanied by two movie clips of hand gestures on both sides of fixation (attended stimulus tagged at 65 Hz; unattended stimulus tagged at 63 Hz). Integration difficulty was manipulated by a lower-order auditory factor (clear/degraded speech) and a higher-order visual semantic factor (matching/mismatching gesture). We observed an enhanced neural response to the attended visual information during degraded speech compared to clear speech. For the unattended information, the neural response to mismatching gestures was enhanced compared to matching gestures. Furthermore, signal power at the intermodulation frequencies of the frequency tags, indexing nonlinear signal interactions, was enhanced in the left frontotemporal and frontal regions. Focusing on the left inferior frontal gyrus, this enhancement was specific for the attended information, for those trials that benefitted from integration with a matching gesture. Together, our results suggest that attention modulates audiovisual processing and interaction, depending on the congruence and quality of the sensory input.

Cross-frequency coupling in cortico-hippocampal networks supports the maintenance of sequential auditory information in short-term memory

It has been suggested that cross-frequency coupling in cortico-hippocampal networks enables the maintenance of multiple visuo-spatial items in working memory. However, whether this mechanism acts as a global neural code for memory retention across sensory modalities remains to be demonstrated. Intracranial EEG data were recorded while drug-resistant patients with epilepsy performed a delayed matched-to-sample task with tone sequences. We manipulated task difficulty by varying the memory load and the duration of the silent retention period between the to-be-compared sequences. We show that the strength of theta-gamma phase amplitude coupling in the superior temporal sulcus, the inferior frontal gyrus, the inferior temporal gyrus, and the hippocampus (i) supports the short-term retention of auditory sequences; (ii) decodes correct and incorrect memory trials as revealed by machine learning analysis; and (iii) is positively correlated with individual short-term memory performance. Specifically, we show that successful task performance is associated with consistent phase coupling in these regions across participants, with gamma bursts restricted to specific theta phase ranges corresponding to higher levels of neural excitability. These findings highlight the role of cortico-hippocampal activity in auditory short-term memory and expand our knowledge about the role of cross-frequency coupling as a global biological mechanism for information processing, integration, and memory in the human brain.

Reduced occipital alpha power marks a movement induced state change that facilitates creative thinking

Walking and minimized movement restriction has a positive effect on creativity, such as divergent thinking. Walking is further known to reduce occipital alpha activity. We used mobile EEG during free and restricted movement, while subjects (N = 23) solved a Guilford's alternate uses test, to understand if occipital alpha power is also affected by movement restriction and if it is a neural marker for creativity. We found that, independent of the task, relative occipital alpha power was higher during movement restriction and showed a negative relationship with creativity scores even though the task was purely based on auditory information. Alpha lateralization was only modulated during the task related think-time (mainly during sitting) and showed a positive relationship with creativity scores but no correlation with the relative alpha power. This indicates that the ongoing alpha power and alpha lateralization mark two independent processes. Overall, our work shows that movement and movement restriction leads to a general change in state which affects cognitive processes. Specifically, limiting one's movements e.g. due to sitting and fixating on a screen can introduce a state of increased occipital alpha power and lowered creativity.

The neural oscillations in delta- and theta-bands contribute to divided attention in audiovisual integration

One of key mechanisms implicated in multisensory processing is neural oscillations in distinct frequency band. Many studies explored the modulation of attention by recording the electroencephalography signals when subjects attended one modality, and ignored the other modality input. However, when attention is directed toward one modality, it may be not always possible to shut out completely inputs from a different modality. Since many situations require division of attention between audition and vision, it is imperative to investigate the neural mechanisms underlying processing of concurrent auditory and visual sensory streams. In the present study, we designed a task of audiovisual semantic discrimination, in which the subjects were asked to share attention to both auditory and visual stimuli. We explored the contribution of neural oscillations in lower-frequency to the modulation of divided attention on audiovisual integration. Our results implied that theta-band activity contributes to the early modulation of divided attention, and delta-band activity contributes to the late modulation of divided attention to audiovisual integration. Moreover, the fronto-central delta- and theta-bands activity is likely a marker of divided attention in audiovisual integration, and the neural oscillation on delta- and theta-bands is conducive to allocating attention resources to dual-tasking involving task-coordinating abilities.

Alterations of Audiovisual Integration in Alzheimer's Disease

Audiovisual integration is a vital information process involved in cognition and is closely correlated with aging and Alzheimer's disease (AD). In this review, we evaluated the altered audiovisual integrative behavioral symptoms in AD. We further analyzed the relationships between AD pathologies and audiovisual integration alterations bidirectionally and suggested the possible mechanisms of audiovisual integration alterations underlying AD, including the imbalance between energy demand and supply, activity-dependent degeneration, disrupted brain networks, and cognitive resource overloading. Then, based on the clinical characteristics including electrophysiological and imaging data related to audiovisual integration, we emphasized the value of audiovisual integration alterations as potential biomarkers for the early diagnosis and progression of AD. We also highlighted that treatments targeted audiovisual integration contributed to widespread pathological improvements in AD animal models and cognitive improvements in AD patients. Moreover, investigation into audiovisual integration alterations in AD also provided new insights and comprehension about sensory information processes.

Impact of negative links on the structural balance of brain functional network during emotion processing

Activation of specific brain areas and synchrony between them has a major role in process of emotions. Nevertheless, impact of anti-synchrony (negative links) in this process still requires to be understood. In this study, we hypothesized that quantity and topology of negative links could influence a network stability by changing of quality of its triadic associations. Therefore, a group of healthy participants were exposed to pleasant and unpleasant images while their brain responses were recorded. Subsequently, functional connectivity networks were estimated and quantity of negative links, balanced and imbalanced triads, tendency to make negative hubs, and balance energy levels of two conditions were compared. The findings indicated that perception of pleasant stimuli was associated with higher amount of negative links with a lower tendency to make a hub in theta band; while the opposite scenario was observed in beta band. It was accompanied with smaller number of imbalanced triads and more stable network in theta band, and smaller number of balanced triads and less stable network in beta band. The findings highlighted that inter regional communications require less changes to receive new information from unpleasant stimuli, although by decrement in beta band stability prepares the network for the upcoming events.

Alpha oscillations protect working memory against distracters in a modality-specific way

Alpha oscillations are thought to be involved in suppressing distracting input in working-memory tasks. Yet, the spatial-temporal dynamics of such suppression remain unclear. Key questions are whether such suppression reflects a domain-general inattentiveness mechanism, or occurs in a stimulus- or modality-specific manner within cortical areas most responsive to the distracters; and whether the suppression is proactive (i.e., preparatory) or reactive. Here, we addressed these questions using a working-memory task where participants had to memorize an array of visually presented digits and reproduce one of them upon being probed. We manipulated the presence of distracters and the sensory modality in which distracters were presented during memory maintenance. Our results show that sensory areas most responsive to visual and auditory distracters exhibited stronger alpha power increase after visual and auditory distracter presentation respectively. These results suggest that alpha oscillations underlie distracter suppression in a reactive, modality-specific manner.

Age-Related Changes to Multisensory Integration and Audiovisual Speech Perception

Multisensory integration is essential for the quick and accurate perception of our environment, particularly in everyday tasks like speech perception. Research has highlighted the importance of investigating bottom-up and top-down contributions to multisensory integration and how these change as a function of ageing. Specifically, perceptual factors like the temporal binding window and cognitive factors like attention and inhibition appear to be fundamental in the integration of visual and auditory information-integration that may become less efficient as we age. These factors have been linked to brain areas like the superior temporal sulcus, with neural oscillations in the alpha-band frequency also being implicated in multisensory processing. Age-related changes in multisensory integration may have significant consequences for the well-being of our increasingly ageing population, affecting their ability to communicate with others and safely move through their environment; it is crucial that the evidence surrounding this subject continues to be carefully investigated. This review will discuss research into age-related changes in the perceptual and cognitive mechanisms of multisensory integration and the impact that these changes have on speech perception and fall risk. The role of oscillatory alpha activity is of particular interest, as it may be key in the modulation of multisensory integration.

The Role of Stimuli-Driven and Goal-Driven Attention in Shopping Decision-Making Behaviors-An EEG and VR Study

The human attention system, similar to other networks in the brain, is of a complex nature. At any moment, our attention can shift between external and internal stimuli. In this study, we aimed to assess three EEG-based measures of attention (Power Spectral Density, Connectivity, and Spectral Entropy) in decision-making situations involving goal-directed and stimulus-driven attention using a Virtual Reality supermarket. We collected the EEG data of 29 participants in 2 shopping phases, planned and unplanned purchases. The three mentioned features were extracted and a statistical analysis was conducted. We evaluated the discriminatory power of these features using an SVM classifier. The results showed a significant (p-value < 0.001) increase in theta power over frontal, central, and temporal lobes for the planned purchase phase. There was also a significant decrease in alpha power over frontal and parietal lobes in the unplanned purchase phase. A significant increase in the frontoparietal connectivity during the planned purchase was observed. Additionally, an increase in spectral entropy was observed in the frontoparietal region for the unplanned purchase phase. The classification results showed that spectral entropy has the highest discriminatory power. This study can provide further insights into the attentional behaviors of consumers and how their type of attentional control can affect their decision-making processes.

Short-term training helps second-language learners read like native readers: An ERP study

This randomized controlled trial study aimed to examine what experience other than immersion may help adult learners read with native-like neural responses. We compared a group of 13 native Chinese English learners completing English letter-sound association training with another group of 12 completing visual symbol-sound association training and included one group of native English readers as the reference. The results showed that after three hours of training, all learners no longer showed attenuated cross-modal mismatch negativity (MMN) to English letter-sound integration as in the pretest. After six hours of training, the learners receiving English letter-sound association training showed enhanced cross-modal MMN and theta oscillations, as native English readers did. The enhanced neural responses were significantly correlated with better phonological awareness. Thus, with training specific to critical second language reading skills of appropriate dosages, adult learners can overcome the constraints of their native language background and learn to read with native-like neural responses.

Hierarchy of Intra- and Cross-modal Redundancy Gains in Visuo-tactile Search: Evidence from the Posterior Contralateral Negativity

Redundant combination of target features from separable dimensions can expedite visual search. The dimension-weighting account explains these "redundancy gains" by assuming that the attention-guiding priority map integrates the feature-contrast signals generated by targets within the respective dimensions. The present study investigated whether this hierarchical architecture is sufficient to explain the gains accruing from redundant targets defined by features in different modalities, or whether an additional level of modality-specific priority coding is necessary, as postulated by the modality-weighting account (MWA). To address this, we had observers perform a visuo-tactile search task in which targets popped out by a visual feature (color or shape) or a tactile feature (vibro-tactile frequency) as well as any combination of these features. The RT gains turned out larger for visuo-tactile versus visual redundant targets, as predicted by the MWA. In addition, we analyzed two lateralized event-related EEG components: the posterior (PCN) and central (CCN) contralateral negativities, which are associated with visual and tactile attentional selection, respectively. The CCN proved to be a stable somatosensory component, unaffected by cross-modal redundancies. In contrast, the PCN was sensitive to cross-modal redundancies, evidenced by earlier onsets and higher amplitudes, which could not be explained by linear superposition of the earlier CCN onto the later PCN. Moreover, linear mixed-effect modeling of the PCN amplitude and timing parameters accounted for approximately 25% of the behavioral RT variance. Together, these behavioral and PCN effects support the hierarchy of priority-signal computation assumed by the MWA.

What do functional neuroimaging studies tell us about the association between falls and cognition in older adults? A systematic review

Impaired cognition is a known risk factor for falls in older adults. To enhance prevention strategies and treatment of falls among an aging global population, an understanding of the neural processes and networks involved is required. We present a systematic review investigating how functional neuroimaging techniques have been used to examine the association between falls and cognition in seniors. Peer-reviewed articles were identified through searching five electronic databases: 1) Medline, 2) PsycINFO, 3) CINAHL, 4) EMBASE, and 5) Pubmed. Key author, key paper, and reference searching was also conducted. Nine studies were included in this review. A questionnaire composed of seven questions was used to assess the quality of each study. EEG, fMRI, and PET were utilized across studies to examine brain function in older adults. Consistent evidence demonstrates that cognition is associated with measures of falls/falls risk, specifically visual attention and executive function. Our results show that falls/falls risk may be implicated with specific brain regions and networks. Future studies should be prospective and long-term in nature, with standardized outcome measures. Mobile neuroimaging techniques may also provide insight into brain activity as it pertains to cognition and falls in older adults in real-world settings.

High-gamma activity is coupled to low-gamma oscillations in precentral cortices and modulates with movement and speech

Planning and executing motor behaviors requires coordinated neural activity among multiple cortical and subcortical regions of the brain. Phase-amplitude coupling between the high-gamma band amplitude and the phase of low frequency oscillations (theta, alpha, beta) has been proposed to reflect neural communication, as has synchronization of low-gamma oscillations. However, coupling between low-gamma and high-gamma bands has not been investigated. Here, we measured phase-amplitude coupling between low- and high-gamma in monkeys performing a reaching task and in humans either performing finger movements or speaking words aloud. We found significant coupling between low-gamma phase and high-gamma amplitude in multiple sensorimotor and premotor cortices of both species during all tasks. This coupling modulated with the onset of movement. These findings suggest that interactions between the low and high gamma bands are markers of network dynamics related to movement and speech generation.

Functional connectivity and gray matter deficits within the auditory attention circuit in first-episode psychosis

Background

Selective attention deficits in first episode of psychosis (FEP) can be indexed by impaired attentional modulation of auditory M100. It is unknown if the pathophysiology underlying this deficit is restricted to auditory cortex or involves a distributed attention network. We examined the auditory attention network in FEP.

Methods

MEG was recorded from 27 FEP and 31 matched healthy controls (HC) while alternately ignoring or attending tones. A whole-brain analysis of MEG source activity during auditory M100 identified non-auditory areas with increased activity. Time-frequency activity and phase-amplitude coupling were examined in auditory cortex to identify the attentional executive carrier frequency. Attention networks were defined by phase-locking at the carrier frequency. Spectral and gray matter deficits in the identified circuits were examined in FEP.

Results

Attention-related activity was identified in prefrontal and parietal regions, markedly in precuneus. Theta power and phase coupling to gamma amplitude increased with attention in left primary auditory cortex. Two unilateral attention networks were identified with precuneus seeds in HC. Network synchrony was impaired in FEP. Gray matter thickness was reduced within the left hemisphere network in FEP but did not correlate with synchrony.

Conclusion

Several extra-auditory attention areas with attention-related activity were identified. Theta was the carrier frequency for attentional modulation in auditory cortex. Left and right hemisphere attention networks were identified, with bilateral functional deficits and left hemisphere structural deficits, though FEP showed intact auditory cortex theta phase-gamma amplitude coupling. These novel findings indicate attention-related circuitopathy early in psychosis potentially amenable to future non-invasive interventions.

The role of informational content of visual speech in an audiovisual cocktail party: Evidence from cortical oscillations in young and old participants

Age-related differences in the processing of audiovisual speech in a multi-talker environment were investigated analysing event-related spectral perturbations (ERSPs), focusing on theta, alpha and beta oscillations that are assumed to reflect conflict processing, multisensory integration and attentional mechanisms, respectively. Eighteen older and 21 younger healthy adults completed a two-alternative forced-choice word discrimination task, responding to audiovisual speech stimuli. In a cocktail-party scenario with two competing talkers (located at -15° and 15° azimuth), target words (/yes/or/no/) appeared at a pre-defined (attended) position, distractor words at the other position. In two audiovisual conditions, acoustic speech was combined either with informative or uninformative visual speech. While a behavioural benefit for informative visual speech occurred for both age groups, differences between audiovisual conditions in the theta and beta band were only present for older adults. A stronger increase in theta perturbations for stimuli containing uninformative visual speech could be associated with early conflict processing, while a stronger suppression in beta perturbations for informative visual speech could be associated to audiovisual integration. Compared to the younger group, the older group showed generally stronger beta perturbations. No condition differences in the alpha band were found. Overall, the findings suggest age-related differences in audiovisual speech integration in a multi-talker environment. While the behavioural benefit of informative visual speech was unaffected by age, older adults had a stronger need for cognitive control when processing conflicting audiovisual speech input. Furthermore, mechanisms of audiovisual integration are differently activated depending on the informational content of the visual information.

Music and Visual Art Training Increase Auditory-Evoked Theta Oscillations in Older Adults

Music training was shown to induce changes in auditory processing in older adults. However, most findings stem from correlational studies and fewer examine long-term sustainable benefits. Moreover, research shows small and variable changes in auditory event-related potential (ERP) amplitudes and/or latencies in older adults. Conventional time domain analysis methods, however, are susceptible to latency jitter in evoked responses and may miss important information of brain processing. Here, we used time-frequency analyses to examine training-related changes in auditory-evoked oscillatory activity in healthy older adults (N = 50) assigned to a music training (n = 16), visual art training (n = 17), or a no-treatment control (n = 17) group. All three groups were presented with oddball auditory paradigms with synthesized piano tones or vowels during the acquisition of high-density EEG. Neurophysiological measures were collected at three-time points: pre-training, post-training, and at a three-month follow-up. Training programs were administered for 12-weeks. Increased theta power was found pre and post- training for the music (p = 0.010) and visual art group (p = 0.010) as compared to controls (p = 0.776) and maintained at the three-month follow-up. Results showed training-related plasticity on auditory processing in aging adults. Neuroplastic changes were maintained three months post-training, suggesting music and visual art programs yield lasting benefits that might facilitate encoding, retention, and memory retrieval.

Auditory attentional load attenuates age-related audiovisual integration: An EEG study

Studies have revealed that visual attentional load modulated audiovisual integration (AVI) greatly; however, auditory and visual attentional resources are separate to some degree, and task-irrelevant auditory information could arouse much faster and larger attentional alerting effects than visible information. Here, we aimed to explore how auditory attentional load influences AVI and how aging could have an effect. Thirty older and 30 younger adults participated in an AV discrimination task with an additional auditory distractor competing for attentional resources. The race model analysis revealed highest AVI in the low auditory attentional load condition (low > no > medium > high, pairwise comparison, all p ≤ 0.047) for younger adults and a higher AVI under the no auditory attentional-load condition (p = 0.008), but there was a lower AVI under the low (p = 0.019), medium (p < 0.001), and high (p = 0.021) auditory attentional-load conditions for older adults than for younger adults. The time-frequency analysis revealed higher theta- and alpha-band AVI oscillation under no and low auditory attentional-load conditions than under medium and high auditory attentional-load conditions for both older (all p ≤ 0.011) and younger (all p ≤ 0.024) adults. Additionally, Weighted Phase lag index (WPLI) analysis revealed higher theta-band and lower alpha-band global functional connectivity for older adults during AV stimuli processing (all p ≤ 0.031). These results suggested that the AVI was higher in the low attentional-load condition than in the no attentional-load condition but decreased inversely with increasing of attentional load and that there was a significant aging effect in older adults. In addition, the strengthened theta-band global functional connectivity in older adults during AV stimuli processing might be an adaptive phenomenon for age-related perceptual decline.

Decoding brain activities of literary metaphor comprehension: An event-related potential and EEG spectral analysis

Novel metaphors in literary texts (hereinafter referred to as literary metaphors) seem to be more creative and open-ended in meaning than metaphors in non-literary texts (non-literary metaphors). However, some disagreement still exists on how literary metaphors differ from non-literary metaphors. Therefore, this study explored the neural mechanisms of literary metaphors extracted from modern Chinese poetry by using the methods of Event-Related Potentials (ERPs) and Event-Related Spectral Perturbations (ERSPs), as compared with non-literary conventional metaphors and literal expressions outside literary texts. Forty-eight subjects were recruited to make the semantic relatedness judgment after reading the prime-target pairs in three linguistic conditions. According to the ERPs results, the earliest differences were presented during the time window of P200 component (170–260 ms) in the frontal and central areas, with the amplitude of P200 for literary metaphors more positive than the other two conditions, reflecting the early allocation of attention and the early conscious experience of the experimental stimuli. Meanwhile, significant differences were presented during the time window of N400 effect (430–530 ms), with the waveform of literary metaphors more negative than others in the frontal and central topography of scalp distributions, suggesting more efforts in retrieving conceptual knowledge for literary metaphors. The ERSPs analysis revealed that the frequency bands of delta and theta were both involved in the cognitive process of literary metaphor comprehension, with delta band distributed in the frontal and central scalp and theta band in parietal and occipital electrodes. Increases in the two power bands during different time windows provided extra evidences that the processing of literary metaphors required more attention and effort than non-literary metaphors and literal expressions in the semantic related tasks, suggesting that the cognitive process of literary metaphors was distinguished by different EEG spectral patterns.

Drowsiness Detection System Based on PERCLOS and Facial Physiological Signal

Accidents caused by fatigue occur frequently, and numerous scholars have devoted tremendous efforts to investigate methods to reduce accidents caused by fatigued driving. Accordingly, the assessment of the spirit status of the driver through the eyes blinking frequency and the measurement of physiological signals have emerged as effective methods. In this study, a drowsiness detection system is proposed to combine the detection of LF/HF ratio from heart rate variability (HRV) of photoplethysmographic imaging (PPGI) and percentage of eyelid closure over the pupil over time (PERCLOS), and to utilize the advantages of both methods to improve the accuracy and robustness of drowsiness detection. The proposed algorithm performs three functions, including LF/HF ratio from HRV status judgment, eye state detection, and drowsiness judgment. In addition, this study utilized a near-infrared webcam to obtain a facial image to achieve non-contact measurement, alleviate the inconvenience of using a contact wearable device, and for use in a dark environment. Furthermore, we selected the appropriate RGB channel under different light sources to obtain LF/HF ratio from HRV of PPGI. The main drowsiness judgment basis of the proposed drowsiness detection system is the use of algorithm to obtain sympathetic/parasympathetic nervous balance index and percentage of eyelid closure. In the experiment, there are 10 awake samples and 30 sleepy samples. The sensitivity is 88.9%, the specificity is 93.5%, the positive predictive value is 80%, and the system accuracy is 92.5%. In addition, an electroencephalography signal was used as a contrast to validate the reliability of the proposed method.

Alpha oscillatory activity during attentional control in children with Autism Spectrum Disorder (ASD), Attention-Deficit/Hyperactivity Disorder (ADHD), and ASD+ADHD

BACKGROUND

Autism Spectrum Disorder (ASD) and Attention-Deficit/Hyperactivity Disorder (ADHD) share impairments in top-down and bottom-up modulation of attention. However, it is not yet well understood if co-occurrence of ASD and ADHD reflects a distinct or additive profile of attention deficits. We aimed to characterise alpha oscillatory activity (stimulus-locked alpha desynchronisation and prestimulus alpha) as an index of integration of top-down and bottom-up attentional processes in ASD and ADHD.

METHODS

Children with ASD, ADHD, comorbid ASD+ADHD, and typically-developing children completed a fixed-choice reaction-time task ('Fast task') while neurophysiological activity was recorded. Outcome measures were derived from source-decomposed neurophysiological data. Main measures of interest were prestimulus alpha power and alpha desynchronisation (difference between poststimulus and prestimulus alpha). Poststimulus activity linked to attention allocation (P1, P3), attentional control (N2), and cognitive control (theta synchronisation, 100-600 ms) was also examined. ANOVA was used to test differences across diagnostics groups on these measures. Spearman's correlations were used to investigate the relationship between attentional control processes (alpha oscillations), central executive functions (theta synchronisation), early visual processing (P1), and behavioural performance.

RESULTS

Children with ADHD (ADHD and ASD+ADHD) showed attenuated alpha desynchronisation, indicating poor integration of top-down and bottom-up attentional processes. Children with ADHD showed reduced N2 and P3 amplitudes, while children with ASD (ASD and ASD+ADHD) showed greater N2 amplitude, indicating atypical attentional control and attention allocation across ASD and ADHD. In the ASD group, prestimulus alpha and theta synchronisation were negatively correlated, and alpha desynchronisation and theta synchronisation were positively correlated, suggesting an atypical association between attentional control processes and executive functions.

CONCLUSIONS

ASD and ADHD are associated with disorder-specific impairments, while children with ASD+ADHD overall presented an additive profile with attentional deficits of both disorders. Importantly, these findings may inform the improvement of transdiagnostic procedures and optimisation of personalised intervention approaches.

Midfrontal theta power encodes the value of haptic delay

The use of haptic technologies in modern life scenarios is becoming the new normal particularly in rehabilitation, medical training, and entertainment applications. An evident challenge in haptic telepresence systems is the delay in haptic information. How humans perceive delayed visual and audio information has been extensively studied, however, the same for haptically delayed environments remains largely unknown. Here, we develop a visuo-haptic experimental setting that simulates pick and place task and involves continuous haptic feedback stimulation with four possible haptic delay levels. The setting is built using a haptic device and a computer screen. We use electroencephalography (EEG) to study the neural correlates that could be used to identify the amount of the experienced haptic delay. EEG data were collected from 34 participants. Results revealed that midfrontal theta oscillation plays a pivotal role in quantifying the amount of haptic delay while parietal alpha showed a significant modulation that encodes the presence of haptic delay. Based on the available literature, these results suggest that the amount of haptic delay is proportional to the neural activation that is associated with conflict detection and resolution as well as for multi-sensory divided attention.

The Birth of the Mammalian Sleep

Simple Summary

Mammals evolved from reptiles as a consequence of an evolutionary bottleneck. Some diurnal reptiles extended their activity, first to twilight and then to the entire dark time. This forced the change of the visual system. Pursuing maximal sensitivity, they abandoned the filters protecting the eyes against the dangerous diurnal light, which, in turn, forced immobility in lightproof burrows during light time. This was the birth of the mammalian sleep. Then, the Cretacic-Paleogene extinction of dinosaurs leaved free the diurnal niche and allowed the expansion of a few early mammals to diurnal life and the high variability of sleep traits. On the other hand, we propose that the idling rest is a state showing homeostatic regulation. Therefore, the difference between behavioral rest and wakeful idling is rather low: both show quiescence, raised sensory thresholds, reversibility, specific sleeping-resting sites and body positions, it is a pleasing state, and both are dependent of circadian and homeostatic regulation. Indeed, the most important difference is the unconsciousness of sleep and the consciousness of wakeful idling. Thus, we propose that sleep is a mere upgrade of the wakeful rest, and both may have the same function: guaranteeing rest during a part of the daily cycle.

Abstract

Mammals evolved from small-sized reptiles that developed endothermic metabolism. This allowed filling the nocturnal niche. They traded-off visual acuity for sensitivity but became defenseless against the dangerous daylight. To avoid such danger, they rested with closed eyes in lightproof burrows during light-time. This was the birth of the mammalian sleep, the main finding of this report. Improved audition and olfaction counterweighed the visual impairments and facilitated the cortical development. This process is called “The Nocturnal Evolutionary Bottleneck”. Pre-mammals were nocturnal until the Cretacic-Paleogene extinction of dinosaurs. Some early mammals returned to diurnal activity, and this allowed the high variability in sleeping patterns observed today. The traits of Waking Idleness are almost identical to those of behavioral sleep, including homeostatic regulation. This is another important finding of this report. In summary, behavioral sleep seems to be an upgrade of Waking Idleness Indeed, the trait that never fails to show is quiescence. We conclude that the main function of sleep consists in guaranteeing it during a part of the daily cycle.

Spatial attention impairments are characterized by specific electro-encephalographic correlates and partially mediate the association between early life stress and anxiety

Although impaired attention is a diagnostic feature of anxiety disorders, we lack an understanding of which aspects of attention are impaired, the neurobiological basis of these impairments, and the contribution of stressors. To address these gaps in knowledge, we developed and tested behavioral tasks designed to parse the subdomains of attention impairments associated with anxiety symptoms and used electro-encephalographic (EEG) recordings to probe the neural basis of attentional performance. Participants were n = 55 individuals aged 18-35 with mild-to-moderate mood and anxiety symptoms. We also assessed stressful life events that may impact mental health and attention abilities, including stressors that occurred in early life before age 18 years. Severity of anxiety was found to be specifically associated with impairments in spatial attention but not feature-based attention. These impairments in spatial attention also partially mediated the association between early-life stressors and anxiety symptoms. Impairments in spatial selective attention were associated with decreased posterior alpha oscillations in EEG recordings in a subsample of participants, whereas spatial divided attention impairments were associated with decreased frontocentral theta oscillations. Our results provide a thorough characterization of attention impairments associated with anxiety, their EEG correlates, and the impact of stressors both in early life and adulthood.

Changes in Electroencephalography Activity of Sensory Areas Linked to Car Sickness in Real Driving Conditions

Car sickness is a major concern for car passengers, and with the development of autonomous vehicles, increasing numbers of car occupants are likely to be affected. Previous laboratory studies have used EEG measurements to better understand the cerebral changes linked to symptoms. However, the dynamics of motion in labs/simulators differ from those of a real car. This study sought to identify specific cerebral changes associated with the level of car sickness experienced in real driving conditions. Nine healthy volunteers participated as front passengers in a slalom session inducing lateral movements at very low frequency (0.2 Hz). They were continuously monitored via EEG recordings and subjectively rated their level of symptoms after each slalom, using a 5-point likert scale. Car-sickness symptoms evolved concomitantly with changes in theta and alpha power in the occipital and parietal areas. These changes may reflect altered sensory integration, as well as a possible influence of sleepiness mitigating symptoms.

Impoverished Inhibitory Control Exacerbates Multisensory Impairments in Older Fallers

Impaired temporal perception of multisensory cues is a common phenomenon observed in older adults that can lead to unreliable percepts of the external world. For instance, the sound induced flash illusion (SIFI) can induce an illusory percept of a second flash by presenting a beep close in time to an initial flash-beep pair. Older adults that have enhanced susceptibility to a fall demonstrate significantly stronger illusion percepts during the SIFI task compared to those older adults without any history of falling. We hypothesize that a global inhibitory deficit may be driving the impairments across both postural stability and multisensory function in older adults with a fall history (FH). We investigated oscillatory activity and perceptual performance during the SIFI task, to understand how active sensory processing, measured by gamma (30–80 Hz) power, was regulated by alpha activity (8–13 Hz), oscillations that reflect inhibitory control. Compared to young adults (YA), the FH and non-faller (NF) groups demonstrated enhanced susceptibility to the SIFI. Further, the FH group had significantly greater illusion strength compared to the NF group. The FH group also showed significantly impaired performance relative to YA during congruent trials (2 flash-beep pairs resulting in veridical perception of 2 flashes). In illusion compared to non-illusion trials, the NF group demonstrated reduced alpha power (or diminished inhibitory control). Relative to YA and NF, the FH group showed reduced phase-amplitude coupling between alpha and gamma activity in non-illusion trials. This loss of inhibitory capacity over sensory processing in FH compared to NF suggests a more severe change than that consequent of natural aging.

Midfrontal theta oscillation encodes haptic delay

Haptic technologies aim to simulate tactile or kinesthetic interactions with a physical or virtual environment in order to enhance user experience and/or performance. However, due to stringent communication and computational needs, the user experience is influenced by delayed haptic feedback. While delayed feedback is well understood in the visual and auditory modalities, little research has systematically examined the neural correlates associated with delayed haptic feedback. In this paper, we used electroencephalography (EEG) to study sensory and cognitive neural correlates caused by haptic delay during passive and active tasks performed using a haptic device and a computer screen. Results revealed that theta power oscillation was significantly higher at the midfrontal cortex under the presence of haptic delay. Sensory correlates represented by beta rebound were found to be similar in the passive task and different in the active task under the delayed and synchronous conditions. Additionally, the event related potential (ERP) P200 component is modulated under the haptic delay condition during the passive task. The P200 amplitude significantly reduced in the last 20% of trials during the passive task and in the absence of haptic delay. Results suggest that haptic delay could be associated with increased cognitive control processes including multi-sensory divided attention followed by conflict detection and resolution with an earlier detection during the active task. Additionally, haptic delay tends to generate greater perceptual attention that does not significantly decay across trials during the passive task.

The Menstrual Cycle Alters Resting-State Cortical Activity: A Magnetoencephalography Study

Resting-state neural oscillations are used as biomarkers for functional diseases such as dementia, epilepsy, and stroke. However, accurate interpretation of clinical outcomes requires the identification and minimisation of potential confounding factors. While several studies have indicated that the menstrual cycle also alters brain activity, most of these studies were based on visual inspection rather than objective quantitative measures. In the present study, we aimed to clarify the effect of the menstrual cycle on spontaneous neural oscillations based on quantitative magnetoencephalography (MEG) parameters. Resting-state MEG activity was recorded from 25 healthy women with normal menstrual cycles. For each woman, resting-state brain activity was acquired twice using MEG: once during their menstrual period (MP) and once outside of this period (OP). Our results indicated that the median frequency and peak alpha frequency of the power spectrum were low, whereas Shannon spectral entropy was high, during the MP. Theta intensity within the right temporal cortex and right limbic system was significantly lower during the MP than during the OP. High gamma intensity in the left parietal cortex was also significantly lower during the MP than during the OP. Similar differences were also observed in the parietal and occipital regions between the proliferative (the late part of the follicular phase) and secretory phases (luteal phase). Our findings suggest that the menstrual cycle should be considered to ensure accurate interpretation of functional neuroimaging in clinical practice.

Decision-Making and Multisensory Combination Under Time Stress

Using a video game platform, we examined how vision-based decision making was affected by a concurrent, potentially conflicting auditory stimulus. Electroencephalographic responses showed that by 150 milliseconds of stimulus onset, the brain had detected the conflict between visual and auditory stimuli. Systematically reducing the intertrial interval (ITI), which subjects described as stressful, undermined decision making. Subjects' arterial pulse variance decreased along with ITI, signaling increased parasympathetic influence on the heart. When successive trials required a shift in processing mode, short ITIs significantly boosted one trial's influence on the next, suggesting that stress reduces cognitive flexibility. Finally, our study demonstrates the heart's and the brain's important influence on decision making.

Neural oscillations underlying selective attention follow sexually divergent developmental trajectories during adolescence

•

A cohort of 9- to 16-year-olds completed a classic flanker task during MEG.

•

There were developmentally-sensitive interference effects in key attention regions.

•

Youth showed sexually-divergent patterns of age-related interference activity.

•

Maturational differences among males supported improved task behavior.

Selective attention processes are critical to everyday functioning and are known to develop through at least young adulthood. Although numerous investigations have studied the maturation of attention systems in the brain, these studies have largely focused on the spatial configuration of these systems; there is a paucity of research on the neural oscillatory dynamics serving selective attention, particularly among youth. Herein, we examined the developmental trajectory of neural oscillatory activity serving selective attention in 53 typically developing youth age 9-to-16 years-old. Participants completed the classic arrow-based flanker task during magnetoencephalography, and the resulting data were imaged in the time-frequency domain. Flanker interference significantly modulated theta and alpha/beta oscillations within prefrontal, mid-cingulate, cuneus, and occipital regions. Interference-related neural activity also increased with age in the temporoparietal junction and the rostral anterior cingulate. Sex-specific effects indicated that females had greater theta interference activity in the anterior insula, whereas males showed differential effects in theta and alpha/beta oscillations across frontoparietal regions. Finally, males showed age-related changes in alpha/beta interference in the cuneus and middle frontal gyrus, which predicted improved behavioral performance. Taken together, these data suggest sexually-divergent developmental trajectories underlying selective attention in youth.

Capture or suppression? Attentional allocation upon reward and loss-associated nonsalient distractors are supported by distinct neural mechanisms: An EEG study

Previous studies suggest that a reward-associated salient distractor can induce bottom-up attentional capture. Hitherto, the neurophysiological mechanisms underlying attentional allocation upon reward/loss associated nonsalient stimulus remain hardly investigated. The present study built the association between nonsalient stimuli and value, and tested it with a decision-making task. Consequently, we examined whether and how reward/loss-associated nonsalient stimuli (as distractors) influenced attentional allocation in a rapid serial visual presentation task. Behavioral analysis showed a significantly faster recognition of target in the loss condition compared to performance in the neutral/reward conditions. Electrophysiological results showed that reward-associated distractors induced a significant Pd component, while loss-associated distractors induced a significantly higher theta oscillation. These results demonstrated that subjects could proactively suppress reward-associated distractors. More importantly, we showed that attentional allocation upon reward/loss-associated nonsalient distractors is supported by distinct neural mechanisms.

Altered fronto-occipital connectivity during visual selective attention in regular cannabis users

RATIONALE AND OBJECTIVES

Cognitive processing impairments have been associated with acute cannabis use, but there is mixed evidence regarding the cognitive effects of chronic cannabis use. Several neuroimaging studies have noted selective-attention processing differences in those who chronically use cannabis, but the neural dynamics governing the altered processing is unclear.

METHODS

Twenty-four adults reporting at least weekly cannabis use in the past 6 months on the Cannabis Use Disorder Identification Test - Revised were compared to 24 demographically matched controls who reported no prior cannabis use. All participants completed a visual selective attention processing task while undergoing magnetoencephalography. Time-frequency windows of interest were identified using a data-driven method, and spectrally specific neural activity was imaged using a beamforming approach.

RESULTS

All participants performed within normal range on the cognitive task. Regular cannabis users displayed an aberrant cognitive interference effect in the theta (4-8 Hz) frequency range shortly after stimulus onset (i.e., 0-250 ms) in the right occipital cortex. Cannabis users also exhibited altered functional connectivity between the right prefrontal cortex and right occipital cortices in comparison to controls.

CONCLUSIONS

Individuals with a history of regular cannabis use exhibited abnormal theta interference activity in the occipital cortices, as well as altered prefrontal-occipital functional connectivity in the theta range during a visual selective attention task. Such differences may reflect compensatory processing, as these participants performed within normal range on the task. Understanding the neural dynamics in chronic, regular cannabis users may provide insight on how long-term and/or frequent use may affect neural networks underlying cognitive processes.

Aging reduces EEG markers of recognition despite intact performance: Implications for forensic memory detection

ERP-based forensic memory detection is based on the logic that guilty suspects will hold incriminating knowledge about crimes they have committed, and therefore should show parietal ERP positivities related to recognition when presented with reminders of their crimes. We predicted that such forensic memory detection might however be inaccurate in older adults, because of changes to recognition-related brain activity that occurs with aging. We measured both ERPs and EEG oscillations associated with episodic old/new recognition and forensic memory detection in 30 younger (age < 30) and 30 older (age > 65) adults. EEG oscillations were included as a complementary measure which is less sensitive to temporal variability and component overlap than ERPs. In line with predictions, recognition-related parietal ERP positivities were significantly reduced in the older compared to younger group in both tasks, despite highly similar behavioural performance. We also observed aging-related reductions in oscillatory markers of recognition in the forensic memory detection test, while the oscillatory effects associated with episodic recognition were similar across age groups. This pattern of results suggests that while both forensic memory detection and episodic recognition are accompanied by aging-induced reductions in parietal ERP positivities, these reductions may be caused by non-overlapping mechanisms across the two tasks. Our findings suggest that EEG-based forensic memory detection tests are less valid in older than younger populations, limiting their practical applications.

Theta Oscillations and Source Connectivity During Complex Audiovisual Object Encoding in Working Memory

Working memory is a limited capacity memory system that involves the short-term storage and processing of information. Neuroscientific studies of working memory have mostly focused on the essential roles of neural oscillations during item encoding from single sensory modalities (e.g., visual and auditory). However, the characteristics of neural oscillations during multisensory encoding in working memory are rarely studied. Our study investigated the oscillation characteristics of neural signals in scalp electrodes and mapped functional brain connectivity while participants encoded complex audiovisual objects in a working memory task. Experimental results showed that theta oscillations (4–8 Hz) were prominent and topographically distributed across multiple cortical regions, including prefrontal (e.g., superior frontal gyrus), parietal (e.g., precuneus), temporal (e.g., inferior temporal gyrus), and occipital (e.g., cuneus) cortices. Furthermore, neural connectivity at the theta oscillation frequency was significant in these cortical regions during audiovisual object encoding compared with single modality object encoding. These results suggest that local oscillations and interregional connectivity via theta activity play an important role during audiovisual object encoding and may contribute to the formation of working memory traces from multisensory items.

Memory Load Alters Perception-Related Neural Oscillations during Multisensory Integration

Integrating information across different senses is a central feature of human perception. Previous research suggests that multisensory integration is shaped by a context-dependent and largely adaptive interplay between stimulus-driven bottom-up and top-down endogenous influences. One critical question concerns the extent to which this interplay is sensitive to the amount of available cognitive resources. In the present study, we investigated the influence of limited cognitive resources on audiovisual integration by measuring high-density electroencephalography (EEG) in healthy participants performing the sound-induced flash illusion (SIFI) and a verbal n-back task (0-back, low load and 2-back, high load) in a dual-task design. In the SIFI, the integration of a flash with two rapid beeps can induce the illusory perception of two flashes. We found that high compared with low load increased illusion susceptibility and modulated neural oscillations underlying illusion-related crossmodal interactions. Illusion perception under high load was associated with reduced early β power (18-26 Hz, ∼70 ms) in auditory and motor areas, presumably reflecting an early mismatch signal and subsequent top-down influences including increased frontal θ power (7-9 Hz, ∼120 ms) in mid-anterior cingulate cortex (ACC) and a later β power suppression (13-22 Hz, ∼350 ms) in prefrontal and auditory cortex. Our study demonstrates that integrative crossmodal interactions underlying the SIFI are sensitive to the amount of available cognitive resources and that multisensory integration engages top-down θ and β oscillations when cognitive resources are scarce.SIGNIFICANCE STATEMENT The integration of information across multiple senses, a remarkable ability of our perceptual system, is influenced by multiple context-related factors, the role of which is highly debated. It is, for instance, poorly understood how available cognitive resources influence crossmodal interactions during multisensory integration. We addressed this question using the sound-induced flash illusion (SIFI), a phenomenon in which the integration of two rapid beeps together with a flash induces the illusion of a second flash. Replicating our previous work, we demonstrate that depletion of cognitive resources through a working memory (WM) task increases the perception of the illusion. With respect to the underlying neural processes, we show that when available resources are limited, multisensory integration engages top-down θ and β oscillations.

EEG, MEG and neuromodulatory approaches to explore cognition: Current status and future directions

Neural oscillations and their association with brain states and cognitive functions have been object of extensive investigation over the last decades. Several electroencephalography (EEG) and magnetoencephalography (MEG) analysis approaches have been explored and oscillatory properties have been identified, in parallel with the technical and computational advancement. This review provides an up-to-date account of how EEG/MEG oscillations have contributed to the understanding of cognition. Methodological challenges, recent developments and translational potential, along with future research avenues, are discussed.

Characterization of Source-Localized EEG Activity During Sustained Deep-Tissue Pain

Musculoskeletal pain is a clinical condition that is characterized by ongoing pain and discomfort in the deep tissues such as muscle, bones, ligaments, nerves, and tendons. In the last decades, it was subject to extensive research due to its high prevalence. Still, a quantitative description of the electrical brain activity during musculoskeletal pain is lacking. This study aimed to characterize intracranial current source density (CSD) estimations during sustained deep-tissue experimental pain. Twenty-three healthy volunteers received three types of tonic stimuli for three minutes each: computer-controlled cuff pressure (1) below pain threshold (sustained deep-tissue no-pain, SDTnP), (2) above pain threshold (sustained deep-tissue pain, SDTP) and (3) vibrotactile stimulation (VT). The CSD in response to these stimuli was calculated in seven regions of interest (ROIs) likely involved in pain processing: contralateral anterior cingulate cortex, contralateral primary somatosensory cortex, bilateral anterior insula, contralateral dorsolateral prefrontal cortex, posterior parietal cortex and contralateral premotor cortex. Results showed that participants exhibited an overall increase in spectral power during SDTP in all seven ROIs compared to both SDTnP and VT, likely reflecting the differences in the salience of these stimuli. Moreover, we observed a difference is CSD due to the type of stimulus, likely reflecting somatosensory discrimination of stimulus intensity. These results describe the different contributions of neural oscillations within these brain regions in the processing of sustained deep-tissue pain.

Cerebral Cortical Activity Following Non-invasive Cerebellar Stimulation-a Systematic Review of Combined TMS and EEG Studies

The cerebellum sends dense projections to both motor and non-motor regions of the cerebral cortex via the cerebellarthalamocortical tract. The integrity of this tract is crucial for healthy motor and cognitive function. This systematic review examines research using transcranial magnetic stimulation (TMS) and transcranial direct current stimulation (tDCS) to the cerebellum with combined cortical electroencephalography (EEG) to explore the temporal features of cerebellar-cortical connectivity. A detailed discussion of the outcomes and limitations of the studies meeting review criteria is presented. Databases were searched between 1 December 2017 and 6 December 2017, with Scopus alerts current as of 23 July 2019. Of the 407 studies initially identified, 10 met review criteria. Findings suggested that cerebellar-cortical assessment is suited to combined TMS and EEG, although work is required to ensure experimental procedures are optimal for eliciting a reliable cerebellar response from stimulation. A distinct variation in methodologies and outcome measures employed across studies, and small sample sizes limited the conclusions that could be drawn regarding the electrophysiological signatures of cerebellar-cortical communication. This review highlights the need for stringent protocols and methodologies for cerebellar-cortical assessments via combined TMS and EEG. With these in place, combined TMS and EEG will provide a valuable means for exploring cerebellar connectivity with a wide range of cortical sites. Assessments have the potential to aid in the understanding of motor and cognitive function in both healthy and clinical groups, and provide insights into long-range neural communication generally.

Distractor probabilities modulate flanker task performance

Expectations about upcoming events help humans to effectively filter out potential distractors and respond more efficiently to task-relevant inputs. While previous work has emphasized the role of expectations about task-relevant inputs, less is known about the role that expectations play in suppressing specific distractors. To address this question, we manipulated the probabilities of different flanker configurations in the Eriksen flanker task. Across four studies, we found robust evidence for sensitivity to the probability of flankers, with an approximately logarithmic relationship between the likelihood of a particular flanker configuration and the accuracy of subjects' responses. Subjects were also sensitive to length of runs of repeated targets, but minimally sensitive to length of runs of repeated flankers. Two studies used chevron stimuli, and two used letters (confirming that results generalize with greater dissimilarity between stimuli). Expanding the set of stimuli (thus reducing the dominance of any one exemplar) eliminated the effect. Our findings suggest that expectations about distractors form in response to statistical regularities at multiple timescales, and that their effects are strongest when stimuli are geometrically similar and subjects are able to respond to trials quickly. Unexpected distractors could disrupt performance, most likely via a form of attentional capture. This work demonstrates how expectations can influence attention in complex cognitive settings, and illuminates the multiple, nested factors that contribute.

Deep Neural Network for Visual Stimulus-Based Reaction Time Estimation Using the Periodogram of Single-Trial EEG

Multiplexed deep neural networks (DNN) have engendered high-performance predictive models gaining popularity for decoding brain waves, extensively collected in the form of electroencephalogram (EEG) signals. In this paper, to the best of our knowledge, we introduce a first-ever DNN-based generalized approach to estimate reaction time (RT) using the periodogram representation of single-trial EEG in a visual stimulus-response experiment with 48 participants. We have designed a Fully Connected Neural Network (FCNN) and a Convolutional Neural Network (CNN) to predict and classify RTs for each trial. Though deep neural networks are widely known for classification applications, cascading FCNN/CNN with the Random Forest model, we designed a robust regression-based estimator to predict RT. With the FCNN model, the accuracies obtained for binary and 3-class classification were 93% and 76%, respectively, which further improved with the use of CNN (94% and 78%, respectively). The regression-based approach predicted RTs with correlation coefficients (CC) of 0.78 and 0.80 for FCNN and CNN, respectively. Investigating further, we found that the left central as well as parietal and occipital lobes were crucial for predicting RT, with significant activities in the theta and alpha frequency bands.

Continuous decoding of cognitive load from electroencephalography reveals task-general and task-specific correlates

OBJECTIVE

Algorithms to detect changes in cognitive load using non-invasive biosensors (e.g. electroencephalography (EEG)) have the potential to improve human-computer interactions by adapting systems to an individual's current information processing capacity, which may enhance performance and mitigate costly errors. However, for algorithms to provide maximal utility, they must be able to detect load across a variety of tasks and contexts. The current study aimed to build models that capture task-general EEG correlates of cognitive load, which would allow for load detection across variable task contexts.

APPROACH

Sliding-window support vector machines (SVM) were trained to predict periods of high versus low cognitive load across three cognitively and perceptually distinct tasks: n-back, mental arithmetic, and multi-object tracking. To determine how well these SVMs could generalize to novel tasks, they were trained on data from two of the three tasks and evaluated on the held-out task. Additionally, to better understand task-general and task-specific correlates of cognitive load, a set of models were trained on subsets of EEG frequency features.

MAIN RESULTS

Models achieved reliable performance in classifying periods of high versus low cognitive load both within and across tasks, demonstrating their generalizability. Furthermore, continuous model outputs correlated with subtle differences in self-reported mental effort and they captured predicted changes in load within individual trials of each task. Additionally, alpha or beta frequency features achieved reliable within- and cross-task performance, suggesting that activity in these frequency bands capture task-general signatures of cognitive load. In contrast, delta and theta frequency features performed considerably worse than the full cross-task models, suggesting that delta and theta activity may be reflective of task-specific differences across cognitive load conditions.

SIGNIFICANCE

EEG data contains task-general signatures of cognitive load. Sliding-window SVMs can capture these signatures and continuously detect load across multiple task contexts.

Age-Related Shifts in Theta Oscillatory Activity During Audio-Visual Integration Regardless of Visual Attentional Load

Audio-visual integration (AVI) is higher in attended conditions than in unattended conditions. Here, we explore the AVI effect when the attentional recourse is competed by additional visual distractors, and its aging effect using single- and dual-tasks. The results showed the highest AVI effect under single-task-attentional-load condition than under no- and dual-task-attentional-load conditions (all P < 0.05) in both older and younger groups, but the AVI effect was weaker and delayed for older adults compared to younger adults for all attentional-load conditions (all P < 0.05). The non-phase-locked oscillation for AVI analysis illustrated the highest theta and alpha oscillatory activity for single-task-attentional-load condition than for no- and dual-task-attentional-load conditions, and the AVI oscillatory activity mainly occurred in the Cz, CP1 and Oz of older adults but in the Fz, FC1, and Cz of younger adults. The AVI effect was significantly negatively correlated with FC1 (r² = 0.1468, P = 0.05) and Cz (r² = 0.1447, P = 0.048) theta activity and with Fz (r² = 0.1557, P = 0.043), FC1 (r² = 0.1042, P = 0.008), and Cz (r² = 0.0897, P = 0.010) alpha activity for older adults but not for younger adults in dual task. These results suggested a reduction in AVI ability for peripheral stimuli and a shift in AVI oscillation from anterior to posterior regions in older adults as an adaptive mechanism.

Age-related functional brain connectivity during audio-visual hand-held tool recognition

INTRODUCTION

Previous studies have confirmed increased functional connectivity in elderly adults during processing of simple audio-visual stimuli; however, it is unclear whether elderly adults maximize their performance by strengthening their functional brain connectivity when processing dynamic audio-visual hand-held tool stimuli. The present study aimed to explore this question using global functional connectivity.

METHODS

Twenty-one healthy elderly adults and 21 healthy younger adults were recruited to conduct a dynamic hand-held tool recognition task with high/low-intensity stimuli.

RESULTS

Elderly adults exhibited higher areas under the curve for both the high-intensity (3.5 versus. 2.7) and low-intensity (3.0 versus. 1.2) stimuli, indicating a higher audio-visual integration ability, but a delayed and widened audio-visual integration window for elderly adults for both the high-intensity (390 - 690 ms versus. 360 - 560 ms) and low-intensity (460 - 690 ms versus. 430 - 500 ms) stimuli. Additionally, elderly adults exhibited higher theta-band (all p < .01) but lower alpha-, beta-, and gamma-band functional connectivity (all p < .05) than younger adults under both the high- and low-intensity-stimulus conditions when processing audio-visual stimuli, except for gamma-band functional connectivity under the high-intensity-stimulus condition. Furthermore, higher theta- and alpha-band functional connectivity were observed for the audio-visual stimuli than for the auditory and visual stimuli and under the high-intensity-stimulus condition than under the low-intensity-stimulus condition.

CONCLUSION

The higher theta-band functional connectivity in elderly adults was mainly due to higher attention allocation. The results further suggested that in the case of sensory processing, theta, alpha, beta, and gamma activity might participate in different stages of perception.