Musical expertise is related to altered functional connectivity during audiovisual integration

Music training is associated with better audio-visual integration in Chinese language

In the present study, we aimed to investigate whether long-term music training could improve audio-visual speech integration in Chinese, using event-related brain potential (ERP) measurements. Specifically, we recruited musicians and non-musicians to participate in our experiment where visual Chinese characters were presented simultaneously with congruent or incongruent speech sounds. In order to maintain participants' focus on both auditory and visual modalities, they were instructed to perform a probe detection task. Our study revealed that for the musicians, audiovisual incongruent stimuli elicited larger N1 and N400 amplitudes compared to audiovisual congruent stimuli. Conversely, for the non-musicians, only a larger N400 amplitude was observed for incongruent stimuli relative to congruent stimuli, without a significant difference in N1 amplitude. Furthermore, correlation analyses indicated that more years of music training was associated with a larger N1 effect for the musicians. These results suggest that musicians were capable of detecting character-speech sound incongruence at an earlier time window compared to non-musicians. Overall, our findings provide compelling evidence that music training is associated with better integration of visual characters and auditory speech sounds in language processing.

Increased body movement equals better performance? Not always! Musical style determines motion degree perceived as optimal in music performance

Musicians' body behaviour has a preponderant role in audience perception. We investigated how performers' motion is perceived depending on the musical style and musical expertise. To further explore the effect of visual input, stimuli were presented in audio-only, audio-visual and visual-only conditions. We used motion and audio recordings of expert saxophone players playing two contrasting excerpts (positively and negatively valenced). For each excerpt, stimuli represented five motion degrees with increasing quantity of motion (QoM) and distinct predominant gestures. In the experiment (online and in-person), 384 participants rated performance recordings for expressiveness, professionalism and overall quality. Results revealed that, for the positively valenced excerpt, ratings increased as a function of QoM, whilst for the negatively valenced, the recording with predominant flap motion was favoured. Musicianship did not have a significant effect in motion perception. Concerning multisensory integration, both musicians and non-musicians presented visual dominance in the positively valenced excerpt, whereas in the negatively valenced, musicians shifted to auditory dominance. Our findings demonstrate that musical style not only determines the way observers perceive musicians' movement as adequate, but also that it can promote changes in multisensory integration.

Musical experience enhances time discrimination: Evidence from cortical responses

Time discrimination, a critical aspect of auditory perception, is influenced by numerous factors. Previous research has suggested that musical experience can restructure the brain, thereby enhancing time discrimination. However, this phenomenon remains underexplored. In this study, we seek to elucidate the enhancing effect of musical experience on time discrimination, utilizing both behavioral and electroencephalogram methodologies. Additionally, we aim to explore, through brain connectivity analysis, the role of increased connectivity in brain regions associated with auditory perception as a potential contributory factor to time discrimination induced by musical experience. The results show that the music-experienced group demonstrated higher behavioral accuracy, shorter reaction time, and shorter P3 and mismatch response latencies as compared to the control group. Furthermore, the music-experienced group had higher connectivity in the left temporal lobe. In summary, our research underscores the positive impact of musical experience on time discrimination and suggests that enhanced connectivity in brain regions linked to auditory perception may be responsible for this enhancement.

Unravelling the multisensory learning advantage: Different patterns of within and across frequency-specific interactions drive uni- and multisensory neuroplasticity

In the field of learning theory and practice, the superior efficacy of multisensory learning over uni-sensory is well-accepted. However, the underlying neural mechanisms at the macro-level of the human brain remain largely unexplored. This study addresses this gap by providing novel empirical evidence and a theoretical framework for understanding the superiority of multisensory learning. Through a cognitive, behavioral, and electroencephalographic assessment of carefully controlled uni-sensory and multisensory training interventions, our study uncovers a fundamental distinction in their neuroplastic patterns. A multilayered network analysis of pre- and post- training EEG data allowed us to model connectivity within and across different frequency bands at the cortical level. Pre-training EEG analysis unveils a complex network of distributed sources communicating through cross-frequency coupling, while comparison of pre- and post-training EEG data demonstrates significant differences in the reorganizational patterns of uni-sensory and multisensory learning. Uni-sensory training primarily modifies cross-frequency coupling between lower and higher frequencies, whereas multisensory training induces changes within the beta band in a more focused network, implying the development of a unified representation of audiovisual stimuli. In combination with behavioural and cognitive findings this suggests that, multisensory learning benefits from an automatic top-down transfer of training, while uni-sensory training relies mainly on limited bottom-up generalization. Our findings offer a compelling theoretical framework for understanding the advantage of multisensory learning.

Exploring the neurofunctional impairments and cognitive biases concerning food and body related stimuli in anorexia nervosa: An integrated EEG and eye-tracking study protocol

BACKGROUND

Patients with Anorexia Nervosa (AN) exhibit significant cognitive and neural disturbances compared to healthy individuals when processing food and body-related stimuli. These disturbances not only contribute to the manifestation and chronification of their pathological eating behaviour but also underscore the complex interplay of cognitive, emotional, and neurobiological factors in AN. However, the precise underlying cognitive and neural mechanisms of these disturbances remain a compelling area of investigation.

METHODS

This study presents a protocol developed for conducting a cross-sectional quasi-experimental study using a mixed model ANOVA approach with a crossover design. Our participants will consist of 20 patients with an active diagnosis of AN, 20 Overweight/obese individuals, and 20 Healthy Controls (HCs) with a normal BMI. An integrated eye-tracking and EEG methodology will be used in conjunction, with the primary aim of assessing participants' cognitive and neural processing towards high and low-calorie food stimuli. On an exploratory level, by utilizing the same methods, the present study will also investigate AN patients' responses towards high weight, normal weight, low weight, and self-body pictures, as well as towards images from the International Affective Picture System (IAPS) characterized by elevated valence and arousal levels. Additionally, behavioural methods such as yes or no questions, and self-reported questionnaires will be administered. The EEG and eye-tracking data will be analysed at early (50-300 ms) and late (350-500 ms) time intervals.

DISCUSSION

The investigation of the underlying cognitive and neural processes employed by patients with AN during the processing of food and body-related stimuli can help us develop a better understanding of the cognitive and neural mechanisms that contribute to the manifestation and maintenance of the disorder and assist in the development of more effective screening methods.

ETHICAL APPROVAL AND CONSENT TO PARTICIPATE

Ethical approval for the study has been obtained by the Cyprus National Bioethics Committee on 27.04.2023 (ΕΕΒΚ/ΕΠ/2023/19), and by the University of Cyprus (20.02.2023). Written informed consent will be obtained from all participants.

Audiovisual integration in the McGurk effect is impervious to music training

The McGurk effect refers to an audiovisual speech illusion where the discrepant auditory and visual syllables produce a fused percept between the visual and auditory component. However, little is known about how individual differences contribute to the McGurk effect. Here, we examined whether music training experience-which involves audiovisual integration-can modulate the McGurk effect. Seventy-three participants completed the Goldsmiths Musical Sophistication Index (Gold-MSI) questionnaire to evaluate their music expertise on a continuous scale. Gold-MSI considers participants' daily-life exposure to music learning experiences (formal and informal), instead of merely classifying people into different groups according to how many years they have been trained in music. Participants were instructed to report, via a 3-alternative forced choice task, "what a person said": /Ba/, /Ga/ or /Da/. The experiment consisted of 96 audiovisual congruent trials and 96 audiovisual incongruent (McGurk) trials. We observed no significant correlations between the susceptibility of the McGurk effect and the different subscales of the Gold-MSI (active engagement, perceptual abilities, music training, singing abilities, emotion) or the general musical sophistication composite score. Together, these findings suggest that music training experience does not modulate audiovisual integration in speech as reflected by the McGurk effect.

Audiovisual spatial ventriloquism is reduced in musicians

There is great scientific and public interest in claims that musical training improves general cognitive and perceptual abilities. While this is controversial, recent and rather convincing evidence suggests that musical training refines the temporal integration of auditory and visual stimuli at a general level. We investigated whether musical training also affects integration in the spatial domain, via an auditory localisation experiment that measured ventriloquism (where localisation is biased towards visual stimuli on audiovisual trials) and recalibration (a unimodal localisation aftereffect). While musicians (n = 22) and non-musicians (n = 22) did not have significantly different unimodal precision or accuracy, musicians were significantly less susceptible than non-musicians to ventriloquism, with large effect sizes. We replicated these results in another experiment with an independent sample of 24 musicians and 21 non-musicians. Across both experiments, spatial recalibration did not significantly differ between the groups even though musicians resisted ventriloquism. Our results suggest that the multisensory expertise afforded by musical training refines spatial integration, a process that underpins multisensory perception.

Tinnitus-frequency specific activity and connectivity: A MEG study

Tinnitus pathophysiology has been associated with an atypical cortical network that involves functional changes in auditory and non-auditory areas. Numerous resting-state studies have replicated a tinnitus brain network to be significantly different from healthy-controls. Yet it is still unknown whether the cortical reorganization is attributed to the tinnitus frequency specifically or if it is frequency-irrelevant. Employing magnetoencephalography (MEG), the current study aimed to identify frequency-specific activity patterns by using an individual tinnitus tone (TT) and a 500 Hz-control tone (CT) as auditory stimuli, across 54 tinnitus patients. MEG data were analyzed in a data-driven approach employing a whole-head model in source space and in sources' functional connectivity. Compared to the CT, the event related source space analysis revealed a statistically significant response to TT involving fronto-parietal regions. The CT mainly involved typical auditory activation-related regions. A comparison of the cortical responses to a healthy control group that underwent the same paradigm rejected the alternative interpretation that the frequency-specific activation differences were due to the higher frequency of the TT. Overall, the results suggest frequency-specificity of tinnitus-related cortical patterns. In line with previous studies, we demonstrated a tinnitus-frequency specific network comprising left fronto-temporal, fronto-parietal and tempo-parietal junctions.

Differences in brain functional networks for audiovisual integration during reading between children and adults

Building robust letter-to-sound correspondences is a prerequisite for developing reading capacity. However, the neural mechanisms underlying the development of audiovisual integration for reading are largely unknown. This study used functional magnetic resonance imaging in a lexical decision task to investigate functional brain networks that support audiovisual integration during reading in developing child readers (10-12 years old) and skilled adult readers (20-28 years old). The results revealed enhanced connectivity in a prefrontal-superior temporal network (including the right medial frontal gyrus, right superior frontal gyrus, and left superior temporal gyrus) in adults relative to children, reflecting the development of attentional modulation of audiovisual integration involved in reading processing. Furthermore, the connectivity strength of this brain network was correlated with reading accuracy. Collectively, this study, for the first time, elucidates the differences in brain networks of audiovisual integration for reading between children and adults, promoting the understanding of the neurodevelopment of multisensory integration in high-level human cognition.

Multisensory interactions on auditory and somatosensory information in expert pianists

Fine-tuned sensory functions typically characterize skilled individuals. Although numerous studies demonstrated enhanced unimodal sensory functions at both neural and behavioral levels in skilled individuals, little is known about their multisensory interaction function, especially multisensory integration and selective attention that involve volitional control of information derived from multiple sensory organs. In the current study, expert pianists and musically untrained individuals performed five sets of intensity discrimination tasks at the auditory and somatosensory modalities with different conditions: (1) auditory stimulus, (2) somatosensory stimulus, (3) congruent auditory and somatosensory stimuli (i.e., multisensory integration), (4) auditory and task-irrelevant somatosensory stimuli, and (5) somatosensory and task-irrelevant auditory stimuli. In the fourth and fifth conditions, participants were instructed to ignore a task-irrelevant stimulus and to pay attention to a task-relevant stimulus (i.e., selective attention), respectively. While the discrimination perception was superior in the condition (3) compared to the better one of the individual unimodal conditions only in the pianists, the task-irrelevant somatosensory stimulus worsened the auditory discrimination more in the pianists than the nonmusicians. These findings indicate unique multisensory interactions in expert pianists, which enables pianists to efficiently integrate the auditory and somatosensory information, but exacerbates top-down selective inhibition of somatosensory information during auditory processing.

Musicians show more integrated neural processing of contextually relevant acoustic features

Little is known about expertise-related plasticity of neural mechanisms for auditory feature integration. Here, we contrast two diverging hypotheses that musical expertise is associated with more independent or more integrated predictive processing of acoustic features relevant to melody perception. Mismatch negativity (MMNm) was recorded with magnetoencephalography (MEG) from 25 musicians and 25 non-musicians, exposed to interleaved blocks of a complex, melody-like multi-feature paradigm and a simple, oddball control paradigm. In addition to single deviants differing in frequency (F), intensity (I), or perceived location (L), double and triple deviants were included reflecting all possible feature combinations (FI, IL, LF, FIL). Following previous work, early neural processing overlap was approximated in terms of MMNm additivity by comparing empirical MMNms obtained with double and triple deviants to modeled MMNms corresponding to summed constituent single-deviant MMNms. Significantly greater subadditivity was found in musicians compared to non-musicians, specifically for frequency-related deviants in complex, melody-like stimuli. Despite using identical sounds, expertise effects were absent from the simple oddball paradigm. This novel finding supports the integrated processing hypothesis whereby musicians recruit overlapping neural resources facilitating more integrative representations of contextually relevant stimuli such as frequency (perceived as pitch) during melody perception. More generally, these specialized refinements in predictive processing may enable experts to optimally capitalize upon complex, domain-relevant, acoustic cues.

Interaction within and between cortical networks subserving multisensory learning and its reorganization due to musical expertise

Recent advancements in the field of network science allow us to quantify inter-network information exchange and model the interaction within and between task-defined states of large-scale networks. Here, we modeled the inter- and intra- network interactions related to multisensory statistical learning. To this aim, we implemented a multifeatured statistical learning paradigm and measured evoked magnetoencephalographic responses to estimate task-defined state of functional connectivity based on cortical phase interaction. Each network state represented the whole-brain network processing modality-specific (auditory, visual and audiovisual) statistical learning irregularities embedded within a multisensory stimulation stream. The way by which domain-specific expertise re-organizes the interaction between the networks was investigated by a comparison of musicians and non-musicians. Between the modality-specific network states, the estimated connectivity quantified the characteristics of a supramodal mechanism supporting the identification of statistical irregularities that are compartmentalized and applied in the identification of uni-modal irregularities embedded within multisensory stimuli. Expertise-related re-organization was expressed by an increase of intra- and a decrease of inter-network connectivity, showing increased compartmentalization.

Computerized Music-Reading Intervention Improves Resistance to Unisensory Distraction Within a Multisensory Task, in Young and Older Adults

Incoming information from multiple sensory channels compete for attention. Processing the relevant ones and ignoring distractors, while at the same time monitoring the environment for potential threats, is crucial for survival, throughout the lifespan. However, sensory and cognitive mechanisms often decline in aging populations, making them more susceptible to distraction. Previous interventions in older adults have successfully improved resistance to distraction, but the inclusion of multisensory integration, with its unique properties in attentional capture, in the training protocol is underexplored. Here, we studied whether, and how, a 4-week intervention, which targets audiovisual integration, affects the ability to deal with task-irrelevant unisensory deviants within a multisensory task. Musically naïve participants engaged in a computerized music reading game and were asked to detect audiovisual incongruences between the pitch of a song's melody and the position of a disk on the screen, similar to a simplistic music staff. The effects of the intervention were evaluated via behavioral and EEG measurements in young and older adults. Behavioral findings include the absence of age-related differences in distraction and the indirect improvement of performance due to the intervention, seen as an amelioration of response bias. An asymmetry between the effects of auditory and visual deviants was identified and attributed to modality dominance. The electroencephalographic results showed that both groups shared an increase in activation strength after training, when processing auditory deviants, located in the left dorsolateral prefrontal cortex. A functional connectivity analysis revealed that only young adults improved flow of information, in a network comprised of a fronto-parietal subnetwork and a multisensory temporal area. Overall, both behavioral measures and neurophysiological findings suggest that the intervention was indirectly successful, driving a shift in response strategy in the cognitive domain and higher-level or multisensory brain areas, and leaving lower level unisensory processing unaffected.

Exogenous Bimodal Cues Attenuate Age-Related Audiovisual Integration

Previous studies have demonstrated that exogenous attention decreases audiovisual integration (AVI); however, whether the AVI is different when exogenous attention is elicited by bimodal and unimodal cues and its aging effect remain unclear. To clarify this matter, 20 older adults and 20 younger adults were recruited to conduct an auditory/visual discrimination task following bimodal audiovisual cues or unimodal auditory/visual cues. The results showed that the response to all stimulus types was faster in younger adults compared with older adults, and the response was faster when responding to audiovisual stimuli compared with auditory or visual stimuli. Analysis using the race model revealed that the AVI was lower in the exogenous-cue conditions compared with the no-cue condition for both older and younger adults. The AVI was observed in all exogenous-cue conditions for the younger adults (visual cue > auditory cue > audiovisual cue); however, for older adults, the AVI was only found in the visual-cue condition. In addition, the AVI was lower in older adults compared to younger adults under no- and visual-cue conditions. These results suggested that exogenous attention decreased the AVI, and the AVI was lower in exogenous attention elicited by bimodal-cue than by unimodal-cue conditions. In addition, the AVI was reduced for older adults compared with younger adults under exogenous attention.

Computerized physical and cognitive training improves the functional architecture of the brain in adults with Down syndrome: A network science EEG study

Understanding the neuroplastic capacity of people with Down syndrome (PwDS) can potentially reveal the causal relationship between aberrant brain organization and phenotypic characteristics. We used resting-state EEG recordings to identify how a neuroplasticity-triggering training protocol relates to changes in the functional connectivity of the brain's intrinsic cortical networks. Brain activity of 12 PwDS before and after a 10-week protocol of combined physical and cognitive training was statistically compared to quantify changes in directed functional connectivity in conjunction with psychosomatometric assessments. PwDS showed increased connectivity within the left hemisphere and from left-to-right hemisphere, as well as increased physical and cognitive performance. Our findings reveal a strong adaptive neuroplastic reorganization as a result of the training that leads to a less-random network with a more pronounced hierarchical organization. Our results go beyond previous findings by indicating a transition to a healthier, more efficient, and flexible network architecture, with improved integration and segregation abilities in the brain of PwDS. Resting-state electrophysiological brain activity is used here for the first time to display meaningful relationships to underlying Down syndrome processes and outcomes of importance in a translational inquiry. This trial is registered with ClinicalTrials.gov Identifier NCT04390321.

Audiovisual structural connectivity in musicians and non-musicians: a cortical thickness and diffusion tensor imaging study

Our sensory systems provide complementary information about the multimodal objects and events that are the target of perception in everyday life. Professional musicians' specialization in the auditory domain is reflected in the morphology of their brains, which has distinctive characteristics, particularly in areas related to auditory and audio-motor activity. Here, we combined diffusion tensor imaging (DTI) with a behavioral measure of visually induced gain in pitch discrimination, and we used measures of cortical thickness (CT) correlations to assess how auditory specialization and musical expertise are reflected in the structural architecture of white and grey matter relevant to audiovisual processing. Across all participants (n = 45), we found a correlation (p < 0.001) between reliance on visual cues in pitch discrimination and the fractional anisotropy (FA) in the left inferior fronto-occipital fasciculus (IFOF), a structure connecting visual and auditory brain areas. Group analyses also revealed greater cortical thickness correlation between visual and auditory areas in non-musicians (n = 28) compared to musicians (n = 17), possibly reflecting musicians' auditory specialization (FDR < 10%). Our results corroborate and expand current knowledge of functional specialization with a specific focus on audition, and highlight the fact that perception is essentially multimodal while uni-sensory processing is a specialized task.

The Effect of Media Professionalization on Cognitive Neurodynamics During Audiovisual Cuts

Experts apply their experience to the proper development of their routine activities. Their acquired expertise or professionalization is expected to help in the development of those recurring tasks. Media professionals spend their daily work watching narrative contents on screens, so learning how they manage visual perception of those contents could be of interest in an increasingly audiovisual society. Media works require not only the understanding of the storytelling, but also the decoding of the formal rules and presentations. We recorded electroencephalographic (EEG) signals from 36 participants (18 media professionals and 18 non-media professionals) while they were watching audiovisual contents, and compared their eyeblink rate and their brain activity and connectivity. We found that media professionals decreased their blink rate after the cuts, suggesting that they can better manage the loss of visual information that blinks entail by sparing them when new visual information is being presented. Cuts triggered similar activation of basic brain processing in the visual cortex of the two groups, but different processing in medial and frontal cortical areas, where media professionals showed a lower activity. Effective brain connectivity occurred in a more organized way in media professionals–possibly due to a better communication between cortical areas that are coordinated for decoding new visual content after cuts.

Aging Effects on the Neuroplastic Attributes of Multisensory Cortical Networks as Triggered by a Computerized Music Reading Training Intervention

The constant increase in the graying population is the result of a great expansion of life expectancy. A smaller expansion of healthy cognitive and brain functioning diminishes the gains achieved by longevity. Music training, as a special case of multisensory learning, may induce restorative neuroplasticity in older ages. The current study aimed to explore aging effects on the cortical network supporting multisensory cognition and to define aging effects on the network's neuroplastic attributes. A computer-based music reading protocol was developed and evaluated via electroencephalography measurements pre- and post-training on young and older adults. Results revealed that multisensory integration is performed via diverse strategies in the two groups: Older adults employ higher-order supramodal areas to a greater extent than lower level perceptual regions, in contrast to younger adults, indicating an age-related shift in the weight of each processing strategy. Restorative neuroplasticity was revealed in the left inferior frontal gyrus and right medial temporal gyrus, as a result of the training, while task-related reorganization of cortical connectivity was obstructed in the group of older adults, probably due to systemic maturation mechanisms. On the contrary, younger adults significantly increased functional connectivity among the regions supporting multisensory integration.

Auditory but Not Audiovisual Cues Lead to Higher Neural Sensitivity to the Statistical Regularities of an Unfamiliar Musical Style

It is still a matter of debate whether visual aids improve learning of music. In a multisession study, we investigated the neural signatures of novel music sequence learning with or without aids (auditory-only: AO, audiovisual: AV). During three training sessions on three separate days, participants (nonmusicians) reproduced (note by note on a keyboard) melodic sequences generated by an artificial musical grammar. The AV group (n = 20) had each note color-coded on screen, whereas the AO group (n = 20) had no color indication. We evaluated learning of the statistical regularities of the novel music grammar before and after training by presenting melodies ending on correct or incorrect notes and by asking participants to judge the correctness and surprisal of the final note, while EEG was recorded. We found that participants successfully learned the new grammar. Although the AV group, as compared to the AO group, reproduced longer sequences during training, there was no significant difference in learning between groups. At the neural level, after training, the AO group showed a larger N100 response to low-probability compared with high-probability notes, suggesting an increased neural sensitivity to statistical properties of the grammar; this effect was not observed in the AV group. Our findings indicate that visual aids might improve sequence reproduction while not necessarily promoting better learning, indicating a potential dissociation between sequence reproduction and learning. We suggest that the difficulty induced by auditory-only input during music training might enhance cognitive engagement, thereby improving neural sensitivity to the underlying statistical properties of the learned material.

Auditory Categorization of Man-Made Sounds Versus Natural Sounds by Means of MEG Functional Brain Connectivity

Previous neuroimaging studies have shown that sounds can be discriminated due to living-related or man-made-related characteristics and involve different brain regions. However, these studies have mainly provided source space analyses, which offer simple maps of activated brain regions but do not explain how regions of a distributed system are functionally organized under a specific task. In the present study, we aimed to further examine the functional connectivity of the auditory processing pathway across different categories of non-speech sounds in healthy adults, by means of MEG. Our analyses demonstrated significant activation and interconnection differences between living and man-made object sounds, in the prefrontal areas, anterior-superior temporal gyrus (aSTG), posterior cingulate cortex (PCC), and supramarginal gyrus (SMG), occurring within 80–120 ms post-stimulus interval. Current findings replicated previous ones, in that other regions beyond the auditory cortex are involved during auditory processing. According to the functional connectivity analysis, differential brain networks across the categories exist, which proposes that sound category discrimination processing relies on distinct cortical networks, a notion that has been strongly argued in the literature also in relation to the visual system.

Visually induced gains in pitch discrimination: Linking audio-visual processing with auditory abilities

Perception is fundamentally a multisensory experience. The principle of inverse effectiveness (PoIE) states how the multisensory gain is maximal when responses to the unisensory constituents of the stimuli are weak. It is one of the basic principles underlying multisensory processing of spatiotemporally corresponding crossmodal stimuli that are well established at behavioral as well as neural levels. It is not yet clear, however, how modality-specific stimulus features influence discrimination of subtle changes in a crossmodally corresponding feature belonging to another modality. Here, we tested the hypothesis that reliance on visual cues to pitch discrimination follow the PoIE at the interindividual level (i.e., varies with varying levels of auditory-only pitch discrimination abilities). Using an oddball pitch discrimination task, we measured the effect of varying visually perceived vertical position in participants exhibiting a wide range of pitch discrimination abilities (i.e., musicians and nonmusicians). Visual cues significantly enhanced pitch discrimination as measured by the sensitivity index d', and more so in the crossmodally congruent than incongruent condition. The magnitude of gain caused by compatible visual cues was associated with individual pitch discrimination thresholds, as predicted by the PoIE. This was not the case for the magnitude of the congruence effect, which was unrelated to individual pitch discrimination thresholds, indicating that the pitch-height association is robust to variations in auditory skills. Our findings shed light on individual differences in multisensory processing by suggesting that relevant multisensory information that crucially aids some perceivers' performance may be of less importance to others, depending on their unisensory abilities.

Increased Functional Brain Network Efficiency During Audiovisual Temporal Asynchrony Integration Task in Aging

Audiovisual integration significantly changes over the lifespan, but age-related functional connectivity in audiovisual temporal asynchrony integration tasks remains underexplored. In the present study, electroencephalograms (EEGs) of 27 young adults (22–25 years) and 25 old adults (61–76 years) were recorded during an audiovisual temporal asynchrony integration task with seven conditions [auditory (A), visual (V), AV, A50V, A100V, V50A and V100A]. We calculated the phase lag index (PLI)-weighted connectivity networks modulated by the audiovisual tasks and found that the PLI connections showed obvious dynamic changes after stimulus onset. In the theta (4–7 Hz) and alpha (8–13 Hz) bands, the AV and V50A conditions induced stronger functional connections and higher global and local efficiencies, reflecting a stronger audiovisual integration effect, which was attributed to the auditory information arriving at the primary auditory cortex earlier than the visual information reaching the primary visual cortex. Importantly, the functional connectivity and network efficiencies of old adults revealed higher global and local efficiencies and higher degree in both the theta and alpha bands. These larger network efficiencies indicated that old adults might experience more difficulties in attention and cognitive control during the audiovisual integration task with temporal asynchrony than young adults. There were significant associations between network efficiencies and peak time of integration only in young adults. We propose that an audiovisual task with multiple conditions might arouse the appropriate attention in young adults but would lead to a ceiling effect in old adults. Our findings provide new insights into the network topography of old adults during audiovisual integration and highlight higher functional connectivity and network efficiencies due to greater cognitive demand.

Musical deficits and cortical thickness in people with schizophrenia

Investigation of acquired amusia caused by brain damage suggested that cortical lesions of the right hemisphere contributed to musical deficits. We previously reported reduced musical ability in schizophrenia; these deficits were correlated with clinical manifestations such as cognitive dysfunction and negative symptoms. However, the neural substrate underlying the musical disability in schizophrenia remains unclear. We investigated the relationship between musical deficits and cortical thickness in patients with schizophrenia using structural MRI. We recruited 24 patients (13 males; age mean=45.9years old), and 22 controls (14 males, age mean=43.5years old). Musical ability was assessed with the Montreal Battery for Evaluation of Amusia (MBEA), cognitive function with the Brief Assessment of Cognition in Schizophrenia (BACS) and clinical features of illness with the Positive and Negative Syndrome Scale (PANSS). MRI Images were acquired and processed using FreeSurfer. Surface-based analysis showed that thinner cortex in left temporal and inferior frontal region was associated with lower musical ability in schizophrenia. In contrast, in controls thicker cortex in the left supramarginal region was correlated with lower musical ability. These results shed light on the clinical pathology underlying the associations of musical ability, cognitive dysfunction and negative symptoms in patients with schizophrenia.

Causal inference and temporal predictions in audiovisual perception of speech and music

To form a coherent percept of the environment, the brain must integrate sensory signals emanating from a common source but segregate those from different sources. Temporal regularities are prominent cues for multisensory integration, particularly for speech and music perception. In line with models of predictive coding, we suggest that the brain adapts an internal model to the statistical regularities in its environment. This internal model enables cross-sensory and sensorimotor temporal predictions as a mechanism to arbitrate between integration and segregation of signals from different senses.

Long-Term Musical Training Alters Tactile Temporal-Order Judgment

Long-term musical training is an enriched multisensory training environment that can alter uni- and multisensory substrates and abilities. Amongst these altered abilities are faster reaction times for simple and complex sensory tasks. The crossed arm temporal-order judgement (TOJ) task is a complex tactile task in which TOJ error rate increases when arms are crossed. Reaction times (RTs) for this task are typically proportionate to the difficulty of the stimulus onset asynchrony (SOA) and increase more when the arms are crossed than when uncrossed. The objective of this study was to study the impact of musical training on RTs and accuracy for the crossed arm TOJ task. Seventeen musicians and 20 controls were tested. Musicians had significantly faster RTs for all crossed arm conditions and half of the uncrossed conditions. However, musicians had significantly more TOJ errors for the crossed posture. We speculate that faster musician TOJ RTs leave little time to consolidate conflicting internal and external task-related information when crossing the arms, leading to increased incorrect responses. These results provide novel insights on the potential mechanisms underlying the increased TOJ error rates when arms are crossed. Moreover, they add to the growing literature of altered sensory ability in musicians and propose an unexpected consequence of faster reaction times.

Functional connectivity of the cortical network supporting statistical learning in musicians and non-musicians: an MEG study

Statistical learning is a cognitive process of great importance for the detection and representation of environmental regularities. Complex cognitive processes such as statistical learning usually emerge as a result of the activation of widespread cortical areas functioning in dynamic networks. The present study investigated the cortical large-scale network supporting statistical learning of tone sequences in humans. The reorganization of this network related to musical expertise was assessed via a cross-sectional comparison of a group of musicians to a group of non-musicians. The cortical responses to a statistical learning paradigm incorporating an oddball approach were measured via Magnetoencephalographic (MEG) recordings. Large-scale connectivity of the cortical activity was calculated via a statistical comparison of the estimated transfer entropy in the sources' activity. Results revealed the functional architecture of the network supporting the processing of statistical learning, highlighting the prominent role of informational processing pathways that bilaterally connect superior temporal and intraparietal sources with the left IFG. Musical expertise is related to extensive reorganization of this network, as the group of musicians showed a network comprising of more widespread and distributed cortical areas as well as enhanced global efficiency and increased contribution of additional temporal and frontal sources in the information processing pathway.

Increased functional connectivity in the ventral and dorsal streams during retrieval of novel words in professional musicians

Current models of speech and language processing postulate the involvement of two parallel processing streams (the dual stream model): a ventral stream involved in mapping sensory and phonological representations onto lexical and conceptual representations and a dorsal stream contributing to sound-to-motor mapping, articulation, and to how verbal information is encoded and manipulated in memory. Based on previous evidence showing that music training has an influence on language processing, cognitive functions, and word learning, we examined EEG-based intracranial functional connectivity in the ventral and dorsal streams while musicians and nonmusicians learned the meaning of novel words through picture-word associations. In accordance with the dual stream model, word learning was generally associated with increased beta functional connectivity in the ventral stream compared to the dorsal stream. In addition, in the linguistically most demanding "semantic task," musicians outperformed nonmusicians, and this behavioral advantage was accompanied by increased left-hemispheric theta connectivity in both streams. Moreover, theta coherence in the left dorsal pathway was positively correlated with the number of years of music training. These results provide evidence for a complex interplay within a network of brain regions involved in semantic processing and verbal memory functions, and suggest that intensive music training can modify its functional architecture leading to advantages in novel word learning.

Beta-Band Functional Connectivity Influences Audiovisual Integration in Older Age: An EEG Study

Audiovisual integration occurs frequently and has been shown to exhibit age-related differences via behavior experiments or time-frequency analyses. In the present study, we examined whether functional connectivity influences audiovisual integration during normal aging. Visual, auditory, and audiovisual stimuli were randomly presented peripherally; during this time, participants were asked to respond immediately to the target stimulus. Electroencephalography recordings captured visual, auditory, and audiovisual processing in 12 old (60-78 years) and 12 young (22-28 years) male adults. For non-target stimuli, we focused on alpha (8-13 Hz), beta (13-30 Hz), and gamma (30-50 Hz) bands. We applied the Phase Lag Index to study the dynamics of functional connectivity. Then, the network topology parameters, which included the clustering coefficient, path length, small-worldness global efficiency, local efficiency and degree, were calculated for each condition. For the target stimulus, a race model was used to analyze the response time. Then, a Pearson correlation was used to test the relationship between each network topology parameters and response time. The results showed that old adults activated stronger connections during audiovisual processing in the beta band. The relationship between network topology parameters and the performance of audiovisual integration was detected only in old adults. Thus, we concluded that old adults who have a higher load during audiovisual integration need more cognitive resources. Furthermore, increased beta band functional connectivity influences the performance of audiovisual integration during normal aging.

Variability in functional brain networks predicts expertise during action observation

Observing an action performed by another individual activates, in the observer, similar circuits as those involved in the actual execution of that action. This activation is modulated by prior experience; indeed, sustained training in a particular motor domain leads to structural and functional changes in critical brain areas. Here, we capitalized on a novel graph-theory approach to electroencephalographic data (Fraiman et al., 2016) to test whether variability in functional brain networks implicated in Tango observation can discriminate between groups differing in their level of expertise. We found that experts and beginners significantly differed in the functional organization of task-relevant networks. Specifically, networks in expert Tango dancers exhibited less variability and a more robust functional architecture. Notably, these expertise-dependent effects were captured within networks derived from electrophysiological brain activity recorded in a very short time window (2s). In brief, variability in the organization of task-related networks seems to be a highly sensitive indicator of long-lasting training effects. This finding opens new methodological and theoretical windows to explore the impact of domain-specific expertise on brain plasticity, while highlighting variability as a fruitful measure in neuroimaging research.

Skilled musicians are not subject to the McGurk effect

The McGurk effect is a compelling illusion in which humans auditorily perceive mismatched audiovisual speech as a completely different syllable. In this study evidences are provided that professional musicians are not subject to this illusion, possibly because of their finer auditory or attentional abilities. 80 healthy age-matched graduate students volunteered to the study. 40 were musicians of Brescia Luca Marenzio Conservatory of Music with at least 8–13 years of musical academic studies. /la/, /da/, /ta/, /ga/, /ka/, /na/, /ba/, /pa/ phonemes were presented to participants in audiovisual congruent and incongruent conditions, or in unimodal (only visual or only auditory) conditions while engaged in syllable recognition tasks. Overall musicians showed no significant McGurk effect for any of the phonemes. Controls showed a marked McGurk effect for several phonemes (including alveolar-nasal, velar-occlusive and bilabial ones). The results indicate that the early and intensive musical training might affect the way the auditory cortex process phonetic information.

The Unfitted Discontinuous Galerkin Method for Solving the EEG Forward Problem

OBJECTIVE

The purpose of this study is to introduce and evaluate the unfitted discontinuous Galerkin finite element method (UDG-FEM) for solving the electroencephalography (EEG) forward problem.

METHODS

This new approach for source analysis does not use a geometry conforming volume triangulation, but instead uses a structured mesh that does not resolve the geometry. The geometry is described using level set functions and is incorporated implicitly in its mathematical formulation. As no triangulation is necessary, the complexity of a simulation pipeline and the need for manual interaction for patient-specific simulations can be reduced and is comparable with that of the FEM for hexahedral meshes. In addition, it maintains conservation laws on a discrete level. Here, we present the theory for UDG-FEM forward modeling, its verification using quasi-analytical solutions in multilayer sphere models and an evaluation in a comparison with a discontinuous Galerkin (DG-FEM) method on hexahedral and on conforming tetrahedral meshes. We furthermore apply the UDG-FEM forward approach in a realistic head model simulation study.

RESULTS

The results show convergence to the quasi-analytical solution and indicate a good accuracy of UDG-FEM. UDG-FEM performs comparable or even better than DG-FEM on a conforming tetrahedral mesh while providing a less complex simulation pipeline. When compared to DG-FEM on hexahedral meshes, an overall better accuracy is achieved.

CONCLUSION

The UDG-FEM approach is an accurate, flexible, and promising method to solve the EEG forward problem.

SIGNIFICANCE

This study shows the first application of the UDG-FEM approach to the EEG forward problem.

Multi-Dimensional Dynamics of Human Electromagnetic Brain Activity

Magnetoencephalography (MEG) and electroencephalography (EEG) are invaluable neuroscientific tools for unveiling human neural dynamics in three dimensions (space, time, and frequency), which are associated with a wide variety of perceptions, cognition, and actions. MEG/EEG also provides different categories of neuronal indices including activity magnitude, connectivity, and network properties along the three dimensions. In the last 20 years, interest has increased in inter-regional connectivity and complex network properties assessed by various sophisticated scientific analyses. We herein review the definition, computation, short history, and pros and cons of connectivity and complex network (graph-theory) analyses applied to MEG/EEG signals. We briefly describe recent developments in source reconstruction algorithms essential for source-space connectivity and network analyses. Furthermore, we discuss a relatively novel approach used in MEG/EEG studies to examine the complex dynamics represented by human brain activity. The correct and effective use of these neuronal metrics provides a new insight into the multi-dimensional dynamics of the neural representations of various functions in the complex human brain.