1
|
Celma-Miralles A, Seeberg AB, Haumann NT, Vuust P, Petersen B. Experience with the cochlear implant enhances the neural tracking of spectrotemporal patterns in the Alberti bass. Hear Res 2024; 452:109105. [PMID: 39216335 DOI: 10.1016/j.heares.2024.109105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 08/08/2024] [Accepted: 08/13/2024] [Indexed: 09/04/2024]
Abstract
Cochlear implant (CI) users experience diminished music enjoyment due to the technical limitations of the CI. Nonetheless, behavioral studies have reported that rhythmic features are well-transmitted through the CI. Still, the gradual improvement of rhythm perception after the CI switch-on has not yet been determined using neurophysiological measures. To fill this gap, we here reanalyzed the electroencephalographic responses of participants from two previous mismatch negativity studies. These studies included eight recently implanted CI users measured twice, within the first six weeks after CI switch-on and approximately three months later; thirteen experienced CI users with a median experience of 7 years; and fourteen normally hearing (NH) controls. All participants listened to a repetitive four-tone pattern (known in music as Alberti bass) for 35 min. Applying frequency tagging, we aimed to estimate the neural activity synchronized to the periodicities of the Alberti bass. We hypothesized that longer experience with the CI would be reflected in stronger frequency-tagged neural responses approaching the responses of NH controls. We found an increase in the frequency-tagged amplitudes after only 3 months of CI use. This increase in neural synchronization may reflect an early adaptation to the CI stimulation. Moreover, the frequency-tagged amplitudes of experienced CI users were significantly greater than those of recently implanted CI users, but still smaller than those of NH controls. The frequency-tagged neural responses did not just reflect spectrotemporal changes in the stimuli (i.e., intensity or spectral content fluctuating over time), but also showed non-linear transformations that seemed to enhance relevant periodicities of the Alberti bass. Our findings provide neurophysiological evidence indicating a gradual adaptation to the CI, which is noticeable already after three months, resulting in close to NH brain processing of spectrotemporal features of musical rhythms after extended CI use.
Collapse
Affiliation(s)
- Alexandre Celma-Miralles
- Center for Music in the Brain, dept. of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark.
| | - Alberte B Seeberg
- Center for Music in the Brain, dept. of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| | - Niels T Haumann
- Center for Music in the Brain, dept. of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| | - Peter Vuust
- Center for Music in the Brain, dept. of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| | - Bjørn Petersen
- Center for Music in the Brain, dept. of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| |
Collapse
|
2
|
Wu Q, Sun L, Ding N, Yang Y. Musical tension is affected by metrical structure dynamically and hierarchically. Cogn Neurodyn 2024; 18:1955-1976. [PMID: 39104669 PMCID: PMC11297889 DOI: 10.1007/s11571-023-10058-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 11/29/2023] [Accepted: 12/11/2023] [Indexed: 08/07/2024] Open
Abstract
As the basis of musical emotions, dynamic tension experience is felt by listeners as music unfolds over time. The effects of musical harmonic and melodic structures on tension have been widely investigated, however, the potential roles of metrical structures in tension perception remain largely unexplored. This experiment examined how different metrical structures affect tension experience and explored the underlying neural activities. The electroencephalogram (EEG) was recorded and subjective tension was rated simultaneously while participants listened to music meter sequences. On large time scale of whole meter sequences, it was found that different overall tension and low-frequency (1 ~ 4 Hz) steady-state evoked potentials were elicited by metrical structures with different periods of strong beats, and the higher overall tension was associated with metrical structure with the shorter intervals between strong beats. On small time scale of measures, dynamic tension fluctuations within measures was found to be associated with the periodic modulations of high-frequency (10 ~ 25 Hz) neural activities. The comparisons between the same beats within measures and across different meters both on small and large time scales verified the contextual effects of meter on tension induced by beats. Our findings suggest that the overall tension is determined by temporal intervals between strong beats, and the dynamic tension experience may arise from cognitive processing of hierarchical temporal expectation and attention, which are discussed under the theoretical frameworks of metrical hierarchy, musical expectation and dynamic attention.
Collapse
Affiliation(s)
- Qiong Wu
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, No. 16 Lincui Road, Chaoyang District, Beijing, 100101 China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Lijun Sun
- College of Arts, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Nai Ding
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou, China
| | - Yufang Yang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, No. 16 Lincui Road, Chaoyang District, Beijing, 100101 China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
3
|
Nisha KV, Parmar A, Shivaiah C, Prabhu P. Differential advantages of musical backgrounds on binaural integration and interaction skills in instrumentalists, vocalists, and non-musicians. J Otol 2023; 18:185-192. [PMID: 37877069 PMCID: PMC10593578 DOI: 10.1016/j.joto.2023.06.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 06/22/2023] [Accepted: 06/26/2023] [Indexed: 10/26/2023] Open
Abstract
Background Musical perception requires a host of skills. Instrumental musicians place greater emphasis on motor coordination, whereas vocal musicians rehearse vocal sounds. The study explored the differential advantages of musical background on binaural integration and interaction in musicians (instrumentalists, vocalists) and compared them with age-matched non-musicians. Methods Eight six participants aged 20-40 y with normal hearing sensitivity were subjected to binaural tests using a standard group comparison research design. The participants were segregated into three groups - Group 1 included instrumentalists (n = 26, mean age: 17.73 ± 2.83 y), while Group 2 and Group 3 consisted of vocalists (n = 30, mean age: 19.30 ± 2.47 y) and non-musicians (n = 30, mean age: 18.20 ± 3.02 y) respectively. The binaural processes namely integration (Dichotic syllable test, DST; and virtual acoustic space identification - VASI) and interaction (Interaural difference thresholds for time and level: ITD & ILD), were administered on all the participants. Results Statistical analyses showed the main effect of musicianship. Bonferroni pair-wise test revealed that the musicians (instrumentalists and vocalists) outperformed (p < 0.05) non-musicians in all the tests. The differential advantage of the musical background was seen on the binaural integration test with instrumentalists performing better in the VASI test compared to vocalists, and vice-versa for DST. No difference was observed in interaction tasks (ITD & ILD) between vocalists and instrumentalists (p > 0.05). Conclusion Musical background-induced differential advantages can be reasonably noted in the binaural skills of instrumentalists and vocalists (compared to non-musicians).
Collapse
Affiliation(s)
- Kavassery Venkateswaran Nisha
- Department of Audiology, All India Institute of Speech and Hearing (AIISH), Naimisham Campus, Manasagangothri, Mysore, 570006, India
| | - Adya Parmar
- Department of Audiology, All India Institute of Speech and Hearing (AIISH), Naimisham Campus, Manasagangothri, Mysore, 570006, India
| | - Chandana Shivaiah
- Department of Audiology, All India Institute of Speech and Hearing (AIISH), Naimisham Campus, Manasagangothri, Mysore, 570006, India
| | - Prashanth Prabhu
- Department of Audiology, All India Institute of Speech and Hearing (AIISH), Naimisham Campus, Manasagangothri, Mysore, 570006, India
| |
Collapse
|
4
|
Hunter S, Flaten E, Petersen C, Gervain J, Werker JF, Trainor LJ, Finlay BB. Babies, bugs and brains: How the early microbiome associates with infant brain and behavior development. PLoS One 2023; 18:e0288689. [PMID: 37556397 PMCID: PMC10411758 DOI: 10.1371/journal.pone.0288689] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Accepted: 06/30/2023] [Indexed: 08/11/2023] Open
Abstract
Growing evidence is demonstrating the connection between the microbiota gut-brain axis and neurodevelopment. Microbiota colonization occurs before the maturation of many neural systems and is linked to brain health. Because of this it has been hypothesized that the early microbiome interactions along the gut-brain axis evolved to promote advanced cognitive functions and behaviors. Here, we performed a pilot study with a multidisciplinary approach to test if the microbiota composition of infants is associated with measures of early cognitive development, in particular neural rhythm tracking; language (forward speech) versus non-language (backwards speech) discrimination; and social joint attention. Fecal samples were collected from 56 infants between four and six months of age and sequenced by shotgun metagenomic sequencing. Of these, 44 performed the behavioral Point and Gaze test to measure joint attention. Infants were tested on either language discrimination using functional near-infrared spectroscopy (fNIRS; 25 infants had usable data) or neural rhythm tracking using electroencephalogram (EEG; 15 had usable data). Infants who succeeded at the Point and Gaze test tended to have increased Actinobacteria and reduced Firmicutes at the phylum level; and an increase in Bifidobacterium and Eggerthella along with a reduction in Hungatella and Streptococcus at the genus level. Measurements of neural rhythm tracking associated negatively to the abundance of Bifidobacterium and positively to the abundance of Clostridium and Enterococcus for the bacterial abundances, and associated positively to metabolic pathways that can influence neurodevelopment, including branched chain amino acid biosynthesis and pentose phosphate pathways. No associations were found for the fNIRS language discrimination measurements. Although the tests were underpowered due to the small pilot sample sizes, potential associations were identified between the microbiome and measurements of early cognitive development that are worth exploring further.
Collapse
Affiliation(s)
- Sebastian Hunter
- Michael Smith Laboratories, University of British Columbia, Vancouver, BC, Canada
| | - Erica Flaten
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada
| | - Charisse Petersen
- Department of Pediatrics, BC Children’s Hospital, University of British Columbia, Vancouver, BC, Canada
- British Columbia Children’s Hospital, Vancouver, BC, Canada
| | - Judit Gervain
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
- University of Padua, Padova Neuroscience Center, Padua, Italy
- Université Paris Cité & CNRS, Integrative Neuroscience and Cognition Center, Paris, France
| | - Janet F. Werker
- Department of Psychology, University of British Columbia, Vancouver, BC, Canada
| | - Laurel J. Trainor
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada
- McMaster Institute for Music and the Mind, McMaster University, Hamilton, Ontario, Canada
- Rotman Research Institute, Baycrest Hospital, Toronto, Ontario, Canada
| | - Brett B. Finlay
- Michael Smith Laboratories, University of British Columbia, Vancouver, BC, Canada
- Department of Microbiology and Immunology, University of British Columbia, Vancouver, BC, Canada
- Department of Biochemistry and Molecular Biology, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|
5
|
Papatzikis E, Agapaki M, Selvan RN, Pandey V, Zeba F. Quality standards and recommendations for research in music and neuroplasticity. Ann N Y Acad Sci 2023; 1520:20-33. [PMID: 36478395 DOI: 10.1111/nyas.14944] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Research on how music influences brain plasticity has gained momentum in recent years. Considering, however, the nonuniform methodological standards implemented, the findings end up being nonreplicable and less generalizable. To address the need for a standardized baseline of research quality, we gathered all the studies in the music and neuroplasticity field in 2019 and appraised their methodological rigor systematically and critically. The aim was to provide a preliminary and, at the minimum, acceptable quality threshold-and, ipso facto, suggested recommendations-whereupon further discussion and development may take place. Quality appraisal was performed on 89 articles by three independent raters, following a standardized scoring system. The raters' scoring was cross-referenced following an inter-rater reliability measure, and further studied by performing multiple ratings comparisons and matrix analyses. The results for methodological quality were at a quite good level (quantitative articles: mean = 0.737, SD = 0.084; qualitative articles: mean = 0.677, SD = 0.144), following a moderate but statistically significant level of agreement between the raters (W = 0.44, χ2 = 117.249, p = 0.020). We conclude that the standards for implementation and reporting are of high quality; however, certain improvements are needed to reach the stringent levels presumed for such an influential interdisciplinary scientific field.
Collapse
Affiliation(s)
- Efthymios Papatzikis
- Department of Early Childhood Education and Care, Oslo Metropolitan University, Oslo, Norway
| | - Maria Agapaki
- Department of Early Childhood Education and Care, Oslo Metropolitan University, Oslo, Norway
| | - Rosari Naveena Selvan
- Institute for Physics 3 - Biophysics and Bernstein Center for Computational Neuroscience (BCCN), University of Göttingen, Göttingen, Germany.,Department of Psychology, University of Münster, Münster, Germany
| | | | - Fathima Zeba
- School of Humanities and Social Sciences, Manipal Academy of Higher Education Dubai, Dubai, United Arab Emirates
| |
Collapse
|
6
|
Kasdan AV, Burgess AN, Pizzagalli F, Scartozzi A, Chern A, Kotz SA, Wilson SM, Gordon RL. Identifying a brain network for musical rhythm: A functional neuroimaging meta-analysis and systematic review. Neurosci Biobehav Rev 2022; 136:104588. [PMID: 35259422 PMCID: PMC9195154 DOI: 10.1016/j.neubiorev.2022.104588] [Citation(s) in RCA: 29] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Revised: 01/31/2022] [Accepted: 02/14/2022] [Indexed: 01/05/2023]
Abstract
We conducted a systematic review and meta-analysis of 30 functional magnetic resonance imaging studies investigating processing of musical rhythms in neurotypical adults. First, we identified a general network for musical rhythm, encompassing all relevant sensory and motor processes (Beat-based, rest baseline, 12 contrasts) which revealed a large network involving auditory and motor regions. This network included the bilateral superior temporal cortices, supplementary motor area (SMA), putamen, and cerebellum. Second, we identified more precise loci for beat-based musical rhythms (Beat-based, audio-motor control, 8 contrasts) in the bilateral putamen. Third, we identified regions modulated by beat based rhythmic complexity (Complexity, 16 contrasts) which included the bilateral SMA-proper/pre-SMA, cerebellum, inferior parietal regions, and right temporal areas. This meta-analysis suggests that musical rhythm is largely represented in a bilateral cortico-subcortical network. Our findings align with existing theoretical frameworks about auditory-motor coupling to a musical beat and provide a foundation for studying how the neural bases of musical rhythm may overlap with other cognitive domains.
Collapse
Affiliation(s)
- Anna V Kasdan
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA; Curb Center for Art, Enterprise, and Public Policy, Nashville, TN, USA.
| | - Andrea N Burgess
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA
| | | | - Alyssa Scartozzi
- Department of Otolaryngology - Head and Neck Surgery, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Alexander Chern
- Department of Otolaryngology - Head & Neck Surgery, New York-Presbyterian/Columbia University Irving Medical Center and Columbia University Vagelos College of Physicians and Surgeons, New York, NY, USA; Department of Otolaryngology - Head and Neck Surgery, New York-Presbyterian/Weill Cornell Medical Center, New York, NY, USA
| | - Sonja A Kotz
- Department of Neuropsychology and Psychopharmacology, Maastricht University, Maastricht, The Netherlands; Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Stephen M Wilson
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA; Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Reyna L Gordon
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, USA; Curb Center for Art, Enterprise, and Public Policy, Nashville, TN, USA; Department of Otolaryngology - Head and Neck Surgery, Vanderbilt University Medical Center, Nashville, TN, USA
| |
Collapse
|
7
|
Flaten E, Marshall SA, Dittrich A, Trainor L. Evidence for Top-down Meter Perception in Infancy as Shown by Primed Neural Responses to an Ambiguous Rhythm. Eur J Neurosci 2022; 55:2003-2023. [PMID: 35445451 DOI: 10.1111/ejn.15671] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Revised: 03/23/2022] [Accepted: 03/24/2022] [Indexed: 11/30/2022]
Abstract
From auditory rhythm patterns, listeners extract the underlying steady beat, and perceptually group beats to form meters. While previous studies show infants discriminate different auditory meters, it remains unknown whether they can maintain (imagine) a metrical interpretation of an ambiguous rhythm through top-down processes. We investigated this via electroencephalographic mismatch responses. We primed 6-month-old infants (N = 24) to hear a 6-beat ambiguous rhythm either in duple meter (n = 13), or in triple meter (n = 11) through loudness accents either on every second or every third beat. Periods of priming were inserted before sequences of the ambiguous unaccented rhythm. To elicit mismatch responses, occasional pitch deviants occurred on either beat 4 (strong beat in triple meter; weak in duple) or beat 5 (strong in duple; weak in triple) of the unaccented trials. At frontal left sites, we found a significant interaction between beat and priming group in the predicted direction. Post-hoc analyses showed mismatch response amplitudes were significantly larger for beat 5 in the duple- than triple-primed group (p = .047) and were non-significantly larger for beat 4 in the triple- than duple-primed group. Further, amplitudes were generally larger in infants with musically experienced parents. At frontal right sites, mismatch responses were generally larger for those in the duple compared to triple group, which may reflect a processing advantage for duple meter. These results indicate infants can impose a top-down, internally generated meter on ambiguous auditory rhythms, an ability that would aid early language and music learning.
Collapse
Affiliation(s)
- Erica Flaten
- Department of Psychology, Neuroscience and Behaviour, McMaster University
| | - Sara A Marshall
- Department of Psychology, Neuroscience and Behaviour, McMaster University
| | - Angela Dittrich
- Department of Psychology, Neuroscience and Behaviour, McMaster University
| | - Laurel Trainor
- Department of Psychology, Neuroscience and Behaviour, McMaster University.,McMaster Institute for Music and the Mind, McMaster University.,Rotman Research Institute, Baycrest Hospital, Toronto, ON, Canada
| |
Collapse
|
8
|
Bonetti L, Brattico E, Carlomagno F, Donati G, Cabral J, Haumann NT, Deco G, Vuust P, Kringelbach ML. Rapid encoding of musical tones discovered in whole-brain connectivity. Neuroimage 2021; 245:118735. [PMID: 34813972 DOI: 10.1016/j.neuroimage.2021.118735] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Revised: 09/30/2021] [Accepted: 11/14/2021] [Indexed: 11/26/2022] Open
Abstract
Information encoding has received a wide neuroscientific attention, but the underlying rapid spatiotemporal brain dynamics remain largely unknown. Here, we investigated the rapid brain mechanisms for encoding of sounds forming a complex temporal sequence. Specifically, we used magnetoencephalography (MEG) to record the brain activity of 68 participants while they listened to a highly structured musical prelude. Functional connectivity analyses performed using phase synchronisation and graph theoretical measures showed a large network of brain areas recruited during encoding of sounds, comprising primary and secondary auditory cortices, frontal operculum, insula, hippocampus and basal ganglia. Moreover, our results highlighted the rapid transition of brain activity from primary auditory cortex to higher order association areas including insula and superior temporal pole within a whole-brain network, occurring during the first 220 ms of the encoding process. Further, we discovered that individual differences along cognitive abilities and musicianship modulated the degree centrality of the brain areas implicated in the encoding process. Indeed, participants with higher musical expertise presented a stronger centrality of superior temporal gyrus and insula, while individuals with high working memory abilities showed a stronger centrality of frontal operculum. In conclusion, our study revealed the rapid unfolding of brain network dynamics responsible for the encoding of sounds and their relationship with individual differences, showing a complex picture which extends beyond the well-known involvement of auditory areas. Indeed, our results expanded our understanding of the general mechanisms underlying auditory pattern encoding in the human brain.
Collapse
Affiliation(s)
- L Bonetti
- Centre for Eudaimonia and Human Flourishing, University of Oxford, United Kingdom; Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark; Department of Psychiatry, University of Oxford, Oxford, United Kingdom; Department of Psychology, University of Bologna, Italy.
| | - E Brattico
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark; Department of Education, Psychology, Communication, University of Bari Aldo Moro, Italy
| | - F Carlomagno
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| | - G Donati
- Department of Psychology, University of Bologna, Italy; Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| | - J Cabral
- Centre for Eudaimonia and Human Flourishing, University of Oxford, United Kingdom; Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark; Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, 4710-057 Braga, Portugal
| | - N T Haumann
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| | - G Deco
- Institució Catalana de la Recerca i Estudis Avançats (ICREA), Passeig Lluís Companys 23, Barcelona, 08010, Spain; Computational and Theoretical Neuroscience Group, Center for Brain and Cognition, Universitat Pompeu Fabra, Barcelona, Spain
| | - P Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| | - M L Kringelbach
- Centre for Eudaimonia and Human Flourishing, University of Oxford, United Kingdom; Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark; Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
9
|
Bakas S, Adamos DA, Laskaris N. On the estimate of music appraisal from surface EEG: a dynamic-network approach based on cross-sensor PAC measurements. J Neural Eng 2021; 18. [PMID: 33975291 DOI: 10.1088/1741-2552/abffe6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2020] [Accepted: 05/11/2021] [Indexed: 11/11/2022]
Abstract
Objective.The aesthetic evaluation of music is strongly dependent on the listener and reflects manifold brain processes that go well beyond the perception of incident sound. Being a high-level cognitive reaction, it is difficult to predict merely from the acoustic features of the audio signal and this poses serious challenges to contemporary music recommendation systems. We attempted to decode music appraisal from brain activity, recorded via wearable EEG, during music listening.Approach.To comply with the dynamic nature of music stimuli, cross-frequency coupling measurements were employed in a time-evolving manner to capture the evolving interactions between distinct brain-rhythms during music listening. Brain response to music was first represented as a continuous flow of functional couplings referring to both regional and inter-regional brain dynamics and then modelled as an ensemble of time-varying (sub)networks. Dynamic graph centrality measures were derived, next, as the final feature-engineering step and, lastly, a support-vector machine was trained to decode the subjective music appraisal. A carefully designed experimental paradigm provided the labeled brain signals.Main results.Using data from 20 subjects, dynamic programming to tailor the decoder to each subject individually and cross-validation, we demonstrated highly satisfactory performance (MAE= 0.948,R2= 0.63) that can be attributed, mostly, to interactions of left frontal gamma rhythm. In addition, our music-appraisal decoder was also employed in a part of the DEAP dataset with similar success. Finally, even a generic version of the decoder (common for all subjects) was found to perform sufficiently.Significance.A novel brain signal decoding scheme was introduced and validated empirically on suitable experimental data. It requires simple operations and leaves room for real-time implementation. Both the code and the experimental data are publicly available.
Collapse
Affiliation(s)
- Stylianos Bakas
- Department of Informatics, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece.,Neuroinformatics GRoup, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Dimitrios A Adamos
- School of Music Studies, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece.,Department of Computing, Imperial College London, SW7 2AZ London, United Kingdom.,Neuroinformatics GRoup, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Nikolaos Laskaris
- Department of Informatics, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece.,Neuroinformatics GRoup, Aristotle University of Thessaloniki, Thessaloniki, Greece
| |
Collapse
|
10
|
Nijhuis P, Keller PE, Nozaradan S, Varlet M. Dynamic modulation of cortico-muscular coupling during real and imagined sensorimotor synchronisation. Neuroimage 2021; 238:118209. [PMID: 34051354 DOI: 10.1016/j.neuroimage.2021.118209] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2020] [Revised: 04/19/2021] [Accepted: 05/10/2021] [Indexed: 12/20/2022] Open
Abstract
People have a natural and intrinsic ability to coordinate body movements with rhythms surrounding them, known as sensorimotor synchronisation. This can be observed in daily environments, when dancing or singing along with music, or spontaneously walking, talking or applauding in synchrony with one another. However, the neurophysiological mechanisms underlying accurately synchronised movement with selected rhythms in the environment remain unclear. Here we studied real and imagined sensorimotor synchronisation with interleaved auditory and visual rhythms using cortico-muscular coherence (CMC) to better understand the processes underlying the preparation and execution of synchronised movement. Electroencephalography (EEG), electromyography (EMG) from the finger flexors, and continuous force signals were recorded in 20 participants during tapping and imagined tapping with discrete stimulus sequences consisting of alternating auditory beeps and visual flashes. The results show that the synchronisation between cortical and muscular activity in the beta (14-38 Hz) frequency band becomes time-locked to the taps executed in synchrony with the visual and auditory stimuli. Dynamic modulation in CMC also occurred when participants imagined tapping with the visual stimuli, but with lower amplitude and a different temporal profile compared to real tapping. These results suggest that CMC does not only reflect changes related to the production of the synchronised movement, but also to its preparation, which appears heightened under higher attentional demands imposed when synchronising with the visual stimuli. These findings highlight a critical role of beta band neural oscillations in the cortical-muscular coupling underlying sensorimotor synchronisation.
Collapse
Affiliation(s)
- Patti Nijhuis
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia.
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia
| | - Sylvie Nozaradan
- Institute of Neuroscience (Ions), Université catholique de Louvain (UCL), Belgium
| | - Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia; School of Psychology, Western Sydney University, Sydney, Australia
| |
Collapse
|
11
|
Manting CL, Gulyas B, Ullén F, Lundqvist D. Auditory steady-state responses during and after a stimulus: Cortical sources, and the influence of attention and musicality. Neuroimage 2021; 233:117962. [PMID: 33744455 DOI: 10.1016/j.neuroimage.2021.117962] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Revised: 02/19/2021] [Accepted: 03/08/2021] [Indexed: 11/28/2022] Open
Abstract
The auditory steady-state response (ASSR) is an oscillatory brain response generated by periodic auditory stimuli and originates mainly from the temporal auditory cortices. Recent data show that while the auditory cortices are indeed strongly activated by the stimulus when it is present (ON ASSR), the anatomical distribution of ASSR sources involves also parietal and frontal cortices, indicating that the ASSR is a more complex phenomenon than previously believed. Furthermore, while the ASSR typically continues to oscillate even after the stimulus has stopped (OFF ASSR), very little is known about the characteristics of the OFF ASSR and how it compares to the ON ASSR. Here, we assessed whether the OFF and ON ASSR powers are modulated by the stimulus properties (i.e. volume and pitch), selective attention, as well as individual musical sophistication. We also investigated the cortical source distribution of the OFF ASSR using a melody tracking task, in which attention was directed between uniquely amplitude-modulated melody streams that differed in pitch. The ON and OFF ASSRs were recorded with magnetoencephalography (MEG) on a group of participants varying from low to high degree of musical sophistication. Our results show that the OFF ASSR is different from the ON ASSR in nearly every aspect. While the ON ASSR was modulated by the stimulus properties and selective attention, the OFF ASSR was not influenced by any of these factors. Furthermore, while the ON ASSR was generated primarily from temporal sources, the OFF ASSR originated mainly from the frontal cortex. These findings challenge the notion that the OFF ASSR is merely a continuation of the ON ASSR. Rather, they suggest that the OFF ASSR is an internally-driven signal that develops from an initial sensory processing state (ON ASSR), with both types of ASSRs clearly differing in cortical representation and character. Furthermore, our results show that the ON ASSR power was enhanced by selective attention at cortical sources within each of the bilateral frontal, temporal, parietal and insular lobes. Finally, the ON ASSR proved sensitive to musicality, demonstrating positive correlations between musical sophistication and ASSR power, as well as with the degree of attentional ASSR modulation at the left and right parietal cortices. Taken together, these results show new aspects of the ASSR response, and demonstrate its usefulness as an effective tool for analysing how selective attention interacts with individual abilities in music perception.
Collapse
Affiliation(s)
- Cassia Low Manting
- NatMEG, Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden; Cognitive Neuroimaging Centre (CoNiC), Lee Kong Chien School of Medicine, Nanyang Technological University, Singapore.
| | - Balazs Gulyas
- Cognitive Neuroimaging Centre (CoNiC), Lee Kong Chien School of Medicine, Nanyang Technological University, Singapore; Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden
| | - Fredrik Ullén
- Department of Neuroscience, Karolinska Institutet, Stockholm, Sweden
| | - Daniel Lundqvist
- NatMEG, Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden; Cognitive Neuroimaging Centre (CoNiC), Lee Kong Chien School of Medicine, Nanyang Technological University, Singapore
| |
Collapse
|