1
|
Wu Q, Sun L, Ding N, Yang Y. Musical tension is affected by metrical structure dynamically and hierarchically. Cogn Neurodyn 2024; 18:1955-1976. [PMID: 39104669 PMCID: PMC11297889 DOI: 10.1007/s11571-023-10058-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 11/29/2023] [Accepted: 12/11/2023] [Indexed: 08/07/2024] Open
Abstract
As the basis of musical emotions, dynamic tension experience is felt by listeners as music unfolds over time. The effects of musical harmonic and melodic structures on tension have been widely investigated, however, the potential roles of metrical structures in tension perception remain largely unexplored. This experiment examined how different metrical structures affect tension experience and explored the underlying neural activities. The electroencephalogram (EEG) was recorded and subjective tension was rated simultaneously while participants listened to music meter sequences. On large time scale of whole meter sequences, it was found that different overall tension and low-frequency (1 ~ 4 Hz) steady-state evoked potentials were elicited by metrical structures with different periods of strong beats, and the higher overall tension was associated with metrical structure with the shorter intervals between strong beats. On small time scale of measures, dynamic tension fluctuations within measures was found to be associated with the periodic modulations of high-frequency (10 ~ 25 Hz) neural activities. The comparisons between the same beats within measures and across different meters both on small and large time scales verified the contextual effects of meter on tension induced by beats. Our findings suggest that the overall tension is determined by temporal intervals between strong beats, and the dynamic tension experience may arise from cognitive processing of hierarchical temporal expectation and attention, which are discussed under the theoretical frameworks of metrical hierarchy, musical expectation and dynamic attention.
Collapse
Affiliation(s)
- Qiong Wu
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, No. 16 Lincui Road, Chaoyang District, Beijing, 100101 China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Lijun Sun
- College of Arts, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Nai Ding
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou, China
| | - Yufang Yang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, No. 16 Lincui Road, Chaoyang District, Beijing, 100101 China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
2
|
Carrillo C, Chang A, Armstrong H, Cairney J, McAuley JD, Trainor LJ. Auditory rhythm facilitates perception and action in children at risk for developmental coordination disorder. Sci Rep 2024; 14:12203. [PMID: 38806554 PMCID: PMC11133375 DOI: 10.1038/s41598-024-62322-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Accepted: 05/15/2024] [Indexed: 05/30/2024] Open
Abstract
Developmental Coordination Disorder (DCD) is a common neurodevelopmental disorder featuring deficits in motor coordination and motor timing among children. Deficits in rhythmic tracking, including perceptually tracking and synchronizing action with auditory rhythms, have been studied in a wide range of motor disorders, providing a foundation for developing rehabilitation programs incorporating auditory rhythms. We tested whether DCD also features these auditory-motor deficits among 7-10 year-old children. In a speech recognition task with no overt motor component, modulating the speech rhythm interfered more with the performance of children at risk for DCD than typically developing (TD) children. A set of auditory-motor tapping tasks further showed that, although children at risk for DCD performed worse than TD children in general, the presence of an auditory rhythmic cue (isochronous metronome or music) facilitated the temporal consistency of tapping. Finally, accuracy in the recognition of rhythmically modulated speech and tapping consistency correlated with performance on the standardized motor assessment. Together, the results show auditory rhythmic regularity benefits auditory perception and auditory-motor coordination in children at risk for DCD. This provides a foundation for future clinical studies to develop evidence-based interventions involving auditory-motor rhythmic coordination for children with DCD.
Collapse
Affiliation(s)
- Chantal Carrillo
- Department of Psychology, Neuroscience, and Behaviour, McMaster University, Hamilton, ON, Canada.
| | - Andrew Chang
- Department of Psychology, Neuroscience, and Behaviour, McMaster University, Hamilton, ON, Canada
- Department of Psychology, New York University, New York, USA
| | - Hannah Armstrong
- Department of Psychology, Neuroscience, and Behaviour, McMaster University, Hamilton, ON, Canada
| | - John Cairney
- Infant and Child Health (INCH) Lab, Department of Family Medicine, McMaster University, Hamilton, ON, Canada
- School of Human Movement and Nutrition Sciences, University of Queensland, Brisbane, QLD, Australia
| | - J Devin McAuley
- Department of Psychology, Michigan State University, Michigan, USA
| | - Laurel J Trainor
- Department of Psychology, Neuroscience, and Behaviour, McMaster University, Hamilton, ON, Canada
- McMaster Institute for Music and the Mind, McMaster University, Hamilton, ON, Canada
- Rotman Research Institute, Baycrest Hospital, Toronto, ON, Canada
| |
Collapse
|
3
|
Maidhof C, Müller V, Lartillot O, Agres K, Bloska J, Asano R, Odell-Miller H, Fachner J. Intra- and inter-brain coupling and activity dynamics during improvisational music therapy with a person with dementia: an explorative EEG-hyperscanning single case study. Front Psychol 2023; 14:1155732. [PMID: 37842703 PMCID: PMC10570426 DOI: 10.3389/fpsyg.2023.1155732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 09/06/2023] [Indexed: 10/17/2023] Open
Abstract
Objective Real-life research into the underlying neural dynamics of improvisational music therapy, used with various clinical populations, is largely lacking. This single case study explored within-session differences in musical features and in within- and between-brain coupling between a Person with Dementia (PwD) and a music therapist during a music therapy session. Methods Dual-EEG from a music therapist and a PwD (male, 31 years) was recorded. Note density, pulse clarity and synchronicity were extracted from audio-visual data. Three music therapists identified moments of interest and no interest (MOI/MONI) in two drum improvisations. The Integrative Coupling Index, reflecting time-lagged neural synchronization, and musical features were compared between the MOI and MONI. Results Between-brain coupling of 2 Hz activity was increased during the MOI, showing anteriority of the therapist's neural activity. Within-brain coupling for the PwD was stronger from frontal and central areas during the MOI, but within-brain coupling for the therapist was stronger during MONI. Differences in musical features indicated that both acted musically more similar to one another during the MOI. Conclusion Within-session differences in neural synchronization and musical features highlight the dynamic nature of music therapy. Significance The findings contribute to a better understanding of social and affective processes in the brain and (interactive) musical behaviors during specific moments in a real-life music therapy session. This may provide insights into the role of such moments for relational-therapeutic processes.
Collapse
Affiliation(s)
- Clemens Maidhof
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
- Josef Ressel Centre for Personalized Music Therapy, University of Applied Sciences IMC Krems, Krems an der Donau, Austria
| | - Viktor Müller
- Center for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany
| | - Olivier Lartillot
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
| | - Kat Agres
- Yong Siew Toh Conservatory of Music, National University of Singapore, Singapore, Singapore
- Centre for Music and Health, National University of Singapore, Singapore, Singapore
| | - Jodie Bloska
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
| | - Rie Asano
- Institute of Musicology, University of Cologne, Cologne, Germany
- Advanced Comprehensive Research Organization, Teikyo University, Tokyo, Japan
| | - Helen Odell-Miller
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
| | - Jörg Fachner
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
- Josef Ressel Centre for Personalized Music Therapy, University of Applied Sciences IMC Krems, Krems an der Donau, Austria
| |
Collapse
|
4
|
Quique YM, Gnanateja GN, Dickey MW, Evans WS, Chandrasekaran B. Examining cortical tracking of the speech envelope in post-stroke aphasia. Front Hum Neurosci 2023; 17:1122480. [PMID: 37780966 PMCID: PMC10538638 DOI: 10.3389/fnhum.2023.1122480] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Accepted: 08/28/2023] [Indexed: 10/03/2023] Open
Abstract
Introduction People with aphasia have been shown to benefit from rhythmic elements for language production during aphasia rehabilitation. However, it is unknown whether rhythmic processing is associated with such benefits. Cortical tracking of the speech envelope (CTenv) may provide a measure of encoding of speech rhythmic properties and serve as a predictor of candidacy for rhythm-based aphasia interventions. Methods Electroencephalography was used to capture electrophysiological responses while Spanish speakers with aphasia (n = 9) listened to a continuous speech narrative (audiobook). The Temporal Response Function was used to estimate CTenv in the delta (associated with word- and phrase-level properties), theta (syllable-level properties), and alpha bands (attention-related properties). CTenv estimates were used to predict aphasia severity, performance in rhythmic perception and production tasks, and treatment response in a sentence-level rhythm-based intervention. Results CTenv in delta and theta, but not alpha, predicted aphasia severity. Neither CTenv in delta, alpha, or theta bands predicted performance in rhythmic perception or production tasks. Some evidence supported that CTenv in theta could predict sentence-level learning in aphasia, but alpha and delta did not. Conclusion CTenv of the syllable-level properties was relatively preserved in individuals with less language impairment. In contrast, higher encoding of word- and phrase-level properties was relatively impaired and was predictive of more severe language impairments. CTenv and treatment response to sentence-level rhythm-based interventions need to be further investigated.
Collapse
Affiliation(s)
- Yina M. Quique
- Center for Education in Health Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, United States
| | - G. Nike Gnanateja
- Department of Communication Sciences and Disorders, University of Wisconsin-Madison, Madison, WI, United States
| | - Michael Walsh Dickey
- VA Pittsburgh Healthcare System, Pittsburgh, PA, United States
- Department of Communication Sciences and Disorders, University of Pittsburgh, Pittsburgh, PA, United States
| | | | - Bharath Chandrasekaran
- Department of Communication Sciences and Disorders, University of Pittsburgh, Pittsburgh, PA, United States
- Roxelyn and Richard Pepper Department of Communication Science and Disorders, School of Communication. Northwestern University, Evanston, IL, United States
| |
Collapse
|
5
|
Rosso M, Moens B, Leman M, Moumdjian L. Neural entrainment underpins sensorimotor synchronization to dynamic rhythmic stimuli. Neuroimage 2023; 277:120226. [PMID: 37321359 DOI: 10.1016/j.neuroimage.2023.120226] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2023] [Revised: 05/02/2023] [Accepted: 06/12/2023] [Indexed: 06/17/2023] Open
Abstract
Neural entrainment, defined as unidirectional synchronization of neural oscillations to an external rhythmic stimulus, is a topic of major interest in the field of neuroscience. Despite broad scientific consensus on its existence, on its pivotal role in sensory and motor processes, and on its fundamental definition, empirical research struggles in quantifying it with non-invasive electrophysiology. To this date, broadly adopted state-of-the-art methods still fail to capture the dynamic underlying the phenomenon. Here, we present event-related frequency adjustment (ERFA) as a methodological framework to induce and to measure neural entrainment in human participants, optimized for multivariate EEG datasets. By applying dynamic phase and tempo perturbations to isochronous auditory metronomes during a finger-tapping task, we analyzed adaptive changes in instantaneous frequency of entrained oscillatory components during error correction. Spatial filter design allowed us to untangle, from the multivariate EEG signal, perceptual and sensorimotor oscillatory components attuned to the stimulation frequency. Both components dynamically adjusted their frequency in response to perturbations, tracking the stimulus dynamics by slowing down and speeding up the oscillation over time. Source separation revealed that sensorimotor processing enhanced the entrained response, supporting the notion that the active engagement of the motor system plays a critical role in processing rhythmic stimuli. In the case of phase shift, motor engagement was a necessary condition to observe any response, whereas sustained tempo changes induced frequency adjustment even in the perceptual oscillatory component. Although the magnitude of the perturbations was controlled across positive and negative direction, we observed a general bias in the frequency adjustments towards positive changes, which points at the effect of intrinsic dynamics constraining neural entrainment. We conclude that our findings provide compelling evidence for neural entrainment as mechanism underlying overt sensorimotor synchronization, and highlight that our methodology offers a paradigm and a measure for quantifying its oscillatory dynamics by means of non-invasive electrophysiology, rigorously informed by the fundamental definition of entrainment.
Collapse
Affiliation(s)
- Mattia Rosso
- IPEM Institute for Systematic Musicology, Ghent University, Ghent, Belgium; Université de Lille, ULR 4072 - PSITEC - Psychologie: Interactions, Temps, Emotions, Cognition, Lille, France.
| | - Bart Moens
- IPEM Institute for Systematic Musicology, Ghent University, Ghent, Belgium
| | - Marc Leman
- IPEM Institute for Systematic Musicology, Ghent University, Ghent, Belgium
| | - Lousin Moumdjian
- IPEM Institute for Systematic Musicology, Ghent University, Ghent, Belgium; REVAL Rehabilitation Research Center, Faculty of Rehabilitation Sciences, Hasselt University, Hasselt, Belgium; UMSC Hasselt, Pelt, Belgium
| |
Collapse
|
6
|
Fiveash A, Ferreri L, Bouwer FL, Kösem A, Moghimi S, Ravignani A, Keller PE, Tillmann B. Can rhythm-mediated reward boost learning, memory, and social connection? Perspectives for future research. Neurosci Biobehav Rev 2023; 149:105153. [PMID: 37019245 DOI: 10.1016/j.neubiorev.2023.105153] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 03/14/2023] [Accepted: 03/31/2023] [Indexed: 04/05/2023]
Abstract
Studies of rhythm processing and of reward have progressed separately, with little connection between the two. However, consistent links between rhythm and reward are beginning to surface, with research suggesting that synchronization to rhythm is rewarding, and that this rewarding element may in turn also boost this synchronization. The current mini review shows that the combined study of rhythm and reward can be beneficial to better understand their independent and combined roles across two central aspects of cognition: 1) learning and memory, and 2) social connection and interpersonal synchronization; which have so far been studied largely independently. From this basis, it is discussed how connections between rhythm and reward can be applied to learning and memory and social connection across different populations, taking into account individual differences, clinical populations, human development, and animal research. Future research will need to consider the rewarding nature of rhythm, and that rhythm can in turn boost reward, potentially enhancing other cognitive and social processes.
Collapse
Affiliation(s)
- A Fiveash
- Lyon Neuroscience Research Center, CRNL, CNRS, UMR 5292, INSERM U1028, F-69000 Lyon, France; University of Lyon 1, Lyon, France; The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia.
| | - L Ferreri
- Department of Brain and Behavioural Sciences, University of Pavia, Pavia, Italy; Laboratoire d'Étude des Mécanismes Cognitifs, Université Lumière Lyon 2, Lyon, France
| | - F L Bouwer
- Department of Psychology, Brain and Cognition, University of Amsterdam, Amsterdam, the Netherlands
| | - A Kösem
- Lyon Neuroscience Research Center, CRNL, CNRS, UMR 5292, INSERM U1028, F-69000 Lyon, France
| | - S Moghimi
- Groupe de Recherches sur l'Analyse Multimodale de la Fonction Cérébrale, INSERM U1105, Amiens, France
| | - A Ravignani
- Comparative Bioacoustics Group, Max Planck Institute for Psycholinguistics, 6525 XD Nijmegen, the Netherlands; Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| | - P E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, Australia; Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| | - B Tillmann
- Lyon Neuroscience Research Center, CRNL, CNRS, UMR 5292, INSERM U1028, F-69000 Lyon, France; University of Lyon 1, Lyon, France; Laboratory for Research on Learning and Development, LEAD - CNRS UMR5022, Université de Bourgogne, Dijon, France
| |
Collapse
|
7
|
Criscuolo A, Schwartze M, Henry MJ, Obermeier C, Kotz SA. Individual neurophysiological signatures of spontaneous rhythm processing. Neuroimage 2023; 273:120090. [PMID: 37028735 DOI: 10.1016/j.neuroimage.2023.120090] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Revised: 03/14/2023] [Accepted: 04/04/2023] [Indexed: 04/08/2023] Open
Abstract
When sensory input conveys rhythmic regularity, we can form predictions about the timing of upcoming events. Although rhythm processing capacities differ considerably between individuals, these differences are often obscured by participant- and trial-level data averaging procedures in M/EEG research. Here, we systematically assessed neurophysiological variability displayed by individuals listening to isochronous (1.54Hz) equitone sequences interspersed with unexpected (amplitude-attenuated) deviant tones. Our approach aimed at revealing time-varying adaptive neural mechanisms for sampling the acoustic environment at multiple timescales. Rhythm tracking analyses confirmed that individuals encode temporal regularities and form temporal expectations, as indicated in delta-band (1.54Hz) power and its anticipatory phase alignment to expected tone onsets. Zooming into tone- and participant-level data, we further characterized intra- and inter-individual variabilities in phase-alignment across auditory sequences. Further, individual modelling of beta-band tone-locked responses showed that a subset of auditory sequences was sampled rhythmically by superimposing binary (strong-weak; S-w), ternary (S-w-w) and mixed accentuation patterns. In these sequences, neural responses to standard and deviant tones were modulated by a binary accentuation pattern, thus pointing towards a mechanism of dynamic attending. Altogether, the current results point toward complementary roles of delta- and beta-band activity in rhythm processing and further highlight diverse and adaptive mechanisms to track and sample the acoustic environment at multiple timescales, even in the absence of task-specific instructions.
Collapse
Affiliation(s)
- A Criscuolo
- Department of Neuropsychology & Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht 6200 MD, the Netherlands
| | - M Schwartze
- Department of Neuropsychology & Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht 6200 MD, the Netherlands
| | - M J Henry
- Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany; Department of Psychology, Toronto Metropolitan University, Canada
| | - C Obermeier
- BG Klinikum Bergmannstrost Halle, Halle 06112, Germany; Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - S A Kotz
- Department of Neuropsychology & Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht 6200 MD, the Netherlands; Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany.
| |
Collapse
|
8
|
Lapenta OM, Keller PE, Nozaradan S, Varlet M. Spatial and temporal (non)binding of audiovisual rhythms in sensorimotor synchronisation. Exp Brain Res 2023; 241:875-887. [PMID: 36788141 PMCID: PMC9985575 DOI: 10.1007/s00221-023-06569-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Accepted: 02/06/2023] [Indexed: 02/16/2023]
Abstract
Human movement synchronisation with moving objects strongly relies on visual input. However, auditory information also plays an important role, since real environments are intrinsically multimodal. We used electroencephalography (EEG) frequency tagging to investigate the selective neural processing and integration of visual and auditory information during motor tracking and tested the effects of spatial and temporal congruency between audiovisual modalities. EEG was recorded while participants tracked with their index finger a red flickering (rate fV = 15 Hz) dot oscillating horizontally on a screen. The simultaneous auditory stimulus was modulated in pitch (rate fA = 32 Hz) and lateralised between left and right audio channels to induce perception of a periodic displacement of the sound source. Audiovisual congruency was manipulated in terms of space in Experiment 1 (no motion, same direction or opposite direction), and timing in Experiment 2 (no delay, medium delay or large delay). For both experiments, significant EEG responses were elicited at fV and fA tagging frequencies. It was also hypothesised that intermodulation products corresponding to the nonlinear integration of visual and auditory stimuli at frequencies fV ± fA would be elicited, due to audiovisual integration, especially in Congruent conditions. However, these components were not observed. Moreover, synchronisation and EEG results were not influenced by congruency manipulations, which invites further exploration of the conditions which may modulate audiovisual processing and the motor tracking of moving objects.
Collapse
Affiliation(s)
- Olivia Morgan Lapenta
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia.
- Psychological Neuroscience Lab, Center for Investigation in Psychology, University of Minho, Rua da Universidade, 4710-057, Braga, Portugal.
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Sylvie Nozaradan
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
- Institute of Neuroscience, Université Catholique de Louvain, Woluwe-Saint-Lambert, Belgium
| | - Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
- School of Psychology, Western Sydney University, Penrith, Australia
| |
Collapse
|
9
|
Gugnowska K, Novembre G, Kohler N, Villringer A, Keller PE, Sammler D. Endogenous sources of interbrain synchrony in duetting pianists. Cereb Cortex 2022; 32:4110-4127. [PMID: 35029645 PMCID: PMC9476614 DOI: 10.1093/cercor/bhab469] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2021] [Revised: 11/16/2021] [Accepted: 11/17/2021] [Indexed: 11/12/2022] Open
Abstract
When people interact with each other, their brains synchronize. However, it remains unclear whether interbrain synchrony (IBS) is functionally relevant for social interaction or stems from exposure of individual brains to identical sensorimotor information. To disentangle these views, the current dual-EEG study investigated amplitude-based IBS in pianists jointly performing duets containing a silent pause followed by a tempo change. First, we manipulated the similarity of the anticipated tempo change and measured IBS during the pause, hence, capturing the alignment of purely endogenous, temporal plans without sound or movement. Notably, right posterior gamma IBS was higher when partners planned similar tempi, it predicted whether partners' tempi matched after the pause, and it was modulated only in real, not in surrogate pairs. Second, we manipulated the familiarity with the partner's actions and measured IBS during joint performance with sound. Although sensorimotor information was similar across conditions, gamma IBS was higher when partners were unfamiliar with each other's part and had to attend more closely to the sound of the performance. These combined findings demonstrate that IBS is not merely an epiphenomenon of shared sensorimotor information but can also hinge on endogenous, cognitive processes crucial for behavioral synchrony and successful social interaction.
Collapse
Affiliation(s)
- Katarzyna Gugnowska
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main 60322, Germany
| | - Giacomo Novembre
- Neuroscience of Perception and Action Lab, Italian Institute of Technology (IIT), Rome 00161, Italy
| | - Natalie Kohler
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main 60322, Germany
| | - Arno Villringer
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - Peter E Keller
- Department of Clinical Medicine, Center for Music in the Brain, Aarhus University, Aarhus 8000, Denmark
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, NSW 2751, Australia
| | - Daniela Sammler
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main 60322, Germany
| |
Collapse
|
10
|
Sauvé SA, Bolt ELW, Nozaradan S, Zendel BR. Aging effects on neural processing of rhythm and meter. Front Aging Neurosci 2022; 14:848608. [PMID: 36118692 PMCID: PMC9475293 DOI: 10.3389/fnagi.2022.848608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2022] [Accepted: 08/01/2022] [Indexed: 11/13/2022] Open
Abstract
When listening to musical rhythm, humans can perceive and move to beat-like metrical pulses. Recently, it has been hypothesized that meter perception is related to brain activity responding to the acoustic fluctuation of the rhythmic input, with selective enhancement of the brain response elicited at meter-related frequencies. In the current study, electroencephalography (EEG) was recorded while younger (<35) and older (>60) adults listened to rhythmic patterns presented at two different tempi while intermittently performing a tapping task. Despite significant hearing loss compared to younger adults, older adults showed preserved brain activity to the rhythms. However, age effects were observed in the distribution of amplitude across frequencies. Specifically, in contrast with younger adults, older adults showed relatively larger amplitude at the frequency corresponding to the rate of individual events making up the rhythms as compared to lower meter-related frequencies. This difference is compatible with larger N1-P2 potentials as generally observed in older adults in response to acoustic onsets, irrespective of meter perception. These larger low-level responses to sounds have been linked to processes by which age-related hearing loss would be compensated by cortical sensory mechanisms. Importantly, this low-level effect would be associated here with relatively reduced neural activity at lower frequencies corresponding to higher-level metrical grouping of the acoustic events, as compared to younger adults.
Collapse
|
11
|
Peter V, van Ommen S, Kalashnikova M, Mazuka R, Nazzi T, Burnham D. Language specificity in cortical tracking of speech rhythm at the mora, syllable, and foot levels. Sci Rep 2022; 12:13477. [PMID: 35931787 PMCID: PMC9356059 DOI: 10.1038/s41598-022-17401-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2021] [Accepted: 07/25/2022] [Indexed: 11/29/2022] Open
Abstract
Recent research shows that adults’ neural oscillations track the rhythm of the speech signal. However, the extent to which this tracking is driven by the acoustics of the signal, or by language-specific processing remains unknown. Here adult native listeners of three rhythmically different languages (English, French, Japanese) were compared on their cortical tracking of speech envelopes synthesized in their three native languages, which allowed for coding at each of the three language’s dominant rhythmic unit, respectively the foot (2.5 Hz), syllable (5 Hz), or mora (10 Hz) level. The three language groups were also tested with a sequence in a non-native language, Polish, and a non-speech vocoded equivalent, to investigate possible differential speech/nonspeech processing. The results first showed that cortical tracking was most prominent at 5 Hz (syllable rate) for all three groups, but the French listeners showed enhanced tracking at 5 Hz compared to the English and the Japanese groups. Second, across groups, there were no differences in responses for speech versus non-speech at 5 Hz (syllable rate), but there was better tracking for speech than for non-speech at 10 Hz (not the syllable rate). Together these results provide evidence for both language-general and language-specific influences on cortical tracking.
Collapse
Affiliation(s)
- Varghese Peter
- MARCS Institute for Brain Behaviour and Development, Western Sydney University, Penrith, NSW, Australia. .,School of Health and Behavioural Sciences, University of the Sunshine Coast, Sippy Downs, Australia.
| | - Sandrien van Ommen
- Integrative Neuroscience and Cognition Center, CNRS-Université Paris Cité, Paris, France.,Neurosciences Fondamentales, University of Geneva, Geneva, Switzerland
| | - Marina Kalashnikova
- MARCS Institute for Brain Behaviour and Development, Western Sydney University, Penrith, NSW, Australia.,BCBL, Basque Center on Cognition, Brain and Language, San Sebastian, Guipuzcoa, Spain.,IKERBASQUE, Basque Foundation for Science, Bilbao, Bizcaya, Spain
| | - Reiko Mazuka
- Laboratory for Language Development, RIKEN Center for Brain Science, Saitama, Japan.,Department of Psychology and Neuroscience, Duke University, Durham, NC, USA
| | - Thierry Nazzi
- Integrative Neuroscience and Cognition Center, CNRS-Université Paris Cité, Paris, France
| | - Denis Burnham
- MARCS Institute for Brain Behaviour and Development, Western Sydney University, Penrith, NSW, Australia
| |
Collapse
|
12
|
Comstock DC, Balasubramaniam R. Differential motor system entrainment to auditory and visual rhythms. J Neurophysiol 2022; 128:326-335. [PMID: 35766371 PMCID: PMC9342137 DOI: 10.1152/jn.00432.2021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Perception of, and synchronization to, auditory rhythms is known to be more accurate than with flashing visual rhythms. The motor system is known to play a role in the processing of timing information for auditory rhythm perception, but it is unclear if the motor system plays the same role for visual rhythm perception. One demonstrated component of auditory rhythm perception is neural entrainment at the frequency of the auditory rhythm. In this study, we use EEG to measure the entrainment of both auditory and visual rhythms from the motor cortex while subjects either tapped in synchrony with or passively attended to the presented rhythms. To isolate activity from motor cortex, we used independent component analysis to first separate out neural sources, then selected components using a combination of component topography, dipole location, mu activation, and beta modulation. This process took advantage of the fact that tapping activity results in reduced mu power, and characteristic beta modulation, which helped select motor components. Our findings suggest neural entrainment in motor components was stronger for visual rhythms than auditory rhythms and strongest during the tapping conditions for both modalities. We also find mu power increased in response to both auditory and visual rhythms. These findings indicate that the generally greater rhythm perception capabilities of the auditory system over the visual system may not depend entirely on neural entrainment in the motor system, but rather how the motor system is able to use the timing information made available to it. NEW & NOTEWORTHY We investigated neural entrainment in the motor system for both auditory and visual isochronous rhythms using electroencephalogram. Counter to expectations, our findings suggest stronger entrainment for visual rhythms than for auditory rhythms. Motor system activity was isolated with a novel procedure using independent component analysis as a means of blind source separation, along with known markers of mu activity from the motor system to identify motor components.
Collapse
Affiliation(s)
- Daniel C Comstock
- Center for Mind and Brain, University of California, Davis, California.,Cognitive and Information Sciences, University of California, Merced, California
| | | |
Collapse
|
13
|
Cariani P, Baker JM. Time Is of the Essence: Neural Codes, Synchronies, Oscillations, Architectures. Front Comput Neurosci 2022; 16:898829. [PMID: 35814343 PMCID: PMC9262106 DOI: 10.3389/fncom.2022.898829] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Accepted: 05/04/2022] [Indexed: 11/25/2022] Open
Abstract
Time is of the essence in how neural codes, synchronies, and oscillations might function in encoding, representation, transmission, integration, storage, and retrieval of information in brains. This Hypothesis and Theory article examines observed and possible relations between codes, synchronies, oscillations, and types of neural networks they require. Toward reverse-engineering informational functions in brains, prospective, alternative neural architectures incorporating principles from radio modulation and demodulation, active reverberant circuits, distributed content-addressable memory, signal-signal time-domain correlation and convolution operations, spike-correlation-based holography, and self-organizing, autoencoding anticipatory systems are outlined. Synchronies and oscillations are thought to subserve many possible functions: sensation, perception, action, cognition, motivation, affect, memory, attention, anticipation, and imagination. These include direct involvement in coding attributes of events and objects through phase-locking as well as characteristic patterns of spike latency and oscillatory response. They are thought to be involved in segmentation and binding, working memory, attention, gating and routing of signals, temporal reset mechanisms, inter-regional coordination, time discretization, time-warping transformations, and support for temporal wave-interference based operations. A high level, partial taxonomy of neural codes consists of channel, temporal pattern, and spike latency codes. The functional roles of synchronies and oscillations in candidate neural codes, including oscillatory phase-offset codes, are outlined. Various forms of multiplexing neural signals are considered: time-division, frequency-division, code-division, oscillatory-phase, synchronized channels, oscillatory hierarchies, polychronous ensembles. An expandable, annotative neural spike train framework for encoding low- and high-level attributes of events and objects is proposed. Coding schemes require appropriate neural architectures for their interpretation. Time-delay, oscillatory, wave-interference, synfire chain, polychronous, and neural timing networks are discussed. Some novel concepts for formulating an alternative, more time-centric theory of brain function are discussed. As in radio communication systems, brains can be regarded as networks of dynamic, adaptive transceivers that broadcast and selectively receive multiplexed temporally-patterned pulse signals. These signals enable complex signal interactions that select, reinforce, and bind common subpatterns and create emergent lower dimensional signals that propagate through spreading activation interference networks. If memory traces share the same kind of temporal pattern forms as do active neuronal representations, then distributed, holograph-like content-addressable memories are made possible via temporal pattern resonances.
Collapse
Affiliation(s)
- Peter Cariani
- Hearing Research Center, Boston University, Boston, MA, United States
- Department of Otolaryngology-Head and Neck Surgery, Harvard Medical School, Boston, MA, United States
| | | |
Collapse
|
14
|
Wei Y, Hancock R, Mozeiko J, Large EW. The relationship between entrainment dynamics and reading fluency assessed by sensorimotor perturbation. Exp Brain Res 2022; 240:1775-1790. [PMID: 35507069 DOI: 10.1007/s00221-022-06369-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2022] [Accepted: 04/06/2022] [Indexed: 11/25/2022]
Abstract
A consistent relationship has been found between rhythmic processing and reading skills. Impairment of the ability to entrain movements to an auditory rhythm in clinical populations with language-related deficits, such as children with developmental dyslexia, has been found in both behavioral and neural studies. In this study, we explored the relationship between rhythmic entrainment, behavioral synchronization, reading fluency, and reading comprehension in neurotypical English- and Mandarin-speaking adults. First, we examined entrainment stability by asking participants to coordinate taps with an auditory metronome in which unpredictable perturbations were introduced to disrupt entrainment. Next, we assessed behavioral synchronization by asking participants to coordinate taps with the syllables they produced while reading sentences as naturally as possible (tap to syllable task). Finally, we measured reading fluency and reading comprehension for native English and native Mandarin speakers. Stability of entrainment correlated strongly with tap to syllable task performance and with reading fluency, and both findings generalized across English and Mandarin speakers.
Collapse
Affiliation(s)
- Yi Wei
- Department of Psychological Sciences, University of Connecticut, Storrs, USA.
- Brain Imaging Research Center, University of Connecticut, Storrs, USA.
- The Connecticut Institute for the Brain and Cognitive Sciences of University of Connecticut, Storrs, USA.
| | - Roeland Hancock
- Department of Psychological Sciences, University of Connecticut, Storrs, USA
- Brain Imaging Research Center, University of Connecticut, Storrs, USA
- The Connecticut Institute for the Brain and Cognitive Sciences of University of Connecticut, Storrs, USA
| | - Jennifer Mozeiko
- Department of Speech, Language and Hearing Sciences, University of Connecticut, Storrs, USA
| | - Edward W Large
- Department of Psychological Sciences, University of Connecticut, Storrs, USA
- Department of Physics, University of Connecticut, Storrs, USA
- Brain Imaging Research Center, University of Connecticut, Storrs, USA
- The Connecticut Institute for the Brain and Cognitive Sciences of University of Connecticut, Storrs, USA
| |
Collapse
|
15
|
Lapenta OM, Keller PE, Nozaradan S, Varlet M. Lateralised dynamic modulations of corticomuscular coherence associated with bimanual learning of rhythmic patterns. Sci Rep 2022; 12:6271. [PMID: 35428836 PMCID: PMC9012795 DOI: 10.1038/s41598-022-10342-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2021] [Accepted: 03/28/2022] [Indexed: 11/09/2022] Open
Abstract
Human movements are spontaneously attracted to auditory rhythms, triggering an automatic activation of the motor system, a central phenomenon to music perception and production. Cortico-muscular coherence (CMC) in the theta, alpha, beta and gamma frequencies has been used as an index of the synchronisation between cortical motor regions and the muscles. Here we investigated how learning to produce a bimanual rhythmic pattern composed of low- and high-pitch sounds affects CMC in the beta frequency band. Electroencephalography (EEG) and electromyography (EMG) from the left and right First Dorsal Interosseus and Flexor Digitorum Superficialis muscles were concurrently recorded during constant pressure on a force sensor held between the thumb and index finger while listening to the rhythmic pattern before and after a bimanual training session. During the training, participants learnt to produce the rhythmic pattern guided by visual cues by pressing the force sensors with their left or right hand to produce the low- and high-pitch sounds, respectively. Results revealed no changes after training in overall beta CMC or beta oscillation amplitude, nor in the correlation between the left and right sides for EEG and EMG separately. However, correlation analyses indicated that left- and right-hand beta EEG-EMG coherence were positively correlated over time before training but became uncorrelated after training. This suggests that learning to bimanually produce a rhythmic musical pattern reinforces lateralised and segregated cortico-muscular communication.
Collapse
Affiliation(s)
- Olivia Morgan Lapenta
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia. .,Center for Investigation in Psychology, University of Minho, Braga, Portugal.
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia
| | - Sylvie Nozaradan
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia.,Institute of Neuroscience, Catholic University of Louvain, Woluwe-Saint-Lambert, Belgium
| | - Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, Australia.,School of Psychology, Western Sydney University, Penrith, Australia
| |
Collapse
|
16
|
Cheng THZ, Creel SC, Iversen JR. How Do You Feel the Rhythm: Dynamic Motor-Auditory Interactions Are Involved in the Imagination of Hierarchical Timing. J Neurosci 2022; 42:500-512. [PMID: 34848500 PMCID: PMC8802922 DOI: 10.1523/jneurosci.1121-21.2021] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2021] [Revised: 11/10/2021] [Accepted: 11/12/2021] [Indexed: 11/21/2022] Open
Abstract
Predicting and organizing patterns of events is important for humans to survive in a dynamically changing world. The motor system has been proposed to be actively, and necessarily, engaged in not only the production but the perception of rhythm by organizing hierarchical timing that influences auditory responses. It is not yet well understood how the motor system interacts with the auditory system to perceive and maintain hierarchical structure in time. This study investigated the dynamic interaction between auditory and motor functional sources during the perception and imagination of musical meters. We pursued this using a novel method combining high-density EEG, EMG, and motion capture with independent component analysis to separate motor and auditory activity during meter imagery while robustly controlling against covert movement. We demonstrated that endogenous brain activity in both auditory and motor functional sources reflects the imagination of binary and ternary meters in the absence of corresponding acoustic cues or overt movement at the meter rate. We found clear evidence for hypothesized motor-to-auditory information flow at the beat rate in all conditions, suggesting a role for top-down influence of the motor system on auditory processing of beat-based rhythms, and reflecting an auditory-motor system with tight reciprocal informational coupling. These findings align with and further extend a set of motor hypotheses from beat perception to hierarchical meter imagination, adding supporting evidence to active engagement of the motor system in auditory processing, which may more broadly speak to the neural mechanisms of temporal processing in other human cognitive functions.SIGNIFICANCE STATEMENT Humans live in a world full of hierarchically structured temporal information, the accurate perception of which is essential for understanding speech and music. Music provides a window into the brain mechanisms of time perception, enabling us to examine how the brain groups musical beats into, for example a march or waltz. Using a novel paradigm combining measurement of electrical brain activity with data-driven analysis, this study directly investigates motor-auditory connectivity during meter imagination. Findings highlight the importance of the motor system in the active imagination of meter. This study sheds new light on a fundamental form of perception by demonstrating how auditory-motor interaction may support hierarchical timing processing, which may have clinical implications for speech and motor rehabilitation.
Collapse
Affiliation(s)
- Tzu-Han Zoe Cheng
- Department of Cognitive Science, University of California-San Diego, La Jolla, California 92093
- Institute for Neural Computation and Swartz Center for Computational Neuroscience, University of California-San Diego, La Jolla, California 92093
| | - Sarah C Creel
- Department of Cognitive Science, University of California-San Diego, La Jolla, California 92093
| | - John R Iversen
- Institute for Neural Computation and Swartz Center for Computational Neuroscience, University of California-San Diego, La Jolla, California 92093
| |
Collapse
|
17
|
Cracco E, Lee H, van Belle G, Quenon L, Haggard P, Rossion B, Orgs G. EEG Frequency Tagging Reveals the Integration of Form and Motion Cues into the Perception of Group Movement. Cereb Cortex 2021; 32:2843-2857. [PMID: 34734972 PMCID: PMC9247417 DOI: 10.1093/cercor/bhab385] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Revised: 09/06/2021] [Accepted: 09/07/2021] [Indexed: 11/14/2022] Open
Abstract
The human brain has dedicated mechanisms for processing other people’s movements. Previous research has revealed how these mechanisms contribute to perceiving the movements of individuals but has left open how we perceive groups of people moving together. Across three experiments, we test whether movement perception depends on the spatiotemporal relationships among the movements of multiple agents. In Experiment 1, we combine EEG frequency tagging with apparent human motion and show that posture and movement perception can be dissociated at harmonically related frequencies of stimulus presentation. We then show that movement but not posture processing is enhanced when observing multiple agents move in synchrony. Movement processing was strongest for fluently moving synchronous groups (Experiment 2) and was perturbed by inversion (Experiment 3). Our findings suggest that processing group movement relies on binding body postures into movements and individual movements into groups. Enhanced perceptual processing of movement synchrony may form the basis for higher order social phenomena such as group alignment and its social consequences.
Collapse
Affiliation(s)
- Emiel Cracco
- Department of Experimental Psychology, Ghent University, 9000 Ghent, Belgium
| | - Haeeun Lee
- Department of Psychology, Goldsmiths, University of London, SE14 6NW London, UK
| | - Goedele van Belle
- Psychological Sciences Research Institute, Université Catholique de Louvain, 1340 Ottignies-Louvain-la-Neuve, Belgium
| | - Lisa Quenon
- Institute of Neuroscience, Université Catholique de Louvain, 1000 Brussels, Belgium
| | - Patrick Haggard
- Institute of Cognitive Neuroscience, University College London, WC1N 3AZ London, UK
| | - Bruno Rossion
- Université de Lorraine, CNRS, CRAN, F-54000 Nancy, France.,CHRU-Nancy, Service de Neurologie, F-54000 Nancy, France
| | - Guido Orgs
- Department of Psychology, Goldsmiths, University of London, SE14 6NW London, UK
| |
Collapse
|
18
|
Is neural entrainment to rhythms the basis of social bonding through music? Behav Brain Sci 2021; 44:e73. [PMID: 34588047 DOI: 10.1017/s0140525x20001296] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Music uses the evolutionarily unique temporal sensitivity of the auditory system and its tight coupling to the motor system to create a common neurophysiological clock between individuals that facilitates action coordination. We propose that this shared common clock arises from entrainment to musical rhythms, the process by which partners' brains and bodies become temporally aligned to the same rhythmic pulse.
Collapse
|
19
|
Zamm A, Palmer C, Bauer AKR, Bleichner MG, Demos AP, Debener S. Behavioral and Neural Dynamics of Interpersonal Synchrony Between Performing Musicians: A Wireless EEG Hyperscanning Study. Front Hum Neurosci 2021; 15:717810. [PMID: 34588966 PMCID: PMC8473838 DOI: 10.3389/fnhum.2021.717810] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 07/27/2021] [Indexed: 11/13/2022] Open
Abstract
Interpersonal synchrony refers to the temporal coordination of actions between individuals and is a common feature of social behaviors, from team sport to ensemble music performance. Interpersonal synchrony of many rhythmic (periodic) behaviors displays dynamics of coupled biological oscillators. The current study addresses oscillatory dynamics on the levels of brain and behavior between music duet partners performing at spontaneous (uncued) rates. Wireless EEG was measured from N = 20 pairs of pianists as they performed a melody first in Solo performance (at their spontaneous rate of performance), and then in Duet performances at each partner's spontaneous rate. Influences of partners' spontaneous rates on interpersonal synchrony were assessed by correlating differences in partners' spontaneous rates of Solo performance with Duet tone onset asynchronies. Coupling between partners' neural oscillations was assessed by correlating amplitude envelope fluctuations of cortical oscillations at the Duet performance frequency between observed partners and between surrogate (re-paired) partners, who performed the same melody but at different times. Duet synchronization was influenced by partners' spontaneous rates in Solo performance. The size and direction of the difference in partners' spontaneous rates were mirrored in the size and direction of the Duet asynchronies. Moreover, observed Duet partners showed greater inter-brain correlations of oscillatory amplitude fluctuations than did surrogate partners, suggesting that performing in synchrony with a musical partner is reflected in coupled cortical dynamics at the performance frequency. The current study provides evidence that dynamics of oscillator coupling are reflected in both behavioral and neural measures of temporal coordination during musical joint action.
Collapse
Affiliation(s)
- Anna Zamm
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, QC, Canada
| | - Caroline Palmer
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, QC, Canada
| | - Anna-Katharina R. Bauer
- Neuropsychology Laboratory, Institute for Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
| | - Martin G. Bleichner
- Neuropsychology Laboratory, Institute for Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
| | - Alexander P. Demos
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, QC, Canada
| | - Stefan Debener
- Neuropsychology Laboratory, Institute for Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
- Cluster of Excellence Hearing4All Oldenburg, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
20
|
The influence of auditory rhythms on the speed of inferred motion. Atten Percept Psychophys 2021; 84:2360-2383. [PMID: 34435321 DOI: 10.3758/s13414-021-02364-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/26/2021] [Indexed: 12/24/2022]
Abstract
The present research explored the influence of isochronous auditory rhythms on the timing of movement-related prediction in two experiments. In both experiments, participants observed a moving disc that was visible for a predetermined period before disappearing behind a small, medium, or large occluded area for the remainder of its movement. In Experiment 1, the disc was visible for 1 s. During this period, participants were exposed to either a fast or slow auditory rhythm, or they heard nothing. They were instructed to press a key to indicate when they believed the moving disc had reached a specified location on the other side of the occluded area. The procedure measured the (signed) error in participants' estimate of the time it would take for a moving object to contact a stationary one. The principal results of Experiment 1 were main effects of the rate of the auditory rhythm and of the size of the occlusion on participants' judgments. In Experiment 2, the period of visibility was varied with size of the occlusion area to keep the total movement time constant for all three levels of occlusion. The results replicated the main effect of rhythm found in Experiment 1 and showed a small, significant interaction, but indicated no main effect of occlusion size. Overall, the results indicate that exposure to fast isochronous auditory rhythms during an interval of inferred motion can influence the imagined rate of such motion and suggest a possible role of an internal rhythmicity in the maintenance of temporally accurate dynamic mental representations.
Collapse
|
21
|
Alemi R, Nozaradan S, Lehmann A. Free-Field Cortical Steady-State Evoked Potentials in Cochlear Implant Users. Brain Topogr 2021; 34:664-680. [PMID: 34185222 DOI: 10.1007/s10548-021-00860-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2021] [Accepted: 06/18/2021] [Indexed: 11/25/2022]
Abstract
Auditory steady-state evoked potentials (SS-EPs) are phase-locked neural responses to periodic stimuli, believed to reflect specific neural generators. As an objective measure, steady-state responses have been used in different clinical settings, including measuring hearing thresholds of normal and hearing-impaired subjects. Recent studies are in favor of recording these responses as a part of the cochlear implant (CI) device-fitting procedure. Considering these potential benefits, the goals of the present study were to assess the feasibility of recording free-field SS-EPs in CI users and to compare their characteristics between CI users and controls. By taking advantage of a recently developed dual-frequency tagging method, we attempted to record subcortical and cortical SS-EPs from adult CI users and controls and measured reliable subcortical and cortical SS-EPs in the control group. Independent component analysis (ICA) was used to remove CI stimulation artifacts, yet subcortical responses of several CIs were heavily contaminated by these artifacts. Consequently, only cortical SS-EPs were compared between groups, which were found to be larger in the controls. The lower cortical SS-EPs' amplitude in CI users might indicate a reduction in neural synchrony evoked by the modulation rate of the auditory input across different neural assemblies in the auditory pathway. The brain topographies of cortical auditory SS-EPs, the time course of cortical responses, and the reconstructed cortical maps were highly similar between groups, confirming their neural origin and possibility to obtain such responses also in CI recipients. As for subcortical SS-EPs, our results highlight a need for sophisticated denoising algorithms to pinpoint and remove artifactual components from the biological response.
Collapse
Affiliation(s)
- Razieh Alemi
- Faculty of Medicine, Department of Otolaryngology, McGill University, Montreal, QC, Canada.
- Centre for Research On Brain, Language & Music (CRBLM), Montreal, Canada.
- International Laboratory for Brain, Music & Sound Research (BRAMS), Montreal, QC, Canada.
| | - Sylvie Nozaradan
- Institute of Neuroscience (IONS), Université Catholique de Louvain (UCL), Ottignies-Louvain-la-Neuve, Belgium
| | - Alexandre Lehmann
- Faculty of Medicine, Department of Otolaryngology, McGill University, Montreal, QC, Canada
- Centre for Research On Brain, Language & Music (CRBLM), Montreal, Canada
- International Laboratory for Brain, Music & Sound Research (BRAMS), Montreal, QC, Canada
| |
Collapse
|
22
|
Rosso M, Leman M, Moumdjian L. Neural Entrainment Meets Behavior: The Stability Index as a Neural Outcome Measure of Auditory-Motor Coupling. Front Hum Neurosci 2021; 15:668918. [PMID: 34177492 PMCID: PMC8219856 DOI: 10.3389/fnhum.2021.668918] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Accepted: 04/29/2021] [Indexed: 01/23/2023] Open
Abstract
Understanding rhythmic behavior in the context of coupled auditory and motor systems has been of interest to neurological rehabilitation, in particular, to facilitate walking. Recent work based on behavioral measures revealed an entrainment effect of auditory rhythms on motor rhythms. In this study, we propose a method to compute the neural component of such a process from an electroencephalographic (EEG) signal. A simple auditory-motor synchronization paradigm was used, where 28 healthy participants were instructed to synchronize their finger-tapping with a metronome. The computation of the neural outcome measure was carried out in two blocks. In the first block, we used Generalized Eigendecomposition (GED) to reduce the data dimensionality to the component which maximally entrained to the metronome frequency. The scalp topography pointed at brain activity over contralateral sensorimotor regions. In the second block, we computed instantaneous frequency from the analytic signal of the extracted component. This returned a time-varying measure of frequency fluctuations, whose standard deviation provided our "stability index" as a neural outcome measure of auditory-motor coupling. Finally, the proposed neural measure was validated by conducting a correlation analysis with a set of behavioral outcomes from the synchronization task: resultant vector length, relative phase angle, mean asynchrony, and tempo matching. Significant moderate negative correlations were found with the first three measures, suggesting that the stability index provided a quantifiable neural outcome measure of entrainment, with selectivity towards phase-correction mechanisms. We address further adoption of the proposed approach, especially with populations where sensorimotor abilities are compromised by an underlying pathological condition. The impact of using stability index can potentially be used as an outcome measure to assess rehabilitation protocols, and possibly provide further insight into neuropathological models of auditory-motor coupling.
Collapse
Affiliation(s)
- Mattia Rosso
- Institute of Psychoacoustics and Electronic Music (IPEM), Faculty of Arts and Philosophy, Ghent University, Ghent, Belgium
| | - Marc Leman
- Institute of Psychoacoustics and Electronic Music (IPEM), Faculty of Arts and Philosophy, Ghent University, Ghent, Belgium
| | - Lousin Moumdjian
- Institute of Psychoacoustics and Electronic Music (IPEM), Faculty of Arts and Philosophy, Ghent University, Ghent, Belgium.,UMSC Hasselt-Pelt, Limburg, Belgium.,REVAL Rehabilitation Research Center, Faculty of Rehabilitation Sciences, Limburg, Belgium
| |
Collapse
|
23
|
Tichko P, Kim JC, Large EW. Bouncing the network: A dynamical systems model of auditory-vestibular interactions underlying infants' perception of musical rhythm. Dev Sci 2021; 24:e13103. [PMID: 33570778 DOI: 10.1111/desc.13103] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2020] [Accepted: 02/03/2021] [Indexed: 11/26/2022]
Abstract
Previous work suggests that auditory-vestibular interactions, which emerge during bodily movement to music, can influence the perception of musical rhythm. In a seminal study on the ontogeny of musical rhythm, Phillips-Silver and Trainor (2005) found that bouncing infants to an unaccented rhythm influenced infants' perceptual preferences for accented rhythms that matched the rate of bouncing. In the current study, we ask whether nascent, diffuse coupling between auditory and motor systems is sufficient to bootstrap short-term Hebbian plasticity in the auditory system and explain infants' preferences for accented rhythms thought to arise from auditory-vestibular interactions. First, we specify a nonlinear, dynamical system in which two oscillatory neural networks, representing developmentally nascent auditory and motor systems, interact through weak, non-specific coupling. The auditory network was equipped with short-term Hebbian plasticity, allowing the auditory network to tune its intrinsic resonant properties. Next, we simulate the effect of vestibular input (e.g., infant bouncing) on infants' perceptual preferences for accented rhythms. We found that simultaneous auditory-vestibular training shaped the model's response to musical rhythm, enhancing vestibular-related frequencies in auditory-network activity. Moreover, simultaneous auditory-vestibular training, relative to auditory- or vestibular-only training, facilitated short-term auditory plasticity in the model, producing stronger oscillator connections in the auditory network. Finally, when tested on a musical rhythm, models which received simultaneous auditory-vestibular training, but not models that received auditory- or vestibular-only training, resonated strongly at frequencies related to their "bouncing," a finding qualitatively similar to infants' preferences for accented rhythms that matched the rate of infant bouncing.
Collapse
Affiliation(s)
- Parker Tichko
- Department of Music, Northeastern University, Boston, MA, USA
| | - Ji Chul Kim
- Department of Psychological Sciences, Perception, Action, Cognition (PAC) Division, University of Connecticut, Storrs, CT, USA
| | - Edward W Large
- Department of Psychological Sciences, Perception, Action, Cognition (PAC) Division, University of Connecticut, Storrs, CT, USA.,Department of Psychological Sciences, Center for the Ecological Study of Perception & Action (CESPA), University of Connecticut, Storrs, CT, USA.,Department of Physics, University of Connecticut, Storrs, CT, USA
| |
Collapse
|
24
|
Bouvet CJ, Bardy BG, Keller PE, Dalla Bella S, Nozaradan S, Varlet M. Accent-induced Modulation of Neural and Movement Patterns during Spontaneous Synchronization to Auditory Rhythms. J Cogn Neurosci 2020; 32:2260-2271. [DOI: 10.1162/jocn_a_01605] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
Human rhythmic movements spontaneously synchronize with auditory rhythms at various frequency ratios. The emergence of more complex relationships—for instance, frequency ratios of 1:2 and 1:3—is enhanced by adding a congruent accentuation pattern (binary for 1:2 and ternary for 1:3), resulting in a 1:1 movement–accentuation relationship. However, this benefit of accentuation on movement synchronization appears to be stronger for the ternary pattern than for the binary pattern. Here, we investigated whether this difference in accent-induced movement synchronization may be related to a difference in the neural tracking of these accentuation profiles. Accented and control unaccented auditory sequences were presented to participants who concurrently produced finger taps at their preferred frequency, and spontaneous movement synchronization was measured. EEG was recorded during passive listening to each auditory sequence. The results revealed that enhanced movement synchronization with ternary accentuation was accompanied by enhanced neural tracking of this pattern. Larger EEG responses at the accentuation frequency were found for the ternary pattern compared with the binary pattern. Moreover, the amplitude of accent-induced EEG responses was positively correlated with the magnitude of accent-induced movement synchronization across participants. Altogether, these findings show that the dynamics of spontaneous auditory–motor synchronization is strongly driven by the multi-time-scale sensory processing of auditory rhythms, highlighting the importance of considering neural responses to rhythmic sequences for understanding and enhancing synchronization performance.
Collapse
Affiliation(s)
| | | | | | - Simone Dalla Bella
- Université Montpellier
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Canada
- University of Montreal
- University of Economics and Human Sciences in Warsaw
| | - Sylvie Nozaradan
- Western Sydney University
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Canada
- Université Catholique de Louvain
| | | |
Collapse
|
25
|
Mathias B, Zamm A, Gianferrara PG, Ross B, Palmer C. Rhythm Complexity Modulates Behavioral and Neural Dynamics During Auditory–Motor Synchronization. J Cogn Neurosci 2020; 32:1864-1880. [DOI: 10.1162/jocn_a_01601] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
We addressed how rhythm complexity influences auditory–motor synchronization in musically trained individuals who perceived and produced complex rhythms while EEG was recorded. Participants first listened to two-part auditory sequences (Listen condition). Each part featured a single pitch presented at a fixed rate; the integer ratio formed between the two rates varied in rhythmic complexity from low (1:1) to moderate (1:2) to high (3:2). One of the two parts occurred at a constant rate across conditions. Then, participants heard the same rhythms as they synchronized their tapping at a fixed rate (Synchronize condition). Finally, they tapped at the same fixed rate (Motor condition). Auditory feedback from their taps was present in all conditions. Behavioral effects of rhythmic complexity were evidenced in all tasks; detection of missing beats (Listen) worsened in the most complex (3:2) rhythm condition, and tap durations (Synchronize) were most variable and least synchronous with stimulus onsets in the 3:2 condition. EEG power spectral density was lowest at the fixed rate during the 3:2 rhythm and greatest during the 1:1 rhythm (Listen and Synchronize). ERP amplitudes corresponding to an N1 time window were smallest for the 3:2 rhythm and greatest for the 1:1 rhythm (Listen). Finally, synchronization accuracy (Synchronize) decreased as amplitudes in the N1 time window became more positive during the high rhythmic complexity condition (3:2). Thus, measures of neural entrainment corresponded to synchronization accuracy, and rhythmic complexity modulated the behavioral and neural measures similarly.
Collapse
Affiliation(s)
- Brian Mathias
- McGill University
- Max Planck Institute for Human Cognitive and Brain Science
| | - Anna Zamm
- McGill University
- Central European University, Budapest, Hungary
| | | | | | | |
Collapse
|
26
|
Prefrontal High Gamma in ECoG Tags Periodicity of Musical Rhythms in Perception and Imagination. eNeuro 2020; 7:ENEURO.0413-19.2020. [PMID: 32586843 PMCID: PMC7405071 DOI: 10.1523/eneuro.0413-19.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2019] [Revised: 05/19/2020] [Accepted: 06/01/2020] [Indexed: 01/08/2023] Open
Abstract
Rhythmic auditory stimuli are known to elicit matching activity patterns in neural populations. Furthermore, recent research has established the particular importance of high-gamma brain activity in auditory processing by showing its involvement in auditory phrase segmentation and envelope tracking. Here, we use electrocorticographic (ECoG) recordings from eight human listeners to see whether periodicities in high-gamma activity track the periodicities in the envelope of musical rhythms during rhythm perception and imagination. Rhythm imagination was elicited by instructing participants to imagine the rhythm to continue during pauses of several repetitions. To identify electrodes whose periodicities in high-gamma activity track the periodicities in the musical rhythms, we compute the correlation between the autocorrelations (ACCs) of both the musical rhythms and the neural signals. A condition in which participants listened to white noise was used to establish a baseline. High-gamma autocorrelations in auditory areas in the superior temporal gyrus and in frontal areas on both hemispheres significantly matched the autocorrelations of the musical rhythms. Overall, numerous significant electrodes are observed on the right hemisphere. Of particular interest is a large cluster of electrodes in the right prefrontal cortex that is active during both rhythm perception and imagination. This indicates conscious processing of the rhythms’ structure as opposed to mere auditory phenomena. The autocorrelation approach clearly highlights that high-gamma activity measured from cortical electrodes tracks both attended and imagined rhythms.
Collapse
|
27
|
Lenc T, Keller PE, Varlet M, Nozaradan S. Neural and Behavioral Evidence for Frequency-Selective Context Effects in Rhythm Processing in Humans. Cereb Cortex Commun 2020; 1:tgaa037. [PMID: 34296106 PMCID: PMC8152888 DOI: 10.1093/texcom/tgaa037] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Revised: 06/30/2020] [Accepted: 07/16/2020] [Indexed: 01/17/2023] Open
Abstract
When listening to music, people often perceive and move along with a periodic meter. However, the dynamics of mapping between meter perception and the acoustic cues to meter periodicities in the sensory input remain largely unknown. To capture these dynamics, we recorded the electroencephalography while nonmusician and musician participants listened to nonrepeating rhythmic sequences, where acoustic cues to meter frequencies either gradually decreased (from regular to degraded) or increased (from degraded to regular). The results revealed greater neural activity selectively elicited at meter frequencies when the sequence gradually changed from regular to degraded compared with the opposite. Importantly, this effect was unlikely to arise from overall gain, or low-level auditory processing, as revealed by physiological modeling. Moreover, the context effect was more pronounced in nonmusicians, who also demonstrated facilitated sensory-motor synchronization with the meter for sequences that started as regular. In contrast, musicians showed weaker effects of recent context in their neural responses and robust ability to move along with the meter irrespective of stimulus degradation. Together, our results demonstrate that brain activity elicited by rhythm does not only reflect passive tracking of stimulus features, but represents continuous integration of sensory input with recent context.
Collapse
Affiliation(s)
- Tomas Lenc
- MARCS Institute for Brain, Behaviour, and Development, Western Sydney University, Penrith, Sydney, NSW 2751, Australia
| | - Peter E Keller
- MARCS Institute for Brain, Behaviour, and Development, Western Sydney University, Penrith, Sydney, NSW 2751, Australia
| | - Manuel Varlet
- MARCS Institute for Brain, Behaviour, and Development, Western Sydney University, Penrith, Sydney, NSW 2751, Australia
- School of Psychology, Western Sydney University, Penrith, Sydney, NSW 2751, Australia
| | - Sylvie Nozaradan
- MARCS Institute for Brain, Behaviour, and Development, Western Sydney University, Penrith, Sydney, NSW 2751, Australia
- Institute of Neuroscience (IONS), Université Catholique de Louvain (UCL), Brussels 1200, Belgium
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal QC H3C 3J7, Canada
| |
Collapse
|
28
|
Fanuel L, Portrat S, Dalla Bella S, Tillmann B, Plancher G. Do Temporal Regularities during Maintenance Benefit Short-term Memory in the Elderly? Inhibition Capacities Matter. Exp Aging Res 2020; 46:396-415. [PMID: 32538313 DOI: 10.1080/0361073x.2020.1776572] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
BACKGROUND/STUDY CONTEXT Recent research has shown a benefit of temporally regular structure presented during the maintenance period in short-term memory for young adults. Because maintenance is impaired in aging, we investigated whether older adults can also benefit from the temporal regularities for maintenance and how their cognitive capacities might affect this potential benefit. METHODS Healthy older adults (range: 63-90 years old) had to memorize visually presented letters and maintain them in short-term memory for 6 s until recall. The six-second retention interval was either filled with an isochronous rhythmic sound sequence that provided a temporally regular structure or silent. RESULTS The effect of the isochronous rhythm on recall performance was modulated by inhibition capacities of older adults: as compared to silence, improved recall performance thanks to the rhythm emerged with increased inhibitory capacity of the participants. CONCLUSION Even though maintenance of older adults benefits less from the presence of temporal regularities than does the maintenance of younger ones, our findings provide evidence for improved maintenance in short-term memory for older adults in the presence of a temporally regular structure, probably due to enhanced attentional refreshing. It further provides perspectives for training and rehabilitation of age-related working memory deficits.
Collapse
Affiliation(s)
- Lison Fanuel
- Université Lumiére Lyon 2, Laboratoire d'Etude des Mécanismes Cognitifs , Bron, France.,CNRS, UMR5292; INSERM, U1028; Lyon Neuroscience Research Center, Lyon, F-69000, France.,University Lyon 1 , Villeurbanne, F-69000, France
| | - Sophie Portrat
- University Grenoble Alpes, CNRS, LPNC, 38000 , Grenoble, France
| | - Simone Dalla Bella
- International Laboratory for Brain, Music, and Sound Research (BRAMS), Montreal, Canada.,Department of Psychology, University of Montreal , Montreal, Canada.,Centre for Research on Brain, Language, and Music (CRBLM), Montreal, Canada.,University of Economics and Human Sciences in Warsaw, Warsaw, Poland
| | - Barbara Tillmann
- CNRS, UMR5292; INSERM, U1028; Lyon Neuroscience Research Center, Lyon, F-69000, France.,University Lyon 1 , Villeurbanne, F-69000, France
| | - Gaën Plancher
- Université Lumiére Lyon 2, Laboratoire d'Etude des Mécanismes Cognitifs , Bron, France
| |
Collapse
|
29
|
Why do we move to the beat? A multi-scale approach, from physical principles to brain dynamics. Neurosci Biobehav Rev 2020; 112:553-584. [DOI: 10.1016/j.neubiorev.2019.12.024] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2019] [Revised: 10/20/2019] [Accepted: 12/13/2019] [Indexed: 01/08/2023]
|
30
|
Yurgil KA, Velasquez MA, Winston JL, Reichman NB, Colombo PJ. Music Training, Working Memory, and Neural Oscillations: A Review. Front Psychol 2020; 11:266. [PMID: 32153474 PMCID: PMC7047970 DOI: 10.3389/fpsyg.2020.00266] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2019] [Accepted: 02/04/2020] [Indexed: 12/18/2022] Open
Abstract
This review focuses on reports that link music training to working memory and neural oscillations. Music training is increasingly associated with improvement in working memory, which is strongly related to both localized and distributed patterns of neural oscillations. Importantly, there is a small but growing number of reports of relationships between music training, working memory, and neural oscillations in adults. Taken together, these studies make important contributions to our understanding of the neural mechanisms that support effects of music training on behavioral measures of executive functions. In addition, they reveal gaps in our knowledge that hold promise for further investigation. The current review is divided into the main sections that follow: (1) discussion of behavioral measures of working memory, and effects of music training on working memory in adults; (2) relationships between music training and neural oscillations during temporal stages of working memory; (3) relationships between music training and working memory in children; (4) relationships between music training and working memory in older adults; and (5) effects of entrainment of neural oscillations on cognitive processing. We conclude that the study of neural oscillations is proving useful in elucidating the neural mechanisms of relationships between music training and the temporal stages of working memory. Moreover, a lifespan approach to these studies will likely reveal strategies to improve and maintain executive function during development and aging.
Collapse
Affiliation(s)
- Kate A. Yurgil
- Department of Psychological Sciences, Loyola University, New Orleans, LA, United States
| | | | - Jenna L. Winston
- Department of Psychology, Tulane University, New Orleans, LA, United States
| | - Noah B. Reichman
- Brain Institute, Tulane University, New Orleans, LA, United States
| | - Paul J. Colombo
- Department of Psychology, Tulane University, New Orleans, LA, United States
- Brain Institute, Tulane University, New Orleans, LA, United States
| |
Collapse
|
31
|
Ríos-López P, Molinaro N, Lallier M. Tapping to a beat in synchrony predicts brain print sensitivity in pre-readers. BRAIN AND LANGUAGE 2019; 199:104693. [PMID: 31539633 DOI: 10.1016/j.bandl.2019.104693] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/18/2019] [Revised: 08/30/2019] [Accepted: 09/01/2019] [Indexed: 06/10/2023]
Abstract
This longitudinal study was aimed at testing the relation between rhythm sensitivity and behavioural and neural orthographic sensitivity in pre-reading stages. Basque-speaking children performed several behavioural and EEG tasks at two time points prior to formal reading acquisition (T1: 4 years old; T2: 5 years old). Neural sensitivity to print was measured via a novel child friendly N170-elicitation paradigm. Our results highlight a transversal and longitudinal relation between rhythm sensitivity and letter name knowledge in pre-reading children. Moreover, they show that children's rhythm sensitivity predicts a significant part of the variance of their N170 response one year later, highlighting the potential of rhythm tasks to predict future orthographic sensitivity in pre-reading stages. Interestingly, the relation between rhythmic skills and print sensitivity was not mediated by the children's phonological short-term memory. Our results provide novel evidence on the importance of rhythm sensitivity for the development of early orthographic sensitivity.
Collapse
Affiliation(s)
- Paula Ríos-López
- BCBL, Basque Center on Cognition, Brain and Language, Paseo Mikeletegi, 69, 20009 Donostia-San Sebastián, Spain.
| | - Nicola Molinaro
- BCBL, Basque Center on Cognition, Brain and Language, Paseo Mikeletegi, 69, 20009 Donostia-San Sebastián, Spain; Ikerbasque, Basque Foundation for Science, Bilbao, Spain
| | - Marie Lallier
- BCBL, Basque Center on Cognition, Brain and Language, Paseo Mikeletegi, 69, 20009 Donostia-San Sebastián, Spain
| |
Collapse
|
32
|
Pflug A, Gompf F, Muthuraman M, Groppa S, Kell CA. Differential contributions of the two human cerebral hemispheres to action timing. eLife 2019; 8:e48404. [PMID: 31697640 PMCID: PMC6837842 DOI: 10.7554/elife.48404] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2019] [Accepted: 10/08/2019] [Indexed: 01/22/2023] Open
Abstract
Rhythmic actions benefit from synchronization with external events. Auditory-paced finger tapping studies indicate the two cerebral hemispheres preferentially control different rhythms. It is unclear whether left-lateralized processing of faster rhythms and right-lateralized processing of slower rhythms bases upon hemispheric timing differences that arise in the motor or sensory system or whether asymmetry results from lateralized sensorimotor interactions. We measured fMRI and MEG during symmetric finger tapping, in which fast tapping was defined as auditory-motor synchronization at 2.5 Hz. Slow tapping corresponded to tapping to every fourth auditory beat (0.625 Hz). We demonstrate that the left auditory cortex preferentially represents the relative fast rhythm in an amplitude modulation of low beta oscillations while the right auditory cortex additionally represents the internally generated slower rhythm. We show coupling of auditory-motor beta oscillations supports building a metric structure. Our findings reveal a strong contribution of sensory cortices to hemispheric specialization in action control.
Collapse
Affiliation(s)
- Anja Pflug
- Cognitive Neuroscience Group, Brain Imaging Center and Department of NeurologyGoethe UniversityFrankfurtGermany
| | - Florian Gompf
- Cognitive Neuroscience Group, Brain Imaging Center and Department of NeurologyGoethe UniversityFrankfurtGermany
| | - Muthuraman Muthuraman
- Movement Disorders and Neurostimulation, Biomedical Statistics and Multimodal Signal Processing Unit, Department of NeurologyJohannes Gutenberg UniversityMainzGermany
| | - Sergiu Groppa
- Movement Disorders and Neurostimulation, Biomedical Statistics and Multimodal Signal Processing Unit, Department of NeurologyJohannes Gutenberg UniversityMainzGermany
| | - Christian Alexander Kell
- Cognitive Neuroscience Group, Brain Imaging Center and Department of NeurologyGoethe UniversityFrankfurtGermany
| |
Collapse
|
33
|
Maróti E, Honbolygó F, Weiss B. Neural entrainment to the beat in multiple frequency bands in 6-7-year-old children. Int J Psychophysiol 2019; 141:45-55. [PMID: 31078641 DOI: 10.1016/j.ijpsycho.2019.05.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2018] [Revised: 05/03/2019] [Accepted: 05/08/2019] [Indexed: 11/28/2022]
Abstract
Entrainment to periodic acoustic stimuli has been found to relate both to the auditory and motor cortices, and it could be influenced by the maturity of these brain regions. However, existing research in this topic provides data about different oscillatory brain activities in different age groups with different musical background. In order to obtain a more coherent picture and examine early manifestations of entrainment, we assessed brain oscillations at multiple time scales (beta: 15-25 Hz, gamma: 28-48 Hz) and in steady state evoked potentials (SS-EPs in short) in 6-7-year-old children with no musical background right at the start of primary school before they learnt to read. Our goal was to exclude the effect of music training and reading, since previous studies have shown that sensorimotor entrainment (movement synchronization to the beat) is related to musical and reading abilities. We found evidence for endogenous anticipatory processing in the gamma band related to meter perception, and stimulus-related frequency specific responses. However, we did not find evidence for an interaction between auditory and motor networks, which suggests that endogenous mechanisms related to auditory processing may mature earlier than those that underlie motor actions, such as sensorimotor synchronization.
Collapse
Affiliation(s)
- Emese Maróti
- Brain Imaging Centre, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Budapest, Hungary; Department of Cognitive Science, Budapest University of Technology and Economics, Budapest, Hungary.
| | - Ferenc Honbolygó
- Brain Imaging Centre, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Budapest, Hungary; Institute of Psychology, Eötvös Loránd University, Budapest, Hungary
| | - Béla Weiss
- Brain Imaging Centre, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Budapest, Hungary
| |
Collapse
|
34
|
Bouvet CJ, Varlet M, Dalla Bella S, Keller PE, Zelic G, Bardy BG. Preferred frequency ratios for spontaneous auditory-motor synchronization: Dynamical stability and hysteresis. Acta Psychol (Amst) 2019; 196:33-41. [PMID: 30978534 DOI: 10.1016/j.actpsy.2019.03.007] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2018] [Revised: 02/16/2019] [Accepted: 03/28/2019] [Indexed: 11/16/2022] Open
Abstract
Humans spontaneously synchronize their movements with external auditory rhythms such as a metronome or music. Although such synchronization preferentially occurs toward simple 1:1 movement-stimulus frequency ratio, the extent to which spontaneous synchronization can also occur toward more complex frequency ratios remains largely unclear. The present study investigates the occurrence and dynamical stability of spontaneous auditory-motor synchronization at multiple frequency ratios. Participants performed index finger oscillations at their preferred tempo while listening to auditory metronomes with frequency progressively increasing or decreasing between 1 Hz and 6 Hz. The results demonstrated that participants' movements were not only entrained toward the 1:1 frequency ratio but also toward the 1:2 ratio. The occurrence and stability of these ratios differed as a function of the direction of frequency change. Participants synchronized to the 1:2 ratio and transitioned to a 1:1 ratio in the descending condition. In the ascending condition only the 1:1 ratio was sustained, for a longer extent than in the descending condition. These results show that the initial coordination pattern influenced pattern transition, demonstrating the occurrence of a hysteresis effect that is typical of complex system dynamics. These findings provide new insight into the mechanisms underlying the occurrence and stability of spontaneous movement synchronization to auditory rhythms.
Collapse
Affiliation(s)
- Cécile J Bouvet
- EuroMov, Univ. Montpellier, Montpellier, France; The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Australia.
| | - Manuel Varlet
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Australia; School of Social Sciences and Psychology, Western Sydney University, Australia
| | - Simone Dalla Bella
- EuroMov, Univ. Montpellier, Montpellier, France; International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Canada; Department of Psychology, University of Montreal, Canada; Dept. of Cognitive Psychology, WSFiZ in Warsaw, Poland
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Australia
| | - Grégory Zelic
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Australia
| | | |
Collapse
|
35
|
Braun Janzen T, Haase M, Thaut MH. Rhythmic priming across effector systems: A randomized controlled trial with Parkinson’s disease patients. Hum Mov Sci 2019; 64:355-365. [DOI: 10.1016/j.humov.2019.03.001] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2018] [Revised: 02/21/2019] [Accepted: 03/01/2019] [Indexed: 01/23/2023]
|
36
|
Aydın S, Güdücü Ç, Kutluk F, Öniz A, Özgören M. The impact of musical experience on neural sound encoding performance. Neurosci Lett 2018; 694:124-128. [PMID: 30503922 DOI: 10.1016/j.neulet.2018.11.034] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2018] [Revised: 10/26/2018] [Accepted: 11/13/2018] [Indexed: 11/24/2022]
Abstract
In this study, 64-channel single trial auditory brain oscillations (STABO) have been firstly analyzed by using complexity metrics to observe the effect of musical experience on brain functions. Experimental data was recorded from eyes-opened volunteers during listening the musical chords by piano. Complexity estimation methods were compared to each other for classification of groups (professional musicians and non-musicians) by using both classifiers (support vector machine (SVM), Naive Bayes (NB)) and statistical tests (one-way ANOVA) with respect to electrode locations. Permutation entropy (PermEn) is found to be the best metric (p ≪ 0.0001, 98.37% and 98.41% accuracies for tonal and atonal ensembles) at fronto-temporal regions which are responsible for cognitive task evaluation and perception of sound. PermEn also provides the meaningful results at the whole cortex (p ≪ 0.0001, 99.81% accuracy for both tonal and atonal ensembles) through SVM with Radial Basis kernels superior to Gaussians. Almost the similar performance is also obtained for temporal features. Although, performance improvements are observed for spectral methods with NB, the considerable better results are obtained with SVM. The results indicate that musical stimuli cause pattern variations instead of spectral variations on STABO due to relatively higher neuronal activities around auditory cortex. In conclusion, temporal regions produce response to auditory stimuli, while frontal area integrates the auditory task at the same time. As well, the parietal cortex produces neural information according to the degree of attention generated by environmental changes such as atonal stimuli. It can be clearly stated that musical experience enhances the neural encoding performance of sound tonality at mostly fronto-temporal regions.
Collapse
Affiliation(s)
- Serap Aydın
- Department of Biophysics, Faculty of Medicine, University of Hacettepe, Ankara, Turkey
| | - Çağdaş Güdücü
- Department of Biophysics, Faculty of Medicine, University of Dokuz Eylül, Izmir, Turkey
| | - Fırat Kutluk
- Department of Musicology, Faculty of Fine Arts, University of Dokuz Eylül, Izmir, Turkey
| | - Adile Öniz
- Department of Biophysics, Faculty of Medicine, University of Dokuz Eylül, Izmir, Turkey
| | - Murat Özgören
- Department of Biophysics, Faculty of Medicine, University of Dokuz Eylül, Izmir, Turkey
| |
Collapse
|
37
|
Harrison SJ, Hough M, Schmid K, Groff BR, Stergiou N. When Coordinating Finger Tapping to a Variable Beat the Variability Scaling Structure of the Movement and the Cortical BOLD Signal are Both Entrained to the Auditory Stimuli. Neuroscience 2018; 392:203-218. [PMID: 29958941 PMCID: PMC8091912 DOI: 10.1016/j.neuroscience.2018.06.025] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2017] [Revised: 06/12/2018] [Accepted: 06/18/2018] [Indexed: 01/13/2023]
Abstract
Rhythmic actions are characterizable as a repeating invariant pattern of movement together with variability taking the form of cycle-to-cycle fluctuations. Variability in behavioral measures is atypically random, and often exhibits serial temporal dependencies and statistical self-similarity in the scaling of variability magnitudes across timescales. Self-similar (i.e. fractal) variability scaling is evident in measures of both brain and behavior. Variability scaling structure can be quantified via the scaling exponent (α) from detrended fluctuation analysis (DFA). Here we study the task of coordinating thumb-finger tapping to the beats of constructed auditory stimuli. We test the hypothesis that variability scaling evident in tap-to-tap intervals as well as in the fluctuations of cortical hemodynamics will become entrained to (i.e. drawn toward) manipulated changes in the variability scaling of a stimulus's beat-to-beat intervals. Consistent with this hypothesis, manipulated changes of the exponent α of the experimental stimuli produced corresponding changes in the exponent α of both tap-to-tap intervals and cortical hemodynamics. The changes in hemodynamics were observed in both motor and sensorimotor cortical areas in the contralateral hemisphere. These results were observed only for the longer timescales of the detrended fluctuation analysis used to measure the exponent α. These findings suggest that complex auditory stimuli engage both brain and behavior at the level of variability scaling structures.
Collapse
Affiliation(s)
- Steven J Harrison
- Department of Kinesiology, University of Connecticut, United States.
| | - Michael Hough
- Department of Biomechanics, University of Nebraska at Omaha, United States
| | - Kendra Schmid
- Department of Biostatistics, University of Nebraska Medical Center, United States
| | - Boman R Groff
- Department of Biomechanics, University of Nebraska at Omaha, United States
| | - Nicholas Stergiou
- Department of Biomechanics, University of Nebraska at Omaha, United States
| |
Collapse
|
38
|
De Pretto M, Deiber MP, James CE. Steady-state evoked potentials distinguish brain mechanisms of self-paced versus synchronization finger tapping. Hum Mov Sci 2018; 61:151-166. [PMID: 30098488 DOI: 10.1016/j.humov.2018.07.007] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2018] [Revised: 07/12/2018] [Accepted: 07/18/2018] [Indexed: 10/28/2022]
Abstract
Sensorimotor synchronization (SMS) requires aligning motor actions to external events and represents a core part of both musical and dance performances. In the current study, to isolate the brain mechanisms involved in synchronizing finger tapping with a musical beat, we compared SMS to pure self-paced finger tapping and listen-only conditions at different tempi. We analyzed EEG data using frequency domain steady-state evoked potentials (SSEPs) to identify sustained electrophysiological brain activity during repetitive tasks. Behavioral results revealed different timing modes between SMS and self-paced finger tapping, associated with distinct scalp topographies, thus suggesting different underlying brain sources. After subtraction of the listen-only brain activity, SMS was compared to self-paced finger tapping. Resulting source estimations showed stronger activation of the left inferior frontal gyrus during SMS, and stronger activation of the bilateral inferior parietal lobule during self-paced finger tapping. These results point to the left inferior frontal gyrus as a pivot for perception-action coupling. We discuss our findings in the context of the ongoing debate about SSEPs interpretation given the variety of brain events contributing to SSEPs and similar EEG frequency responses.
Collapse
Affiliation(s)
- Michael De Pretto
- Faculty of Psychology and Educational Sciences, Department of Psychology, University of Geneva, 40 Boulevard du Pont-d'Arve, CH-1211 Geneva, Switzerland; Neurology Unit, Medicine Department, Faculty of Sciences, University of Fribourg, Chemin du Musée 5, CH-1700 Fribourg, Switzerland; School of Philosophy, Psychology and Language Sciences, Department of Psychology, University of Edinburgh, 7 George Square, Edinburgh EH8 9JZ, UK.
| | - Marie-Pierre Deiber
- Psychiatry Department, Division of Psychiatric Specialties, University Hospitals of Geneva, 20 bis rue de Lausanne, CH-1201 Geneva, Switzerland; NCCR Synapsy, 9 Chemin des Mines, CH-1202 Geneva, Switzerland
| | - Clara E James
- Faculty of Psychology and Educational Sciences, Department of Psychology, University of Geneva, 40 Boulevard du Pont-d'Arve, CH-1211 Geneva, Switzerland; School of Health Sciences Geneva, HES-SO University of Applied Sciences and Arts Western Switzerland, 47 Avenue de Champel, CH-1206 Geneva, Switzerland
| |
Collapse
|
39
|
Huang Y, Gu L, Yang J, Zhong S, Wu X. Relative Contributions of the Speed Characteristic and Other Possible Ecological Factors in Synchronization to a Visual Beat Consisting of Periodically Moving Stimuli. Front Psychol 2018; 9:1226. [PMID: 30072936 PMCID: PMC6058225 DOI: 10.3389/fpsyg.2018.01226] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2017] [Accepted: 06/27/2018] [Indexed: 11/13/2022] Open
Abstract
Daily music experience involves synchronizing movements in time with a perceived periodic beat. Contrary to the auditory-specific view of beat synchronization, synchronization to a visual beat composed of a periodically bouncing ball has been shown to be not less stable than synchronization to auditory beats. The ecological relevance of periodically moving visual stimuli is considered to be essential for such synchronization improvement. However, multiple factors could be associated with the ecological relevance and the relative contributions of the ecological factors to the synchronization improvement remain unclear. The present study investigated whether ecological factors other than a proposed critical factor, i.e., the speed characteristic, are required to account for the synchronization improvement of the bouncing ball. A periodically contracting ring that had the same speed characteristic as the periodically bouncing ball but lacked other possible ecological factors of the ball was designed. The results showed that synchronization was more stable for the bouncing ball than for the contracting ring, and this stability difference was larger in the difficult 300-ms than in the comfortable 600-ms inter-beat interval tapping condition. The finding suggests that ecological factors other than the speed characteristic are required to explain the synchronization improvement of periodically moving visual stimuli, particularly in difficult tapping conditions.
Collapse
Affiliation(s)
- Yingyu Huang
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Li Gu
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Junkai Yang
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Shengqi Zhong
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| | - Xiang Wu
- Department of Psychology, Sun Yat-Sen University, Guangzhou, China
| |
Collapse
|
40
|
Chemin B, Huang G, Mulders D, Mouraux A. EEG time-warping to study non-strictly-periodic EEG signals related to the production of rhythmic movements. J Neurosci Methods 2018; 308:106-115. [PMID: 30053483 DOI: 10.1016/j.jneumeth.2018.07.016] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2018] [Revised: 07/23/2018] [Accepted: 07/23/2018] [Indexed: 11/17/2022]
Abstract
BACKGROUND Many sensorimotor functions are intrinsically rhythmic, and are underlined by neural processes that are functionally distinct from neural responses related to the processing of transient events. EEG frequency tagging is a technique that is increasingly used in neuroscience to study these processes. It relies on the fact that perceiving and/or producing rhythms generates periodic neural activity that translates into periodic variations of the EEG signal. In the EEG spectrum, those variations appear as peaks localized at the frequency of the rhythm and its harmonics. NEW METHOD Many natural rhythms, such as music or dance, are not strictly periodic and, instead, show fluctuations of their period over time. Here, we introduce a time-warping method to identify non-strictly-periodic EEG activities in the frequency domain. RESULTS EEG time-warping can be used to characterize the sensorimotor activity related to the performance of self-paced rhythmic finger movements. Furthermore, the EEG time-warping method can disentangle auditory- and movement-related EEG activity produced when participants perform rhythmic movements synchronized to an acoustic rhythm. This is possible because the movement-related activity has different period fluctuations than the auditory-related activity. COMPARISON WITH EXISTING METHODS With the classic frequency-tagging approach, rhythm fluctuations result in a spreading of the peaks to neighboring frequencies, to the point that they cannot be distinguished from background noise. CONCLUSIONS The proposed time-warping procedure is as a simple and effective mean to study natural non-strictly-periodic rhythmic neural processes such as rhythmic movement production, acoustic rhythm perception and sensorimotor synchronization.
Collapse
Affiliation(s)
- B Chemin
- Institute of NeuroScience (IoNS), System and Cognition Department, Université catholique de Louvain, Belgium; International Laboratory for Brain, Music and Sound Research (BRAMS), Université de Montréal, Canada.
| | - G Huang
- Institute of NeuroScience (IoNS), System and Cognition Department, Université catholique de Louvain, Belgium; School of Mobile Information Engineering, Sun Yat-Sen University, China
| | - D Mulders
- Institute of NeuroScience (IoNS), System and Cognition Department, Université catholique de Louvain, Belgium
| | - A Mouraux
- Institute of NeuroScience (IoNS), System and Cognition Department, Université catholique de Louvain, Belgium
| |
Collapse
|
41
|
Zamm A, Debener S, Bauer AKR, Bleichner MG, Demos AP, Palmer C. Amplitude envelope correlations measure synchronous cortical oscillations in performing musicians. Ann N Y Acad Sci 2018; 1423:251-263. [PMID: 29756657 DOI: 10.1111/nyas.13738] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2017] [Revised: 03/19/2018] [Accepted: 03/27/2018] [Indexed: 11/29/2022]
Abstract
A major question facing cognitive neuroscience is measurement of interbrain synchrony between individuals performing joint actions. We describe the application of a novel method for measuring musicians' interbrain synchrony: amplitude envelope correlations (AECs). Amplitude envelopes (AEs) reflect energy fluctuations in cortical oscillations over time; AE correlations measure the degree to which two envelope fluctuations are temporally correlated, such as cortical oscillations arising from two individuals performing a joint action. Wireless electroencephalography was recorded from two pianists performing a musical duet; an analysis pipeline is described for computing AEs of cortical oscillations at the duet performance frequency (number of tones produced per second) to test whether these oscillations reflect the temporal dynamics of partners' performances. The pianists' AE correlations were compared with correlations based on a distribution of AEs simulated from white noise signals using the same methods. The AE method was also applied to the temporal characteristics of the pianists' performances, to show that the observed pair's AEs reflect the temporal dynamics of their performance. AE correlations offer a promising approach for assessing interbrain correspondences in cortical activity associated with performing joint tasks.
Collapse
Affiliation(s)
- Anna Zamm
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, Canada
| | - Stefan Debener
- Neuropsychology Laboratory, European Medical School, Institute for Psychology, University of Oldenburg, Oldenburg, Germany
- Cluster of Excellence Hearing4all Oldenburg, University of Oldenburg, Oldenburg, Germany
| | - Anna-Katharina R Bauer
- Neuropsychology Laboratory, European Medical School, Institute for Psychology, University of Oldenburg, Oldenburg, Germany
| | - Martin G Bleichner
- Neuropsychology Laboratory, European Medical School, Institute for Psychology, University of Oldenburg, Oldenburg, Germany
- Cluster of Excellence Hearing4all Oldenburg, University of Oldenburg, Oldenburg, Germany
| | - Alexander P Demos
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, Canada
| | - Caroline Palmer
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, Canada
| |
Collapse
|
42
|
Silva S, Folia V, Inácio F, Castro SL, Petersson KM. Modality effects in implicit artificial grammar learning: An EEG study. Brain Res 2018; 1687:50-59. [DOI: 10.1016/j.brainres.2018.02.020] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2017] [Revised: 12/26/2017] [Accepted: 02/15/2018] [Indexed: 11/25/2022]
|
43
|
Zoefel B, Ten Oever S, Sack AT. The Involvement of Endogenous Neural Oscillations in the Processing of Rhythmic Input: More Than a Regular Repetition of Evoked Neural Responses. Front Neurosci 2018; 12:95. [PMID: 29563860 PMCID: PMC5845906 DOI: 10.3389/fnins.2018.00095] [Citation(s) in RCA: 85] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2017] [Accepted: 02/05/2018] [Indexed: 11/13/2022] Open
Abstract
It is undisputed that presenting a rhythmic stimulus leads to a measurable brain response that follows the rhythmic structure of this stimulus. What is still debated, however, is the question whether this brain response exclusively reflects a regular repetition of evoked responses, or whether it also includes entrained oscillatory activity. Here we systematically present evidence in favor of an involvement of entrained neural oscillations in the processing of rhythmic input while critically pointing out which questions still need to be addressed before this evidence could be considered conclusive. In this context, we also explicitly discuss the potential functional role of such entrained oscillations, suggesting that these stimulus-aligned oscillations reflect, and serve as, predictive processes, an idea often only implicitly assumed in the literature.
Collapse
Affiliation(s)
- Benedikt Zoefel
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom
| | - Sanne Ten Oever
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
| | - Alexander T Sack
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
| |
Collapse
|
44
|
Nozaradan S, Schönwiesner M, Keller PE, Lenc T, Lehmann A. Neural bases of rhythmic entrainment in humans: critical transformation between cortical and lower-level representations of auditory rhythm. Eur J Neurosci 2018; 47:321-332. [PMID: 29356161 DOI: 10.1111/ejn.13826] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2017] [Revised: 01/12/2018] [Accepted: 01/15/2018] [Indexed: 11/29/2022]
Abstract
The spontaneous ability to entrain to meter periodicities is central to music perception and production across cultures. There is increasing evidence that this ability involves selective neural responses to meter-related frequencies. This phenomenon has been observed in the human auditory cortex, yet it could be the product of evolutionarily older lower-level properties of brainstem auditory neurons, as suggested by recent recordings from rodent midbrain. We addressed this question by taking advantage of a new method to simultaneously record human EEG activity originating from cortical and lower-level sources, in the form of slow (< 20 Hz) and fast (> 150 Hz) responses to auditory rhythms. Cortical responses showed increased amplitudes at meter-related frequencies compared to meter-unrelated frequencies, regardless of the prominence of the meter-related frequencies in the modulation spectrum of the rhythmic inputs. In contrast, frequency-following responses showed increased amplitudes at meter-related frequencies only in rhythms with prominent meter-related frequencies in the input but not for a more complex rhythm requiring more endogenous generation of the meter. This interaction with rhythm complexity suggests that the selective enhancement of meter-related frequencies does not fully rely on subcortical auditory properties, but is critically shaped at the cortical level, possibly through functional connections between the auditory cortex and other, movement-related, brain structures. This process of temporal selection would thus enable endogenous and motor entrainment to emerge with substantial flexibility and invariance with respect to the rhythmic input in humans in contrast with non-human animals.
Collapse
Affiliation(s)
- Sylvie Nozaradan
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Locked Bag 1797, Penrith, Sydney, NSW, 2751, Australia.,Institute of Neuroscience (IONS), Université catholique de Louvain (UCL), Louvain, Belgium.,International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, QC, Canada
| | - Marc Schönwiesner
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, QC, Canada.,Center for Research on Brain, Language and Music (CRBLM), Montreal, QC, Canada.,Faculty of Psychology, Université de Montréal, Montreal, QC, Canada
| | - Peter E Keller
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Locked Bag 1797, Penrith, Sydney, NSW, 2751, Australia
| | - Tomas Lenc
- MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Locked Bag 1797, Penrith, Sydney, NSW, 2751, Australia
| | - Alexandre Lehmann
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, QC, Canada.,Center for Research on Brain, Language and Music (CRBLM), Montreal, QC, Canada.,Faculty of Psychology, Université de Montréal, Montreal, QC, Canada.,Otolaryngology Department, Faculty of Medicine, McGill University Hospital, Montreal, QC, Canada
| |
Collapse
|
45
|
Timora J, Budd T. Steady-State EEG and Psychophysical Measures of Multisensory Integration to Cross-Modally Synchronous and Asynchronous Acoustic and Vibrotactile Amplitude Modulation Rate. Multisens Res 2018; 31:391-418. [DOI: 10.1163/22134808-00002549] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2016] [Accepted: 01/16/2017] [Indexed: 11/19/2022]
Abstract
According to thetemporal principleof multisensory integration, cross-modal synchronisation of stimulus onset facilitates multisensory integration. This is typically observed as a greater response to multisensory stimulation relative to the sum of the constituent unisensory responses (i.e.,superadditivity). The aim of the present study was to examine whether the temporal principle extends to the cross-modal synchrony of amplitude-modulation (AM) rate. It is well established that psychophysical sensitivity to AM stimulation is strongly influenced by AM rate where the optimum rate differs according to sensory modality. This rate-dependent sensitivity is also apparent from EEG steady-state response (SSR) activity, which becomes entrained to the stimulation rate and is thought to reflect neural processing of the temporal characteristics of AM stimulation. In this study we investigated whether cross-modal congruence of AM rate reveals both psychophysical and EEG evidence of enhanced multisensory integration. To achieve this, EEG SSR and psychophysical sensitivity to simultaneous acoustic and/or vibrotactile AM stimuli were measured at cross-modally congruent and incongruent AM rates. While the results provided no evidence of superadditive multisensory SSR activity or psychophysical sensitivity, the complex pattern of results did reveal a consistent correspondence between SSR activity and psychophysical sensitivity to AM stimulation. This indicates that entrained EEG activity may provide a direct measure of cortical activity underlying multisensory integration. Consistent with the temporal principle of multisensory integration, increased vibrotactile SSR responses and psychophysical sensitivity were found for cross-modally congruent relative to incongruent AM rate. However, no corresponding increase in auditory SSR or psychophysical sensitivity was observed for cross-modally congruent AM rates. This complex pattern of results can be understood in terms of the likely influence of theprinciple of inverse effectivenesswhere the temporal principle of multisensory integration was only evident in the context of reduced perceptual sensitivity for the vibrotactile but not the auditory modality.
Collapse
Affiliation(s)
- Justin R. Timora
- Brain Imaging Lab, School of Psychology, University of Newcastle, Ourimbah, NSW, Australia
| | - Timothy W. Budd
- Brain Imaging Lab, School of Psychology, University of Newcastle, Ourimbah, NSW, Australia
| |
Collapse
|
46
|
Nozaradan S, Keller PE, Rossion B, Mouraux A. EEG Frequency-Tagging and Input-Output Comparison in Rhythm Perception. Brain Topogr 2017; 31:153-160. [PMID: 29127530 DOI: 10.1007/s10548-017-0605-8] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2017] [Accepted: 10/27/2017] [Indexed: 01/23/2023]
Abstract
The combination of frequency-tagging with electroencephalography (EEG) has recently proved fruitful for understanding the perception of beat and meter in musical rhythm, a common behavior shared by humans of all cultures. EEG frequency-tagging allows the objective measurement of input-output transforms to investigate beat perception, its modulation by exogenous and endogenous factors, development, and neural basis. Recent doubt has been raised about the validity of comparing frequency-domain representations of auditory rhythmic stimuli and corresponding EEG responses, assuming that it implies a one-to-one mapping between the envelope of the rhythmic input and the neural output, and that it neglects the sensitivity of frequency-domain representations to acoustic features making up the rhythms. Here we argue that these elements actually reinforce the strengths of the approach. The obvious fact that acoustic features influence the frequency spectrum of the sound envelope precisely justifies taking into consideration the sounds used to generate a beat percept for interpreting neural responses to auditory rhythms. Most importantly, the many-to-one relationship between rhythmic input and perceived beat actually validates an approach that objectively measures the input-output transforms underlying the perceptual categorization of rhythmic inputs. Hence, provided that a number of potential pitfalls and fallacies are avoided, EEG frequency-tagging to study input-output relationships appears valuable for understanding rhythm perception.
Collapse
Affiliation(s)
- Sylvie Nozaradan
- The MARCS Institute for Brain, Behaviour and Development (WSU), Sydney, NSW, Australia. .,Institute of Neuroscience (Ions), Université catholique de Louvain (UCL), Brussels, Belgium. .,International Laboratory for Brain, Music and Sound Research (Brams), Montreal, QC, Canada. .,MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Locked Bag 1797, Penrith, NSW, 2751, Australia.
| | - Peter E Keller
- The MARCS Institute for Brain, Behaviour and Development (WSU), Sydney, NSW, Australia
| | - Bruno Rossion
- Institute of Neuroscience (Ions), Université catholique de Louvain (UCL), Brussels, Belgium.,Neurology Unit, Centre Hospitalier Régional Universitaire (CHRU) de Nancy, Nancy, France
| | - André Mouraux
- Institute of Neuroscience (Ions), Université catholique de Louvain (UCL), Brussels, Belgium
| |
Collapse
|
47
|
Nicolaou N, Malik A, Daly I, Weaver J, Hwang F, Kirke A, Roesch EB, Williams D, Miranda ER, Nasuto SJ. Directed Motor-Auditory EEG Connectivity Is Modulated by Music Tempo. Front Hum Neurosci 2017; 11:502. [PMID: 29093672 PMCID: PMC5651276 DOI: 10.3389/fnhum.2017.00502] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2017] [Accepted: 10/02/2017] [Indexed: 11/18/2022] Open
Abstract
Beat perception is fundamental to how we experience music, and yet the mechanism behind this spontaneous building of the internal beat representation is largely unknown. Existing findings support links between the tempo (speed) of the beat and enhancement of electroencephalogram (EEG) activity at tempo-related frequencies, but there are no studies looking at how tempo may affect the underlying long-range interactions between EEG activity at different electrodes. The present study investigates these long-range interactions using EEG activity recorded from 21 volunteers listening to music stimuli played at 4 different tempi (50, 100, 150 and 200 beats per minute). The music stimuli consisted of piano excerpts designed to convey the emotion of “peacefulness”. Noise stimuli with an identical acoustic content to the music excerpts were also presented for comparison purposes. The brain activity interactions were characterized with the imaginary part of coherence (iCOH) in the frequency range 1.5–18 Hz (δ, θ, α and lower β) between all pairs of EEG electrodes for the four tempi and the music/noise conditions, as well as a baseline resting state (RS) condition obtained at the start of the experimental task. Our findings can be summarized as follows: (a) there was an ongoing long-range interaction in the RS engaging fronto-posterior areas; (b) this interaction was maintained in both music and noise, but its strength and directionality were modulated as a result of acoustic stimulation; (c) the topological patterns of iCOH were similar for music, noise and RS, however statistically significant differences in strength and direction of iCOH were identified; and (d) tempo had an effect on the direction and strength of motor-auditory interactions. Our findings are in line with existing literature and illustrate a part of the mechanism by which musical stimuli with different tempi can entrain changes in cortical activity.
Collapse
Affiliation(s)
- Nicoletta Nicolaou
- Brain Embodiment Laboratory, Biomedical Engineering Section, School of Biological Sciences, University of Reading, Reading, United Kingdom.,Department of Electrical and Electronic Engineering, Imperial College London, London, United Kingdom
| | - Asad Malik
- Brain Embodiment Laboratory, Biomedical Engineering Section, School of Biological Sciences, University of Reading, Reading, United Kingdom.,School of Psychology, University of Reading, Reading, United Kingdom.,Centre for Integrative Neuroscience and Neurodynamics, University of Reading, Reading, United Kingdom
| | - Ian Daly
- Brain-Computer Interfacing and Neural Engineering Laboratory, Department of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
| | - James Weaver
- Brain Embodiment Laboratory, Biomedical Engineering Section, School of Biological Sciences, University of Reading, Reading, United Kingdom
| | - Faustina Hwang
- Brain Embodiment Laboratory, Biomedical Engineering Section, School of Biological Sciences, University of Reading, Reading, United Kingdom
| | - Alexis Kirke
- Interdisciplinary Centre for Computer Music Research, University of Plymouth, Plymouth, United Kingdom
| | - Etienne B Roesch
- School of Psychology, University of Reading, Reading, United Kingdom.,Centre for Integrative Neuroscience and Neurodynamics, University of Reading, Reading, United Kingdom
| | - Duncan Williams
- Interdisciplinary Centre for Computer Music Research, University of Plymouth, Plymouth, United Kingdom
| | - Eduardo R Miranda
- Interdisciplinary Centre for Computer Music Research, University of Plymouth, Plymouth, United Kingdom
| | - Slawomir J Nasuto
- Brain Embodiment Laboratory, Biomedical Engineering Section, School of Biological Sciences, University of Reading, Reading, United Kingdom
| |
Collapse
|
48
|
Nozaradan S, Schwartze M, Obermeier C, Kotz SA. Specific contributions of basal ganglia and cerebellum to the neural tracking of rhythm. Cortex 2017; 95:156-168. [DOI: 10.1016/j.cortex.2017.08.015] [Citation(s) in RCA: 60] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2017] [Revised: 07/16/2017] [Accepted: 08/07/2017] [Indexed: 11/29/2022]
|
49
|
Białuńska A, Dalla Bella S. Music and speech distractors disrupt sensorimotor synchronization: effects of musical training. Exp Brain Res 2017; 235:3619-3630. [PMID: 28889178 DOI: 10.1007/s00221-017-5080-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2016] [Accepted: 09/02/2017] [Indexed: 11/29/2022]
Abstract
Humans display a natural tendency to move to the beat of music, more than to the rhythm of any other auditory stimulus. We typically move with music, but rarely with speech. This proclivity is apparent early during development and can be further developed over the years via joint dancing, singing, or instrument playing. Synchronization of movement to the beat can thus improve with age, but also with musical experience. In a previous study, we found that music perturbed synchronization with a metronome more than speech fragments; music superiority disappeared when distractors shared isochrony and the same meter (Dalla Bella et al., PLoS One 8(8):e71945, 2013). Here, we examined if the interfering effect of music and speech distractors in a synchronization task is influenced by musical training. Musicians and non-musicians synchronized by producing finger force pulses to the sounds of a metronome while music and speech distractors were presented at one of various phase relationships with respect to the target. Distractors were familiar musical excerpts and fragments of children poetry comparable in terms of beat/stress isochrony. Music perturbed synchronization with the metronome more than speech did in both groups. However, the difference in synchronization error between music and speech distractors was smaller for musicians than for non-musicians, especially when the peak force of movement is reached. These findings point to a link between musical training and timing of sensorimotor synchronization when reacting to music and speech distractors.
Collapse
Affiliation(s)
- Anita Białuńska
- Department of Cognitive Psychology, WSFiZ, Warsaw, Poland.
- Department of Rehabilitation Sciences, College of Health Sciences, University of Texas at El Paso, 1101 Campbell Street, El Paso, TX, 79902, USA.
| | - Simone Dalla Bella
- Department of Cognitive Psychology, WSFiZ, Warsaw, Poland.
- EuroMov, University of Montpellier, 700 Avenue du Pic St Loup, 34090, Montpellier, France.
- Institut Universitaire de France, Paris, France.
- International Laboratory for Brain, Music and Sound Research (BRAMS), Montreal, Canada.
| |
Collapse
|
50
|
Colling LJ, Noble HL, Goswami U. Neural Entrainment and Sensorimotor Synchronization to the Beat in Children with Developmental Dyslexia: An EEG Study. Front Neurosci 2017; 11:360. [PMID: 28747870 PMCID: PMC5506338 DOI: 10.3389/fnins.2017.00360] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2016] [Accepted: 06/08/2017] [Indexed: 11/13/2022] Open
Abstract
Tapping in time to a metronome beat (hereafter beat synchronization) shows considerable variability in child populations, and individual differences in beat synchronization are reliably related to reading development. Children with developmental dyslexia show impairments in beat synchronization. These impairments may reflect deficiencies in auditory perception of the beat which in turn affect auditory-motor mapping, or may reflect an independent motor deficit. Here, we used a new methodology in EEG based on measuring beat-related steady-state evoked potentials (SS-EPs, Nozaradan et al., 2015) in an attempt to disentangle neural sensory and motor contributions to behavioral beat synchronization in children with dyslexia. Children tapped with both their left and right hands to every second beat of a metronome pulse delivered at 2.4 Hz, or listened passively to the beat. Analyses of preferred phase in EEG showed that the children with dyslexia had a significantly different preferred phase compared to control children in all conditions. Regarding SS-EPs, the groups differed significantly for the passive Auditory listening condition at 2.4 Hz, and showed a trend toward a difference in the Right hand tapping condition at 3.6 Hz (sensorimotor integration measure). The data suggest that neural rhythmic entrainment is atypical in children with dyslexia for both an auditory beat and during sensorimotor coupling (tapping). The data are relevant to a growing literature suggesting that rhythm-based interventions may help language processing in children with developmental disorders of language learning.
Collapse
Affiliation(s)
- Lincoln J Colling
- Department of Psychology, Centre for Neuroscience in Education, University of CambridgeCambridge, United Kingdom
| | - Hannah L Noble
- Department of Psychology, Centre for Neuroscience in Education, University of CambridgeCambridge, United Kingdom
| | - Usha Goswami
- Department of Psychology, Centre for Neuroscience in Education, University of CambridgeCambridge, United Kingdom
| |
Collapse
|