1
|
Herman D, Baker S, Chow R, Cazes J, Alain C, Rosenbaum RS. Mismatch negativity as a marker of auditory pattern separation. Cereb Cortex 2023; 33:10181-10193. [PMID: 37522256 DOI: 10.1093/cercor/bhad274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 07/02/2023] [Accepted: 07/04/2023] [Indexed: 08/01/2023] Open
Abstract
To what extent does incidental encoding of auditory stimuli influence subsequent episodic memory for the same stimuli? We examined whether the mismatch negativity (MMN), an event-related potential generated by auditory change detection, is correlated with participants' ability to discriminate those stimuli (i.e. targets) from highly similar lures and from dissimilar foils. We measured the MMN in 30 young adults (18-32 years, 18 females) using a passive auditory oddball task with standard and deviant 5-tone sequences differing in pitch contour. After exposure, all participants completed an incidental memory test for old targets, lures, and foils. As expected, participants at test exhibited high sensitivity in recognizing target items relative to foils and lower sensitivity in recognizing target items relative to lures. Notably, we found a significant correlation between MMN amplitude and lure discrimination, but not foil discrimination. Our investigation shows that our capacity to discriminate sensory inputs at encoding, as measured by the MMN, translates into precision in memory for those inputs.
Collapse
Affiliation(s)
- Deena Herman
- Department of Psychology and Centre for Vision Research, York University, 4700 Keele Street, Toronto, Ontario, M3J 1P3, Canada
- Rotman Research Institute, Baycrest Academy for Research and Education, 3560 Bathurst Street, Toronto, Ontario, M6A 2E1, Canada
| | - Stevenson Baker
- Department of Psychology and Centre for Vision Research, York University, 4700 Keele Street, Toronto, Ontario, M3J 1P3, Canada
- Rotman Research Institute, Baycrest Academy for Research and Education, 3560 Bathurst Street, Toronto, Ontario, M6A 2E1, Canada
| | - Ricky Chow
- Department of Psychology and Centre for Vision Research, York University, 4700 Keele Street, Toronto, Ontario, M3J 1P3, Canada
- Rotman Research Institute, Baycrest Academy for Research and Education, 3560 Bathurst Street, Toronto, Ontario, M6A 2E1, Canada
| | - Jaime Cazes
- Department of Psychology and Centre for Vision Research, York University, 4700 Keele Street, Toronto, Ontario, M3J 1P3, Canada
| | - Claude Alain
- Rotman Research Institute, Baycrest Academy for Research and Education, 3560 Bathurst Street, Toronto, Ontario, M6A 2E1, Canada
- Department of Psychology, Institute of Medical Science, University of Toronto, Temerty Faculty of Medicine, 1 King's College Circle, Medical Sciences Building, Toronto, Ontario, M5S 1A8, Canada
| | - R Shayna Rosenbaum
- Department of Psychology and Centre for Vision Research, York University, 4700 Keele Street, Toronto, Ontario, M3J 1P3, Canada
- Rotman Research Institute, Baycrest Academy for Research and Education, 3560 Bathurst Street, Toronto, Ontario, M6A 2E1, Canada
| |
Collapse
|
2
|
Shin JH, Jeong E. Virtual reality-based music attention training for acquired brain injury: A protocol for randomized cross-over trial. Front Neurol 2023; 14:1192181. [PMID: 37638184 PMCID: PMC10450247 DOI: 10.3389/fneur.2023.1192181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Accepted: 07/24/2023] [Indexed: 08/29/2023] Open
Abstract
Attention training is the primary step in the rehabilitation for patients with acquired brain injury (ABI). While active music performance has been reported to aid neural and functional recovery, its efficacy for patients with ABI remains uncertain due to methodological concerns. The purpose of the study is to develop a virtual reality-based music attention training (VR-MAT), which utilizes a visually guided, bilateral drumming in an immersive environment to train attention and executive functions. We also aims to examine the feasibility and effectiveness of the VR-MAT with a small sample size of participants (3-60 months after ABI, N = 20 approximately). Participants will be randomly assigned to either a waitlist control or music group, in which VR-MAT will take place five times weekly over 4 weeks (randomized crossover design). The evaluation of VR-MAT performance will include accuracy and response time in music responses. Neurocognitive outcome measures will be administered to quantify pre-post changes in attention, working memory, and executive functions. Additionally, functional near-infrared spectroscopy will be employed to explore the relationships between musical behavior, neurocognitive function, and neurophysiological responses.
Collapse
Affiliation(s)
- Joon-Ho Shin
- Department of Rehabilitation, National Rehabilitation Center, Ewha Womans University, Seoul, Republic of Korea
| | - Eunju Jeong
- Department of Music Therapy, Graduate School, Ewha Womans University, Seoul, Republic of Korea
| |
Collapse
|
3
|
Bellier L, Llorens A, Marciano D, Gunduz A, Schalk G, Brunner P, Knight RT. Music can be reconstructed from human auditory cortex activity using nonlinear decoding models. PLoS Biol 2023; 21:e3002176. [PMID: 37582062 PMCID: PMC10427021 DOI: 10.1371/journal.pbio.3002176] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Accepted: 05/30/2023] [Indexed: 08/17/2023] Open
Abstract
Music is core to human experience, yet the precise neural dynamics underlying music perception remain unknown. We analyzed a unique intracranial electroencephalography (iEEG) dataset of 29 patients who listened to a Pink Floyd song and applied a stimulus reconstruction approach previously used in the speech domain. We successfully reconstructed a recognizable song from direct neural recordings and quantified the impact of different factors on decoding accuracy. Combining encoding and decoding analyses, we found a right-hemisphere dominance for music perception with a primary role of the superior temporal gyrus (STG), evidenced a new STG subregion tuned to musical rhythm, and defined an anterior-posterior STG organization exhibiting sustained and onset responses to musical elements. Our findings show the feasibility of applying predictive modeling on short datasets acquired in single patients, paving the way for adding musical elements to brain-computer interface (BCI) applications.
Collapse
Affiliation(s)
- Ludovic Bellier
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California, United States of America
| | - Anaïs Llorens
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California, United States of America
| | - Déborah Marciano
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California, United States of America
| | - Aysegul Gunduz
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, Florida, United States of America
| | - Gerwin Schalk
- Department of Neurology, Albany Medical College, Albany, New York, United States of America
| | - Peter Brunner
- Department of Neurology, Albany Medical College, Albany, New York, United States of America
- Department of Neurosurgery, Washington University School of Medicine, St. Louis, Missouri, United States of America
- National Center for Adaptive Neurotechnologies, Albany, New York, United States of America
| | - Robert T. Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, California, United States of America
- Department of Psychology, University of California, Berkeley, Berkeley, California, United States of America
| |
Collapse
|
4
|
Ngan VSH, Cheung LYT, Ng HTY, Yip KHM, Wong YK, Wong ACN. An early perceptual locus of absolute pitch. Psychophysiology 2023; 60:e14170. [PMID: 36094011 DOI: 10.1111/psyp.14170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Revised: 07/04/2022] [Accepted: 08/08/2022] [Indexed: 01/04/2023]
Abstract
Absolute pitch (AP) refers to the naming of musical tone without external reference. The influential two-component model states that AP is limited by the late-emerging pitch labeling process only and not the earlier perceptual and memory processes. Over the years, however, support for this model at the neural level has been mixed with various methodological limitations. Here, the electroencephalography responses of 27 AP possessors and 27 non-AP possessors were recorded. During both name verification and passive listening, event-related potential analyses showed a difference between AP and non-AP possessors at about 200 ms in their response toward tones compared with noise stimuli. Multivariate pattern analyses suggested that pitch naming was subserved by a series of transient processes for the first 250 ms, followed by a stage-like process for both AP and non-AP possessors with no group differences between them. These findings are inconsistent with the predictions of the two-component model, and instead suggest the existence of an early perceptual locus of AP.
Collapse
Affiliation(s)
- Vince S H Ngan
- Department of Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Leo Y T Cheung
- Department of Educational Psychology, Faculty of Education, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Hezul T Y Ng
- Department of Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Ken H M Yip
- Department of Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Yetta Kwailing Wong
- Department of Educational Psychology, Faculty of Education, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Alan C-N Wong
- Department of Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong
| |
Collapse
|
5
|
Jeong E, Ireland SJ. Criterion-Related Validation of a Music-Based Attention Assessment for Individuals with Traumatic Brain Injury. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:16285. [PMID: 36498353 PMCID: PMC9738551 DOI: 10.3390/ijerph192316285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 11/15/2022] [Accepted: 11/24/2022] [Indexed: 06/17/2023]
Abstract
The music-based attention assessment (MAA) is a melody contour identification task that evaluates different types of attention. Previous studies have examined the psychometric and physiological validity of the MAA across various age groups in clinical and typical populations. The purpose of this study was to confirm the MAA's criterion validity in individuals with traumatic brain injury (TBI) and to correlate this with standardized neuropsychological measurements. The MAA and various neurocognitive tests (i.e., the Wechsler adult intelligence scale DST, Delis-Kaplan executive functioning scale color-word interference test, and Conner's continuous performance test) were administered to 38 patients within two weeks prior to or post to the MAA administration. Significant correlations between MAA and neurocognitive batteries were found, indicating the potential of MAA as a valid measure of different types of attention deficits. An additional multiple regression analysis revealed that MAA was a significant factor in predicting attention ability.
Collapse
Affiliation(s)
- Eunju Jeong
- Department of Music Therapy, Graduate School, Ewha Womans University, Seoul 03760, Republic of Korea
| | | |
Collapse
|
6
|
Lin B, Chen Y, Li B, Avitt A, Guo Y, Pan L, Huang X. Spatial Selectivity of the Visual Duration Aftereffect in the Sub-second Range: An Event-related Potentials Study. Behav Brain Res 2022; 431:113950. [DOI: 10.1016/j.bbr.2022.113950] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2021] [Revised: 05/03/2022] [Accepted: 05/29/2022] [Indexed: 11/28/2022]
|
7
|
Prete DA, Heikoop D, McGillivray JE, Reilly JP, Trainor LJ. The sound of silence: Predictive error responses to unexpected sound omission in adults. Eur J Neurosci 2022; 55:1972-1985. [PMID: 35357048 DOI: 10.1111/ejn.15660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2021] [Revised: 09/09/2021] [Accepted: 03/22/2022] [Indexed: 11/28/2022]
Abstract
The human auditory system excels at detecting patterns needed for processing speech and music. According to predictive coding, the brain predicts incoming sounds, compares predictions to sensory input, and generates a prediction error whenever a mismatch between the prediction and sensory input occurs. Predictive coding can be indexed in EEG with the mismatch negativity (MMN) and P3a components, two ERP components that are elicited by infrequent deviant sounds (e.g., differing in pitch, duration, loudness) in a stream of frequent sounds. If these components reflect prediction error, they should also be elicited by omitting an expected sound, but few studies have examined this. We compared ERPs elicited by infrequent randomly occurring omissions (unexpected silences) in tone sequences presented at 2 tones/sec to ERPs elicited by frequent, regularly occurring omissions (expected silences) within a sequence of tones and resting state EEG (a constant silence). We found that unexpected silences elicited significant MMN and P3a, although the magnitude of these components was quite small and variable. These results provide evidence for hierarchical predictive coding, indicating that the brain predicts silences as well as sounds.
Collapse
Affiliation(s)
- David A Prete
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, ON, Canada
| | - David Heikoop
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, ON, Canada
| | | | - James P Reilly
- Electrical and Computer Engineering, McMaster University, Hamilton, Canada.,ARiEAL Research Centre, McMaster University, Hamilton, Canada.,School of Biomedical Engineering, McMaster University, Hamilton, Canada.,Vector Institute, MaRS Centre, Toronto, Canada
| | - Laurel J Trainor
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, ON, Canada.,McMaster Institute for Music and the Mind, McMaster University, Hamilton, ON, Canada.,Rotman Research Institute, Baycrest Hospital, Toronto, ON, Canada
| |
Collapse
|
8
|
Sihvonen AJ, Särkämö T. Music processing and amusia. HANDBOOK OF CLINICAL NEUROLOGY 2022; 187:55-67. [PMID: 35964992 DOI: 10.1016/b978-0-12-823493-8.00014-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Music is a universal and important human trait, which is orchestrated by complex brain network centered in the temporal lobe but connecting broadly to multiple cortical and subcortical regions. In the human brain, music engages a widespread bilateral network of regions that govern auditory perception, syntactic and semantic processing, attention and memory, emotion and reward, and motor skills. The ability to perceive or produce music can be severely impaired either due to abnormal brain development or brain damage, leading to a condition called amusia. Modern neuroimaging studies of amusia have provided valuable knowledge about the structure and function of specific brain regions and white matter pathways that are crucial for music perception, highlighting the role of the right frontotemporal network in this process. In this chapter, we provide an overview on the neural basis of music processing in a healthy brain and review evidence obtained from the studies of congenital and acquired amusia.
Collapse
Affiliation(s)
- Aleksi J Sihvonen
- School of Health and Rehabilitation Sciences, Queensland Aphasia Research Centre, The University of Queensland, Herston, QLD, Australia; Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland
| | - Teppo Särkämö
- Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland.
| |
Collapse
|
9
|
Edalati M, Mahmoudzadeh M, Safaie J, Wallois F, Moghimi S. Violation of rhythmic expectancies can elicit late frontal gamma activity nested in theta oscillations. Psychophysiology 2021; 58:e13909. [PMID: 34310719 PMCID: PMC9285090 DOI: 10.1111/psyp.13909] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Revised: 06/25/2021] [Accepted: 07/08/2021] [Indexed: 11/29/2022]
Abstract
Rhythm processing involves building expectations according to the hierarchical temporal structure of auditory events. Although rhythm processing has been addressed in the context of predictive coding, the properties of the oscillatory response in different cortical areas are still not clear. We explored the oscillatory properties of the neural response to rhythmic incongruence and the cross-frequency coupling between multiple frequencies to further investigate the mechanisms underlying rhythm perception. We designed an experiment to investigate the neural response to rhythmic deviations in which the tone either arrived earlier than expected or the tone in the same metrical position was omitted. These two manipulations modulate the rhythmic structure differently, with the former creating a larger violation of the general structure of the musical stimulus than the latter. Both deviations resulted in an MMN response, whereas only the rhythmic deviant resulted in a subsequent P3a. Rhythmic deviants due to the early occurrence of a tone, but not omission deviants, seemed to elicit a late high gamma response (60-80 Hz) at the end of the P3a over the left frontal region, which, interestingly, correlated with the P3a amplitude over the same region and was also nested in theta oscillations. The timing of the elicited high-frequency gamma oscillations related to rhythmic deviation suggests that it might be related to the update of the predictive neural model, corresponding to the temporal structure of the events in higher-level cortical areas.
Collapse
Affiliation(s)
- M Edalati
- Inserm UMR1105, Groupe de Recherches sur l'Analyse Multimodale de la Fonction Cérébrale, CURS, Amiens, France.,Electrical Engineering Department, Ferdowsi University of Mashhad, Mashhad, Iran
| | - M Mahmoudzadeh
- Inserm UMR1105, Groupe de Recherches sur l'Analyse Multimodale de la Fonction Cérébrale, CURS, Amiens, France.,Inserm UMR1105, EFSN Pédiatriques, CHU Amiens sud, Amiens, France
| | - J Safaie
- Electrical Engineering Department, Ferdowsi University of Mashhad, Mashhad, Iran
| | - F Wallois
- Inserm UMR1105, Groupe de Recherches sur l'Analyse Multimodale de la Fonction Cérébrale, CURS, Amiens, France.,Inserm UMR1105, EFSN Pédiatriques, CHU Amiens sud, Amiens, France
| | - S Moghimi
- Inserm UMR1105, Groupe de Recherches sur l'Analyse Multimodale de la Fonction Cérébrale, CURS, Amiens, France.,Electrical Engineering Department, Ferdowsi University of Mashhad, Mashhad, Iran.,Inserm UMR1105, EFSN Pédiatriques, CHU Amiens sud, Amiens, France
| |
Collapse
|
10
|
Coy N, Bader M, Schröger E, Grimm S. Change detection of auditory tonal patterns defined by absolute versus relative pitch information. A combined behavioural and EEG study. PLoS One 2021; 16:e0247495. [PMID: 33630974 PMCID: PMC7906474 DOI: 10.1371/journal.pone.0247495] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Accepted: 02/08/2021] [Indexed: 11/18/2022] Open
Abstract
The human auditory system often relies on relative pitch information to extract and identify auditory objects; such as when the same melody is played in different keys. The current study investigated the mental chronometry underlying the active discrimination of unfamiliar melodic six-tone patterns by measuring behavioural performance and event-related potentials (ERPs). In a roving standard paradigm, such patterns were either repeated identically within a stimulus train, carrying absolute frequency information about the pattern, or shifted in pitch (transposed) between repetitions, so only relative pitch information was available to extract the pattern identity. Results showed that participants were able to use relative pitch to detect when a new melodic pattern occurred. Though in the absence of absolute pitch sensitivity significantly decreased and behavioural reaction time to pattern changes increased. Mismatch-Negativity (MMN), an ERP indicator of auditory deviance detection, was elicited at approximately 206 ms after stimulus onset at frontocentral electrodes, even when only relative pitch was available to inform pattern discrimination. A P3a was elicited in both conditions, comparable in amplitude and latency. Increased latencies but no differences in amplitudes of N2b, and P3b suggest that processing at higher levels is affected when, in the absence of absolute pitch cues, relative pitch has to be extracted to inform pattern discrimination. Interestingly, the response delay of approximately 70 ms on the behavioural level, already fully manifests at the level of N2b. This is in accordance with recent findings on implicit auditory learning processes and suggests that in the absence of absolute pitch cues a slowing of target selection rather than a slowing of the auditory pattern change detection process causes the deterioration in behavioural performance.
Collapse
Affiliation(s)
- Nina Coy
- Institute of Psychology–Wilhelm Wundt, Leipzig University, Leipzig, Germany
| | - Maria Bader
- Institute of Psychology–Wilhelm Wundt, Leipzig University, Leipzig, Germany
| | - Erich Schröger
- Institute of Psychology–Wilhelm Wundt, Leipzig University, Leipzig, Germany
| | - Sabine Grimm
- Institute of Psychology–Wilhelm Wundt, Leipzig University, Leipzig, Germany
| |
Collapse
|
11
|
Andermann M, Günther M, Patterson RD, Rupp A. Early cortical processing of pitch height and the role of adaptation and musicality. Neuroimage 2020; 225:117501. [PMID: 33169697 DOI: 10.1016/j.neuroimage.2020.117501] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Revised: 10/19/2020] [Accepted: 10/21/2020] [Indexed: 02/06/2023] Open
Abstract
Pitch is an important perceptual feature; however, it is poorly understood how its cortical correlates are shaped by absolute vs relative fundamental frequency (f0), and by neural adaptation. In this study, we assessed transient and sustained auditory evoked fields (AEFs) at the onset, progression, and offset of short pitch height sequences, taking into account the listener's musicality. We show that neuromagnetic activity reflects absolute f0 at pitch onset and offset, and relative f0 at transitions within pitch sequences; further, sequences with fixed f0 lead to larger response suppression than sequences with variable f0 contour, and to enhanced offset activity. Musical listeners exhibit stronger f0-related AEFs and larger differences between their responses to fixed vs variable sequences, both within sequences and at pitch offset. The results resemble prominent psychoacoustic phenomena in the perception of pitch contours; moreover, they suggest a strong influence of adaptive mechanisms on cortical pitch processing which, in turn, might be modulated by a listener's musical expertise.
Collapse
Affiliation(s)
- Martin Andermann
- Section of Biomagnetism, Department of Neurology, Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany.
| | - Melanie Günther
- Section of Biomagnetism, Department of Neurology, Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany
| | - Roy D Patterson
- Department of Physiology, Development and Neuroscience, University of Cambridge, Downing Street, Cambridge, CB2 3EG, United Kingdom
| | - André Rupp
- Section of Biomagnetism, Department of Neurology, Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120 Heidelberg, Germany
| |
Collapse
|
12
|
Lumaca M, Kleber B, Brattico E, Vuust P, Baggio G. Functional connectivity in human auditory networks and the origins of variation in the transmission of musical systems. eLife 2019; 8:48710. [PMID: 31658945 PMCID: PMC6819097 DOI: 10.7554/elife.48710] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2019] [Accepted: 10/09/2019] [Indexed: 02/02/2023] Open
Abstract
Music producers, whether original composers or performers, vary in their ability to acquire and faithfully transmit music. This form of variation may serve as a mechanism for the emergence of new traits in musical systems. In this study, we aim to investigate whether individual differences in the social learning and transmission of music relate to intrinsic neural dynamics of auditory processing systems. We combined auditory and resting-state functional magnetic resonance imaging (fMRI) with an interactive laboratory model of cultural transmission, the signaling game, in an experiment with a large cohort of participants (N=51). We found that the degree of interhemispheric rs-FC within fronto-temporal auditory networks predicts—weeks after scanning—learning, transmission, and structural modification of an artificial tone system. Our study introduces neuroimaging in cultural transmission research and points to specific neural auditory processing mechanisms that constrain and drive variation in the cultural transmission and regularization of musical systems.
Collapse
Affiliation(s)
- Massimo Lumaca
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and The Royal Academy of Music, Aarhus, Denmark
| | - Boris Kleber
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and The Royal Academy of Music, Aarhus, Denmark
| | - Elvira Brattico
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and The Royal Academy of Music, Aarhus, Denmark
| | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and The Royal Academy of Music, Aarhus, Denmark
| | - Giosue Baggio
- Language Acquisition and Language Processing Lab, Department of Language and Literature, Norwegian University of Science and Technology, Trondheim, Norway
| |
Collapse
|
13
|
Cognitive Load Changes during Music Listening and its Implication in Earcon Design in Public Environments: An fNIRS Study. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2018; 15:ijerph15102075. [PMID: 30248908 PMCID: PMC6210363 DOI: 10.3390/ijerph15102075] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/21/2018] [Revised: 09/13/2018] [Accepted: 09/17/2018] [Indexed: 11/16/2022]
Abstract
A key for earcon design in public environments is to incorporate an individual’s perceived level of cognitive load for better communication. This study aimed to examine the cognitive load changes required to perform a melodic contour identification task (CIT). While healthy college students (N = 16) were presented with five CITs, behavioral (reaction time and accuracy) and cerebral hemodynamic responses were measured using functional near-infrared spectroscopy. Our behavioral findings showed a gradual increase in cognitive load from CIT1 to CIT3 followed by an abrupt increase between CIT4 (i.e., listening to two concurrent melodic contours in an alternating manner and identifying the direction of the target contour, p < 0.001) and CIT5 (i.e., listening to two concurrent melodic contours in a divided manner and identifying the directions of both contours, p < 0.001). Cerebral hemodynamic responses showed a congruent trend with behavioral findings. Specific to the frontopolar area (Brodmann’s area 10), oxygenated hemoglobin increased significantly between CIT4 and CIT5 (p < 0.05) while the level of deoxygenated hemoglobin decreased. Altogether, the findings indicate that the cognitive threshold for young adults (CIT5) and appropriate tuning of the relationship between timbre and pitch contour can lower the perceived cognitive load and, thus, can be an effective design strategy for earcon in a public environment.
Collapse
|
14
|
Chen A, Peter V, Wijnen F, Schnack H, Burnham D. Are lexical tones musical? Native language's influence on neural response to pitch in different domains. BRAIN AND LANGUAGE 2018; 180-182:31-41. [PMID: 29689493 DOI: 10.1016/j.bandl.2018.04.006] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/19/2017] [Revised: 03/15/2018] [Accepted: 04/14/2018] [Indexed: 06/08/2023]
Abstract
Language experience shapes musical and speech pitch processing. We investigated whether speaking a lexical tone language natively modulates neural processing of pitch in language and music as well as their correlation. We tested tone language (Mandarin Chinese), and non-tone language (Dutch) listeners in a passive oddball paradigm measuring mismatch negativity (MMN) for (i) Chinese lexical tones and (ii) three-note musical melodies with similar pitch contours. For lexical tones, Chinese listeners showed a later MMN peak than the non-tone language listeners, whereas for MMN amplitude there were no significant differences between groups. Dutch participants also showed a late discriminative negativity (LDN). In the music condition two MMNs, corresponding to the two notes that differed between the standard and the deviant were found for both groups, and an LDN were found for both the Dutch and the Chinese listeners. The music MMNs were significantly right lateralized. Importantly, significant correlations were found between the lexical tone and the music MMNs for the Dutch but not the Chinese participants. The results suggest that speaking a tone language natively does not necessarily enhance neural responses to pitch either in language or in music, but that it does change the nature of neural pitch processing: non-tone language speakers appear to perceive lexical tones as musical, whereas for tone language speakers, lexical tones and music may activate different neural networks. Neural resources seem to be assigned differently for the lexical tones and for musical melodies, presumably depending on the presence or absence of long-term phonological memory traces.
Collapse
Affiliation(s)
- Ao Chen
- Utrecht Institute of Linguistics OTS, Utrecht University, Utrecht, The Netherlands; MARCS Institute for Brain, Behaviour & Development, Western Sydney University, Sydney, Australia; School of Communication Science, Beijing Language and Culture University, Beijing, China.
| | - Varghese Peter
- MARCS Institute for Brain, Behaviour & Development, Western Sydney University, Sydney, Australia; Department of Linguistics, Macquarie University, North Ryde, NSW 2109, Australia
| | - Frank Wijnen
- Utrecht Institute of Linguistics OTS, Utrecht University, Utrecht, The Netherlands
| | - Hugo Schnack
- Utrecht Institute of Linguistics OTS, Utrecht University, Utrecht, The Netherlands; Department of Psychiatry, Brain Center Rudolf Magnus, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Denis Burnham
- MARCS Institute for Brain, Behaviour & Development, Western Sydney University, Sydney, Australia
| |
Collapse
|
15
|
Haumann NT, Vuust P, Bertelsen F, Garza-Villarreal EA. Influence of Musical Enculturation on Brain Responses to Metric Deviants. Front Neurosci 2018; 12:218. [PMID: 29720932 PMCID: PMC5915898 DOI: 10.3389/fnins.2018.00218] [Citation(s) in RCA: 42] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2017] [Accepted: 03/19/2018] [Indexed: 11/13/2022] Open
Abstract
The ability to recognize metric accents is fundamental in both music and language perception. It has been suggested that music listeners prefer rhythms that follow simple binary meters, which are common in Western music. This means that listeners expect odd-numbered beats to be strong and even-numbered beats to be weak. In support of this, studies have shown that listeners exposed to Western music show stronger novelty and incongruity related P3 and irregularity detection related mismatch negativity (MMN) brain responses to attenuated odd- than attenuated even-numbered metric positions. Furthermore, behavioral evidence suggests that music listeners' preferences can be changed by long-term exposure to non-Western rhythms and meters, e.g., by listening to African or Balkan music. In our study, we investigated whether it might be possible to measure effects of music enculturation on neural responses to attenuated tones on specific metric positions. We compared the magnetic mismatch negativity (MMNm) to attenuated beats in a “Western group” of listeners (n = 12) mainly exposed to Western music and a “Bicultural group” of listeners (n = 13) exposed for at least 1 year to both Sub-Saharan African music in addition to Western music. We found that in the “Western group” the MMNm was higher in amplitude to deviant tones on odd compared to even metric positions, but not in the “Bicultural group.” In support of this finding, there was also a trend of the “Western group” to rate omitted beats as more surprising on odd than even metric positions, whereas the “Bicultural group” seemed to discriminate less between metric positions in terms of surprise ratings. Also, we observed that the overall latency of the MMNm was significantly shorter in the Bicultural group compared to the Western group. These effects were not biased by possible differences in rhythm perception ability or music training, measured with the Musical Ear Test (MET). Furthermore, source localization analyses suggest that auditory, inferior temporal, sensory-motor, superior frontal, and parahippocampal regions might be involved in eliciting the MMNm to the metric deviants. These findings suggest that effects of music enculturation can be measured on MMNm responses to attenuated tones on specific metric positions.
Collapse
Affiliation(s)
- Niels T Haumann
- Department of Aesthetics and Communication (Musicology), Faculty of Arts, Aarhus University, Aarhus, Denmark.,Department of Clinical Medicine, Center for Music in the Brain, Royal Academy of Music, Aarhus University, Aarhus, Denmark
| | - Peter Vuust
- Department of Clinical Medicine, Center for Music in the Brain, Royal Academy of Music, Aarhus University, Aarhus, Denmark
| | - Freja Bertelsen
- Center of Functionally Integrative Neuroscience, Aarhus University, Aarhus, Denmark.,Department of Nuclear Medicine and PET Centre, Aarhus University Hospital, Aarhus, Denmark
| | - Eduardo A Garza-Villarreal
- Department of Clinical Medicine, Center for Music in the Brain, Royal Academy of Music, Aarhus University, Aarhus, Denmark.,Clinical Research Division, Instituto Nacional de Psiquiatría Ramón de la Fuente Muñiz (INPRFM), Mexico City, Mexico.,Department of Neurology, Faculty of Medicine and University Hospital, Universidad Autonoma de Nuevo Leon, Monterrey, Mexico
| |
Collapse
|
16
|
Xiao XZ, Wong HK, Wang Y, Zhao K, Zeng GQ, Yip LY, Wong GCS, Tse CY. Detecting violation in abstract pitch patterns with mismatch negativity. Psychophysiology 2018; 55:e13078. [DOI: 10.1111/psyp.13078] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2018] [Revised: 02/25/2018] [Accepted: 02/26/2018] [Indexed: 12/31/2022]
Affiliation(s)
- Xue-Zhen Xiao
- Department of Psychology & Center for Cognition and Brain Studies; The Chinese University of Hong Kong; Hong Kong SAR China
| | - Hoi Ki Wong
- Department of Psychology & Center for Cognition and Brain Studies; The Chinese University of Hong Kong; Hong Kong SAR China
| | - Yang Wang
- Department of Psychology & Center for Cognition and Brain Studies; The Chinese University of Hong Kong; Hong Kong SAR China
| | - Kunyang Zhao
- Department of Psychology & Center for Cognition and Brain Studies; The Chinese University of Hong Kong; Hong Kong SAR China
| | - Ginger Qinghong Zeng
- Department of Psychology & Center for Cognition and Brain Studies; The Chinese University of Hong Kong; Hong Kong SAR China
| | - Long-Yin Yip
- Department of Psychology & Center for Cognition and Brain Studies; The Chinese University of Hong Kong; Hong Kong SAR China
| | - Geoffrey Chun-Sung Wong
- Department of Psychology & Center for Cognition and Brain Studies; The Chinese University of Hong Kong; Hong Kong SAR China
| | - Chun-Yu Tse
- Department of Psychology & Center for Cognition and Brain Studies; The Chinese University of Hong Kong; Hong Kong SAR China
| |
Collapse
|
17
|
Huberth M, Fujioka T. Neural representation of a melodic motif: Effects of polyphonic contexts. Brain Cogn 2017; 111:144-155. [DOI: 10.1016/j.bandc.2016.11.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2016] [Revised: 09/26/2016] [Accepted: 11/11/2016] [Indexed: 11/28/2022]
|
18
|
Jeong E, Ryu H. Melodic Contour Identification Reflects the Cognitive Threshold of Aging. Front Aging Neurosci 2016; 8:134. [PMID: 27378907 PMCID: PMC4904015 DOI: 10.3389/fnagi.2016.00134] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2016] [Accepted: 05/27/2016] [Indexed: 01/16/2023] Open
Abstract
Cognitive decline is a natural phenomenon of aging. Although there exists a consensus that sensitivity to acoustic features of music is associated with such decline, no solid evidence has yet shown that structural elements and contexts of music explain this loss of cognitive performance. This study examined the extent and the type of cognitive decline that is related to the contour identification task (CIT) using tones with different pitches (i.e., melodic contours). Both younger and older adult groups participated in the CIT given in three listening conditions (i.e., focused, selective, and alternating). Behavioral data (accuracy and response times) and hemodynamic reactions were measured using functional near-infrared spectroscopy (fNIRS). Our findings showed cognitive declines in the older adult group but with a subtle difference from the younger adult group. The accuracy of the melodic CITs given in the target-like distraction task (CIT2) was significantly lower than that in the environmental noise (CIT1) condition in the older adult group, indicating that CIT2 may be a benchmark test for age-specific cognitive decline. The fNIRS findings also agreed with this interpretation, revealing significant increases in oxygenated hemoglobin (oxyHb) concentration in the younger (p < 0.05 for Δpre - on task; p < 0.01 for Δon – post task) rather than the older adult group (n.s for Δpre - on task; n.s for Δon – post task). We further concluded that the oxyHb difference was present in the brain regions near the right dorsolateral prefrontal cortex. Taken together, these findings suggest that CIT2 (i.e., the melodic contour task in the target-like distraction) is an optimized task that could indicate the degree and type of age-related cognitive decline.
Collapse
Affiliation(s)
- Eunju Jeong
- Department of Arts and Technology, Hanyang University Seoul, South Korea
| | - Hokyoung Ryu
- Department of Arts and Technology, Hanyang University Seoul, South Korea
| |
Collapse
|
19
|
Hancock L, Correia S, Ahern D, Barredo J, Resnik L. Cognitive predictors of skilled performance with an advanced upper limb multifunction prosthesis: a preliminary analysis. Disabil Rehabil Assist Technol 2016; 12:504-511. [PMID: 27049235 DOI: 10.3109/17483107.2016.1158326] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Purpose The objectives were to 1) identify major cognitive domains involved in learning to use the DEKA Arm; 2) specify cognitive domain-specific skills associated with basic versus advanced users; and 3) examine whether baseline memory and executive function predicted learning. Method Sample included 35 persons with upper limb amputation. Subjects were administered a brief neuropsychological test battery prior to start of DEKA Arm training, as well as physical performance measures at the onset of, and following training. Multiple regression models controlling for age and including neuropsychological tests were developed to predict physical performance scores. Prosthetic performance scores were divided into quartiles and independent samples t-tests compared neuropsychological test scores of advanced scorers and basic scorers. Baseline neuropsychological test scores were used to predict change in scores on physical performance measures across time. Results Cognitive domains of attention and processing speed were statistically significantly related to proficiency of DEKA Arm use and predicted level of proficiency. Conclusions Results support use of neuropsychological tests to predict learning and use of a multifunctional prosthesis. Assessment of cognitive status at the outset of training may help set expectations for the duration and outcomes of treatment. Implications for Rehabilitation Cognitive domains of attention and processing speed were significantly related to level of proficiencyof an advanced multifunctional prosthesis (the DEKA Arm) after training. Results provide initial support for the use of neuropsychological tests to predict advanced learningand use of a multifunctional prosthesis in upper-limb amputees. Results suggest that assessment of patients' cognitive status at the outset of upper limb prosthetictraining may, in the future, help patients, their families and therapists set expectations for theduration and intensity of training and may help set reasonable proficiency goals.
Collapse
Affiliation(s)
- Laura Hancock
- a Department of Psychiatry and Human Behavior , Alpert Medical School of Brown University , Providence , RI , USA
| | - Stephen Correia
- b Department of Neuropsychology , Providence VA Medical Center , Providence , RI , USA.,c Department of Psychiatry , Brown University , Providence , RI , USA
| | - David Ahern
- d Department of Psychiatry and Human Behavior , The Miriam Hospital, Alpert Medical School of Brown University , Providence , RI , USA
| | - Jennifer Barredo
- e Research Health Scientist, Providence VA Medical Center , Providence , RI , USA.,f Brown Institute for Brain Sciences, Brown University , Providence , RI , USA
| | - Linda Resnik
- g Research Career Scientist, Providence VA Medical Center , Providence , RI , USA.,h Department of Health Services, Policy and Practice, School of Public Health , Brown University , Providence , RI , USA
| |
Collapse
|
20
|
Fedorenko E, Varley R. Language and thought are not the same thing: evidence from neuroimaging and neurological patients. Ann N Y Acad Sci 2016; 1369:132-53. [PMID: 27096882 PMCID: PMC4874898 DOI: 10.1111/nyas.13046] [Citation(s) in RCA: 80] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2015] [Revised: 02/18/2016] [Accepted: 02/25/2016] [Indexed: 01/29/2023]
Abstract
Is thought possible without language? Individuals with global aphasia, who have almost no ability to understand or produce language, provide a powerful opportunity to find out. Surprisingly, despite their near-total loss of language, these individuals are nonetheless able to add and subtract, solve logic problems, think about another person's thoughts, appreciate music, and successfully navigate their environments. Further, neuroimaging studies show that healthy adults strongly engage the brain's language areas when they understand a sentence, but not when they perform other nonlinguistic tasks such as arithmetic, storing information in working memory, inhibiting prepotent responses, or listening to music. Together, these two complementary lines of evidence provide a clear answer: many aspects of thought engage distinct brain regions from, and do not depend on, language.
Collapse
Affiliation(s)
- Evelina Fedorenko
- Psychiatry Department, Massachusetts General Hospital, Charlestown, Massachusetts
- Harvard Medical School, Boston, Massachusetts
- Center for Academic Research and Training in Anthropogeny (CARTA), University of California, San Diego, La Jolla, California
| | | |
Collapse
|
21
|
Bidelman G, Chung WL. Tone-language speakers show hemispheric specialization and differential cortical processing of contour and interval cues for pitch. Neuroscience 2015; 305:384-92. [DOI: 10.1016/j.neuroscience.2015.08.010] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2015] [Revised: 07/18/2015] [Accepted: 08/05/2015] [Indexed: 11/30/2022]
|
22
|
François C, Grau-Sánchez J, Duarte E, Rodriguez-Fornells A. Musical training as an alternative and effective method for neuro-education and neuro-rehabilitation. Front Psychol 2015; 6:475. [PMID: 25972820 PMCID: PMC4411999 DOI: 10.3389/fpsyg.2015.00475] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2014] [Accepted: 04/02/2015] [Indexed: 01/14/2023] Open
Abstract
In the last decade, important advances in the field of cognitive science, psychology, and neuroscience have largely contributed to improve our knowledge on brain functioning. More recently, a line of research has been developed that aims at using musical training and practice as alternative tools for boosting specific perceptual, motor, cognitive, and emotional skills both in healthy population and in neurologic patients. These findings are of great hope for a better treatment of language-based learning disorders or motor impairment in chronic non-communicative diseases. In the first part of this review, we highlight several studies showing that learning to play a musical instrument can induce substantial neuroplastic changes in cortical and subcortical regions of motor, auditory and speech processing networks in healthy population. In a second part, we provide an overview of the evidence showing that musical training can be an alternative, low-cost and effective method for the treatment of language-based learning impaired populations. We then report results of the few studies showing that training with musical instruments can have positive effects on motor, emotional, and cognitive deficits observed in patients with non-communicable diseases such as stroke or Parkinson Disease. Despite inherent differences between musical training in educational and rehabilitation contexts, these results favor the idea that the structural, multimodal, and emotional properties of musical training can play an important role in developing new, creative and cost-effective intervention programs for education and rehabilitation in the next future.
Collapse
Affiliation(s)
- Clément François
- Department of Basic Psychology, University of Barcelona , Barcelona, Spain ; Cognition and Brain Plasticity Group, Bellvitge Biomedical Research Institute , Barcelona, Spain
| | - Jennifer Grau-Sánchez
- Department of Basic Psychology, University of Barcelona , Barcelona, Spain ; Cognition and Brain Plasticity Group, Bellvitge Biomedical Research Institute , Barcelona, Spain
| | - Esther Duarte
- Department of Physical Medicine and Rehabilitation, Parc de Salut Mar, Hospitals del Mar i de l'Esperança , Barcelona, Spain
| | - Antoni Rodriguez-Fornells
- Department of Basic Psychology, University of Barcelona , Barcelona, Spain ; Cognition and Brain Plasticity Group, Bellvitge Biomedical Research Institute , Barcelona, Spain ; Catalan Institution for Research and Advanced Studies , Barcelona, Spain
| |
Collapse
|
23
|
|
24
|
Sturm I, Blankertz B, Potes C, Schalk G, Curio G. ECoG high gamma activity reveals distinct cortical representations of lyrics passages, harmonic and timbre-related changes in a rock song. Front Hum Neurosci 2014; 8:798. [PMID: 25352799 PMCID: PMC4195312 DOI: 10.3389/fnhum.2014.00798] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2014] [Accepted: 09/19/2014] [Indexed: 11/13/2022] Open
Abstract
Listening to music moves our minds and moods, stirring interest in its neural underpinnings. A multitude of compositional features drives the appeal of natural music. How such original music, where a composer's opus is not manipulated for experimental purposes, engages a listener's brain has not been studied until recently. Here, we report an in-depth analysis of two electrocorticographic (ECoG) data sets obtained over the left hemisphere in ten patients during presentation of either a rock song or a read-out narrative. First, the time courses of five acoustic features (intensity, presence/absence of vocals with lyrics, spectral centroid, harmonic change, and pulse clarity) were extracted from the audio tracks and found to be correlated with each other to varying degrees. In a second step, we uncovered the specific impact of each musical feature on ECoG high-gamma power (70-170 Hz) by calculating partial correlations to remove the influence of the other four features. In the music condition, the onset and offset of vocal lyrics in ongoing instrumental music was consistently identified within the group as the dominant driver for ECoG high-gamma power changes over temporal auditory areas, while concurrently subject-individual activation spots were identified for sound intensity, timbral, and harmonic features. The distinct cortical activations to vocal speech-related content embedded in instrumental music directly demonstrate that song integrated in instrumental music represents a distinct dimension in complex music. In contrast, in the speech condition, the full sound envelope was reflected in the high gamma response rather than the onset or offset of the vocal lyrics. This demonstrates how the contributions of stimulus features that modulate the brain response differ across the two examples of a full-length natural stimulus, which suggests a context-dependent feature selection in the processing of complex auditory stimuli.
Collapse
Affiliation(s)
- Irene Sturm
- Berlin School of Mind and Brain, Humboldt Universität zu Berlin Berlin, Germany ; Neurotechnology Group, Department of Electrical Engineering and Computer Science, Berlin Institute of Technology Berlin, Germany ; Neurophysics Group, Department of Neurology and Clinical Neurophysiology, Charité - University Medicine Berlin Berlin, Germany
| | - Benjamin Blankertz
- Neurotechnology Group, Department of Electrical Engineering and Computer Science, Berlin Institute of Technology Berlin, Germany ; Bernstein Focus: Neurotechnology Berlin, Germany
| | - Cristhian Potes
- National Resource Center for Adaptive Neurotechnologies, Wadsworth Center, New York State Department of Health Albany, NY, USA ; Department of Electrical and Computer Engineering, University of Texas at El Paso El Paso, TX, USA
| | - Gerwin Schalk
- National Resource Center for Adaptive Neurotechnologies, Wadsworth Center, New York State Department of Health Albany, NY, USA ; Department of Electrical and Computer Engineering, University of Texas at El Paso El Paso, TX, USA ; Department of Neurosurgery, Washington University in St. Louis St. Louis, MO, USA ; Department of Biomedical Engineering, Rensselaer Polytechnic Institute Troy, NY, USA ; Department of Neurology, Albany Medical College Albany, NY, USA ; Department of Neurosurgery, Washington University in St. Louis St. Louis, MO, USA
| | - Gabriel Curio
- Berlin School of Mind and Brain, Humboldt Universität zu Berlin Berlin, Germany ; Neurophysics Group, Department of Neurology and Clinical Neurophysiology, Charité - University Medicine Berlin Berlin, Germany ; Bernstein Focus: Neurotechnology Berlin, Germany
| |
Collapse
|
25
|
Vuust P, Witek MAG. Rhythmic complexity and predictive coding: a novel approach to modeling rhythm and meter perception in music. Front Psychol 2014; 5:1111. [PMID: 25324813 PMCID: PMC4181238 DOI: 10.3389/fpsyg.2014.01111] [Citation(s) in RCA: 104] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2014] [Accepted: 09/12/2014] [Indexed: 11/18/2022] Open
Abstract
Musical rhythm, consisting of apparently abstract intervals of accented temporal events, has a remarkable capacity to move our minds and bodies. How does the cognitive system enable our experiences of rhythmically complex music? In this paper, we describe some common forms of rhythmic complexity in music and propose the theory of predictive coding (PC) as a framework for understanding how rhythm and rhythmic complexity are processed in the brain. We also consider why we feel so compelled by rhythmic tension in music. First, we consider theories of rhythm and meter perception, which provide hierarchical and computational approaches to modeling. Second, we present the theory of PC, which posits a hierarchical organization of brain responses reflecting fundamental, survival-related mechanisms associated with predicting future events. According to this theory, perception and learning is manifested through the brain’s Bayesian minimization of the error between the input to the brain and the brain’s prior expectations. Third, we develop a PC model of musical rhythm, in which rhythm perception is conceptualized as an interaction between what is heard (“rhythm”) and the brain’s anticipatory structuring of music (“meter”). Finally, we review empirical studies of the neural and behavioral effects of syncopation, polyrhythm and groove, and propose how these studies can be seen as special cases of the PC theory. We argue that musical rhythm exploits the brain’s general principles of prediction and propose that pleasure and desire for sensorimotor synchronization from musical rhythm may be a result of such mechanisms.
Collapse
Affiliation(s)
- Peter Vuust
- Center of Functionally Integrative Neuroscience, Aarhus University Hospital Aarhus, Denmark ; Royal Academy of Music Aarhus/Aalborg, Denmark
| | - Maria A G Witek
- Center of Functionally Integrative Neuroscience, Aarhus University Hospital Aarhus, Denmark
| |
Collapse
|
26
|
Marti S, Thibault L, Dehaene S. How does the extraction of local and global auditory regularities vary with context? PLoS One 2014; 9:e107227. [PMID: 25197987 PMCID: PMC4157871 DOI: 10.1371/journal.pone.0107227] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2014] [Accepted: 08/11/2014] [Indexed: 11/18/2022] Open
Abstract
How does the human brain extract regularities from its environment? There is evidence that short range or ‘local’ regularities (within seconds) are automatically detected by the brain while long range or ‘global’ regularities (over tens of seconds or more) require conscious awareness. In the present experiment, we asked whether participants' attention was needed to acquire such auditory regularities, to detect their violation or both. We designed a paradigm in which participants listened to predictable sounds. Subjects could be distracted by a visual task at two moments: when they were first exposed to a regularity or when they detected violations of this regularity. MEG recordings revealed that early brain responses (100–130 ms) to violations of short range regularities were unaffected by visual distraction and driven essentially by local transitional probabilities. Based on global workspace theory and prior results, we expected that visual distraction would eliminate the long range global effect, but unexpectedly, we found the contrary, i.e. late brain responses (300–600 ms) to violations of long range regularities on audio-visual trials but not on auditory only trials. Further analyses showed that, in fact, visual distraction was incomplete and that auditory and visual stimuli interfered in both directions. Our results show that conscious, attentive subjects can learn the long range dependencies present in auditory stimuli even while performing a visual task on synchronous visual stimuli. Furthermore, they acquire a complex regularity and end up making different predictions for the very same stimulus depending on the context (i.e. absence or presence of visual stimuli). These results suggest that while short-range regularity detection is driven by local transitional probabilities between stimuli, the human brain detects and stores long-range regularities in a highly flexible, context dependent manner.
Collapse
Affiliation(s)
- Sébastien Marti
- INSERM, U992, Cognitive Neuroimaging Unit, Gif/Yvette, France
- CEA, DSV/I2BM, NeuroSpin Center, Gif/Yvette, France
- * E-mail:
| | - Louis Thibault
- Laboratoire Psychologie de la Perception, UMR 8242, Université Paris Descartes, Paris, France
| | - Stanislas Dehaene
- INSERM, U992, Cognitive Neuroimaging Unit, Gif/Yvette, France
- CEA, DSV/I2BM, NeuroSpin Center, Gif/Yvette, France
- Collège de France, Paris, France
| |
Collapse
|
27
|
Abstract
AbstractObjectives: An increasing number of research studies support the benefits of providing music therapy in addition to standard treatment for people who have mental disorders. The objective of this paper was to review and summarise recent research findings in relation to this work.Method: A review of music therapy studies published since 1994 was undertaken. Criteria for including papers were that they a) were published in English in an indexed, peer-reviewed journal, and b) were conducted as a randomised controlled trial (RCT) or a controlled trial (CT), or c) provided a meta-analysis of existing studies. The large number of papers pertaining to music therapy for older adults who have mental disorders, including Alzheimer's disease and other types of dementia was not included.Results: The findings support a role for music therapy as a structured interaction that patients are able to use to participate successfully, manage some of their symptoms, and express feelings relating to their experiences. Music therapy is demonstrated to be a beneficial intervention for people who have enduring mental illness. Music therapy invites and encourages participation from people of lower functioning levels and employs a non-verbal medium with which people have prior positive associations and in most cases have lifelong experience of using music for self-expression and pleasure. Additionally, the available peer reviewed literature supports the proposition that clinical outcomes are available through the use of music therapy intervention in conjunction with standard, well-established treatment methods.Conclusions: Music therapy is beneficial for patients receiving care for mental disorders and establishing this therapy within mental health service provision should be considered.
Collapse
|
28
|
Melody recognition revisited: influence of melodic Gestalt on the encoding of relational pitch information. Psychon Bull Rev 2014; 22:163-9. [DOI: 10.3758/s13423-014-0653-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
29
|
Cerebral activations related to audition-driven performance imagery in professional musicians. PLoS One 2014; 9:e93681. [PMID: 24714661 PMCID: PMC3979724 DOI: 10.1371/journal.pone.0093681] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2013] [Accepted: 03/10/2014] [Indexed: 11/18/2022] Open
Abstract
Functional Magnetic Resonance Imaging (fMRI) was used to study the activation of cerebral motor networks during auditory perception of music in professional keyboard musicians (n = 12). The activation paradigm implied that subjects listened to two-part polyphonic music, while either critically appraising the performance or imagining they were performing themselves. Two-part polyphonic audition and bimanual motor imagery circumvented a hemisphere bias associated with the convention of playing the melody with the right hand. Both tasks activated ventral premotor and auditory cortices, bilaterally, and the right anterior parietal cortex, when contrasted to 12 musically unskilled controls. Although left ventral premotor activation was increased during imagery (compared to judgment), bilateral dorsal premotor and right posterior-superior parietal activations were quite unique to motor imagery. The latter suggests that musicians not only recruited their manual motor repertoire but also performed a spatial transformation from the vertically perceived pitch axis (high and low sound) to the horizontal axis of the keyboard. Imagery-specific activations in controls were seen in left dorsal parietal-premotor and supplementary motor cortices. Although these activations were less strong compared to musicians, this overlapping distribution indicated the recruitment of a general 'mirror-neuron' circuitry. These two levels of sensori-motor transformations point towards common principles by which the brain organizes audition-driven music performance and visually guided task performance.
Collapse
|
30
|
Zhang F, Benson C, Fu QJ. Cortical encoding of pitch contour changes in cochlear implant users: a mismatch negativity study. Audiol Neurootol 2013; 18:275-88. [PMID: 23920129 DOI: 10.1159/000351802] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2012] [Accepted: 04/26/2013] [Indexed: 11/19/2022] Open
Abstract
A better understanding of melodic pitch perception in cochlear implants (CIs) may guide signal processing and/or rehabilitation techniques to improve music perception and appreciation in CI patients. In this study, the mismatch negativity (MMN) in response to infrequent changes in 5-tone pitch contours was obtained in CI users and normal-hearing (NH) listeners. Melodic contour identification (MCI) was also measured. Results showed that MCI performance was poorer in CI than in NH subjects; the MMNs were missing in all CI subjects for the 1-semitone contours. The MMNs with the 5-semitone contours were observed in a smaller proportion of CI than NH subjects. Results suggest that encoding of pitch contour changes in CI users appears to be degraded, most likely due to the limited pitch cues provided by the CI and deafness-related compromise of brain substrates.
Collapse
Affiliation(s)
- Fawen Zhang
- Department of Communication Sciences and Disorders, University of Cincinnati, Cincinnati, Ohio, USA
| | | | | |
Collapse
|
31
|
Abstract
Music has existed in human societies since prehistory, perhaps because it allows expression and regulation of emotion and evokes pleasure. In this review, we present findings from cognitive neuroscience that bear on the question of how we get from perception of sound patterns to pleasurable responses. First, we identify some of the auditory cortical circuits that are responsible for encoding and storing tonal patterns and discuss evidence that cortical loops between auditory and frontal cortices are important for maintaining musical information in working memory and for the recognition of structural regularities in musical patterns, which then lead to expectancies. Second, we review evidence concerning the mesolimbic striatal system and its involvement in reward, motivation, and pleasure in other domains. Recent data indicate that this dopaminergic system mediates pleasure associated with music; specifically, reward value for music can be coded by activity levels in the nucleus accumbens, whose functional connectivity with auditory and frontal areas increases as a function of increasing musical reward. We propose that pleasure in music arises from interactions between cortical loops that enable predictions and expectancies to emerge from sound patterns and subcortical systems responsible for reward and valuation.
Collapse
|
32
|
Brattico E, Bogert B, Jacobsen T. Toward a neural chronometry for the aesthetic experience of music. Front Psychol 2013; 4:206. [PMID: 23641223 PMCID: PMC3640187 DOI: 10.3389/fpsyg.2013.00206] [Citation(s) in RCA: 85] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2012] [Accepted: 04/02/2013] [Indexed: 01/06/2023] Open
Abstract
Music is often studied as a cognitive domain alongside language. The emotional aspects of music have also been shown to be important, but views on their nature diverge. For instance, the specific emotions that music induces and how they relate to emotional expression are still under debate. Here we propose a mental and neural chronometry of the aesthetic experience of music initiated and mediated by external and internal contexts such as intentionality, background mood, attention, and expertise. The initial stages necessary for an aesthetic experience of music are feature analysis, integration across modalities, and cognitive processing on the basis of long-term knowledge. These stages are common to individuals belonging to the same musical culture. The initial emotional reactions to music include the startle reflex, core "liking," and arousal. Subsequently, discrete emotions are perceived and induced. Presumably somatomotor processes synchronizing the body with the music also come into play here. The subsequent stages, in which cognitive, affective, and decisional processes intermingle, require controlled cross-modal neural processes to result in aesthetic emotions, aesthetic judgments, and conscious liking. These latter aesthetic stages often require attention, intentionality, and expertise for their full actualization.
Collapse
Affiliation(s)
- Elvira Brattico
- Cognitive Brain Research Unit, Institute of Behavioural Sciences, University of HelsinkiHelsinki, Finland
- Finnish Center of Excellence in Interdisciplinary Music Research, University of JyväskyläJyväskylä, Finland
- Brain and Mind Laboratory, Department of Biomedical Engineering and Computational Science, Aalto University School of ScienceHelsinki, Finland
| | - Brigitte Bogert
- Cognitive Brain Research Unit, Institute of Behavioural Sciences, University of HelsinkiHelsinki, Finland
- Finnish Center of Excellence in Interdisciplinary Music Research, University of JyväskyläJyväskylä, Finland
| | - Thomas Jacobsen
- Experimental Psychology Unit, Faculty of Humanities and Social Sciences, Helmut Schmidt University/University of the Federal Armed Forces HamburgHamburg, Germany
| |
Collapse
|
33
|
Ouimet T, Foster NEV, Hyde KL. Auditory global-local processing: effects of attention and musical experience. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2012; 132:2536-2544. [PMID: 23039447 DOI: 10.1121/1.4747009] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
In vision, global (whole) features are typically processed before local (detail) features ("global precedence effect"). However, the distinction between global and local processing is less clear in the auditory domain. The aims of the present study were to investigate: (i) the effects of directed versus divided attention, and (ii) the effect musical training on auditory global-local processing in 16 adult musicians and 16 non-musicians. Participants were presented with short nine-tone melodies, each comprised of three triplet sequences (three-tone units). In a "directed attention" task, participants were asked to focus on either the global or local pitch pattern and had to determine if the pitch pattern went up or down. In a "divided attention" task, participants judged whether the target pattern (up or down) was present or absent. Overall, global structure was perceived faster and more accurately than local structure. The global precedence effect was observed regardless of whether attention was directed to a specific level or divided between levels. Musicians performed more accurately than non-musicians overall, but non-musicians showed a more pronounced global advantage. This study provides evidence for an auditory global precedence effect across attention tasks, and for differences in auditory global-local processing associated with musical experience.
Collapse
Affiliation(s)
- Tia Ouimet
- Faculty of Medicine, Montreal Children's Hospital, McGill University, 4060 Sainte Catherine West, room 322, Montréal, Québec H3Z 2Z3, Canada.
| | | | | |
Collapse
|
34
|
Trainor LJ, Marie C, Gerry D, Whiskin E, Unrau A. Becoming musically enculturated: effects of music classes for infants on brain and behavior. Ann N Y Acad Sci 2012; 1252:129-38. [PMID: 22524350 DOI: 10.1111/j.1749-6632.2012.06462.x] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
Musical enculturation is a complex, multifaceted process that includes the development of perceptual processing specialized for the pitch and rhythmic structures of the musical system in the culture, understanding of esthetic and expressive norms, and learning the pragmatic uses of music in different social situations. Here, we summarize the results of a study in which 6-month-old Western infants were randomly assigned to 6 months of either an active participatory music class or a class in which they experienced music passively while playing. Active music participation resulted in earlier enculturation to Western tonal pitch structure, larger and/or earlier brain responses to musical tones, and a more positive social trajectory. Furthermore, the data suggest that early exposure to cultural norms of musical expression leads to early preferences for those norms. We conclude that musical enculturation begins in infancy and that active participatory music making in a positive social setting accelerates enculturation.
Collapse
Affiliation(s)
- Laurel J Trainor
- McMaster Institute for Music and the Mind, Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, Ontario, Canada.
| | | | | | | | | |
Collapse
|
35
|
Interaction between bottom-up and top-down effects during the processing of pitch intervals in sequences of spoken and sung syllables. Neuroimage 2012; 61:715-22. [PMID: 22503936 DOI: 10.1016/j.neuroimage.2012.03.086] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2011] [Revised: 03/14/2012] [Accepted: 03/29/2012] [Indexed: 11/21/2022] Open
Abstract
The processing of pitch intervals may be differentially influenced when musical or speech stimuli carry the pitch information. Most insights into the neural basis of pitch interval processing come from studies on music perception. However, music, in contrast to speech, contains a stable set of pitch intervals. To converge the investigation of pitch interval processing in music and speech, we used sequences of the same spoken or sung syllables. The pitch of these syllables varied either by semitone steps like in music or by smaller intervals. Participants had to differentiate the sequences according to their different sizes of pitch intervals or to the direction of the last frequency step in the sequence. The results depended strongly on the specific task demands. Whereas the interval-size task itself recruited more regions in right lateralized fronto-parietal brain network, stronger activity on semitone than on non-semitone sequences was found in the left hemisphere (mainly in frontal cortex) during this task. These effects were also influenced by the speech mode (spoken or sung syllables). Our findings suggest that the processing of pitch intervals in sequences of syllables depends on an interaction between bottom-up (speech mode, pitch interval) and top-down effects (task).
Collapse
|
36
|
Gerry D, Unrau A, Trainor LJ. Active music classes in infancy enhance musical, communicative and social development. Dev Sci 2012; 15:398-407. [PMID: 22490179 DOI: 10.1111/j.1467-7687.2012.01142.x] [Citation(s) in RCA: 103] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
Previous studies suggest that musical training in children can positively affect various aspects of development. However, it remains unknown as to how early in development musical experience can have an effect, the nature of any such effects, and whether different types of music experience affect development differently. We found that random assignment to 6 months of active participatory musical experience beginning at 6 months of age accelerates acquisition of culture-specific knowledge of Western tonality in comparison to a similar amount of passive exposure to music. Furthermore, infants assigned to the active musical experience showed superior development of prelinguistic communicative gestures and social behaviour compared to infants assigned to the passive musical experience. These results indicate that (1) infants can engage in meaningful musical training when appropriate pedagogical approaches are used, (2) active musical participation in infancy enhances culture-specific musical acquisition, and (3) active musical participation in infancy impacts social and communication development.
Collapse
Affiliation(s)
- David Gerry
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, ON L8S 4K1, Canada
| | | | | |
Collapse
|
37
|
Winkler I, Czigler I. Evidence from auditory and visual event-related potential (ERP) studies of deviance detection (MMN and vMMN) linking predictive coding theories and perceptual object representations. Int J Psychophysiol 2012; 83:132-43. [DOI: 10.1016/j.ijpsycho.2011.10.001] [Citation(s) in RCA: 134] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2011] [Revised: 10/03/2011] [Accepted: 10/05/2011] [Indexed: 10/15/2022]
|
38
|
Trainor LJ. Predictive information processing is a fundamental learning mechanism present in early development: Evidence from infants. Int J Psychophysiol 2012; 83:256-8. [DOI: 10.1016/j.ijpsycho.2011.12.008] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2011] [Accepted: 12/22/2011] [Indexed: 12/01/2022]
|
39
|
Predictive information processing in music cognition. A critical review. Int J Psychophysiol 2012; 83:164-75. [PMID: 22245599 DOI: 10.1016/j.ijpsycho.2011.12.010] [Citation(s) in RCA: 100] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2011] [Revised: 12/27/2011] [Accepted: 12/28/2011] [Indexed: 11/21/2022]
|
40
|
Croom AM. Music, neuroscience, and the psychology of well-being: a précis. Front Psychol 2012; 2:393. [PMID: 22232614 PMCID: PMC3249389 DOI: 10.3389/fpsyg.2011.00393] [Citation(s) in RCA: 49] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2011] [Accepted: 12/15/2011] [Indexed: 11/30/2022] Open
Abstract
In Flourish, the positive psychologist Seligman (2011) identifies five commonly recognized factors that are characteristic of human flourishing or well-being: (1) "positive emotion," (2) "relationships," (3) "engagement," (4) "achievement," and (5) "meaning" (p. 24). Although there is no settled set of necessary and sufficient conditions neatly circumscribing the bounds of human flourishing (Seligman, 2011), we would mostly likely consider a person that possessed high levels of these five factors as paradigmatic or prototypical of human flourishing. Accordingly, if we wanted to go about the practical task of actually increasing our level of well-being, we ought to do so by focusing on practically increasing the levels of the five factors that are characteristic of well-being. If, for instance, an activity such as musical engagement can be shown to positively influence each or all of these five factors, this would be compelling evidence that an activity such as musical engagement can positively contribute to one's living a flourishing life. I am of the belief that psychological research can and should be used, not only to identify and diagnose maladaptive psychological states, but identify and promote adaptive psychological states as well. In this article I advance the hypothesis and provide supporting evidence for the claim that musical engagement can positively contribute to one's living a flourishing life. Since there has not yet been a substantive and up-to-date investigation of the possible role of music in contributing to one's living a flourishing life, the purpose of this article is to conduct this investigation, thereby bridging the gap and stimulating discussion between the psychology of music and the psychology of well-being.
Collapse
Affiliation(s)
- Adam M. Croom
- Positive Psychology Center, University of PennsylvaniaPhiladelphia, PA, USA
- Department of Psychology, University of PennsylvaniaPhiladelphia, PA, USA
| |
Collapse
|
41
|
|
42
|
Continuation tapping to triggered melodies: motor resonance effects of melodic motion. Exp Brain Res 2011; 216:51-60. [PMID: 22038717 DOI: 10.1007/s00221-011-2907-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2010] [Accepted: 10/07/2011] [Indexed: 10/16/2022]
Abstract
Common Coding theory predicts that perceived action should resonate in produced action to which it bears some resemblance. Here we show that the qualities of motion commonly attributed to melodies are instantiated in motor plans that control timed movements. Participants attempted to tap a steady beat. Each tap triggered a sounded tone, and successive tones were systematically varied in pitch to form short melodies. Tapping behavior was monitored with motion capture. Although instructed to ignore them, triggered tones systematically affected timing and finger movement. When slower melodic motion was implied by a contour change or a smaller pitch displacement, the interval-tap interval (ITI) was longer. When faster melodic motion was implied by a preserved pitch contour or a larger pitch displacement, ITI was shorter. Kinematic recordings suggested that ITI Error arose from an initial failure to disambiguate perception (i.e., velocity implied by melodic motion) from action (i.e., finger velocity [FV]). Early in the tap trajectory, slower FV was associated with longer ITI and faster FV was associated with shorter ITI. These associations were reversed near mid-trajectory, suggesting a transition from execution of motor planning to online control (Glover et al. in Exp Brain Res 154:103-108, 2004).
Collapse
|
43
|
Subcortical processing of speech regularities underlies reading and music aptitude in children. Behav Brain Funct 2011; 7:44. [PMID: 22005291 PMCID: PMC3233514 DOI: 10.1186/1744-9081-7-44] [Citation(s) in RCA: 93] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2011] [Accepted: 10/17/2011] [Indexed: 11/24/2022] Open
Abstract
Background Neural sensitivity to acoustic regularities supports fundamental human behaviors such as hearing in noise and reading. Although the failure to encode acoustic regularities in ongoing speech has been associated with language and literacy deficits, how auditory expertise, such as the expertise that is associated with musical skill, relates to the brainstem processing of speech regularities is unknown. An association between musical skill and neural sensitivity to acoustic regularities would not be surprising given the importance of repetition and regularity in music. Here, we aimed to define relationships between the subcortical processing of speech regularities, music aptitude, and reading abilities in children with and without reading impairment. We hypothesized that, in combination with auditory cognitive abilities, neural sensitivity to regularities in ongoing speech provides a common biological mechanism underlying the development of music and reading abilities. Methods We assessed auditory working memory and attention, music aptitude, reading ability, and neural sensitivity to acoustic regularities in 42 school-aged children with a wide range of reading ability. Neural sensitivity to acoustic regularities was assessed by recording brainstem responses to the same speech sound presented in predictable and variable speech streams. Results Through correlation analyses and structural equation modeling, we reveal that music aptitude and literacy both relate to the extent of subcortical adaptation to regularities in ongoing speech as well as with auditory working memory and attention. Relationships between music and speech processing are specifically driven by performance on a musical rhythm task, underscoring the importance of rhythmic regularity for both language and music. Conclusions These data indicate common brain mechanisms underlying reading and music abilities that relate to how the nervous system responds to regularities in auditory input. Definition of common biological underpinnings for music and reading supports the usefulness of music for promoting child literacy, with the potential to improve reading remediation.
Collapse
|
44
|
Bidelman GM, Gandour JT, Krishnan A. Musicians demonstrate experience-dependent brainstem enhancement of musical scale features within continuously gliding pitch. Neurosci Lett 2011; 503:203-7. [PMID: 21906656 DOI: 10.1016/j.neulet.2011.08.036] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2011] [Revised: 08/16/2011] [Accepted: 08/18/2011] [Indexed: 10/17/2022]
Abstract
In contrast to language, where pitch patterns consist of continuous and curvilinear contours, musical pitch consists of relatively discrete, stair-stepped sequences of notes. Behavioral and neurophysiological studies suggest that both tone-language and music experience enhance the representation of pitch cues associated with a listener's domain of expertise, e.g., curvilinear pitch in language, discrete scale steps in music. We compared brainstem frequency-following responses (FFRs) of English-speaking musicians (musical pitch experience) and native speakers of Mandarin Chinese (linguistic pitch experience) elicited by rising and falling tonal sweeps that are exemplary of Mandarin tonal contours but uncharacteristic of the pitch patterns typically found in music. In spite of musicians' unfamiliarity with such glides, we find that their brainstem FFRs show enhancement of the stimulus where the curvilinear sweep traverses discrete notes along the diatonic musical scale. This enhancement was note specific in that it was not observed immediately preceding or following the scale tone of interest (passing note). No such enhancements were observed in Chinese listeners. These findings suggest that the musician's brainstem may be differentially tuned by long-term exposure to the pitch patterns inherent to music, extracting pitch in relation to a fixed, hierarchical scale.
Collapse
Affiliation(s)
- Gavin M Bidelman
- Department of Speech, Language, and Hearing Sciences, Purdue University, W. Lafayette, IN 47907, USA.
| | | | | |
Collapse
|
45
|
Schaefer RS, Farquhar J, Blokland Y, Sadakata M, Desain P. Name that tune: Decoding music from the listening brain. Neuroimage 2011; 56:843-9. [PMID: 20541612 DOI: 10.1016/j.neuroimage.2010.05.084] [Citation(s) in RCA: 32] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2009] [Revised: 02/28/2010] [Accepted: 05/31/2010] [Indexed: 10/19/2022] Open
|
46
|
Lee YS, Janata P, Frost C, Hanke M, Granger R. Investigation of melodic contour processing in the brain using multivariate pattern-based fMRI. Neuroimage 2011; 57:293-300. [PMID: 21315158 DOI: 10.1016/j.neuroimage.2011.02.006] [Citation(s) in RCA: 55] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2010] [Revised: 01/28/2011] [Accepted: 02/02/2011] [Indexed: 10/18/2022] Open
Abstract
Music perception generally involves processing the frequency relationships between successive pitches and extraction of the melodic contour. Previous evidence has suggested that the 'ups' and 'downs' of melodic contour are categorically and automatically processed, but knowledge of the brain regions that discriminate different types of contour is limited. Here, we examined melodic contour discrimination using multivariate pattern analysis (MVPA) of fMRI data. Twelve non-musicians were presented with various ascending and descending melodic sequences while being scanned. Whole-brain MVPA was used to identify regions in which the local pattern of activity accurately discriminated between contour categories. We identified three distinct cortical loci: the right superior temporal sulcus (rSTS), the left inferior parietal lobule (lIPL), and the anterior cingulate cortex (ACC). These results complement previous findings of melodic processing within the rSTS, and extend our understanding of the way in which abstract auditory sequences are categorized by the human brain.
Collapse
Affiliation(s)
- Yune-Sang Lee
- Dept. of Psychological & Brain Sciences, Dartmouth College, Hanover, NH, USA; Center for Cognitive Neuroscience, Dartmouth College, Hanover, NH, USA; Neurology Department, University of Pennsylvania, Philadelphia, PA, USA.
| | - Petr Janata
- Center for Mind and Brain, U.C. Davis, CA, USA
| | - Carlton Frost
- Dept. of Psychological & Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Michael Hanke
- Dept. of Psychological & Brain Sciences, Dartmouth College, Hanover, NH, USA; Center for Cognitive Neuroscience, Dartmouth College, Hanover, NH, USA; Dept. of Experimental Psychology, Otto-von-Guericke University, Magdeburg, Germany
| | - Richard Granger
- Dept. of Psychological & Brain Sciences, Dartmouth College, Hanover, NH, USA; Center for Cognitive Neuroscience, Dartmouth College, Hanover, NH, USA
| |
Collapse
|
47
|
Ramos D, Bueno JLO, Bigand E. Manipulating Greek musical modes and tempo affects perceived musical emotion in musicians and nonmusicians. Braz J Med Biol Res 2010; 44:165-72. [PMID: 21180883 DOI: 10.1590/s0100-879x2010007500148] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2010] [Accepted: 12/08/2010] [Indexed: 05/26/2023] Open
Abstract
The combined influence of tempo and mode on emotional responses to music was studied by crossing 7 changes in mode with 3 changes in tempo. Twenty-four musicians aged 19 to 25 years (12 males and 12 females) and 24 nonmusicians aged 17 to 25 years (12 males and 12 females) were required to perform two tasks: 1) listening to different musical excerpts, and 2) associating an emotion to them such as happiness, serenity, fear, anger, or sadness. ANOVA showed that increasing the tempo strongly affected the arousal (F(2,116) = 268.62, mean square error (MSE) = 0.6676, P < 0.001) and, to a lesser extent, the valence of emotional responses (F(6,348) = 8.71, MSE = 0.6196, P < 0.001). Changes in modes modulated the affective valence of the perceived emotions (F(6,348) = 4.24, MSE = 0.6764, P < 0.001). Some interactive effects were found between tempo and mode (F (1,58) = 115.6, MSE = 0.6428, P < 0.001), but, in most cases, the two parameters had additive effects. This finding demonstrates that small changes in the pitch structures of modes modulate the emotions associated with the pieces, confirming the cognitive foundation of emotional responses to music.
Collapse
Affiliation(s)
- D Ramos
- Departamento de Psicologia e Educação, Faculdade de Filosofia, Ciências e Letras de Ribeirão Preto, Universidade de São Paulo, Ribeirão Preto, SP, Brazil.
| | | | | |
Collapse
|
48
|
McDermott JH, Keebler MV, Micheyl C, Oxenham AJ. Musical intervals and relative pitch: frequency resolution, not interval resolution, is special. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2010; 128:1943-1951. [PMID: 20968366 PMCID: PMC2981111 DOI: 10.1121/1.3478785] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/03/2009] [Revised: 07/16/2010] [Accepted: 07/19/2010] [Indexed: 05/26/2023]
Abstract
Pitch intervals are central to most musical systems, which utilize pitch at the expense of other acoustic dimensions. It seemed plausible that pitch might uniquely permit precise perception of the interval separating two sounds, as this could help explain its importance in music. To explore this notion, a simple discrimination task was used to measure the precision of interval perception for the auditory dimensions of pitch, brightness, and loudness. Interval thresholds were then expressed in units of just-noticeable differences for each dimension, to enable comparison across dimensions. Contrary to expectation, when expressed in these common units, interval acuity was actually worse for pitch than for loudness or brightness. This likely indicates that the perceptual dimension of pitch is unusual not for interval perception per se, but rather for the basic frequency resolution it supports. The ubiquity of pitch in music may be due in part to this fine-grained basic resolution.
Collapse
Affiliation(s)
- Josh H McDermott
- Center for Neural Science, New York University, 4 Washington Place, New York, New York 10003, USA.
| | | | | | | |
Collapse
|
49
|
Näätänen R, Kujala T, Winkler I. Auditory processing that leads to conscious perception: A unique window to central auditory processing opened by the mismatch negativity and related responses. Psychophysiology 2010; 48:4-22. [PMID: 20880261 DOI: 10.1111/j.1469-8986.2010.01114.x] [Citation(s) in RCA: 338] [Impact Index Per Article: 24.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Affiliation(s)
- Risto Näätänen
- Department of Psychology, University of Tartu, Tartu, Estonia.
| | | | | |
Collapse
|
50
|
Halgren E, Sherfey J, Irimia A, Dale AM, Marinkovic K. Sequential temporo-fronto-temporal activation during monitoring of the auditory environment for temporal patterns. Hum Brain Mapp 2010; 32:1260-76. [PMID: 20665718 DOI: 10.1002/hbm.21106] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2009] [Revised: 04/24/2010] [Accepted: 05/02/2010] [Indexed: 11/11/2022] Open
Abstract
Subjects detected rarely occurring shifts between two simple tone-patterns, in a paradigm that dissociated the effects of rarity from those of pitch, habituation, and attention. Whole-head magnetoencephalography suggested that rare attended pattern-shifts evoked activity first in the superior temporal plane (sTp, peak ~100 ms), then superior temporal sulcus (sTs, peak ~130 ms), then posteroventral prefrontal (pvpF, peak ~230 ms), and anterior temporal cortices (aT, peak ~370 ms). Activity was more prominent in the right hemisphere. After subtracting the effects of nonshift tones (balanced for pitch and habituation status), weak but consistent differential effects of pattern-shifts began in aT at 90-130 ms, spread to sTs and sTp at ∼130 ms, then pvpF, and finally returned to aT. Cingulate activity resembled prefrontal. Responses to pattern shifts were greatly attenuated when the same stimuli were ignored, suggesting that the initial superior temporal activity reflected an attention-related mismatch negativity. The prefrontal activity at ~230 ms corresponded in latency and task correlates with simultaneously recorded event-related potential components N2b and P3a; the subsequent temporal activity corresponded to the P3b. These results were confirmed in sensors specific for frontal or temporal cortex, and thus are independent of the inverse method used. Overall, these results suggest that auditory working memory for temporal patterns begins with detection of the pattern change by an interaction of anterior and superior temporal structures, followed by identification of the event and its consequences led by posteroventral prefrontal and cingulate cortices, and finally, definitive encoding of the event in anterior temporal areas.
Collapse
Affiliation(s)
- Eric Halgren
- Department of Radiology, Multimodal Imaging Laboratory, University of California at San Diego, La Jolla, CA, USA.
| | | | | | | | | |
Collapse
|