1
|
Wu Q, Sun L, Ding N, Yang Y. Musical tension is affected by metrical structure dynamically and hierarchically. Cogn Neurodyn 2024; 18:1955-1976. [PMID: 39104669 PMCID: PMC11297889 DOI: 10.1007/s11571-023-10058-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 11/29/2023] [Accepted: 12/11/2023] [Indexed: 08/07/2024] Open
Abstract
As the basis of musical emotions, dynamic tension experience is felt by listeners as music unfolds over time. The effects of musical harmonic and melodic structures on tension have been widely investigated, however, the potential roles of metrical structures in tension perception remain largely unexplored. This experiment examined how different metrical structures affect tension experience and explored the underlying neural activities. The electroencephalogram (EEG) was recorded and subjective tension was rated simultaneously while participants listened to music meter sequences. On large time scale of whole meter sequences, it was found that different overall tension and low-frequency (1 ~ 4 Hz) steady-state evoked potentials were elicited by metrical structures with different periods of strong beats, and the higher overall tension was associated with metrical structure with the shorter intervals between strong beats. On small time scale of measures, dynamic tension fluctuations within measures was found to be associated with the periodic modulations of high-frequency (10 ~ 25 Hz) neural activities. The comparisons between the same beats within measures and across different meters both on small and large time scales verified the contextual effects of meter on tension induced by beats. Our findings suggest that the overall tension is determined by temporal intervals between strong beats, and the dynamic tension experience may arise from cognitive processing of hierarchical temporal expectation and attention, which are discussed under the theoretical frameworks of metrical hierarchy, musical expectation and dynamic attention.
Collapse
Affiliation(s)
- Qiong Wu
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, No. 16 Lincui Road, Chaoyang District, Beijing, 100101 China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Lijun Sun
- College of Arts, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Nai Ding
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou, China
| | - Yufang Yang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, No. 16 Lincui Road, Chaoyang District, Beijing, 100101 China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
2
|
Prasad R, Tarai S, Bit A. Hybrid computational model depicts the contribution of non-significant lobes of human brain during the perception of emotional stimuli. Comput Methods Biomech Biomed Engin 2024:1-27. [PMID: 38328832 DOI: 10.1080/10255842.2024.2311876] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Accepted: 11/03/2023] [Indexed: 02/09/2024]
Abstract
Emotions are synchronizing responses of human brain while executing cognitive tasks. Earlier studies had revealed strong correlation between specific lobes of the brain to different types of emotional valence. In the current study, a comprehensive three-dimensional mapping of human brain for executing emotion specific tasks had been formulated. A hybrid computational machine learning model customized from Custom Weight Allocation Model (CWAM) and defined as Custom Rank Allocation Model (CRAM). This regression-based hybrid computational model computes the allocated tasks to different lobes of the brain during their respective executive stage. Event Related Potentials (ERP) were obtained with significant effect at P1, P2, P3, N170, N2, and N4. These ERPs were configured at Pz, Cz, F3, and T8 regions of the brain with maximal responses; while regions like Cz, C4 and F4 were also found to make effective contributions to elevate the responses of the brain, and thus these regions were configured as augmented source regions of the brain. In another circumstance of frequent -deviant - equal (FDE) presentation of the emotional stimuli, it was observed that the brain channels C3, C4, P3, P4, O1, O2, and Oz were contributing their emotional quotient to the overall response of the brain regions; whereas, the interaction effect was found presentable at O2, Oz, P3, P4, T8 and C3 regions of brain. The proposed computational model had identified the potential neural pathways during the execution of emotional task.
Collapse
Affiliation(s)
| | | | - Arindam Bit
- Department of Biomedical Engineering, NIT Raipur
| |
Collapse
|
3
|
Kobayashi K, Shiba Y, Honda S, Nakajima S, Fujii S, Mimura M, Noda Y. Short-Term Effect of Auditory Stimulation on Neural Activities: A Scoping Review of Longitudinal Electroencephalography and Magnetoencephalography Studies. Brain Sci 2024; 14:131. [PMID: 38391706 PMCID: PMC10887208 DOI: 10.3390/brainsci14020131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2023] [Revised: 12/24/2023] [Accepted: 01/24/2024] [Indexed: 02/24/2024] Open
Abstract
Explored through EEG/MEG, auditory stimuli function as a suitable research probe to reveal various neural activities, including event-related potentials, brain oscillations and functional connectivity. Accumulating evidence in this field stems from studies investigating neuroplasticity induced by long-term auditory training, specifically cross-sectional studies comparing musicians and non-musicians as well as longitudinal studies with musicians. In contrast, studies that address the neural effects of short-term interventions whose duration lasts from minutes to hours are only beginning to be featured. Over the past decade, an increasing body of evidence has shown that short-term auditory interventions evoke rapid changes in neural activities, and oscillatory fluctuations can be observed even in the prestimulus period. In this scoping review, we divided the extracted neurophysiological studies into three groups to discuss neural activities with short-term auditory interventions: the pre-stimulus period, during stimulation, and a comparison of before and after stimulation. We show that oscillatory activities vary depending on the context of the stimuli and are greatly affected by the interplay of bottom-up and top-down modulational mechanisms, including attention. We conclude that the observed rapid changes in neural activitiesin the auditory cortex and the higher-order cognitive part of the brain are causally attributed to short-term auditory interventions.
Collapse
Affiliation(s)
- Kanon Kobayashi
- Department of Neuropsychiatry, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Yasushi Shiba
- Faculty of Medicine, University of Tokyo, Tokyo 113-8655, Japan
| | - Shiori Honda
- Department of Neuropsychiatry, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Shinichiro Nakajima
- Department of Neuropsychiatry, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Shinya Fujii
- Faculty of Environment and Information Studies, Keio University, Fujisawa 252-0816, Japan
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Yoshihiro Noda
- Department of Neuropsychiatry, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| |
Collapse
|
4
|
Bouwer FL, Háden GP, Honing H. Probing Beat Perception with Event-Related Potentials (ERPs) in Human Adults, Newborns, and Nonhuman Primates. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2024; 1455:227-256. [PMID: 38918355 DOI: 10.1007/978-3-031-60183-5_13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/27/2024]
Abstract
The aim of this chapter is to give an overview of how the perception of rhythmic temporal regularity such as a regular beat in music can be studied in human adults, human newborns, and nonhuman primates using event-related brain potentials (ERPs). First, we discuss different aspects of temporal structure in general, and musical rhythm in particular, and we discuss the possible mechanisms underlying the perception of regularity (e.g., a beat) in rhythm. Additionally, we highlight the importance of dissociating beat perception from the perception of other types of structure in rhythm, such as predictable sequences of temporal intervals, ordinal structure, and rhythmic grouping. In the second section of the chapter, we start with a discussion of auditory ERPs elicited by infrequent and frequent sounds: ERP responses to regularity violations, such as mismatch negativity (MMN), N2b, and P3, as well as early sensory responses to sounds, such as P1 and N1, have been shown to be instrumental in probing beat perception. Subsequently, we discuss how beat perception can be probed by comparing ERP responses to sounds in regular and irregular sequences, and by comparing ERP responses to sounds in different metrical positions in a rhythm, such as on and off the beat or on strong and weak beats. Finally, we will discuss previous research that has used the aforementioned ERPs and paradigms to study beat perception in human adults, human newborns, and nonhuman primates. In doing so, we consider the possible pitfalls and prospects of the technique, as well as future perspectives.
Collapse
Affiliation(s)
- Fleur L Bouwer
- Cognitive Psychology Unit, Institute of Psychology, Leiden Institute for Brain and Cognition, Leiden University, Leiden, The Netherlands.
- Department of Psychology, Brain & Cognition, University of Amsterdam, Amsterdam, The Netherlands.
| | - Gábor P Háden
- Institute of Cognitive Neuroscience and Psychology, Budapest, Hungary
- Department of Telecommunications and Media Informatics, Faculty of Electrical Engineering and Informatics, Budapest University of Technology and Economics, Budapest, Hungary
| | - Henkjan Honing
- Music Cognition group (MCG), Institute for Logic, Language and Computation (ILLC), Amsterdam Brain and Cognition (ABC), University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
5
|
Foldal MD, Leske S, Blenkmann AO, Endestad T, Solbakk AK. Attentional modulation of beta-power aligns with the timing of behaviorally relevant rhythmic sounds. Cereb Cortex 2023; 33:1876-1894. [PMID: 35639957 PMCID: PMC9977362 DOI: 10.1093/cercor/bhac179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Revised: 04/05/2022] [Accepted: 04/06/2022] [Indexed: 11/12/2022] Open
Abstract
It is largely unknown how attention adapts to the timing of acoustic stimuli. To address this, we investigated how hemispheric lateralization of alpha (7-13 Hz) and beta (14-24 Hz) oscillations, reflecting voluntary allocation of auditory spatial attention, is influenced by tempo and predictability of sounds. We recorded electroencephalography while healthy adults listened to rhythmic sound streams with different tempos that were presented dichotically to separate ears, thus permitting manipulation of spatial-temporal attention. Participants responded to stimulus-onset-asynchrony (SOA) deviants (-90 ms) for given tones in the attended rhythm. Rhythm predictability was controlled via the probability of SOA deviants per block. First, the results revealed hemispheric lateralization of beta-power according to attention direction, reflected as ipsilateral enhancement and contralateral suppression, which was amplified in high- relative to low-predictability conditions. Second, fluctuations in the time-resolved beta-lateralization aligned more strongly with the attended than the unattended tempo. Finally, a trend-level association was found between the degree of beta-lateralization and improved ability to distinguish between SOA-deviants in the attended versus unattended ear. Differently from previous studies, we presented continuous rhythms in which task-relevant and irrelevant stimuli had different tempo, thereby demonstrating that temporal alignment of beta-lateralization with attended sounds reflects top-down attention to sound timing.
Collapse
Affiliation(s)
- Maja D Foldal
- Department of Psychology, University of Oslo, Forskningsveien 3A, 0373 Oslo, Norway.,RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Forskningsveien 3A, 0373 Oslo, Norway
| | - Sabine Leske
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Forskningsveien 3A, 0373 Oslo, Norway.,Department of Musicology, University of Oslo, Sem Sælands vei 2, 0371 Oslo, Norway
| | - Alejandro O Blenkmann
- Department of Psychology, University of Oslo, Forskningsveien 3A, 0373 Oslo, Norway.,RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Forskningsveien 3A, 0373 Oslo, Norway
| | - Tor Endestad
- Department of Psychology, University of Oslo, Forskningsveien 3A, 0373 Oslo, Norway.,RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Forskningsveien 3A, 0373 Oslo, Norway.,Department of Neuropsychology, Helgeland Hospital, Skjervengan 17, 8657 Mosjøen, Norway
| | - Anne-Kristin Solbakk
- Department of Psychology, University of Oslo, Forskningsveien 3A, 0373 Oslo, Norway.,RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Forskningsveien 3A, 0373 Oslo, Norway.,Department of Neuropsychology, Helgeland Hospital, Skjervengan 17, 8657 Mosjøen, Norway.,Department of Neurosurgery, Oslo University Hospital, Sognsvannsveien 20, 0372 Oslo, Norway
| |
Collapse
|
6
|
Evidence for predictions established by phantom sound. Neuroimage 2022; 264:119766. [PMID: 36435344 DOI: 10.1016/j.neuroimage.2022.119766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 08/24/2022] [Accepted: 11/22/2022] [Indexed: 11/24/2022] Open
Abstract
Predictions, the bridge between the internal and external worlds, are established by prior experience and updated by sensory stimuli. Responses to omitted but unexpected stimuli, known as omission responses, can break the one-to-one mapping of stimulus-response and can expose predictions established by the preceding stimulus built up. While research into exogenous predictions (driven by external stimuli) is often reported, that into endogenous predictions (driven by internal percepts) is rarely available in the literature. Here, we report evidence for endogenous predictions established by the Zwicker tone illusion, a phantom pure-tone-like auditory percept following notch noises. We found that MMN, P300, and theta oscillations could be recorded using an omission paradigm in subjects who can perceive Zwicker tone illusions, but could not in those who cannot. The MMN and P300 responses relied on attention, but theta oscillations did not. In-depth analysis shows that an increase in single-trial theta power, including total and induced theta, with the endogenous prediction, is lateralized to the left frontal brain areas. Our study depicts that the brain automatically analyzes internal perception, progressively establishes predictions and yields prediction errors in the left frontal region when a violation occurs.
Collapse
|