1
|
Álvarez-Meza AM, Torres-Cardona HF, Orozco-Alzate M, Pérez-Nastar HD, Castellanos-Dominguez G. Affective Neural Responses Sonified through Labeled Correlation Alignment. SENSORS (BASEL, SWITZERLAND) 2023; 23:5574. [PMID: 37420740 DOI: 10.3390/s23125574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 06/10/2023] [Accepted: 06/11/2023] [Indexed: 07/09/2023]
Abstract
Sound synthesis refers to the creation of original acoustic signals with broad applications in artistic innovation, such as music creation for games and videos. Nonetheless, machine learning architectures face numerous challenges when learning musical structures from arbitrary corpora. This issue involves adapting patterns borrowed from other contexts to a concrete composition objective. Using Labeled Correlation Alignment (LCA), we propose an approach to sonify neural responses to affective music-listening data, identifying the brain features that are most congruent with the simultaneously extracted auditory features. For dealing with inter/intra-subject variability, a combination of Phase Locking Value and Gaussian Functional Connectivity is employed. The proposed two-step LCA approach embraces a separate coupling stage of input features to a set of emotion label sets using Centered Kernel Alignment. This step is followed by canonical correlation analysis to select multimodal representations with higher relationships. LCA enables physiological explanation by adding a backward transformation to estimate the matching contribution of each extracted brain neural feature set. Correlation estimates and partition quality represent performance measures. The evaluation uses a Vector Quantized Variational AutoEncoder to create an acoustic envelope from the tested Affective Music-Listening database. Validation results demonstrate the ability of the developed LCA approach to generate low-level music based on neural activity elicited by emotions while maintaining the ability to distinguish between the acoustic outputs.
Collapse
Affiliation(s)
| | | | - Mauricio Orozco-Alzate
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170003, Colombia
| | - Hernán Darío Pérez-Nastar
- Signal Processing and Recognition Group, Universidad Nacional de Colombia, Manizales 170003, Colombia
| | | |
Collapse
|
2
|
Papatzikis E, Agapaki M, Selvan RN, Pandey V, Zeba F. Quality standards and recommendations for research in music and neuroplasticity. Ann N Y Acad Sci 2023; 1520:20-33. [PMID: 36478395 DOI: 10.1111/nyas.14944] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Research on how music influences brain plasticity has gained momentum in recent years. Considering, however, the nonuniform methodological standards implemented, the findings end up being nonreplicable and less generalizable. To address the need for a standardized baseline of research quality, we gathered all the studies in the music and neuroplasticity field in 2019 and appraised their methodological rigor systematically and critically. The aim was to provide a preliminary and, at the minimum, acceptable quality threshold-and, ipso facto, suggested recommendations-whereupon further discussion and development may take place. Quality appraisal was performed on 89 articles by three independent raters, following a standardized scoring system. The raters' scoring was cross-referenced following an inter-rater reliability measure, and further studied by performing multiple ratings comparisons and matrix analyses. The results for methodological quality were at a quite good level (quantitative articles: mean = 0.737, SD = 0.084; qualitative articles: mean = 0.677, SD = 0.144), following a moderate but statistically significant level of agreement between the raters (W = 0.44, χ2 = 117.249, p = 0.020). We conclude that the standards for implementation and reporting are of high quality; however, certain improvements are needed to reach the stringent levels presumed for such an influential interdisciplinary scientific field.
Collapse
Affiliation(s)
- Efthymios Papatzikis
- Department of Early Childhood Education and Care, Oslo Metropolitan University, Oslo, Norway
| | - Maria Agapaki
- Department of Early Childhood Education and Care, Oslo Metropolitan University, Oslo, Norway
| | - Rosari Naveena Selvan
- Institute for Physics 3 - Biophysics and Bernstein Center for Computational Neuroscience (BCCN), University of Göttingen, Göttingen, Germany.,Department of Psychology, University of Münster, Münster, Germany
| | | | - Fathima Zeba
- School of Humanities and Social Sciences, Manipal Academy of Higher Education Dubai, Dubai, United Arab Emirates
| |
Collapse
|
3
|
Ngan VSH, Cheung LYT, Ng HTY, Yip KHM, Wong YK, Wong ACN. An early perceptual locus of absolute pitch. Psychophysiology 2023; 60:e14170. [PMID: 36094011 DOI: 10.1111/psyp.14170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Revised: 07/04/2022] [Accepted: 08/08/2022] [Indexed: 01/04/2023]
Abstract
Absolute pitch (AP) refers to the naming of musical tone without external reference. The influential two-component model states that AP is limited by the late-emerging pitch labeling process only and not the earlier perceptual and memory processes. Over the years, however, support for this model at the neural level has been mixed with various methodological limitations. Here, the electroencephalography responses of 27 AP possessors and 27 non-AP possessors were recorded. During both name verification and passive listening, event-related potential analyses showed a difference between AP and non-AP possessors at about 200 ms in their response toward tones compared with noise stimuli. Multivariate pattern analyses suggested that pitch naming was subserved by a series of transient processes for the first 250 ms, followed by a stage-like process for both AP and non-AP possessors with no group differences between them. These findings are inconsistent with the predictions of the two-component model, and instead suggest the existence of an early perceptual locus of AP.
Collapse
Affiliation(s)
- Vince S H Ngan
- Department of Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Leo Y T Cheung
- Department of Educational Psychology, Faculty of Education, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Hezul T Y Ng
- Department of Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Ken H M Yip
- Department of Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Yetta Kwailing Wong
- Department of Educational Psychology, Faculty of Education, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Alan C-N Wong
- Department of Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong
| |
Collapse
|
4
|
Leipold S, Klein C, Jäncke L. Musical Expertise Shapes Functional and Structural Brain Networks Independent of Absolute Pitch Ability. J Neurosci 2021; 41:2496-2511. [PMID: 33495199 PMCID: PMC7984587 DOI: 10.1523/jneurosci.1985-20.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Revised: 11/11/2020] [Accepted: 11/17/2020] [Indexed: 11/21/2022] Open
Abstract
Professional musicians are a popular model for investigating experience-dependent plasticity in human large-scale brain networks. A minority of musicians possess absolute pitch, the ability to name a tone without reference. The study of absolute pitch musicians provides insights into how a very specific talent is reflected in brain networks. Previous studies of the effects of musicianship and absolute pitch on large-scale brain networks have yielded highly heterogeneous findings regarding the localization and direction of the effects. This heterogeneity was likely influenced by small samples and vastly different methodological approaches. Here, we conducted a comprehensive multimodal assessment of effects of musicianship and absolute pitch on intrinsic functional and structural connectivity using a variety of commonly used and state-of-the-art multivariate methods in the largest sample to date (n = 153 female and male human participants; 52 absolute pitch musicians, 51 non-absolute pitch musicians, and 50 non-musicians). Our results show robust effects of musicianship in interhemispheric and intrahemispheric connectivity in both structural and functional networks. Crucially, most of the effects were replicable in both musicians with and without absolute pitch compared with non-musicians. However, we did not find evidence for an effect of absolute pitch on intrinsic functional or structural connectivity in our data: The two musician groups showed strikingly similar networks across all analyses. Our results suggest that long-term musical training is associated with robust changes in large-scale brain networks. The effects of absolute pitch on neural networks might be subtle, requiring very large samples or task-based experiments to be detected.SIGNIFICANCE STATEMENT A question that has fascinated neuroscientists, psychologists, and musicologists for a long time is how musicianship and absolute pitch, the rare talent to name a tone without reference, are reflected in large-scale networks of the human brain. Much is still unknown as previous studies have reported widely inconsistent results based on small samples. Here, we investigate the largest sample of musicians and non-musicians to date (n = 153) using a multitude of established and novel analysis methods. Results provide evidence for robust effects of musicianship on functional and structural networks that were replicable in two separate groups of musicians and independent of absolute pitch ability.
Collapse
Affiliation(s)
- Simon Leipold
- Division of Neuropsychology, Department of Psychology, University of Zurich, 8050 Zurich, Switzerland
- Department of Psychiatry and Behavioral Sciences, Stanford University, School of Medicine, Stanford, California 94305
| | - Carina Klein
- Division of Neuropsychology, Department of Psychology, University of Zurich, 8050 Zurich, Switzerland
| | - Lutz Jäncke
- Division of Neuropsychology, Department of Psychology, University of Zurich, 8050 Zurich, Switzerland
- University Research Priority Program, Dynamics of Healthy Aging, University of Zurich, 8050 Zurich, Switzerland
| |
Collapse
|
5
|
Van Hedger SC, Veillette J, Heald SLM, Nusbaum HC. Revisiting discrete versus continuous models of human behavior: The case of absolute pitch. PLoS One 2020; 15:e0244308. [PMID: 33370349 PMCID: PMC7769265 DOI: 10.1371/journal.pone.0244308] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Accepted: 12/07/2020] [Indexed: 11/18/2022] Open
Abstract
Many human behaviors are discussed in terms of discrete categories. Quantizing behavior in this fashion may provide important traction for understanding the complexities of human experience, but it also may bias understanding of phenomena and associated mechanisms. One example of this is absolute pitch (AP), which is often treated as a discrete trait that is either present or absent (i.e., with easily identifiable near-perfect "genuine" AP possessors and at-chance non-AP possessors) despite emerging evidence that pitch-labeling ability is not all-or-nothing. We used a large-scale online assessment to test the discrete model of AP, specifically by measuring how intermediate performers related to the typically defined "non-AP" and "genuine AP" populations. Consistent with prior research, individuals who performed at-chance (non-AP) reported beginning musical instruction much later than the near-perfect AP participants, and the highest performers were more likely to speak a tonal language than were the lowest performers (though this effect was not as statistically robust as one would expect from prior research). Critically, however, these developmental factors did not differentiate the near-perfect AP performers from the intermediate AP performers. Gaussian mixture modeling supported the existence of two performance distributions-the first distribution encompassed both the intermediate and near-perfect AP possessors, whereas the second distribution encompassed only the at-chance participants. Overall, these results provide support for conceptualizing intermediate levels of pitch-labeling ability along the same continuum as genuine AP-level pitch labeling ability-in other words, a continuous distribution of AP skill among all above-chance performers rather than discrete categories of ability. Expanding the inclusion criteria for AP makes it possible to test hypotheses about the mechanisms that underlie this ability and relate this ability to more general cognitive mechanisms involved in other abilities.
Collapse
Affiliation(s)
- Stephen C. Van Hedger
- Center for Practical Wisdom, The University of Chicago, Chicago, IL, United States of America
- Department of Psychology, The University of Chicago, Chicago, IL, United States of America
- Brain and Mind Institute, Western University, London, ON, Canada
- Department of Psychology, Huron University College, London, ON, Canada
| | - John Veillette
- Center for Practical Wisdom, The University of Chicago, Chicago, IL, United States of America
- Department of Psychology, The University of Chicago, Chicago, IL, United States of America
| | - Shannon L. M. Heald
- Center for Practical Wisdom, The University of Chicago, Chicago, IL, United States of America
- Department of Psychology, The University of Chicago, Chicago, IL, United States of America
| | - Howard C. Nusbaum
- Center for Practical Wisdom, The University of Chicago, Chicago, IL, United States of America
- Department of Psychology, The University of Chicago, Chicago, IL, United States of America
| |
Collapse
|
6
|
Greber M, Jäncke L. Suppression of Pitch Labeling: No Evidence for an Impact of Absolute Pitch on Behavioral and Neurophysiological Measures of Cognitive Inhibition in an Auditory Go/Nogo Task. Front Hum Neurosci 2020; 14:585505. [PMID: 33281584 PMCID: PMC7688746 DOI: 10.3389/fnhum.2020.585505] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Accepted: 10/15/2020] [Indexed: 11/13/2022] Open
Abstract
Pitch labeling in absolute pitch (AP), the ability to recognize the pitch class of a sound without an external reference, is effortless, fast, and presumably automatic. Previous studies have shown that pitch labeling in AP can interfere with task demands. In the current study, we used a cued auditory Go/Nogo task requiring same/different decisions to investigate both behavioral and electrophysiological correlates of increased inhibitory demands related to automatic pitch labeling. The task comprised two Nogo conditions: a Nogo condition with pitch differences larger than one semitone, and a second Nogo condition with pitch differences of only a quarter semitone. The first Nogo condition tested if auditory-related inhibition processes are generally altered in AP musicians. The second Nogo condition tested the suppressibility of the pitch labeling using a Stroop-like effect: the two tones belonged to the same pitch class but were not identical in terms of tone frequency. If pitch labeling cannot be suppressed, the conflicting information would be expected to increase the inhibitory load in AP musicians. Our data provided no evidence for an increased difficulty to inhibit a prepotent response or to suppress conflicting pitch-labeling information in AP: AP musicians showed similar commission error rates as non-AP musicians in both Nogo conditions. N2d and P3d amplitudes of AP musicians were also comparable to those of non-AP musicians. The event-related potentials (ERPs) were, however, modulated by the Nogo condition, probably indicating an effect of stimulus similarity. It is possible that, depending on the context, pitch labeling in AP musicians is not entirely automatic and can be suppressed.
Collapse
Affiliation(s)
- Marielle Greber
- Division Neuropsychology, Department of Psychology, University of Zurich, Zurich, Switzerland
| | - Lutz Jäncke
- Division Neuropsychology, Department of Psychology, University of Zurich, Zurich, Switzerland
- University Research Priority Program (URPP), Dynamics of Healthy Aging, University of Zurich, Zurich, Switzerland
| |
Collapse
|
7
|
Diminished large-scale functional brain networks in absolute pitch during the perception of naturalistic music and audiobooks. Neuroimage 2020; 216:116513. [DOI: 10.1016/j.neuroimage.2019.116513] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2019] [Revised: 12/16/2019] [Accepted: 12/31/2019] [Indexed: 12/26/2022] Open
|
8
|
Greber M, Klein C, Leipold S, Sele S, Jäncke L. Heterogeneity of EEG resting-state brain networks in absolute pitch. Int J Psychophysiol 2020; 157:11-22. [PMID: 32721558 DOI: 10.1016/j.ijpsycho.2020.07.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2020] [Revised: 07/09/2020] [Accepted: 07/19/2020] [Indexed: 01/13/2023]
Abstract
The neural basis of absolute pitch (AP), the ability to effortlessly identify a musical tone without an external reference, is poorly understood. One of the key questions is whether perceptual or cognitive processes underlie the phenomenon, as both sensory and higher-order brain regions have been associated with AP. To integrate the perceptual and cognitive views on AP, here, we investigated joint contributions of sensory and higher-order brain regions to AP resting-state networks. We performed a comprehensive functional network analysis of source-level EEG in a large sample of AP musicians (n = 54) and non-AP musicians (n = 51), adopting two analysis approaches: First, we applied an ROI-based analysis to examine the connectivity between the auditory cortex and the dorsolateral prefrontal cortex (DLPFC) using several established functional connectivity measures. This analysis is a replication of a previous study which reported increased connectivity between these two regions in AP musicians. Second, we performed a whole-brain network-based analysis on the same functional connectivity measures to gain a more complete picture of the brain regions involved in a possibly large-scale network supporting AP ability. In our sample, the ROI-based analysis did not provide evidence for an AP-specific connectivity increase between the auditory cortex and the DLPFC. The whole-brain analysis revealed three networks with increased connectivity in AP musicians comprising nodes in frontal, temporal, subcortical, and occipital areas. Commonalities of the networks were found in both sensory and higher-order brain regions of the perisylvian area. Further research will be needed to confirm these exploratory results.
Collapse
Affiliation(s)
- Marielle Greber
- Division Neuropsychology, Department of Psychology, University of Zurich, Zurich, Switzerland.
| | - Carina Klein
- Division Neuropsychology, Department of Psychology, University of Zurich, Zurich, Switzerland
| | - Simon Leipold
- Division Neuropsychology, Department of Psychology, University of Zurich, Zurich, Switzerland; Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, USA
| | - Silvano Sele
- Division Neuropsychology, Department of Psychology, University of Zurich, Zurich, Switzerland; University Research Priority Program (URPP), Dynamics of Healthy Aging, University of Zurich, Zurich, Switzerland
| | - Lutz Jäncke
- Division Neuropsychology, Department of Psychology, University of Zurich, Zurich, Switzerland; University Research Priority Program (URPP), Dynamics of Healthy Aging, University of Zurich, Zurich, Switzerland.
| |
Collapse
|