1
|
Van Caenegem EE, Moreno-Verdú M, Waltzing BM, Hamoline G, McAteer SM, Lennart F, Hardwick RM. Multisensory approach in Mental Imagery: ALE meta-analyses comparing Motor, Visual and Auditory Imagery. Neurosci Biobehav Rev 2024; 167:105902. [PMID: 39303775 DOI: 10.1016/j.neubiorev.2024.105902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2024] [Revised: 08/29/2024] [Accepted: 09/17/2024] [Indexed: 09/22/2024]
Abstract
Mental Imagery is a topic of longstanding and widespread scientific interest. Individual studies have typically focused on a single modality (e.g. Motor, Visual, Auditory) of Mental Imagery. Relatively little work has considered directly comparing and contrasting the brain networks associated with these different modalities of Imagery. The present study integrates data from 439 neuroimaging experiments to identify both modality-specific and shared neural networks involved in Mental Imagery. Comparing the networks involved in Motor, Visual, and Auditory Imagery identified a pattern whereby each form of Imagery preferentially recruited 'higher level' associative brain regions involved in the associated 'real' experience. Results also indicate significant overlap in a left-lateralized network including the pre-supplementary motor area, ventral premotor cortex and inferior parietal lobule. This pattern of results supports the existence of a 'core' network that supports the attentional, spatial, and decision-making demands of Mental Imagery. Together these results offer new insights into the brain networks underlying human imagination.
Collapse
Affiliation(s)
- Elise E Van Caenegem
- Brain, Action, And Skill Laboratory, Institute of Neurosciences, UCLouvain, Belgium.
| | - Marcos Moreno-Verdú
- Brain, Action, And Skill Laboratory, Institute of Neurosciences, UCLouvain, Belgium
| | - Baptiste M Waltzing
- Brain, Action, And Skill Laboratory, Institute of Neurosciences, UCLouvain, Belgium
| | - Gautier Hamoline
- Brain, Action, And Skill Laboratory, Institute of Neurosciences, UCLouvain, Belgium
| | - Siobhan M McAteer
- Brain, Action, And Skill Laboratory, Institute of Neurosciences, UCLouvain, Belgium
| | - Frahm Lennart
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM7), Research Centre Jülich, Jülich, Germany; Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine,RWTH Aachen University, Aachen, Germany
| | - Robert M Hardwick
- Brain, Action, And Skill Laboratory, Institute of Neurosciences, UCLouvain, Belgium
| |
Collapse
|
2
|
Suggate SP. Beyond self-report: Measuring visual, auditory, and tactile mental imagery using a mental comparison task. Behav Res Methods 2024:10.3758/s13428-024-02496-z. [PMID: 39271632 DOI: 10.3758/s13428-024-02496-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/08/2024] [Indexed: 09/15/2024]
Abstract
Finding a reliable and objective measure of individual differences in mental imagery across sensory modalities is difficult, with measures relying on self-report scales or focusing on one modality alone. Based on the idea that mental imagery involves multimodal sensorimotor simulations, a mental comparison task (MCT) was developed across three studies and tested on adults (n = 96, 345, and 448). Analyses examined: (a) the internal consistency of the MCT, (b) whether lexical features of the MCT stimuli (word length and frequency) predicted performance, (c) whether the MCT related to two widely used self-report scales, (d) response latencies and accuracies across the visual, auditory, and tactile modalities, and (e) whether MCT performance was independent of processing speed. The MCT showed evidence of reliability and validity. Responses were fastest and most accurate for the visual modality, followed by the auditory and tactile. However, consistent with the idea that self-report questionnaires index a different aspect of mental imagery, the MCT showed minimal correlations with self-report imagery. Finally, relations between MCT scales remained strong after controlling for processing speed. Findings are discussed in relation to current understanding and measurement of mental imagery.
Collapse
|
3
|
Della Vedova G, Proverbio AM. Neural signatures of imaginary motivational states: desire for music, movement and social play. Brain Topogr 2024; 37:806-825. [PMID: 38625520 PMCID: PMC11393278 DOI: 10.1007/s10548-024-01047-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Accepted: 03/12/2024] [Indexed: 04/17/2024]
Abstract
The literature has demonstrated the potential for detecting accurate electrical signals that correspond to the will or intention to move, as well as decoding the thoughts of individuals who imagine houses, faces or objects. This investigation examines the presence of precise neural markers of imagined motivational states through the combining of electrophysiological and neuroimaging methods. 20 participants were instructed to vividly imagine the desire to move, listen to music or engage in social activities. Their EEG was recorded from 128 scalp sites and analysed using individual standardized Low-Resolution Brain Electromagnetic Tomographies (LORETAs) in the N400 time window (400-600 ms). The activation of 1056 voxels was examined in relation to the 3 motivational states. The most active dipoles were grouped in eight regions of interest (ROI), including Occipital, Temporal, Fusiform, Premotor, Frontal, OBF/IF, Parietal, and Limbic areas. The statistical analysis revealed that all motivational imaginary states engaged the right hemisphere more than the left hemisphere. Distinct markers were identified for the three motivational states. Specifically, the right temporal area was more relevant for "Social Play", the orbitofrontal/inferior frontal cortex for listening to music, and the left premotor cortex for the "Movement" desire. This outcome is encouraging in terms of the potential use of neural indicators in the realm of brain-computer interface, for interpreting the thoughts and desires of individuals with locked-in syndrome.
Collapse
Affiliation(s)
- Giada Della Vedova
- Cognitive Electrophysiology lab, Dept. of Psychology, University of Milano, Bicocca, Italy
| | - Alice Mado Proverbio
- Cognitive Electrophysiology lab, Dept. of Psychology, University of Milano, Bicocca, Italy.
- NeuroMI, Milan Center for Neuroscience, Milan, Italy.
- Department of Psychology of University of Milano-Bicocca, Piazza dell'Ateneo nuovo 1, Milan, 20162, Italy.
| |
Collapse
|
4
|
Martinez DRQ, Rubio GF, Bonetti L, Achyutuni KG, Tzovara A, Knight RT, Vuust P. Decoding reveals the neural representation of perceived and imagined musical sounds. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.08.15.553456. [PMID: 37645733 PMCID: PMC10462096 DOI: 10.1101/2023.08.15.553456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
Vividly imagining a song or a melody is a skill that many people accomplish with relatively little effort. However, we are only beginning to understand how the brain represents, holds, and manipulates these musical "thoughts". Here, we decoded perceived and imagined melodies from magnetoencephalography (MEG) brain data (N = 71) to characterize their neural representation. We found that, during perception, auditory regions represent the sensory properties of individual sounds. In contrast, a widespread network including fronto-parietal cortex, hippocampus, basal nuclei, and sensorimotor regions hold the melody as an abstract unit during both perception and imagination. Furthermore, the mental manipulation of a melody systematically changes its neural representation, reflecting volitional control of auditory images. Our work sheds light on the nature and dynamics of auditory representations, informing future research on neural decoding of auditory imagination.
Collapse
Affiliation(s)
- David R. Quiroga Martinez
- Helen Wills Neuroscience Institute & Department of Psychology, University of California Berkeley, Berkeley, CA
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and The Royal Academy of Music, Aarhus, Denmark
| | - Gemma Fernandez Rubio
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and The Royal Academy of Music, Aarhus, Denmark
| | - Leonardo Bonetti
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and The Royal Academy of Music, Aarhus, Denmark
- Center for Eudaimonia and Human Flourishing, Linacre College, University of Oxford, Oxford UK
- Department of Psychiatry, University of Oxford, Oxford UK
| | - Kriti G. Achyutuni
- Helen Wills Neuroscience Institute & Department of Psychology, University of California Berkeley, Berkeley, CA
| | - Athina Tzovara
- Helen Wills Neuroscience Institute & Department of Psychology, University of California Berkeley, Berkeley, CA
- Institute of Computer Science, University of Bern, Bern, Switzerland
- Center for Experimental Neurology, Sleep Wake Epilepsy Center, NeuroTec, Department of Neurology, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Robert T. Knight
- Helen Wills Neuroscience Institute & Department of Psychology, University of California Berkeley, Berkeley, CA
| | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University and The Royal Academy of Music, Aarhus, Denmark
| |
Collapse
|
5
|
Chung LKH, Jack BN, Griffiths O, Pearson D, Luque D, Harris AWF, Spencer KM, Le Pelley ME, So SHW, Whitford TJ. Neurophysiological evidence of motor preparation in inner speech and the effect of content predictability. Cereb Cortex 2023; 33:11556-11569. [PMID: 37943760 PMCID: PMC10751289 DOI: 10.1093/cercor/bhad389] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2023] [Revised: 09/25/2023] [Accepted: 09/26/2023] [Indexed: 11/12/2023] Open
Abstract
Self-generated overt actions are preceded by a slow negativity as measured by electroencephalogram, which has been associated with motor preparation. Recent studies have shown that this neural activity is modulated by the predictability of action outcomes. It is unclear whether inner speech is also preceded by a motor-related negativity and influenced by the same factor. In three experiments, we compared the contingent negative variation elicited in a cue paradigm in an active vs. passive condition. In Experiment 1, participants produced an inner phoneme, at which an audible phoneme whose identity was unpredictable was concurrently presented. We found that while passive listening elicited a late contingent negative variation, inner speech production generated a more negative late contingent negative variation. In Experiment 2, the same pattern of results was found when participants were instead asked to overtly vocalize the phoneme. In Experiment 3, the identity of the audible phoneme was made predictable by establishing probabilistic expectations. We observed a smaller late contingent negative variation in the inner speech condition when the identity of the audible phoneme was predictable, but not in the passive condition. These findings suggest that inner speech is associated with motor preparatory activity that may also represent the predicted action-effects of covert actions.
Collapse
Affiliation(s)
- Lawrence K-h Chung
- School of Psychology, University of New South Wales (UNSW Sydney), Mathews Building, Library Walk, Kensington NSW 2052, Australia
- Department of Psychology, The Chinese University of Hong Kong, 3/F Sino Building, Chung Chi Road, Shatin, New Territories, Hong Kong SAR, China
| | - Bradley N Jack
- Research School of Psychology, Australian National University, Building 39, Science Road, Canberra ACT 2601, Australia
| | - Oren Griffiths
- School of Psychological Sciences, University of Newcastle, Behavioural Sciences Building, University Drive, Callaghan NSW 2308, Australia
| | - Daniel Pearson
- School of Psychology, University of Sydney, Griffith Taylor Building, Manning Road, Camperdown NSW 2006, Australia
| | - David Luque
- Department of Basic Psychology and Speech Therapy, University of Malaga, Faculty of Psychology, Dr Ortiz Ramos Street, 29010 Malaga, Spain
| | - Anthony W F Harris
- Westmead Clinical School, University of Sydney, 176 Hawkesbury Road, Westmead NSW 2145, Australia
- Brain Dynamics Centre, Westmead Institute for Medical Research, 176 Hawkesbury Road, Westmead NSW 2145, Australia
| | - Kevin M Spencer
- Research Service, Veterans Affairs Boston Healthcare System, and Department of Psychiatry, Harvard Medical School, 150 South Huntington Avenue, Boston MA 02130, United States
| | - Mike E Le Pelley
- School of Psychology, University of New South Wales (UNSW Sydney), Mathews Building, Library Walk, Kensington NSW 2052, Australia
| | - Suzanne H-w So
- Department of Psychology, The Chinese University of Hong Kong, 3/F Sino Building, Chung Chi Road, Shatin, New Territories, Hong Kong SAR, China
| | - Thomas J Whitford
- School of Psychology, University of New South Wales (UNSW Sydney), Mathews Building, Library Walk, Kensington NSW 2052, Australia
- Brain Dynamics Centre, Westmead Institute for Medical Research, 176 Hawkesbury Road, Westmead NSW 2145, Australia
| |
Collapse
|
6
|
Toader C, Tataru CP, Florian IA, Covache-Busuioc RA, Bratu BG, Glavan LA, Bordeianu A, Dumitrascu DI, Ciurea AV. Cognitive Crescendo: How Music Shapes the Brain's Structure and Function. Brain Sci 2023; 13:1390. [PMID: 37891759 PMCID: PMC10605363 DOI: 10.3390/brainsci13101390] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Revised: 09/25/2023] [Accepted: 09/27/2023] [Indexed: 10/29/2023] Open
Abstract
Music is a complex phenomenon with multiple brain areas and neural connections being implicated. Centuries ago, music was discovered as an efficient modality for psychological status enrichment and even for the treatment of multiple pathologies. Modern research investigations give a new avenue for music perception and the understanding of the underlying neurological mechanisms, using neuroimaging, especially magnetic resonance imaging. Multiple brain areas were depicted in the last decades as being of high value for music processing, and further analyses in the neuropsychology field uncover the implications in emotional and cognitive activities. Music listening improves cognitive functions such as memory, attention span, and behavioral augmentation. In rehabilitation, music-based therapies have a high rate of success for the treatment of depression and anxiety and even in neurological disorders such as regaining the body integrity after a stroke episode. Our review focused on the neurological and psychological implications of music, as well as presenting the significant clinical relevance of therapies using music.
Collapse
Affiliation(s)
- Corneliu Toader
- Department of Neurosurgery, “Carol Davila” University of Medicine and Pharmacy, 020021 Bucharest, Romania; (C.T.); (B.-G.B.); (L.A.G.); (A.B.); (D.-I.D.); (A.V.C.)
- Department of Vascular Neurosurgery, National Institute of Neurology and Neurovascular Diseases, 077160 Bucharest, Romania
| | - Calin Petru Tataru
- Department of Opthamology, “Carol Davila” University of Medicine and Pharmacy, 020021 Bucharest, Romania
- Central Military Emergency Hospital “Dr. Carol Davila”, 010825 Bucharest, Romania
| | - Ioan-Alexandru Florian
- Department of Neurosciences, “Iuliu Hatieganu” University of Medicine and Pharmacy, 400012 Cluj-Napoca, Romania
| | - Razvan-Adrian Covache-Busuioc
- Department of Neurosurgery, “Carol Davila” University of Medicine and Pharmacy, 020021 Bucharest, Romania; (C.T.); (B.-G.B.); (L.A.G.); (A.B.); (D.-I.D.); (A.V.C.)
| | - Bogdan-Gabriel Bratu
- Department of Neurosurgery, “Carol Davila” University of Medicine and Pharmacy, 020021 Bucharest, Romania; (C.T.); (B.-G.B.); (L.A.G.); (A.B.); (D.-I.D.); (A.V.C.)
| | - Luca Andrei Glavan
- Department of Neurosurgery, “Carol Davila” University of Medicine and Pharmacy, 020021 Bucharest, Romania; (C.T.); (B.-G.B.); (L.A.G.); (A.B.); (D.-I.D.); (A.V.C.)
| | - Andrei Bordeianu
- Department of Neurosurgery, “Carol Davila” University of Medicine and Pharmacy, 020021 Bucharest, Romania; (C.T.); (B.-G.B.); (L.A.G.); (A.B.); (D.-I.D.); (A.V.C.)
| | - David-Ioan Dumitrascu
- Department of Neurosurgery, “Carol Davila” University of Medicine and Pharmacy, 020021 Bucharest, Romania; (C.T.); (B.-G.B.); (L.A.G.); (A.B.); (D.-I.D.); (A.V.C.)
| | - Alexandru Vlad Ciurea
- Department of Neurosurgery, “Carol Davila” University of Medicine and Pharmacy, 020021 Bucharest, Romania; (C.T.); (B.-G.B.); (L.A.G.); (A.B.); (D.-I.D.); (A.V.C.)
- Neurosurgery Department, Sanador Clinical Hospital, 010991 Bucharest, Romania
| |
Collapse
|
7
|
Chu Q, Ma O, Hang Y, Tian X. Dual-stream cortical pathways mediate sensory prediction. Cereb Cortex 2023:7169133. [PMID: 37197767 DOI: 10.1093/cercor/bhad168] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 04/24/2023] [Accepted: 04/26/2023] [Indexed: 05/19/2023] Open
Abstract
Predictions are constantly generated from diverse sources to optimize cognitive functions in the ever-changing environment. However, the neural origin and generation process of top-down induced prediction remain elusive. We hypothesized that motor-based and memory-based predictions are mediated by distinct descending networks from motor and memory systems to the sensory cortices. Using functional magnetic resonance imaging (fMRI) and a dual imagery paradigm, we found that motor and memory upstream systems activated the auditory cortex in a content-specific manner. Moreover, the inferior and posterior parts of the parietal lobe differentially relayed predictive signals in motor-to-sensory and memory-to-sensory networks. Dynamic causal modeling of directed connectivity revealed selective enabling and modulation of connections that mediate top-down sensory prediction and ground the distinctive neurocognitive basis of predictive processing.
Collapse
Affiliation(s)
- Qian Chu
- Shanghai Frontiers Science Center of Artificial Intelligence and Deep Learning, Division of Arts and Sciences, New York University Shanghai, Shanghai 200126, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai 200062, China
- Max Planck-University of Toronto Centre for Neural Science and Technology, Toronto, ON M5S 2E4, Canada
| | - Ou Ma
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai 200062, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China
| | - Yuqi Hang
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai 200062, China
- Department of Administration, Leadership, and Technology, Steinhardt School of Culture, Education, and Human Development, New York University, New York, NY 10003, United States
| | - Xing Tian
- Shanghai Frontiers Science Center of Artificial Intelligence and Deep Learning, Division of Arts and Sciences, New York University Shanghai, Shanghai 200126, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai 200062, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China
| |
Collapse
|
8
|
Vickhoff B. Why art? The role of arts in arts and health. Front Psychol 2023; 14:765019. [PMID: 37034911 PMCID: PMC10075207 DOI: 10.3389/fpsyg.2023.765019] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Accepted: 02/23/2023] [Indexed: 04/11/2023] Open
Abstract
This article is an answer to a report called "What is the evidence on the role of the arts in improving health and well-being?" The authors conclude that the arts have an impact on mental and physical health. Yet, the question of the role of the arts remains unanswered. What is and what is not an art effect? Recently, embodied theory has inspired articles on the perception of art. These articles have not yet received attention in the field of Arts and Health. Scholars in psychosomatic medicine have argued for an approach based on recent work in enactive embodied theory to investigate the connection between the body and the mind. The present article examines how key concepts in this theory relate to art. This leads to a discussion of art in terms of empathy-the relation between the internal state of the artist and the internal state of the beholder. I exemplify with a conceptual framework of musical empathy. Implications for health are addressed.
Collapse
Affiliation(s)
- Björn Vickhoff
- Clinical Sciences, Sahlgrenska Academy, Gothenburg University, Gothenburg, Sweden
| |
Collapse
|
9
|
Kuhnke P, Beaupain MC, Arola J, Kiefer M, Hartwigsen G. Meta-analytic evidence for a novel hierarchical model of conceptual processing. Neurosci Biobehav Rev 2023; 144:104994. [PMID: 36509206 DOI: 10.1016/j.neubiorev.2022.104994] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2022] [Revised: 11/29/2022] [Accepted: 12/07/2022] [Indexed: 12/14/2022]
Abstract
Conceptual knowledge plays a pivotal role in human cognition. Grounded cognition theories propose that concepts consist of perceptual-motor features represented in modality-specific perceptual-motor cortices. However, it is unclear whether conceptual processing consistently engages modality-specific areas. Here, we performed an activation likelihood estimation (ALE) meta-analysis across 212 neuroimaging experiments on conceptual processing related to 7 perceptual-motor modalities (action, sound, visual shape, motion, color, olfaction-gustation, and emotion). We found that conceptual processing consistently engages brain regions also activated during real perceptual-motor experience of the same modalities. In addition, we identified multimodal convergence zones that are recruited for multiple modalities. In particular, the left inferior parietal lobe (IPL) and posterior middle temporal gyrus (pMTG) are engaged for three modalities: action, motion, and sound. These "trimodal" regions are surrounded by "bimodal" regions engaged for two modalities. Our findings support a novel model of the conceptual system, according to which conceptual processing relies on a hierarchical neural architecture from modality-specific to multimodal areas up to an amodal hub.
Collapse
Affiliation(s)
- Philipp Kuhnke
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany; Wilhelm Wundt Institute for Psychology, Leipzig University, Germany.
| | - Marie C Beaupain
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany; Department of Psychology and Neurosciences, Leibniz Research Centre for Working Environment and Human Factors, Dortmund, Germany
| | - Johannes Arola
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | | | - Gesa Hartwigsen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany; Wilhelm Wundt Institute for Psychology, Leipzig University, Germany
| |
Collapse
|
10
|
Evidence for predictions established by phantom sound. Neuroimage 2022; 264:119766. [PMID: 36435344 DOI: 10.1016/j.neuroimage.2022.119766] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Revised: 08/24/2022] [Accepted: 11/22/2022] [Indexed: 11/24/2022] Open
Abstract
Predictions, the bridge between the internal and external worlds, are established by prior experience and updated by sensory stimuli. Responses to omitted but unexpected stimuli, known as omission responses, can break the one-to-one mapping of stimulus-response and can expose predictions established by the preceding stimulus built up. While research into exogenous predictions (driven by external stimuli) is often reported, that into endogenous predictions (driven by internal percepts) is rarely available in the literature. Here, we report evidence for endogenous predictions established by the Zwicker tone illusion, a phantom pure-tone-like auditory percept following notch noises. We found that MMN, P300, and theta oscillations could be recorded using an omission paradigm in subjects who can perceive Zwicker tone illusions, but could not in those who cannot. The MMN and P300 responses relied on attention, but theta oscillations did not. In-depth analysis shows that an increase in single-trial theta power, including total and induced theta, with the endogenous prediction, is lateralized to the left frontal brain areas. Our study depicts that the brain automatically analyzes internal perception, progressively establishes predictions and yields prediction errors in the left frontal region when a violation occurs.
Collapse
|
11
|
Del Casale A, Ferracuti S, Adriani B, Novelli F, Zoppi T, Bargagna P, Pompili M. Neural functional correlates of hypnosis and hypnoanalgesia: Role of the cingulate cortex. AMERICAN JOURNAL OF CLINICAL HYPNOSIS 2022; 64:53-61. [PMID: 34748460 DOI: 10.1080/00029157.2021.1895709] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
Hypnosis is a hetero-induced or self-induced altered state of consciousness that involves focused attention and reduced peripheral awareness. It is determined by response to suggestions and can be used in the management of various clinical conditions. Nowadays there is growing attention to the neurobiological correlates of hypnosis because of its future clinical applications. The greater attention is due to the wide range of applications that might stem from its knowledge. Functional neuroimaging studies show that hypnosis affects attention by modulating the activation of the anterior cingulate cortex and other brain areas, modifying the conflict monitoring and cognitive control. During hypnoanalgesia, several changes in brain functions occur in all the areas of the pain network, and other brain areas. Among these, the anterior cingulate cortex is significantly involved in modulating the activity of pain circuits under hypnosis, both in the affective, sensory-cognitive, and behavioral aspects. The study of the functionality of the cingulate cortices, mainly the anterior and medial portions, appears to be crucial for better understanding the hypnotic phenomena, related to both the neurocognitive and somatosensory aspects.
Collapse
Affiliation(s)
- Antonio Del Casale
- Sapienza University, Rome, Italy
- ‘Sant’Andrea’ University Hospital, Rome, Italy
| | - Stefano Ferracuti
- Sapienza University, Rome, Italy
- ‘Sant’Andrea’ University Hospital, Rome, Italy
| | - Barbara Adriani
- Sapienza University, Rome, Italy
- ‘Sant’Andrea’ University Hospital, Rome, Italy
| | - Francesco Novelli
- Sapienza University, Rome, Italy
- ‘Sant’Andrea’ University Hospital, Rome, Italy
| | - Teodolinda Zoppi
- Sapienza University, Rome, Italy
- ‘Sant’Andrea’ University Hospital, Rome, Italy
| | - Paride Bargagna
- Sapienza University, Rome, Italy
- ‘Sant’Andrea’ University Hospital, Rome, Italy
| | - Maurizio Pompili
- Sapienza University, Rome, Italy
- ‘Sant’Andrea’ University Hospital, Rome, Italy
| |
Collapse
|
12
|
Vuust P, Heggli OA, Friston KJ, Kringelbach ML. Music in the brain. Nat Rev Neurosci 2022; 23:287-305. [PMID: 35352057 DOI: 10.1038/s41583-022-00578-5] [Citation(s) in RCA: 101] [Impact Index Per Article: 50.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/22/2022] [Indexed: 02/06/2023]
Abstract
Music is ubiquitous across human cultures - as a source of affective and pleasurable experience, moving us both physically and emotionally - and learning to play music shapes both brain structure and brain function. Music processing in the brain - namely, the perception of melody, harmony and rhythm - has traditionally been studied as an auditory phenomenon using passive listening paradigms. However, when listening to music, we actively generate predictions about what is likely to happen next. This enactive aspect has led to a more comprehensive understanding of music processing involving brain structures implicated in action, emotion and learning. Here we review the cognitive neuroscience literature of music perception. We show that music perception, action, emotion and learning all rest on the human brain's fundamental capacity for prediction - as formulated by the predictive coding of music model. This Review elucidates how this formulation of music perception and expertise in individuals can be extended to account for the dynamics and underlying brain mechanisms of collective music making. This in turn has important implications for human creativity as evinced by music improvisation. These recent advances shed new light on what makes music meaningful from a neuroscientific perspective.
Collapse
Affiliation(s)
- Peter Vuust
- Center for Music in the Brain, Aarhus University and The Royal Academy of Music (Det Jyske Musikkonservatorium), Aarhus, Denmark.
| | - Ole A Heggli
- Center for Music in the Brain, Aarhus University and The Royal Academy of Music (Det Jyske Musikkonservatorium), Aarhus, Denmark
| | - Karl J Friston
- Wellcome Centre for Human Neuroimaging, University College London, London, UK
| | - Morten L Kringelbach
- Center for Music in the Brain, Aarhus University and The Royal Academy of Music (Det Jyske Musikkonservatorium), Aarhus, Denmark.,Department of Psychiatry, University of Oxford, Oxford, UK.,Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford, Oxford, UK
| |
Collapse
|
13
|
Chabin T, Pazart L, Gabriel D. Vocal melody and musical background are simultaneously processed by the brain for musical predictions. Ann N Y Acad Sci 2022; 1512:126-140. [PMID: 35229293 DOI: 10.1111/nyas.14755] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Accepted: 01/18/2022] [Indexed: 12/18/2022]
Abstract
Musical pleasure is related to the capacity to predict and anticipate the music. By recording early cerebral responses of 16 participants with electroencephalography during periods of silence inserted in known and unknown songs, we aimed to measure the contribution of different musical attributes to musical predictions. We investigated the mismatch between past encoded musical features and the current sensory inputs when listening to lyrics associated with vocal melody, only background instrumental material, or both attributes grouped together. When participants were listening to chords and lyrics for known songs, the brain responses related to musical violation produced event-related potential responses around 150-200 ms that were of a larger amplitude than for chords or lyrics only. Microstate analysis also revealed that for chords and lyrics, the global field power had an increased stability and a longer duration. The source localization identified that the right superior temporal and frontal gyri and the inferior and medial frontal gyri were activated for a longer time for chords and lyrics, likely caused by the increased complexity of the stimuli. We conclude that grouped together, a broader integration and retrieval of several musical attributes at the same time recruit larger neuronal networks that lead to more accurate predictions.
Collapse
Affiliation(s)
- Thibault Chabin
- Centre Hospitalier Universitaire de Besançon, Centre d'Investigation Clinique INSERM CIC 1431, Besançon, France
| | - Lionel Pazart
- Plateforme de Neuroimagerie Fonctionnelle et Neurostimulation Neuraxess, Centre Hospitalier Universitaire de Besançon, Université de Bourgogne Franche-Comté, Bourgogne Franche-Comté, France
| | - Damien Gabriel
- Laboratoire de Recherches Intégratives en Neurosciences et Psychologie Cognitive, Université Bourgogne Franche-Comté, Besançon, France
| |
Collapse
|
14
|
Marion G, Di Liberto GM, Shamma SA. The Music of Silence: Part I: Responses to Musical Imagery Encode Melodic Expectations and Acoustics. J Neurosci 2021; 41:7435-7448. [PMID: 34341155 PMCID: PMC8412990 DOI: 10.1523/jneurosci.0183-21.2021] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2021] [Revised: 06/23/2021] [Accepted: 06/28/2021] [Indexed: 02/06/2023] Open
Abstract
Musical imagery is the voluntary internal hearing of music in the mind without the need for physical action or external stimulation. Numerous studies have already revealed brain areas activated during imagery. However, it remains unclear to what extent imagined music responses preserve the detailed temporal dynamics of the acoustic stimulus envelope and, crucially, whether melodic expectations play any role in modulating responses to imagined music, as they prominently do during listening. These modulations are important as they reflect aspects of the human musical experience, such as its acquisition, engagement, and enjoyment. This study explored the nature of these modulations in imagined music based on EEG recordings from 21 professional musicians (6 females and 15 males). Regression analyses were conducted to demonstrate that imagined neural signals can be predicted accurately, similarly to the listening task, and were sufficiently robust to allow for accurate identification of the imagined musical piece from the EEG. In doing so, our results indicate that imagery and listening tasks elicited an overlapping but distinctive topography of neural responses to sound acoustics, which is in line with previous fMRI literature. Melodic expectation, however, evoked very similar frontal spatial activation in both conditions, suggesting that they are supported by the same underlying mechanisms. Finally, neural responses induced by imagery exhibited a specific transformation from the listening condition, which primarily included a relative delay and a polarity inversion of the response. This transformation demonstrates the top-down predictive nature of the expectation mechanisms arising during both listening and imagery.SIGNIFICANCE STATEMENT It is well known that the human brain is activated during musical imagery: the act of voluntarily hearing music in our mind without external stimulation. It is unclear, however, what the temporal dynamics of this activation are, as well as what musical features are precisely encoded in the neural signals. This study uses an experimental paradigm with high temporal precision to record and analyze the cortical activity during musical imagery. This study reveals that neural signals encode music acoustics and melodic expectations during both listening and imagery. Crucially, it is also found that a simple mapping based on a time-shift and a polarity inversion could robustly describe the relationship between listening and imagery signals.
Collapse
Affiliation(s)
- Guilhem Marion
- Laboratoire des Systèmes Perceptifs, Département d'Étude Cognitive, École Normale Supérieure, PSL, 75005, Paris, France
| | - Giovanni M Di Liberto
- Laboratoire des Systèmes Perceptifs, Département d'Étude Cognitive, École Normale Supérieure, PSL, 75005, Paris, France
- Trinity Centre for Biomedical Engineering, Trinity College Institute of Neuroscience, Department of Mechanical, Manufacturing and Biomedical Engineering, Trinity College, University of Dublin, D02 PN40, Dublin 2, Ireland
- School of Electrical and Electronic Engineering and UCD Centre for Biomedical Engineering, University College Dublin, D04 V1W8, Dublin 4, Ireland
| | - Shihab A Shamma
- Laboratoire des Systèmes Perceptifs, Département d'Étude Cognitive, École Normale Supérieure, PSL, 75005, Paris, France
- Institute for Systems Research, Electrical and Computer Engineering, University of Maryland, College Park, MD 20742
| |
Collapse
|
15
|
Homma NY, Bajo VM. Lemniscal Corticothalamic Feedback in Auditory Scene Analysis. Front Neurosci 2021; 15:723893. [PMID: 34489635 PMCID: PMC8417129 DOI: 10.3389/fnins.2021.723893] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2021] [Accepted: 07/30/2021] [Indexed: 12/15/2022] Open
Abstract
Sound information is transmitted from the ear to central auditory stations of the brain via several nuclei. In addition to these ascending pathways there exist descending projections that can influence the information processing at each of these nuclei. A major descending pathway in the auditory system is the feedback projection from layer VI of the primary auditory cortex (A1) to the ventral division of medial geniculate body (MGBv) in the thalamus. The corticothalamic axons have small glutamatergic terminals that can modulate thalamic processing and thalamocortical information transmission. Corticothalamic neurons also provide input to GABAergic neurons of the thalamic reticular nucleus (TRN) that receives collaterals from the ascending thalamic axons. The balance of corticothalamic and TRN inputs has been shown to refine frequency tuning, firing patterns, and gating of MGBv neurons. Therefore, the thalamus is not merely a relay stage in the chain of auditory nuclei but does participate in complex aspects of sound processing that include top-down modulations. In this review, we aim (i) to examine how lemniscal corticothalamic feedback modulates responses in MGBv neurons, and (ii) to explore how the feedback contributes to auditory scene analysis, particularly on frequency and harmonic perception. Finally, we will discuss potential implications of the role of corticothalamic feedback in music and speech perception, where precise spectral and temporal processing is essential.
Collapse
Affiliation(s)
- Natsumi Y. Homma
- Center for Integrative Neuroscience, University of California, San Francisco, San Francisco, CA, United States
- Coleman Memorial Laboratory, Department of Otolaryngology – Head and Neck Surgery, University of California, San Francisco, San Francisco, CA, United States
| | - Victoria M. Bajo
- Department of Physiology, Anatomy and Genetics, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
16
|
Teshima K, Ishida K, Nittono H. Auditory perceptual processing during musical imagery: An event-related potential study. Neurosci Lett 2021; 762:136148. [PMID: 34339803 DOI: 10.1016/j.neulet.2021.136148] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Revised: 07/25/2021] [Accepted: 07/28/2021] [Indexed: 10/20/2022]
Abstract
The perceptual processing of a sound is facilitated when the sound matches auditory imagery. Previous studies have shown that auditory imagery and actual sound activate the auditory cortex in a similar fashion. To investigate whether auditory imagery is a modality-specific representation or an amodal representation, the current study examined how watching silent music videos affected the auditory processing of sound excerpts. Twenty university students were asked to form musical imagery of Japanese popular songs while watching the official music videos. Event-related brain potentials were recorded in response to short sound excerpts from the on-screen video or from a different video. The results showed that the amplitude of the exogenous N1 component (90-110 ms) was smaller for imagery-matched than for unmatched sound excerpts. The electrical source of the difference was estimated in the auditory cortex. After the N1, the matched excerpts elicited a larger late positive potential (400-800 ms) than the unmatched excerpts. These findings suggest that auditory imagery involves modality-specific neural processing and that imagery-matched sounds are processed efficiently at an early stage, inducing additional cognitive processing at a later stage.
Collapse
Affiliation(s)
- Konomi Teshima
- Graduate School of Human Sciences, Osaka University, Japan
| | - Kai Ishida
- Graduate School of Human Sciences, Osaka University, Japan
| | | |
Collapse
|
17
|
Regev M, Halpern AR, Owen AM, Patel AD, Zatorre RJ. Mapping Specific Mental Content during Musical Imagery. Cereb Cortex 2021; 31:3622-3640. [PMID: 33749742 DOI: 10.1093/cercor/bhab036] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2020] [Revised: 02/02/2021] [Accepted: 02/05/2021] [Indexed: 11/12/2022] Open
Abstract
Humans can mentally represent auditory information without an external stimulus, but the specificity of these internal representations remains unclear. Here, we asked how similar the temporally unfolding neural representations of imagined music are compared to those during the original perceived experience. We also tested whether rhythmic motion can influence the neural representation of music during imagery as during perception. Participants first memorized six 1-min-long instrumental musical pieces with high accuracy. Functional MRI data were collected during: 1) silent imagery of melodies to the beat of a visual metronome; 2) same but while tapping to the beat; and 3) passive listening. During imagery, inter-subject correlation analysis showed that melody-specific temporal response patterns were reinstated in right associative auditory cortices. When tapping accompanied imagery, the melody-specific neural patterns were reinstated in more extensive temporal-lobe regions bilaterally. These results indicate that the specific contents of conscious experience are encoded similarly during imagery and perception in the dynamic activity of auditory cortices. Furthermore, rhythmic motion can enhance the reinstatement of neural patterns associated with the experience of complex sounds, in keeping with models of motor to sensory influences in auditory processing.
Collapse
Affiliation(s)
- Mor Regev
- Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada.,International Laboratory for Brain, Music and Sound Research, Montreal, QC H2V 2J2, Canada.,Centre for Research in Language, Brain, and Music, Montreal, QC H3A 1E3, Canada
| | - Andrea R Halpern
- Department of Psychology, Bucknell University, Lewisburg, PA 17837, USA
| | - Adrian M Owen
- Brain and Mind Institute, Department of Psychology and Department of Physiology and Pharmacology, Western University, London, ON N6A 5B7, Canada.,Canadian Institute for Advanced Research, Brain, Mind, and Consciousness program
| | - Aniruddh D Patel
- Canadian Institute for Advanced Research, Brain, Mind, and Consciousness program.,Department of Psychology, Tufts University, Medford, MA 02155, USA
| | - Robert J Zatorre
- Montreal Neurological Institute, McGill University, Montreal, QC H3A 2B4, Canada.,International Laboratory for Brain, Music and Sound Research, Montreal, QC H2V 2J2, Canada.,Centre for Research in Language, Brain, and Music, Montreal, QC H3A 1E3, Canada.,Canadian Institute for Advanced Research, Brain, Mind, and Consciousness program
| |
Collapse
|
18
|
Waters F, Barnby JM, Blom JD. Hallucination, imagery, dreaming: reassembling stimulus-independent perceptions based on Edmund Parish's classic misperception framework. Philos Trans R Soc Lond B Biol Sci 2020; 376:20190701. [PMID: 33308065 DOI: 10.1098/rstb.2019.0701] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023] Open
Abstract
Within the broad field of human perception lies the category of stimulus-independent perceptions, which draws together experiences such as hallucinations, mental imagery and dreams. Traditional divisions between medical and psychological sciences have contributed to these experiences being investigated separately. This review aims to examine their similarities and differences at the levels of phenomenology and underlying brain function and thus reassemble them within a common framework. Using Edmund Parish's historical work as a guiding tool and the latest research findings in the cognitive, clinical and computational sciences, we consider how different perspectives may be reconciled and help generate novel hypotheses for future research. This article is part of the theme issue 'Offline perception: voluntary and spontaneous perceptual experiences without matching external stimulation'.
Collapse
Affiliation(s)
- Flavie Waters
- Clinical Research Centre, Graylands Hospital, North Metropolitan Health Service-Mental Health, Perth, Western Australia, Australia.,School of Psychological Sciences, University of Western Australia, Perth, Western Australia, Australia
| | - Joseph M Barnby
- Institute of Psychiatry, Psychology and Neuroscience, King's College, London, UK
| | - Jan Dirk Blom
- Faculty of Social and Behavioural Sciences, Leiden University, Leiden, The Netherlands.,Parnassia Psychiatric Institute, The Hague, The Netherlands.,Department of Psychiatry, University of Groningen, Groningen, The Netherlands
| |
Collapse
|
19
|
Liikkanen LA, Jakubowski K. Involuntary musical imagery as a component of ordinary music cognition: A review of empirical evidence. Psychon Bull Rev 2020; 27:1195-1217. [PMID: 32583211 PMCID: PMC7704448 DOI: 10.3758/s13423-020-01750-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Involuntary musical imagery (INMI) refers to a conscious mental experience of music that occurs without deliberate efforts to initiate or sustain it. This experience often consists of the repetition of a short fragment of a melody, colloquially called an "earworm." Here, we present the first comprehensive, qualitative review of published empirical research on INMI to date. We performed an extensive literature search and discovered, in total, 47 studies from 33 peer-reviewed articles that met the inclusion criteria for the review. In analyzing the content of these studies, we identified four major research themes, which concern the phenomenology, dynamics, individual differences, and musical features of INMI. The findings answer many questions of scientific interest-for instance, what is typical in terms of INMI frequency, duration, and content; which factors influence INMI onset; and whether demographic and personality factors can explain individual differences in susceptibility and responses to INMI. This review showcases INMI as a well-established phenomenon in light of a substantial body of empirical studies that have accumulated consistent results. Although the populations under study show an unfavorable bias towards Western, educated participants, the evidence depicts INMI as a universal psychological phenomenon, the possible function of which we do not yet fully understand. The concluding section introduces several suggestions for future research to expand on the topic.
Collapse
Affiliation(s)
- Lassi A Liikkanen
- Department of Digital Humanities, University of Helsinki, Helsinki, Finland
| | | |
Collapse
|
20
|
Mori Y, Ishii K. The effect of speaker-specific auditory images on reading in Japanese. CURRENT PSYCHOLOGY 2020. [DOI: 10.1007/s12144-018-9946-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
21
|
Endestad T, Godøy RI, Sneve MH, Hagen T, Bochynska A, Laeng B. Mental Effort When Playing, Listening, and Imagining Music in One Pianist's Eyes and Brain. Front Hum Neurosci 2020; 14:576888. [PMID: 33192407 PMCID: PMC7593683 DOI: 10.3389/fnhum.2020.576888] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2020] [Accepted: 09/07/2020] [Indexed: 01/17/2023] Open
Abstract
We investigated "musical effort" with an internationally renowned, classical, pianist while playing, listening, and imagining music. We used pupillometry as an objective measure of mental effort and fMRI as an exploratory method of effort with the same musical pieces. We also compared a group of non-professional pianists and non-musicians by the use of pupillometry and a small group of non-musicians with fMRI. This combined approach of psychophysiology and neuroimaging revealed the cognitive work during different musical activities. We found that pupil diameters were largest when "playing" (regardless of whether there was sound produced or not) compared to conditions with no movement (i.e., "listening" and "imagery"). We found positive correlations between pupil diameters of the professional pianist during different conditions with the same piano piece (i.e., normal playing, silenced playing, listen, imagining), which might indicate similar degrees of load on cognitive resources as well as an intimate link between the motor imagery of sound-producing body motions and gestures. We also confirmed that musical imagery had a strong commonality with music listening in both pianists and musically naïve individuals. Neuroimaging provided evidence for a relationship between noradrenergic (NE) activity and mental workload or attentional intensity within the domain of music cognition. We found effort related activity in the superior part of the locus coeruleus (LC) and, similarly to the pupil, the listening and imagery engaged less the LC-NE network than the motor condition. The pianists attended more intensively to the most difficult piece than the non-musicians since they showed larger pupils for the most difficult piece. Non-musicians were the most engaged by the music listening task, suggesting that the amount of attention allocated for the same task may follow a hierarchy of expertise demanding less attentional effort in expert or performers than in novices. In the professional pianist, we found only weak evidence for a commonality between subjective effort (as rated measure-by-measure) and the objective effort gauged with pupil diameter during listening. We suggest that psychophysiological methods like pupillometry can index mental effort in a manner that is not available to subjective awareness or introspection.
Collapse
Affiliation(s)
- Tor Endestad
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
- Helgelandssykehuset, Mosjøen, Norway
| | - Rolf Inge Godøy
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
| | | | - Thomas Hagen
- Department of Psychology, University of Oslo, Oslo, Norway
| | - Agata Bochynska
- Department of Psychology, University of Oslo, Oslo, Norway
- Department of Psychology, New York University, New York, NY, United States
| | - Bruno Laeng
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
| |
Collapse
|
22
|
Li Y, Luo H, Tian X. Mental operations in rhythm: Motor-to-sensory transformation mediates imagined singing. PLoS Biol 2020; 18:e3000504. [PMID: 33017389 PMCID: PMC7561264 DOI: 10.1371/journal.pbio.3000504] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2019] [Revised: 10/15/2020] [Accepted: 09/01/2020] [Indexed: 11/21/2022] Open
Abstract
What enables the mental activities of thinking verbally or humming in our mind? We hypothesized that the interaction between motor and sensory systems induces speech and melodic mental representations, and this motor-to-sensory transformation forms the neural basis that enables our verbal thinking and covert singing. Analogous with the neural entrainment to auditory stimuli, participants imagined singing lyrics of well-known songs rhythmically while their neural electromagnetic signals were recorded using magnetoencephalography (MEG). We found that when participants imagined singing the same song in similar durations across trials, the delta frequency band (1–3 Hz, similar to the rhythm of the songs) showed more consistent phase coherence across trials. This neural phase tracking of imagined singing was observed in a frontal-parietal-temporal network: the proposed motor-to-sensory transformation pathway, including the inferior frontal gyrus (IFG), insula (INS), premotor area, intra-parietal sulcus (IPS), temporal-parietal junction (TPJ), primary auditory cortex (Heschl’s gyrus [HG]), and superior temporal gyrus (STG) and sulcus (STS). These results suggest that neural responses can entrain the rhythm of mental activity. Moreover, the theta-band (4–8 Hz) phase coherence was localized in the auditory cortices. The mu (9–12 Hz) and beta (17–20 Hz) bands were observed in the right-lateralized sensorimotor systems that were consistent with the singing context. The gamma band was broadly manifested in the observed network. The coherent and frequency-specific activations in the motor-to-sensory transformation network mediate the internal construction of perceptual representations and form the foundation of neural computations for mental operations. What enables our mental activities for thinking verbally or humming in our mind? Using an imagined singing paradigm with magnetoencephalography recordings, this study shows that neural oscillations in the motor-to-sensory transformation network tracked inner speech and covert singing.
Collapse
Affiliation(s)
- Yanzhu Li
- New York University Shanghai, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
| | - Huan Luo
- Peking University, Beijing, China
| | - Xing Tian
- New York University Shanghai, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai, China
- * E-mail:
| |
Collapse
|
23
|
Walking in My Shoes: Imagined Synchrony Improves Attitudes Towards Out-groups. PSYCHOLOGICAL STUDIES 2020. [DOI: 10.1007/s12646-020-00568-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
AbstractPeople are prone to dividing others into the categories of ‘us’ and ‘them’. This can be particularly detrimental to minorities who may experience social exclusion, prejudice, and reduced access to equal opportunities. One method of improving intergroup relations is to create opportunities for contact. Common contact interventions have members of different groups meet and engage in conversation. There are also non-verbal embodied intergroup activities that produce the same effects. Previous work has shown that the pro-social effects of coordination may be linked to whether co-actors are classed as in or out-group members. The current study explored whether imagining walking in synchrony with in- or out-group members changed majority members’ attitudes towards those individuals. Imagining walking in synchrony fostered greater increases in empathy and decreases in negative attitudes only towards minority group members following imagined coordination (not in-groups). Implications and future directions are discussed.
Collapse
|
24
|
Mental imagery in animals: Learning, memory, and decision-making in the face of missing information. Learn Behav 2020; 47:193-216. [PMID: 31228005 DOI: 10.3758/s13420-019-00386-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
When we open our eyes, we see a world filled with objects and events. Yet, due to occlusion of some objects by others, we only have partial perceptual access to the events that transpire around us. I discuss the body of research on mental imagery in animals. I first cover prior studies of mental rotation in pigeons and imagery using working memory procedures first developed for human studies. Next, I discuss the seminal work on a type of learning called mediated conditioning in rats. I then provide more in-depth coverage of work from my lab suggesting that rats can use imagery to fill in missing details of the world that are expected but hidden from perception. We have found that rats make use of an active expectation (i.e., an image) of a hidden visual event. I describe the behavioral and neurobiological studies investigating the use of a mental image, its theoretical basis, and its connections to current human cognitive neuroscience research on episodic memory, imagination, and mental simulations. Collectively, the reviewed literature provides insight into the mechanisms that mediate the flexible use of an image during ambiguous situations. I position this work in the broader scientific and philosophical context surrounding the concept of mental imagery in human and nonhuman animals.
Collapse
|
25
|
Mental Singing Reduces Gait Variability More Than Music Listening for Healthy Older Adults and People With Parkinson Disease. J Neurol Phys Ther 2020; 43:204-211. [PMID: 31449178 DOI: 10.1097/npt.0000000000000288] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
Abstract
BACKGROUND AND PURPOSE Previously, we showed that internal cues (such as singing) produce similar motor benefits as external cues (such as listening to music) for people with Parkinson disease (PD). This study takes that research further by exploring how singing-either aloud or mentally-at different tempos can ameliorate gait, and it offers insight into how internal cueing techniques may enhance motor performance for older adults and people with PD. METHODS Sixty participants aged 50 years and older (30 female) were recruited; 30 had PD and 30 were healthy age-matched controls. Participants completed walking trials involving internal and external cueing techniques at 90%, 100%, and 110% of preferred cadence. The effects of different cue types and rates were assessed in a repeated-measures cross-sectional study by comparing gait characteristics (velocity, cadence, stride length) and variabilities (coefficients of variation of stride length, stride time, single support time). RESULTS All participants modified their cadence and stride length during cued conditions, resulting in changes in gait velocity closely reflecting expected changes based upon cue rate. External cues resulted in increased gait variability, whereas internal cues decreased gait variability relative to uncued walking. Variability decreases were more substantial during mental singing at tempos at or above preferred cadence. DISCUSSION AND CONCLUSIONS Matching movement to one's own voice improves gait characteristics while reducing gait variability for older adults and people with PD. Optimizing the use of internal cues to facilitate movement is an important step toward more effectively meeting the needs of people with gait disorders related to aging or neurological disease.Video Abstract available for more insights from authors (see Video, Supplemental Digital Content 1, available at: http://links.lww.com/JNPT/A286).
Collapse
|
26
|
Gelding RW, Harrison PMC, Silas S, Johnson BW, Thompson WF, Müllensiefen D. An efficient and adaptive test of auditory mental imagery. PSYCHOLOGICAL RESEARCH 2020; 85:1201-1220. [PMID: 32356009 PMCID: PMC8049941 DOI: 10.1007/s00426-020-01322-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2019] [Accepted: 03/14/2020] [Indexed: 11/27/2022]
Abstract
The ability to silently hear music in the mind has been argued to be fundamental to musicality. Objective measurements of this subjective imagery experience are needed if this link between imagery ability and musicality is to be investigated. However, previous tests of musical imagery either rely on self-report, rely on melodic memory, or do not cater in range of abilities. The Pitch Imagery Arrow Task (PIAT) was designed to address these shortcomings; however, it is impractically long. In this paper, we shorten the PIAT using adaptive testing and automatic item generation. We interrogate the cognitive processes underlying the PIAT through item response modelling. The result is an efficient online test of auditory mental imagery ability (adaptive Pitch Imagery Arrow Task: aPIAT) that takes 8 min to complete, is adaptive to participant's individual ability, and so can be used to test participants with a range of musical backgrounds. Performance on the aPIAT showed positive moderate-to-strong correlations with measures of non-musical and musical working memory, self-reported musical training, and general musical sophistication. Ability on the task was best predicted by the ability to maintain and manipulate tones in mental imagery, as well as to resist perceptual biases that can lead to incorrect responses. As such, the aPIAT is the ideal tool in which to investigate the relationship between pitch imagery ability and musicality.
Collapse
Affiliation(s)
- Rebecca W. Gelding
- Department of Cognitive Science, Macquarie University, Sydney, Australia
| | - Peter M. C. Harrison
- School of Electronic Engineering and Computer Science, Queen Mary, University Of London, London, UK
- Department of Psychology, Goldsmiths, University of London, London, UK
| | - Sebastian Silas
- Department of Psychology, Goldsmiths, University of London, London, UK
| | - Blake W. Johnson
- Department of Cognitive Science, Macquarie University, Sydney, Australia
| | | | | |
Collapse
|
27
|
Fronto-temporal theta phase-synchronization underlies music-evoked pleasantness. Neuroimage 2020; 212:116665. [PMID: 32087373 DOI: 10.1016/j.neuroimage.2020.116665] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2019] [Revised: 02/12/2020] [Accepted: 02/17/2020] [Indexed: 01/08/2023] Open
Abstract
Listening to pleasant music engages a complex distributed network including pivotal areas for auditory, reward, emotional and memory processing. On the other hand, frontal theta rhythms appear to be relevant in the process of giving value to music. However, it is not clear to which extent this oscillatory mechanism underlies the brain interactions that characterize music-evoked pleasantness and its related processes. The goal of the present experiment was to study brain synchronization in this oscillatory band as a function of music-evoked pleasantness. EEG was recorded from 25 healthy subjects while they were listening to music and rating the experienced degree of induced pleasantness. By using a multilevel Bayesian approach we found that phase synchronization in the theta band between right temporal and frontal signals increased with the degree of pleasure experienced by participants. These results show that slow fronto-temporal loops play a key role in music-evoked pleasantness.
Collapse
|
28
|
Siponkoski ST, Martínez-Molina N, Kuusela L, Laitinen S, Holma M, Ahlfors M, Jordan-Kilkki P, Ala-Kauhaluoma K, Melkas S, Pekkola J, Rodriguez-Fornells A, Laine M, Ylinen A, Rantanen P, Koskinen S, Lipsanen J, Särkämö T. Music Therapy Enhances Executive Functions and Prefrontal Structural Neuroplasticity after Traumatic Brain Injury: Evidence from a Randomized Controlled Trial. J Neurotrauma 2020; 37:618-634. [DOI: 10.1089/neu.2019.6413] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023] Open
Affiliation(s)
- Sini-Tuuli Siponkoski
- Department of Psychology and Logopedics, Cognitive Brain Research Unit, University of Helsinki, Helsinki, Finland
| | - Noelia Martínez-Molina
- Department of Psychology and Logopedics, Cognitive Brain Research Unit, University of Helsinki, Helsinki, Finland
| | - Linda Kuusela
- HUS Medical Imaging Center, Department of Radiology, Helsinki Central University Hospital and University of Helsinki, Helsinki, Finland
- Department of Physics, University of Helsinki, Helsinki, Finland
| | | | - Milla Holma
- Musiikkiterapiaosuuskunta InstruMental (Music Therapy Cooperative InstruMental), Helsinki, Finland
| | | | | | - Katja Ala-Kauhaluoma
- Ludus Oy Tutkimus- ja kuntoutuspalvelut (Assessment and Intervention Services), Helsinki, Finland
| | - Susanna Melkas
- Department of Neurology and Brain Injury Outpatient Clinic, Helsinki University Central Hospital, Helsinki, Finland
| | - Johanna Pekkola
- HUS Medical Imaging Center, Department of Radiology, Helsinki Central University Hospital and University of Helsinki, Helsinki, Finland
| | - Antoni Rodriguez-Fornells
- Cognition and Brain Plasticity Group, Bellvitge Biomedical Research Institute, L'Hospitalet de Llobregat, Barcelona, Spain
- Department of Cognition, Development and Educational Psychology, University of Barcelona, Barcelona, Spain
- Catalan Institution for Research and Advanced Studies, Barcelona, Spain
| | - Matti Laine
- Department of Psychology, Åbo Akademi University, Turku, Finland
| | - Aarne Ylinen
- Department of Neurology and Brain Injury Outpatient Clinic, Helsinki University Central Hospital, Helsinki, Finland
- Tampere University Hospital, Tampere, Finland
| | | | - Sanna Koskinen
- Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland
| | - Jari Lipsanen
- Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland
| | - Teppo Särkämö
- Department of Psychology and Logopedics, Cognitive Brain Research Unit, University of Helsinki, Helsinki, Finland
| |
Collapse
|
29
|
How can we play together? Temporal inconsistencies in neural coding of music. Behav Brain Sci 2019; 42:e242. [PMID: 31775930 DOI: 10.1017/s0140525x19001298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
If sensory organs encode environment, this code must be decoded to perception. The currently dominant theory of perception - predictive coding - assumes a "Bayesian decoder," a probability function, which will present (to whom?) an optimal guess, given previous encodings of the environment - old codes testing new codes. Such a process would delay perception noticeably. This is inconsistent with the perception of music, which for several reasons must be direct.
Collapse
|
30
|
Martin S, Mikutta C, Leonard MK, Hungate D, Koelsch S, Shamma S, Chang EF, Millán JDR, Knight RT, Pasley BN. Neural Encoding of Auditory Features during Music Perception and Imagery. Cereb Cortex 2019; 28:4222-4233. [PMID: 29088345 DOI: 10.1093/cercor/bhx277] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2017] [Indexed: 11/12/2022] Open
Abstract
Despite many behavioral and neuroimaging investigations, it remains unclear how the human cortex represents spectrotemporal sound features during auditory imagery, and how this representation compares to auditory perception. To assess this, we recorded electrocorticographic signals from an epileptic patient with proficient music ability in 2 conditions. First, the participant played 2 piano pieces on an electronic piano with the sound volume of the digital keyboard on. Second, the participant replayed the same piano pieces, but without auditory feedback, and the participant was asked to imagine hearing the music in his mind. In both conditions, the sound output of the keyboard was recorded, thus allowing precise time-locking between the neural activity and the spectrotemporal content of the music imagery. This novel task design provided a unique opportunity to apply receptive field modeling techniques to quantitatively study neural encoding during auditory mental imagery. In both conditions, we built encoding models to predict high gamma neural activity (70-150 Hz) from the spectrogram representation of the recorded sound. We found robust spectrotemporal receptive fields during auditory imagery with substantial, but not complete overlap in frequency tuning and cortical location compared to receptive fields measured during auditory perception.
Collapse
Affiliation(s)
- Stephanie Martin
- Defitech Chair in Brain-Machine Interface, Center for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.,Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
| | - Christian Mikutta
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA.,Translational Research Center and Division of Clinical Research Support, Psychiatric Services University of Bern (UPD), University Hospital of Psychiatry, Bern, Switzerland.,Department of Neurology, Inselspital, Bern, University Hospital, University of Bern, Bern, Switzerland
| | - Matthew K Leonard
- Department of Neurological Surgery, Department of Physiology, and Center for Integrative Neuroscience, University of California, San Francisco, CA, USA
| | - Dylan Hungate
- Department of Neurological Surgery, Department of Physiology, and Center for Integrative Neuroscience, University of California, San Francisco, CA, USA
| | | | - Shihab Shamma
- Département d'études cognitives, École normale supérieure, PSL Research University, Paris, France.,Electrical and Computer Engineering & Institute for Systems Research, Univ. of Maryland in College Park, MD, USA
| | - Edward F Chang
- Department of Neurological Surgery, Department of Physiology, and Center for Integrative Neuroscience, University of California, San Francisco, CA, USA
| | - José Del R Millán
- Defitech Chair in Brain-Machine Interface, Center for Neuroprosthetics, Ecole Polytechnique Fe´de´rale de Lausanne, Lausanne, Switzerland
| | - Robert T Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA.,Department of Psychology, University of California, Berkeley, CA, USA
| | - Brian N Pasley
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
| |
Collapse
|
31
|
Lifshitz-Ben-Basat A, Fostick L. Music-related abilities among readers with dyslexia. ANNALS OF DYSLEXIA 2019; 69:318-334. [PMID: 31446571 DOI: 10.1007/s11881-019-00185-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/16/2019] [Accepted: 08/14/2019] [Indexed: 06/10/2023]
Abstract
Research suggests that a central difficulty in dyslexia may be impaired rapid temporal processing. Good temporal processing is also needed for musical perception, which relies on the ability to detect rapid changes. Our study is the first to measure the perception of adults with and without dyslexia on all three dimensions of music (rhythm, pitch, and spectrum), as well as their capacity for auditory imagery and detection of slow changes, while controlling for working memory. Participants were undergraduate students, aged 20-35 years: 26 readers with dyslexia and 30 typical readers. Participants completed a battery of tests measuring aptitude for recognizing the similarity/difference in tone pitch or rhythm, spectral resolution, vividness/control of auditory imagination, the ability to detect slow changes in auditory stimuli, and working memory. As expected, readers with dyslexia showed poorer performance in pitch and rhythm than controls, but outperformed them in spectral perception. The data for each test was analyzed separately while controlling for the letter-number sequencing score. No differences between groups were found in slow-change detection or auditory imagery. Our results demonstrated that rapid temporal processing appears to be the main difficulty of readers with dyslexia, who demonstrated poorer performance when stimuli were presented quickly rather than slowly and better performance on a task when no temporal component was involved. These findings underscore the need for further study of temporal processing in readers with dyslexia. Remediation of temporal processing deficits may unmask the preserved or even superior abilities of people with dyslexia, leading to enhanced ability in all areas that utilize the temporal component.
Collapse
Affiliation(s)
| | - Leah Fostick
- Department of Communication Disorders, Ariel University, Ariel, Israel
| |
Collapse
|
32
|
Neural Correlates of Music Listening and Recall in the Human Brain. J Neurosci 2019; 39:8112-8123. [PMID: 31501297 DOI: 10.1523/jneurosci.1468-18.2019] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2018] [Revised: 08/13/2019] [Accepted: 08/14/2019] [Indexed: 11/21/2022] Open
Abstract
Previous neuroimaging studies have identified various brain regions that are activated by music listening or recall. However, little is known about how these brain regions represent the time course and temporal features of music during listening and recall. Here we analyzed neural activity in different brain regions associated with music listening and recall using electrocorticography recordings obtained from 10 epilepsy patients of both genders implanted with subdural electrodes. Electrocorticography signals were recorded while subjects were listening to familiar instrumental music or recalling the same music pieces by imagery. During the onset phase (0-500 ms), music listening initiated cortical activity in high-gamma band in the temporal lobe and supramarginal gyrus, followed by the precentral gyrus and the inferior frontal gyrus. In contrast, during music recall, the high-gamma band activity first appeared in the inferior frontal gyrus and precentral gyrus, and then spread to the temporal lobe, showing a reversed temporal sequential order. During the sustained phase (after 500 ms), delta band and high-gamma band responses in the supramarginal gyrus, temporal and frontal lobes dynamically tracked the intensity envelope of the music during listening or recall with distinct temporal delays. During music listening, the neural tracking by the frontal lobe lagged behind that of the temporal lobe; whereas during music recall, the neural tracking by the frontal lobe preceded that of the temporal lobe. These findings demonstrate bottom-up and top-down processes in the cerebral cortex during music listening and recall and provide important insights into music processing by the human brain.SIGNIFICANCE STATEMENT Understanding how the brain analyzes, stores, and retrieves music remains one of the most challenging problems in neuroscience. By analyzing direct neural recordings obtained from the human brain, we observed dispersed and overlapping brain regions associated with music listening and recall. Music listening initiated cortical activity in high-gamma band starting from the temporal lobe and ending at the inferior frontal gyrus. A reversed temporal flow was observed in high-gamma response during music recall. Neural responses of frontal and temporal lobes dynamically tracked the intensity envelope of music that was presented or imagined during listening or recall. These findings demonstrate bottom-up and top-down processes in the cerebral cortex during music listening and recall.
Collapse
|
33
|
Jack BN, Le Pelley ME, Han N, Harris AW, Spencer KM, Whitford TJ. Inner speech is accompanied by a temporally-precise and content-specific corollary discharge. Neuroimage 2019; 198:170-180. [DOI: 10.1016/j.neuroimage.2019.04.038] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2019] [Accepted: 04/11/2019] [Indexed: 11/29/2022] Open
|
34
|
Dhakal K, Norgaard M, Adhikari BM, Yun KS, Dhamala M. Higher Node Activity with Less Functional Connectivity During Musical Improvisation. Brain Connect 2019; 9:296-309. [DOI: 10.1089/brain.2017.0566] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023] Open
Affiliation(s)
- Kiran Dhakal
- Department of Physics and Astronomy, Georgia State University, Atlanta, Georgia
| | | | - Bhim M. Adhikari
- Department of Physics and Astronomy, Georgia State University, Atlanta, Georgia
- Department of Psychiatry, Maryland Psychiatry Research Center, University of Maryland School of Medicine, Baltimore, Maryland
| | - Kristy S. Yun
- Department of Physics and Astronomy, Georgia State University, Atlanta, Georgia
| | - Mukesh Dhamala
- Department of Physics and Astronomy, Georgia State University, Atlanta, Georgia
- Neuroscience Institute, Georgia State University, Atlanta, Georgia
- Center for Behavioral Neuroscience, Georgia State University, Atlanta, Georgia
- Center for Nano-Optics, Georgia State University, Atlanta, Georgia
- Center for Diagnostics and Therapeutics, Georgia State University, Atlanta, Georgia
| |
Collapse
|
35
|
Unterhofer C, Buchberger AMS, Jeleff-Wölfler O, Mansour N, Graf S. Laryngeal and Pharyngeal Movements During Inner Singing: A Cross-Sectional Study. J Voice 2019; 34:807.e1-807.e9. [PMID: 30876720 DOI: 10.1016/j.jvoice.2019.02.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2018] [Revised: 02/19/2019] [Accepted: 02/19/2019] [Indexed: 11/26/2022]
Abstract
INTRODUCTION Laryngeal and pharyngeal activity during inner singing is discussed in the context of vocal hygiene. Inner singing is defined as imagined singing, reading music silently, and listening to vocal music. When vocal rest is prescribed, doctors, speech therapists, and voice pedagogues recommend avoiding listening to music or reading music silently, since it is suggested that inner singing unconsciously influences the glottis, and thus moves the vocal folds involuntarily. The aim of this study was to compare the degree to which involuntary laryngeal and/or pharyngeal activity occur during inner singing, inner speech, and at rest, and to evaluate if current recommendations concerning vocal hygiene are still reasonable. MATERIAL AND METHOD Thirty vocally healthy participants were examined transnasally with a flexible videoendoscope. The sample consisted of 10 nonsingers, 10 lay singers, and 10 professional singers. Participants were examined during five tasks including rest, silent reading, imagining a melody, listening to music, and reading music. Two medical doctors specializing in phoniatrics analyzed the videos both qualitatively and quantitatively. RESULTS During the endoscopic examination, the raters identified movements at the base of the tongue, the posterior and lateral pharynx wall, the arytenoid cartilage, and the vocal folds. The inner singing tasks showed significantly more laryngeal movements as well as significantly more glottal closures than the control tasks (at rest, silent reading). Pharyngeal structures did not show an increase in activity during inner singing. These findings were independent of the level of proficiency in singing. CONCLUSION When total vocal rest is prescribed, patients should also be advised to avoid music imagination. Still, further research is needed to survey in detail the actual effects of these involuntary movements during inner singing on the regeneration process of vocal fold healing.
Collapse
Affiliation(s)
- Carmen Unterhofer
- Department of Otorhinolaryngology/Phoniatrics, Klinikum rechts der Isar, Technical University Munich, Munich, Germany; Department of Otorhinolaryngology/Phoniatrics, Klinikum rechts der Isar, Technical University Munich, Munich, Germany.
| | - Anna Maria Stefanie Buchberger
- Department of Otorhinolaryngology/Phoniatrics, Klinikum rechts der Isar, Technical University Munich, Munich, Germany; Department of Otorhinolaryngology/Phoniatrics, Klinikum rechts der Isar, Technical University Munich, Munich, Germany
| | - Olivia Jeleff-Wölfler
- Department of Otorhinolaryngology/Phoniatrics, Klinikum rechts der Isar, Technical University Munich, Munich, Germany
| | - Naglaa Mansour
- Department of Otorhinolaryngology, Klinikum rechts der Isar, Technical University Munich, Munich, Germany
| | - Simone Graf
- Department of Otorhinolaryngology/Phoniatrics, Klinikum rechts der Isar, Technical University Munich, Munich, Germany
| |
Collapse
|
36
|
Towards reconstructing intelligible speech from the human auditory cortex. Sci Rep 2019; 9:874. [PMID: 30696881 PMCID: PMC6351601 DOI: 10.1038/s41598-018-37359-z] [Citation(s) in RCA: 88] [Impact Index Per Article: 17.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2018] [Accepted: 11/30/2018] [Indexed: 11/08/2022] Open
Abstract
Auditory stimulus reconstruction is a technique that finds the best approximation of the acoustic stimulus from the population of evoked neural activity. Reconstructing speech from the human auditory cortex creates the possibility of a speech neuroprosthetic to establish a direct communication with the brain and has been shown to be possible in both overt and covert conditions. However, the low quality of the reconstructed speech has severely limited the utility of this method for brain-computer interface (BCI) applications. To advance the state-of-the-art in speech neuroprosthesis, we combined the recent advances in deep learning with the latest innovations in speech synthesis technologies to reconstruct closed-set intelligible speech from the human auditory cortex. We investigated the dependence of reconstruction accuracy on linear and nonlinear (deep neural network) regression methods and the acoustic representation that is used as the target of reconstruction, including auditory spectrogram and speech synthesis parameters. In addition, we compared the reconstruction accuracy from low and high neural frequency ranges. Our results show that a deep neural network model that directly estimates the parameters of a speech synthesizer from all neural frequencies achieves the highest subjective and objective scores on a digit recognition task, improving the intelligibility by 65% over the baseline method which used linear regression to reconstruct the auditory spectrogram. These results demonstrate the efficacy of deep learning and speech synthesis algorithms for designing the next generation of speech BCI systems, which not only can restore communications for paralyzed patients but also have the potential to transform human-computer interaction technologies.
Collapse
|
37
|
Is imagining a voice like listening to it? Evidence from ERPs. Cognition 2019; 182:227-241. [DOI: 10.1016/j.cognition.2018.10.014] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2017] [Revised: 10/03/2018] [Accepted: 10/16/2018] [Indexed: 11/22/2022]
|
38
|
Orjuela Rojas JM, Lizarazo Rodríguez IL. The Stuck Song Syndrome: A Case of Musical Obsessions. AMERICAN JOURNAL OF CASE REPORTS 2018; 19:1329-1333. [PMID: 30401794 PMCID: PMC6233206 DOI: 10.12659/ajcr.912402] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
Patient: Female, 32 Final Diagnosis: Obsessive compulsive disorder Symptoms: Compulsive behavior • musical obsessions Medication: — Clinical Procedure: Treatment with serotonin selective reuptake inhibitors Specialty: Psychiatry
Collapse
Affiliation(s)
- Juan Manuel Orjuela Rojas
- Department of Psychiatry, Pontificia Universidad Javeriana (Pontifical Javeriana University), Bogotá, Colombia
| | | |
Collapse
|
39
|
Martin S, Iturrate I, Millán JDR, Knight RT, Pasley BN. Decoding Inner Speech Using Electrocorticography: Progress and Challenges Toward a Speech Prosthesis. Front Neurosci 2018; 12:422. [PMID: 29977189 PMCID: PMC6021529 DOI: 10.3389/fnins.2018.00422] [Citation(s) in RCA: 39] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2018] [Accepted: 06/04/2018] [Indexed: 01/01/2023] Open
Abstract
Certain brain disorders resulting from brainstem infarcts, traumatic brain injury, cerebral palsy, stroke, and amyotrophic lateral sclerosis, limit verbal communication despite the patient being fully aware. People that cannot communicate due to neurological disorders would benefit from a system that can infer internal speech directly from brain signals. In this review article, we describe the state of the art in decoding inner speech, ranging from early acoustic sound features, to higher order speech units. We focused on intracranial recordings, as this technique allows monitoring brain activity with high spatial, temporal, and spectral resolution, and therefore is a good candidate to investigate inner speech. Despite intense efforts, investigating how the human cortex encodes inner speech remains an elusive challenge, due to the lack of behavioral and observable measures. We emphasize various challenges commonly encountered when investigating inner speech decoding, and propose potential solutions in order to get closer to a natural speech assistive device.
Collapse
Affiliation(s)
- Stephanie Martin
- Defitech Chair in Brain Machine Interface, Center for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, United States
| | - Iñaki Iturrate
- Defitech Chair in Brain Machine Interface, Center for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - José del R. Millán
- Defitech Chair in Brain Machine Interface, Center for Neuroprosthetics, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Robert T. Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, United States
- Department of Psychology, University of California, Berkeley, Berkeley, CA, United States
| | - Brian N. Pasley
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA, United States
| |
Collapse
|
40
|
Joucla C, Nicolier M, Giustiniani J, Brunotte G, Noiret N, Monnin J, Magnin E, Pazart L, Moulin T, Haffen E, Vandel P, Gabriel D. Evidence for a neural signature of musical preference during silence. Int J Psychophysiol 2018; 125:50-56. [PMID: 29474854 DOI: 10.1016/j.ijpsycho.2018.02.007] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2017] [Revised: 02/16/2018] [Accepted: 02/18/2018] [Indexed: 11/18/2022]
Abstract
One of the most basic and person-specific affective responses to music is liking. The present investigation sought to determine whether liking was preserved during spontaneous auditory imagery. To this purpose, we inserted two-second silent intervals into liked and disliked songs, a method known to automatically recreate a mental image of these songs. Neural correlates of musical preference were measured by high-density electroencephalography in twenty subjects who had to listen to a set of five pre-selected unknown songs the same number of times for two weeks. Time frequency analysis of the two most liked and the two most disliked songs confirmed the presence of neural responses related to liking. At the beginning of silent intervals (400-900 ms and 1000-1300 ms), significant differences in theta activity were originating from the inferior frontal and superior temporal gyrus. These two brain structures are known to work together to process various aspects of music and are also activated when measuring liking while listening to music. At the end of silent intervals (1400-1900 ms), significant alpha activity differences originating from the insula were observed, whose exact role remains to be explored. Although exposure was controlled for liked and disliked songs, liked songs were rated as more familiar, underlying the strong relationship that exists between liking, exposure, and familiarity.
Collapse
Affiliation(s)
- Coralie Joucla
- Centre d'investigation Clinique-Innovation Technologique CIC-IT 1431, Inserm, CHRU Besançon, F-25000 Besançon, France; Neurosciences intégratives et cliniques EA 481, Univ. Franche-Comté, Univ. Bourgogne Franche-Comté, F-25000 Besançon, France
| | - Magali Nicolier
- Centre d'investigation Clinique-Innovation Technologique CIC-IT 1431, Inserm, CHRU Besançon, F-25000 Besançon, France; Neurosciences intégratives et cliniques EA 481, Univ. Franche-Comté, Univ. Bourgogne Franche-Comté, F-25000 Besançon, France; Service de psychiatrie de l'adulte, CHRU Besançon, F-25000 Besançon, France
| | - Julie Giustiniani
- Centre d'investigation Clinique-Innovation Technologique CIC-IT 1431, Inserm, CHRU Besançon, F-25000 Besançon, France; Neurosciences intégratives et cliniques EA 481, Univ. Franche-Comté, Univ. Bourgogne Franche-Comté, F-25000 Besançon, France; Service de psychiatrie de l'adulte, CHRU Besançon, F-25000 Besançon, France
| | - Gaelle Brunotte
- Centre d'investigation Clinique-Innovation Technologique CIC-IT 1431, Inserm, CHRU Besançon, F-25000 Besançon, France
| | - Nicolas Noiret
- Centre Mémoire de Ressource et de Recherche de Franche-Comté, CHRU Besançon, F-25000 Besançon, France; Laboratoire de psychologie EA 3188, Université de Franche-Comté, F-25000 Besançon, France
| | - Julie Monnin
- Centre d'investigation Clinique-Innovation Technologique CIC-IT 1431, Inserm, CHRU Besançon, F-25000 Besançon, France; Neurosciences intégratives et cliniques EA 481, Univ. Franche-Comté, Univ. Bourgogne Franche-Comté, F-25000 Besançon, France; Service de psychiatrie de l'adulte, CHRU Besançon, F-25000 Besançon, France
| | - Eloi Magnin
- Centre Mémoire de Ressource et de Recherche de Franche-Comté, CHRU Besançon, F-25000 Besançon, France; Service de neurologie, CHRU Besançon, F-25000 Besançon, France
| | - Lionel Pazart
- Centre d'investigation Clinique-Innovation Technologique CIC-IT 1431, Inserm, CHRU Besançon, F-25000 Besançon, France; Neurosciences intégratives et cliniques EA 481, Univ. Franche-Comté, Univ. Bourgogne Franche-Comté, F-25000 Besançon, France
| | - Thierry Moulin
- Centre d'investigation Clinique-Innovation Technologique CIC-IT 1431, Inserm, CHRU Besançon, F-25000 Besançon, France; Neurosciences intégratives et cliniques EA 481, Univ. Franche-Comté, Univ. Bourgogne Franche-Comté, F-25000 Besançon, France; Service de neurologie, CHRU Besançon, F-25000 Besançon, France
| | - Emmanuel Haffen
- Centre d'investigation Clinique-Innovation Technologique CIC-IT 1431, Inserm, CHRU Besançon, F-25000 Besançon, France; Neurosciences intégratives et cliniques EA 481, Univ. Franche-Comté, Univ. Bourgogne Franche-Comté, F-25000 Besançon, France; Service de psychiatrie de l'adulte, CHRU Besançon, F-25000 Besançon, France
| | - Pierre Vandel
- Centre d'investigation Clinique-Innovation Technologique CIC-IT 1431, Inserm, CHRU Besançon, F-25000 Besançon, France; Neurosciences intégratives et cliniques EA 481, Univ. Franche-Comté, Univ. Bourgogne Franche-Comté, F-25000 Besançon, France; Service de psychiatrie de l'adulte, CHRU Besançon, F-25000 Besançon, France; Centre Mémoire de Ressource et de Recherche de Franche-Comté, CHRU Besançon, F-25000 Besançon, France
| | - Damien Gabriel
- Centre d'investigation Clinique-Innovation Technologique CIC-IT 1431, Inserm, CHRU Besançon, F-25000 Besançon, France; Neurosciences intégratives et cliniques EA 481, Univ. Franche-Comté, Univ. Bourgogne Franche-Comté, F-25000 Besançon, France.
| |
Collapse
|
41
|
Choi H, Geden M, Feng J. More visual mind wandering occurrence during visual task performance: Modality of the concurrent task affects how the mind wanders. PLoS One 2017; 12:e0189667. [PMID: 29240817 PMCID: PMC5730149 DOI: 10.1371/journal.pone.0189667] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2017] [Accepted: 11/29/2017] [Indexed: 11/30/2022] Open
Abstract
Mind wandering has been considered as a mental process that is either independent from the concurrent task or regulated like a secondary task. These accounts predict that the form of mind wandering (i.e., images or words) should be either unaffected by or different from the modality form (i.e., visual or auditory) of the concurrent task. Findings from this study challenge these accounts. We measured the rate and the form of mind wandering in three task conditions: fixation, visual 2-back, and auditory 2-back. Contrary to the general expectation, we found that mind wandering was more likely in the same form as the task. This result can be interpreted in light of recent findings on overlapping brain activations during internally- and externally-oriented processes. Our result highlights the importance to consider the unique interplay between the internal and external mental processes and to measure mind wandering as a multifaceted rather than a unitary construct.
Collapse
Affiliation(s)
- HeeSun Choi
- Department of Psychology, North Carolina State University, Raleigh, North Carolina, United States of America
| | - Michael Geden
- Department of Psychology, North Carolina State University, Raleigh, North Carolina, United States of America
| | - Jing Feng
- Department of Psychology, North Carolina State University, Raleigh, North Carolina, United States of America
- * E-mail:
| |
Collapse
|
42
|
Lu J, Yang H, He H, Jeon S, Hou C, Evans AC, Yao D. The Multiple-Demand System in the Novelty of Musical Improvisation: Evidence from an MRI Study on Composers. Front Neurosci 2017; 11:695. [PMID: 29311776 PMCID: PMC5732236 DOI: 10.3389/fnins.2017.00695] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2017] [Accepted: 11/27/2017] [Indexed: 12/29/2022] Open
Abstract
The multiple-demand (MD) system has proven to be associated with creating structured mental programs in comprehensive behaviors, but the functional mechanisms of this system have not been clarified in the musical domain. In this study, we explored the hypothesis that the MD system is involved in a comprehensive music-related behavior known as musical improvisation. Under a functional magnetic resonance imaging (fMRI) paradigm, 29 composers were recruited to improvise melodies through visual imagery tasks according to familiar and unfamiliar cues. We found that the main regions of the MD system were significantly activated during both musical improvisation conditions. However, only a greater involvement of the intraparietal sulcus (IPS) within the MD system was shown when improvising with unfamiliar cues. Our results revealed that the MD system strongly participated in musical improvisation through processing the novelty of melodies, working memory, and attention. In particular, improvising with unfamiliar cues required more musical transposition manipulations. Moreover, both functional and structural analyses indicated evidence of neuroplasticity in MD regions that could be associated with musical improvisation training. These findings can help unveil the functional mechanisms of the MD system in musical cognition, as well as improve our understanding of musical improvisation.
Collapse
Affiliation(s)
- Jing Lu
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China.,Montreal Neurological Institute, McGill University, Montreal, QC, Canada.,Center for Information in BioMedicine, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Hua Yang
- Center for Information in BioMedicine, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China.,Department of Composition, Sichuan Conservatory of Music, Chengdu, China
| | - Hui He
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Seun Jeon
- Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Changyue Hou
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China
| | - Alan C Evans
- Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Dezhong Yao
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China.,Center for Information in BioMedicine, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| |
Collapse
|
43
|
Musical Imagery Involves Wernicke's Area in Bilateral and Anti-Correlated Network Interactions in Musicians. Sci Rep 2017; 7:17066. [PMID: 29213104 PMCID: PMC5719057 DOI: 10.1038/s41598-017-17178-4] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2017] [Accepted: 11/22/2017] [Indexed: 11/27/2022] Open
Abstract
Musical imagery is the human experience of imagining music without actually hearing it. The neural basis of this mental ability is unclear, especially for musicians capable of engaging in accurate and vivid musical imagery. Here, we created a visualization of an 8-minute symphony as a silent movie and used it as real-time cue for musicians to continuously imagine the music for repeated and synchronized sessions during functional magnetic resonance imaging (fMRI). The activations and networks evoked by musical imagery were compared with those elicited by the subjects directly listening to the same music. Musical imagery and musical perception resulted in overlapping activations at the anterolateral belt and Wernicke’s area, where the responses were correlated with the auditory features of the music. Whereas Wernicke’s area interacted within the intrinsic auditory network during musical perception, it was involved in much more complex networks during musical imagery, showing positive correlations with the dorsal attention network and the motor-control network and negative correlations with the default-mode network. Our results highlight the important role of Wernicke’s area in forming vivid musical imagery through bilateral and anti-correlated network interactions, challenging the conventional view of segregated and lateralized processing of music versus language.
Collapse
|
44
|
Whitford TJ, Jack BN, Pearson D, Griffiths O, Luque D, Harris AW, Spencer KM, Le Pelley ME. Neurophysiological evidence of efference copies to inner speech. eLife 2017; 6. [PMID: 29199947 PMCID: PMC5714499 DOI: 10.7554/elife.28197] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2017] [Accepted: 10/28/2017] [Indexed: 11/13/2022] Open
Abstract
Efference copies refer to internal duplicates of movement-producing neural signals. Their primary function is to predict, and often suppress, the sensory consequences of willed movements. Efference copies have been almost exclusively investigated in the context of overt movements. The current electrophysiological study employed a novel design to show that inner speech – the silent production of words in one’s mind – is also associated with an efference copy. Participants produced an inner phoneme at a precisely specified time, at which an audible phoneme was concurrently presented. The production of the inner phoneme resulted in electrophysiological suppression, but only if the content of the inner phoneme matched the content of the audible phoneme. These results demonstrate that inner speech – a purely mental action – is associated with an efference copy with detailed auditory properties. These findings suggest that inner speech may ultimately reflect a special type of overt speech. As you read this text, the chances are you can hear your own inner voice narrating the words. You may hear your inner voice again when silently considering what to have for lunch, or imagining how a phone conversation this afternoon will play out. Estimates suggest that we spend at least a quarter of our lives listening to our own inner speech. But to what extent does the brain distinguish between inner speech and the sounds we produce when we speak out loud? Listening to a recording of your own voice activates the brain more than hearing yourself speak out loud. This is because when the brain sends instructions to the lips, tongue, and vocal cords telling them to move, it also makes a copy of these instructions. This is known as an efference copy, and it enables regions of the brain that process sounds to predict what they are about to hear. When the actual sounds match those predicted – as when you hear yourself speak out loud – the brain’s sound-processing regions dampen down their responses. But does the inner speech in our heads also generate an efference copy? To find out, Whitford et al. tracked the brain activity of healthy volunteers as they listened to speech sounds through headphones. While listening to the sounds, the volunteers had to produce either the same speech sound or a different speech sound inside their heads. A specific type of brain activity decreased whenever the inner speech sound matched the external speech sound. This decrease did not occur when the two sounds were different. This suggests that the brain produces an efference copy for inner speech similar to that for external speech. These findings could ultimately benefit people who suffer from psychotic symptoms, for example as part of schizophrenia. Symptoms such as hearing voices are thought to reflect problems with producing and interpreting inner speech. The technique that Whitford et al. have developed will enable us to test this long-held but hitherto untestable idea. The results should increase our understanding of these symptoms and may eventually lead to new treatments.
Collapse
Affiliation(s)
- Thomas J Whitford
- School of Psychology, University of New South Wales (UNSW Sydney), Sydney, Australia.,Brain Dynamics Centre, Westmead Institute for Medical Research, Sydney, Australia
| | - Bradley N Jack
- School of Psychology, University of New South Wales (UNSW Sydney), Sydney, Australia.,Brain Dynamics Centre, Westmead Institute for Medical Research, Sydney, Australia
| | - Daniel Pearson
- School of Psychology, University of New South Wales (UNSW Sydney), Sydney, Australia.,Brain Dynamics Centre, Westmead Institute for Medical Research, Sydney, Australia
| | - Oren Griffiths
- School of Psychology, University of New South Wales (UNSW Sydney), Sydney, Australia.,Brain Dynamics Centre, Westmead Institute for Medical Research, Sydney, Australia
| | - David Luque
- School of Psychology, University of New South Wales (UNSW Sydney), Sydney, Australia.,Department of Basic Psychology, University of Malaga, Malaga, Spain
| | - Anthony Wf Harris
- Brain Dynamics Centre, Westmead Institute for Medical Research, Sydney, Australia.,Discipline of Psychiatry, University of Sydney, Sydney, Australia
| | - Kevin M Spencer
- Veterans Affairs Boston Healthcare System, Boston, United States.,Department of Psychiatry, Harvard Medical School, Boston, United States
| | - Mike E Le Pelley
- School of Psychology, University of New South Wales (UNSW Sydney), Sydney, Australia
| |
Collapse
|
45
|
Cross L, Atherton G, Wilson AD, Golonka S. Imagined Steps: Mental Simulation of Coordinated Rhythmic Movements Effects on Pro-sociality. Front Psychol 2017; 8:1798. [PMID: 29081761 PMCID: PMC5646020 DOI: 10.3389/fpsyg.2017.01798] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2017] [Accepted: 09/28/2017] [Indexed: 11/16/2022] Open
Abstract
Rhythmically coordinating with a partner can increase pro-sociality, but pro-sociality does not appear to change in proportion to coordination success, or particular classes of coordination. Pro-social benefits may have more to do with simply coordinating in a social context than the details of the actual coordination (Cross et al., 2016). This begs the question, how stripped down can a coordination task be and still affect pro-sociality? Would it be sufficient simply to imagine coordinating with others? Imagining a social interaction can lead to many of the same effects as actual interaction (Crisp and Turner, 2009). We report the first experiments to explore whether imagined coordination affects pro-sociality similarly to actual coordination. Across two experiments and over 450 participants, mentally simulated coordination is shown to promote some, but not all, of the pro-social consequences of actual coordination. Imagined coordination significantly increased group cohesion and de-individuation, but did not consistently affect cooperation.
Collapse
Affiliation(s)
- Liam Cross
- Psychology, School of Science, University of Buckingham, Buckingham, United Kingdom
- Department of Psychology, School of Science and Technology, Sunway University, Selangor, Malaysia
| | - Gray Atherton
- Department of Psychology, School of Science and Technology, Sunway University, Selangor, Malaysia
- Department of Psychology, Health and Learning Sciences, University of Houston, Houston, TX, United States
| | - Andrew D. Wilson
- Psychology, School of Social Sciences, Leeds Beckett University, Leeds, United Kingdom
| | - Sabrina Golonka
- Psychology, School of Social Sciences, Leeds Beckett University, Leeds, United Kingdom
| |
Collapse
|
46
|
Christensen JF, Cela-Conde CJ, Gomila A. Not all about sex: neural and biobehavioral functions of human dance. Ann N Y Acad Sci 2017; 1400:8-32. [PMID: 28787539 DOI: 10.1111/nyas.13420] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2017] [Revised: 04/23/2017] [Accepted: 05/31/2017] [Indexed: 12/15/2022]
Abstract
This paper provides an integrative review of neuroscientific and biobehavioral evidence about the effects of dance on the individual across cultural differences. Dance moves us, and many derive aesthetic pleasure from it. However, in addition-and beyond aesthetics-we propose that dance has noteworthy, deeper neurobiological effects. We first summarize evidence that illustrates the centrality of dance to human life indirectly from archaeology, comparative psychology, developmental psychology, and cross-cultural psychology. Second, we review empirical evidence for six neural and biobehavioral functions of dance: (1) attentional focus/flow, (2) basic emotional experiences, (3) imagery, (4) communication, (5) self-intimation, and (6) social cohesion. We discuss the reviewed evidence in relation to current debates in the field of empirical enquiry into the functions of human dance, questioning the positions that dance is (1) just for pleasure, (2) all about sex, (3) just for mood management and well-being, and (4) for experts only. Being a young field, evidence is still piecemeal and inconclusive. This review aims to take a step toward a systematization of an emerging avenue of research: a neuro- and biobehavioral science of dance.
Collapse
Affiliation(s)
- Julia F Christensen
- Cognitive Neuroscience Research Unit, Department of Psychology, School of Arts and Social Sciences, City, University of London, London, United Kingdom.,Autism Research Group, Department of Psychology, City, University of London, London, United Kingdom
| | - Camilo José Cela-Conde
- Department of Ecology and Evolutionary Biology, University of California Irvine, Irvine, California
| | - Antoni Gomila
- Department of Psychology, University of the Balearic Islands, Palma, Spain
| |
Collapse
|
47
|
Bensafi M, Fournel A, Joussain P, Poncelet J, Przybylski L, Rouby C, Tillmann B. Expertise shapes domain-specific functional cerebral asymmetry during mental imagery: the case of culinary arts and music. Eur J Neurosci 2017; 45:1524-1537. [PMID: 28449277 DOI: 10.1111/ejn.13596] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2014] [Revised: 04/20/2017] [Accepted: 04/22/2017] [Indexed: 11/29/2022]
Abstract
Mental imagery in experts has been documented in visual arts, music and dance. Here, we examined this issue in an understudied art domain, namely, culinary arts. Previous research investigating mental imagery in experts has reported either a stronger involvement of the right hemisphere or bilateral brain activation. The first aim of our study was to examine whether culinary arts also recruit such a hemispheric pattern specifically during odor mental imagery. In a second aim, we investigated whether expertise effects observed in a given sensory domain transfer to another modality. We combined psychophysics and neurophysiology to study mental imagery in cooks, musicians and controls. We collected response times and event-related potentials (ERP) while participants mentally compared the odor of fruits, the timbre of musical instruments and the size of fruits, musical instruments and manufactured objects. Cooks were faster in imagining fruit odors, and musicians were faster in imagining the timbre of musical instruments. These differences were not observed in control participants. This expertise effect was reflected in the ERP late positive complex (LPC): only experts showed symmetric bilateral activation, specifically when cooks imagined odors and when musicians imagined timbres. In contrast, the LPC was significantly greater in the left hemisphere than in the right hemisphere for non-expert participants in all conditions. These findings suggest that sensory expertise does not involve transfer of mental imagery ability across modalities and highlight for the first time that olfactory expertise in cooks induces a balance of activations between hemispheres as does musical expertise in musicians.
Collapse
Affiliation(s)
- Moustafa Bensafi
- CNRS UMR5292, INSERM U1028, Lyon Neuroscience Research Center, Université Claude Bernard, Lyon, University Lyon, 50 Avenue Tony Garnier, F-69366, Lyon, France
| | - Arnaud Fournel
- CNRS UMR5292, INSERM U1028, Lyon Neuroscience Research Center, Université Claude Bernard, Lyon, University Lyon, 50 Avenue Tony Garnier, F-69366, Lyon, France
| | - Pauline Joussain
- CNRS UMR5292, INSERM U1028, Lyon Neuroscience Research Center, Université Claude Bernard, Lyon, University Lyon, 50 Avenue Tony Garnier, F-69366, Lyon, France
| | - Johan Poncelet
- CNRS UMR5292, INSERM U1028, Lyon Neuroscience Research Center, Université Claude Bernard, Lyon, University Lyon, 50 Avenue Tony Garnier, F-69366, Lyon, France
| | - Lauranne Przybylski
- CNRS UMR5292, INSERM U1028, Lyon Neuroscience Research Center, Université Claude Bernard, Lyon, University Lyon, 50 Avenue Tony Garnier, F-69366, Lyon, France
| | - Catherine Rouby
- CNRS UMR5292, INSERM U1028, Lyon Neuroscience Research Center, Université Claude Bernard, Lyon, University Lyon, 50 Avenue Tony Garnier, F-69366, Lyon, France
| | - Barbara Tillmann
- CNRS UMR5292, INSERM U1028, Lyon Neuroscience Research Center, Université Claude Bernard, Lyon, University Lyon, 50 Avenue Tony Garnier, F-69366, Lyon, France
| |
Collapse
|
48
|
Projecting the self outside the body: Body representations underlying proprioceptive imagery. Cognition 2017; 162:41-47. [DOI: 10.1016/j.cognition.2017.01.021] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2016] [Revised: 01/27/2017] [Accepted: 01/31/2017] [Indexed: 01/01/2023]
|
49
|
BOŞNAK MEHMET, KURT AKİFHAKAN, YAMAN SELMA. BEYNİMİZİN MÜZİK FİZYOLOJİSİ. KAHRAMANMARAŞ SÜTÇÜ İMAM ÜNIVERSITESI TIP FAKÜLTESI DERGISI 2017. [DOI: 10.17517/ksutfd.296621] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022] Open
|
50
|
Abstract
Functional brain imaging has revealed much about the neuroanatomical substrates of higher cognition, including music, language, learning, and memory. The technique lends itself to studying of groups of individuals. In contrast, the nature of expert performance is typically studied through the examination of exceptional individuals using behavioral case studies and retrospective biography. Here, we combined fMRI and the study of an individual who is a world-class expert musician and composer in order to better understand the neural underpinnings of his music perception and cognition, in particular, his mental representations for music. We used state of the art multivoxel pattern analysis (MVPA) and representational dissimilarity analysis (RDA) in a fixed set of brain regions to test three exploratory hypotheses with the musician Sting: (1) Composing would recruit neutral structures that are both unique and distinguishable from other creative acts, such as composing prose or visual art; (2) listening and imagining music would recruit similar neural regions, indicating that musical memory shares anatomical substrates with music listening; (3) the MVPA and RDA results would help us to map the representational space for music, revealing which musical pieces and genres are perceived to be similar in the musician's mental models for music. Our hypotheses were confirmed. The act of composing, and even of imagining elements of the composed piece separately, such as melody and rhythm, activated a similar cluster of brain regions, and were distinct from prose and visual art. Listened and imagined music showed high similarity, and in addition, notable similarity/dissimilarity patterns emerged among the various pieces used as stimuli: Muzak and Top 100/Pop songs were far from all other musical styles in Mahalanobis distance (Euclidean representational space), whereas jazz, R&B, tango and rock were comparatively close. Closer inspection revealed principaled explanations for the similarity clusters found, based on key, tempo, motif, and orchestration.
Collapse
Affiliation(s)
- Daniel J Levitin
- a Department of Psychology , McGill University , Montreal , Canada
| | - Scott T Grafton
- b Department of Psychological and Brain Sciences , University of California at Santa Barbara , Santa Barbara , CA , USA
| |
Collapse
|