1
|
Craighero L, Granziol U, Sartori L. Digital Intentions in the Fingers: I Know What You Are Doing with Your Smartphone. Brain Sci 2023; 13:1418. [PMID: 37891787 PMCID: PMC10605869 DOI: 10.3390/brainsci13101418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2023] [Revised: 09/28/2023] [Accepted: 09/29/2023] [Indexed: 10/29/2023] Open
Abstract
Every day, we make thousands of finger movements on the touchscreen of our smartphones. The same movements might be directed at various distal goals. We can type "What is the weather in Rome?" in Google to acquire information from a weather site, or we may type it on WhatsApp to decide whether to visit Rome with a friend. In this study, we show that by watching an agent's typing hands, an observer can infer whether the agent is typing on the smartphone to obtain information or to share it with others. The probability of answering correctly varies with age and typing style. According to embodied cognition, we propose that the recognition process relies on detecting subtle differences in the agent's movement, a skill that grows with sensorimotor competence. We expect that this preliminary work will serve as a starting point for further research on sensorimotor representations of digital actions.
Collapse
Affiliation(s)
- Laila Craighero
- Department of Neuroscience and Rehabilitation, University of Ferrara, via Fossato di Mortara 19, 44121 Ferrara, Italy
| | - Umberto Granziol
- Department of General Psychology, University of Padova, 35131 Padova, Italy
| | - Luisa Sartori
- Department of General Psychology, University of Padova, 35131 Padova, Italy
| |
Collapse
|
2
|
Agapaki M, Pinkerton EA, Papatzikis E. Music and neuroscience research for mental health, cognition, and development: Ways forward. Front Psychol 2022; 13:976883. [PMID: 36092029 PMCID: PMC9453743 DOI: 10.3389/fpsyg.2022.976883] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Accepted: 08/02/2022] [Indexed: 11/13/2022] Open
Affiliation(s)
- Maria Agapaki
- Department of Early Childhood Education and Care, Oslo Metropolitan University, Oslo, Norway
| | | | - Efthymios Papatzikis
- Department of Early Childhood Education and Care, Oslo Metropolitan University, Oslo, Norway
- *Correspondence: Efthymios Papatzikis
| |
Collapse
|
3
|
Abstract
Ten years ago, Perspectives in Psychological Science published the Mirror Neuron Forum, in which authors debated the role of mirror neurons in action understanding, speech, imitation, and autism and asked whether mirror neurons are acquired through visual-motor learning. Subsequent research on these themes has made significant advances, which should encourage further, more systematic research. For action understanding, multivoxel pattern analysis, patient studies, and brain stimulation suggest that mirror-neuron brain areas contribute to low-level processing of observed actions (e.g., distinguishing types of grip) but not to high-level action interpretation (e.g., inferring actors’ intentions). In the area of speech perception, although it remains unclear whether mirror neurons play a specific, causal role in speech perception, there is compelling evidence for the involvement of the motor system in the discrimination of speech in perceptually noisy conditions. For imitation, there is strong evidence from patient, brain-stimulation, and brain-imaging studies that mirror-neuron brain areas play a causal role in copying of body movement topography. In the area of autism, studies using behavioral and neurological measures have tried and failed to find evidence supporting the “broken-mirror theory” of autism. Furthermore, research on the origin of mirror neurons has confirmed the importance of domain-general visual-motor associative learning rather than canalized visual-motor learning, or motor learning alone.
Collapse
Affiliation(s)
- Cecilia Heyes
- All Souls College, University of Oxford.,Department of Experimental Psychology, University of Oxford
| | - Caroline Catmur
- Department of Psychology, Institute of Psychiatry, Psychology, and Neuroscience, King's College London
| |
Collapse
|
4
|
Hansen NC, Reymore L. Articulatory motor planning and timbral idiosyncrasies as underlying mechanisms of instrument-specific absolute pitch in expert musicians. PLoS One 2021; 16:e0247136. [PMID: 33606800 PMCID: PMC7894932 DOI: 10.1371/journal.pone.0247136] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Accepted: 02/01/2021] [Indexed: 11/19/2022] Open
Abstract
The study of musical expertise illustrates how intense training in a specialized domain may instigate development of implicit skills. While absolute pitch, or the ability to identify musical pitches without external reference, is rare even in professional musicians and is understood to have a genetic component, anecdotal evidence and pilot data suggest that some musicians without traditional absolute pitch are nonetheless better able to name notes played on their musical instrument of expertise than notes played on less familiar instruments. We have previously termed this particular gain in absolute pitch identification ability “instrument-specific absolute pitch” (ISAP) and have proposed that this skill is related to learned instrument type-specific timbral and intonational idiosyncrasies and articulatory motor planning activated by the timbre of the instrument. In this Registered Report Protocol, we describe two experiments designed to investigate ISAP in professional oboists. Experiment 1 tests for ISAP ability by comparing oboists’ pitch identification accuracies for notes played on the oboe and on the piano. A subset of the participants from Experiment 1 who demonstrate this ability will be recruited for Experiment 2; the purpose of Experiment 2 is to test hypotheses concerning a mechanistic explanation for ISAP. The outcome of these experiments may provide support for the theory that some individuals have ISAP and that the underlying mechanisms of this ability may rely on the perception of subtle timbral/intonational idiosyncrasies and on articulatory motor planning developed through intensive long-term training. In general, this work will contribute to the understanding of specialized expertise, specifically of implicit abilities and biases that are not addressed directly in training, but that may yet develop through practice of a related skill set.
Collapse
Affiliation(s)
- Niels Chr. Hansen
- Aarhus Institute of Advanced Studies, Aarhus University, Aarhus, Denmark
- Center for Music in the Brain, Aarhus University & Royal Academy of Music Aarhus-Aalborg, Aarhus, Denmark
- * E-mail:
| | - Lindsey Reymore
- Schulich School of Music, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
5
|
Martín-Fernández J, Burunat I, Modroño C, González-Mora JL, Plata-Bello J. Music Style Not Only Modulates the Auditory Cortex, but Also Motor Related Areas. Neuroscience 2021; 457:88-102. [PMID: 33465413 DOI: 10.1016/j.neuroscience.2021.01.012] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2020] [Revised: 12/25/2020] [Accepted: 01/10/2021] [Indexed: 10/22/2022]
Abstract
The neuroscience of music has recently attracted significant attention, but the effect of music style on the activation of auditory-motor regions has not been explored. The aim of the present study is to analyze the differences in brain activity during passive listening to non-vocal excerpts of four different music genres (classical, reggaeton, electronic and folk). A functional magnetic resonance imaging (fMRI) experiment was performed. Twenty-eight participants with no musical training were included in the study. They had to passively listen to music excerpts of the above genres during fMRI acquisition. Imaging analysis was performed at the whole-brain-level and in auditory-motor regions of interest (ROIs). Furthermore, the musical competence of each participant was measured and its relationship with brain activity in the studied ROIs was analyzed. The whole brain analysis showed higher brain activity during reggaeton listening than the other music genres in auditory-related areas. The ROI-analysis showed that reggaeton led to higher activity not only in auditory related areas, but also in some motor related areas, mainly when it was compared with classical music. A positive relationship between the melodic-Music Ear Test (MET) score and brain activity during reggaeton listening was identified in some auditory and motor related areas. The findings revealed that listening to different music styles in musically inexperienced subjects elicits different brain activity in auditory and motor related areas. Reggaeton was, among the studied music genres, the one that evoked the highest activity in the auditory-motor network. These findings are discussed in connection with acoustic analyses of the musical stimuli.
Collapse
Affiliation(s)
- Jesús Martín-Fernández
- Hospital Universitario Nuestra Señora de La Candelaria (Department of Neurosurgery), Spain
| | - Iballa Burunat
- Finnish Centre for Interdisciplinary Music Research, Department of Music, Art and Culture Studies, University of Jyväskylä, Finland
| | - Cristián Modroño
- University of La Laguna (Department of Basic Medical Sciences), Spain
| | | | - Julio Plata-Bello
- Hospital Universitario de Canarias (Department of Neurosurgery), Spain.
| |
Collapse
|
6
|
Reymore L, Hansen NC. A Theory of Instrument-Specific Absolute Pitch. Front Psychol 2020; 11:560877. [PMID: 33192828 PMCID: PMC7642881 DOI: 10.3389/fpsyg.2020.560877] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2020] [Accepted: 09/24/2020] [Indexed: 12/21/2022] Open
Abstract
While absolute pitch (AP)—the ability to name musical pitches globally and without reference—is rare in expert musicians, anecdotal evidence suggests that some musicians may better identify pitches played on their primary instrument than pitches played on other instruments. We call this phenomenon “instrument-specific absolute pitch” (ISAP). In this paper we present a theory of ISAP. Specifically, we offer the hypothesis that some expert musicians without global AP may be able to more accurately identify pitches played on their primary instrument(s), and we propose timbral cues and articulatory motor imagery as two underlying mechanisms. Depending on whether informative timbral cues arise from performer- or instrument-specific idiosyncrasies or from timbre-facilitated tonotopic representations, we predict that performance may be enhanced for notes played by oneself, notes played on one’s own personal instrument, and/or notes played on any exemplar of one’s own instrument type. Sounds of one’s primary instrument may moreover activate kinesthetic memory and motor imagery, aiding pitch identification. In order to demonstrate how our theory can be tested, we report the methodology and analysis of two exemplary experiments conducted on two case-study participants who are professional oboists. The aim of the first experiment was to determine whether the oboists demonstrated ISAP ability, while the purpose of the second experiment was to provide a preliminary investigation of the underlying mechanisms. The results of the first experiment revealed that only one of the two oboists showed an advantage for identifying oboe tones over piano tones. For this oboist demonstrating ISAP, the second experiment demonstrated that pitch-naming accuracy decreased and variance around the correct pitch value increased as an effect of transposition and motor interference, but not of instrument or performer. These preliminary data suggest that some musicians possess ISAP while others do not. Timbral cues and motor imagery may both play roles in the acquisition of this ability. Based on our case study findings, we provide methodological considerations and recommendations for future empirical testing of our theory of ISAP.
Collapse
Affiliation(s)
- Lindsey Reymore
- School of Music, The Ohio State University, Columbus, OH, United States.,Schulich School of Music, McGill University, Montréal, QC, Canada
| | - Niels Chr Hansen
- Aarhus Institute of Advanced Studies, Aarhus University, Aarhus, Denmark.,Center for Music in the Brain, Aarhus University, Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| |
Collapse
|
7
|
Izbicki P, Zaman A, Stegemöller EL. Music Form but Not Music Experience Modulates Motor Cortical Activity in Response to Novel Music. Front Hum Neurosci 2020; 14:127. [PMID: 32372932 PMCID: PMC7179827 DOI: 10.3389/fnhum.2020.00127] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2019] [Accepted: 03/19/2020] [Indexed: 12/03/2022] Open
Abstract
External cues, such as music, improve movement performance in persons with Parkinson’s disease. However, research examining the motor cortical mechanisms by which this occurs is lacking. Research using electroencephalography in healthy young adults has revealed that moving to music can modulate motor cortical activity. Moreover, motor cortical activity is further influenced by music experience. It remains unknown whether these effects extend to corticomotor excitability. Therefore, the primary aim of this study was to determine the effects of novel music on corticomotor excitability using transcranial magnetic stimulation (TMS) in a pilot study of healthy young adults. A secondary aim of this study was to determine the influence of music experience on corticomotor excitability. We hypothesized that corticomotor excitability will change during music conditions, and that it will differ in those with formal music training. Motor evoked potentials (MEPs) were recorded from the first dorsal interosseous using single-pulse TMS in three conditions: (1) No Music, (2) Music Condition I, and (3) Music Condition II. Both pieces were set to novel MIDI piano instrumentation and part-writing conventions typical of early nineteenth-century Western classical practices. Results revealed Music Condition II (i.e., more relaxing music) compared to rest increased MEP amplitude (i.e., corticomotor excitability). Music Condition II as compared to Music Condition I (i.e., more activating music) reduced MEP variability (i.e., corticomotor variability). Finally, years of formal music training did not significantly influence corticomotor excitability while listening to music. Overall, results revealed that unfamiliar music modulates motor cortical excitability but is dependent upon the form of music and possibly music preference. These results will be used to inform planned studies in healthy older adults and people with Parkinson’s disease.
Collapse
Affiliation(s)
- Patricia Izbicki
- Department of Kinesiology, Iowa State University, Ames, IA, United States
| | - Andrew Zaman
- Department of Kinesiology, Iowa State University, Ames, IA, United States
| | | |
Collapse
|
8
|
Burgess JD, Major BP, McNeel C, Clark GM, Lum JAG, Enticott PG. Learning to Expect: Predicting Sounds During Movement Is Related to Sensorimotor Association During Listening. Front Hum Neurosci 2019; 13:215. [PMID: 31333431 PMCID: PMC6624421 DOI: 10.3389/fnhum.2019.00215] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2018] [Accepted: 06/11/2019] [Indexed: 11/13/2022] Open
Abstract
Sensory experiences, such as sound, often result from our motor actions. Over time, repeated sound-producing performance can generate sensorimotor associations. However, it is not clear how sensory and motor information are associated. Here, we explore if sensory prediction is associated with the formation of sensorimotor associations during a learning task. We recorded event-related potentials (ERPs) while participants produced index and little finger-swipes on a bespoke device, generating novel sounds. ERPs were also obtained as participants heard those sounds played back. Peak suppression was compared to assess sensory prediction. Additionally, transcranial magnetic stimulation (TMS) was used during listening to generate finger-motor evoked potentials (MEPs). MEPs were recorded before and after training upon hearing these sounds, and then compared to reveal sensorimotor associations. Finally, we explored the relationship between these components. Results demonstrated that an increased positive-going peak (e.g., P2) and a suppressed negative-going peak (e.g., N2) were recorded during action, revealing some sensory prediction outcomes (P2: p = 0.050, ηp2 = 0.208; N2: p = 0.001, ηp2 = 0.474). Increased MEPs were also observed upon hearing congruent sounds compared with incongruent sounds (i.e., associated to a finger), demonstrating precise sensorimotor associations that were not present before learning (Index finger: p < 0.001, ηp2 = 0.614; Little finger: p < 0.001, ηp2 = 0.529). Consistent with our broad hypotheses, a negative association between the MEPs in one finger during listening and ERPs during performance of the other was observed (Index finger MEPs and Fz N1 action ERPs; r = −0.655, p = 0.003). Overall, data suggest that predictive mechanisms are associated with the fine-tuning of sensorimotor associations.
Collapse
Affiliation(s)
- Jed D Burgess
- Cognitive Neuroscience Unit, School of Psychology, Deakin University, Geelong, VIC, Australia
| | - Brendan P Major
- Cognitive Neuroscience Unit, School of Psychology, Deakin University, Geelong, VIC, Australia
| | - Claire McNeel
- Cognitive Neuroscience Unit, School of Psychology, Deakin University, Geelong, VIC, Australia
| | - Gillian M Clark
- Cognitive Neuroscience Unit, School of Psychology, Deakin University, Geelong, VIC, Australia
| | - Jarrad A G Lum
- Cognitive Neuroscience Unit, School of Psychology, Deakin University, Geelong, VIC, Australia
| | - Peter G Enticott
- Cognitive Neuroscience Unit, School of Psychology, Deakin University, Geelong, VIC, Australia
| |
Collapse
|
9
|
Furuya S, Furukawa Y, Uehara K, Oku T. Probing sensorimotor integration during musical performance. Ann N Y Acad Sci 2018; 1423:211-218. [PMID: 29524356 DOI: 10.1111/nyas.13619] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2017] [Revised: 12/29/2017] [Accepted: 01/05/2018] [Indexed: 11/29/2022]
Abstract
An integration of afferent sensory information from the visual, auditory, and proprioceptive systems into execution and update of motor programs plays crucial roles in control and acquisition of skillful sequential movements in musical performance. However, conventional behavioral and neurophysiological techniques that have been applied to study simplistic motor behaviors limit elucidating online sensorimotor integration processes underlying skillful musical performance. Here, we propose two novel techniques that were developed to investigate the roles of auditory and proprioceptive feedback in piano performance. First, a closed-loop noninvasive brain stimulation system that consists of transcranial magnetic stimulation, a motion sensor, and a microcomputer enabled to assess time-varying cortical processes subserving auditory-motor integration during piano playing. Second, a force-field system capable of manipulating the weight of a piano key allowed for characterizing movement adaptation based on the feedback obtained, which can shed light on the formation of an internal representation of the piano. Results of neurophysiological and psychophysics experiments provided evidence validating these systems as effective means for disentangling computational and neural processes of sensorimotor integration in musical performance.
Collapse
Affiliation(s)
- Shinichi Furuya
- Sony Computer Science Laboratories Inc. (Sony CSL), Tokyo, Japan
- Musical Skill and Injury Center, Sophia University, Tokyo, Japan
| | - Yuta Furukawa
- Musical Skill and Injury Center, Sophia University, Tokyo, Japan
| | - Kazumasa Uehara
- Musical Skill and Injury Center, Sophia University, Tokyo, Japan
- School of Biological and Health Systems Engineering, Arizona State University, Tempe, Arizona
| | - Takanori Oku
- Sony Computer Science Laboratories Inc. (Sony CSL), Tokyo, Japan
- Musical Skill and Injury Center, Sophia University, Tokyo, Japan
| |
Collapse
|