1
|
Thoret E, Aramaki M, Bringoux L, Ystad S, Kronland-Martinet R. Hearing elliptic movements reveals the imprint of action on prototypical geometries. Cognition 2023; 238:105478. [PMID: 37196381 DOI: 10.1016/j.cognition.2023.105478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 05/01/2023] [Accepted: 05/02/2023] [Indexed: 05/19/2023]
Abstract
Within certain categories of geometric shapes, prototypical exemplars that best characterize the category have been evidenced. These geometric prototypes are classically identified through the visual and haptic perception or motor production and are usually characterized by their spatial dimension. However, whether prototypes can be recalled through the auditory channel has not been formally investigated. Here we address this question by using auditory cues issued from timbre-modulated friction sounds evoking human drawing elliptic movements. Since non-spatial auditory cues were previously found useful for discriminating distinct geometric shapes such as circles or ellipses, it is hypothesized that sound dynamics alone can evoke shapes such as an exemplary ellipse. Four experiments were conducted and altogether revealed that a common elliptic prototype emerges from auditory, visual, and motor modalities. This finding supports the hypothesis of a common coding of geometric shapes according to biological rules with a prominent role of sensory-motor contingencies in the emergence of such prototypical geometry.
Collapse
Affiliation(s)
- Etienne Thoret
- Aix Marseille Univ, CNRS, UMR7061 Perception Representations Image Sound Music (PRISM), Marseille, France; Institute of Language, Communication & the Brain, Marseille, France.
| | - Mitsuko Aramaki
- Aix Marseille Univ, CNRS, UMR7061 Perception Representations Image Sound Music (PRISM), Marseille, France
| | - Lionel Bringoux
- Aix Marseille Univ, CNRS, UMR7287 Institut des Sciences du Mouvement (ISM), Marseille, France
| | - Sølvi Ystad
- Aix Marseille Univ, CNRS, UMR7061 Perception Representations Image Sound Music (PRISM), Marseille, France
| | - Richard Kronland-Martinet
- Aix Marseille Univ, CNRS, UMR7061 Perception Representations Image Sound Music (PRISM), Marseille, France
| |
Collapse
|
2
|
Torricelli F, Tomassini A, Pezzulo G, Pozzo T, Fadiga L, D'Ausilio A. Motor invariants in action execution and perception. Phys Life Rev 2023; 44:13-47. [PMID: 36462345 DOI: 10.1016/j.plrev.2022.11.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Accepted: 11/21/2022] [Indexed: 11/27/2022]
Abstract
The nervous system is sensitive to statistical regularities of the external world and forms internal models of these regularities to predict environmental dynamics. Given the inherently social nature of human behavior, being capable of building reliable predictive models of others' actions may be essential for successful interaction. While social prediction might seem to be a daunting task, the study of human motor control has accumulated ample evidence that our movements follow a series of kinematic invariants, which can be used by observers to reduce their uncertainty during social exchanges. Here, we provide an overview of the most salient regularities that shape biological motion, examine the role of these invariants in recognizing others' actions, and speculate that anchoring socially-relevant perceptual decisions to such kinematic invariants provides a key computational advantage for inferring conspecifics' goals and intentions.
Collapse
Affiliation(s)
- Francesco Torricelli
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Alice Tomassini
- Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Via San Martino della Battaglia 44, 00185 Rome, Italy
| | - Thierry Pozzo
- Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; INSERM UMR1093-CAPS, UFR des Sciences du Sport, Université Bourgogne Franche-Comté, F-21000, Dijon, France
| | - Luciano Fadiga
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Alessandro D'Ausilio
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy.
| |
Collapse
|
3
|
Thoret E, Aramaki M, Bringoux L, Ystad S, Kronland-Martinet R. Seeing Circles and Drawing Ellipses: When Sound Biases Reproduction of Visual Motion. PLoS One 2016; 11:e0154475. [PMID: 27119411 PMCID: PMC4847762 DOI: 10.1371/journal.pone.0154475] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2015] [Accepted: 04/14/2016] [Indexed: 11/29/2022] Open
Abstract
The perception and production of biological movements is characterized by the 1/3 power law, a relation linking the curvature and the velocity of an intended action. In particular, motions are perceived and reproduced distorted when their kinematics deviate from this biological law. Whereas most studies dealing with this perceptual-motor relation focused on visual or kinaesthetic modalities in a unimodal context, in this paper we show that auditory dynamics strikingly biases visuomotor processes. Biologically consistent or inconsistent circular visual motions were used in combination with circular or elliptical auditory motions. Auditory motions were synthesized friction sounds mimicking those produced by the friction of the pen on a paper when someone is drawing. Sounds were presented diotically and the auditory motion velocity was evoked through the friction sound timbre variations without any spatial cues. Remarkably, when subjects were asked to reproduce circular visual motion while listening to sounds that evoked elliptical kinematics without seeing their hand, they drew elliptical shapes. Moreover, distortion induced by inconsistent elliptical kinematics in both visual and auditory modalities added up linearly. These results bring to light the substantial role of auditory dynamics in the visuo-motor coupling in a multisensory context.
Collapse
Affiliation(s)
- Etienne Thoret
- Laboratoire de Mécanique et d’Acoustique, CNRS, UPR 7051, Aix Marseille Université, Centrale Marseille, Marseille, France
- * E-mail:
| | - Mitsuko Aramaki
- Laboratoire de Mécanique et d’Acoustique, CNRS, UPR 7051, Aix Marseille Université, Centrale Marseille, Marseille, France
| | - Lionel Bringoux
- Aix-Marseille Université, CNRS, ISM, UMR 7287, Marseille, France
| | - Sølvi Ystad
- Laboratoire de Mécanique et d’Acoustique, CNRS, UPR 7051, Aix Marseille Université, Centrale Marseille, Marseille, France
| | - Richard Kronland-Martinet
- Laboratoire de Mécanique et d’Acoustique, CNRS, UPR 7051, Aix Marseille Université, Centrale Marseille, Marseille, France
| |
Collapse
|