1
|
Proietti R, Pezzulo G, Tessari A. An active inference model of hierarchical action understanding, learning and imitation. Phys Life Rev 2023; 46:92-118. [PMID: 37354642 DOI: 10.1016/j.plrev.2023.05.012] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Accepted: 05/31/2023] [Indexed: 06/26/2023]
Abstract
We advance a novel active inference model of the cognitive processing that underlies the acquisition of a hierarchical action repertoire and its use for observation, understanding and imitation. We illustrate the model in four simulations of a tennis learner who observes a teacher performing tennis shots, forms hierarchical representations of the observed actions, and imitates them. Our simulations show that the agent's oculomotor activity implements an active information sampling strategy that permits inferring the kinematic aspects of the observed movement, which lie at the lowest level of the action hierarchy. In turn, this low-level kinematic inference supports higher-level inferences about deeper aspects of the observed actions: proximal goals and intentions. Finally, the inferred action representations can steer imitative responses, but interfere with the execution of different actions. Our simulations show that hierarchical active inference provides a unified account of action observation, understanding, learning and imitation and helps explain the neurobiological underpinnings of visuomotor cognition, including the multiple routes for action understanding in the dorsal and ventral streams and mirror mechanisms.
Collapse
Affiliation(s)
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy.
| | - Alessia Tessari
- Department of Psychology, University of Bologna, Italy; Alma Mater Research Institute for Human-Centered Artificial Intelligence, University of Bologna, Bologna, Italy
| |
Collapse
|
2
|
Tessari A, Proietti R, Rumiati RI. Bottom-up and top-down modulation of route selection in imitation. Cogn Neuropsychol 2022; 38:515-530. [PMID: 35195056 DOI: 10.1080/02643294.2022.2043264] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
The cognitive system selects the most appropriate action imitative process: a semantic process - relying on long-term memory representations for known actions, and low-level visuomotor transformations for unknown actions. These two processes work in parallel; however, how context regularities and cognitive control modulate them is unclear. In this study, process selection was triggered contextually by presenting mixed known and new actions in predictable or unpredictable lists, while a cue on the forthcoming action triggered top-down control. Known were imitated faster than the new actions in the predictable lists only. Accuracy was higher and reaction times faster in the uncued conditions, and the predictable faster than the unpredictable list in the uncued condition only. In the latter condition, contextual factors modulate process selection, as participants use statistical regularities to perform the task at best. With the cue, the cognitive system tries to control response selection, resulting in more errors and longer reaction times.
Collapse
Affiliation(s)
| | | | - Raffaella I Rumiati
- Cognitive Neuroscience, Scuola Internazionale Superiore di Studi Avanzati, Trieste, Italy
| |
Collapse
|
3
|
Pomeroy VM, Clark CA, Miller JSG, Baron JC, Markus HS, Tallis RC. The Potential for Utilizing the “Mirror Neurone System” to Enhance Recovery of the Severely Affected Upper Limb Early after Stroke: A Review and Hypothesis. Neurorehabil Neural Repair 2016; 19:4-13. [PMID: 15673838 DOI: 10.1177/1545968304274351] [Citation(s) in RCA: 76] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Recovery of upper limb movement control after stroke might be enhanced by repetitive goal-directed functional activities. Providing such activity is challenging in the presence of severe paresis. A possible new approach is based on the discovery of mirror neurons in the monkey cortical area F5, which are active both in observing and executing a movement. Indirect evidence for a comparable human “mirror neurone system” is provided by functional imaging. The primary motor cortex, the premotor cortex, other brain areas, and muscles appropriate for the action being observed are probably activated in healthy volunteers observing another’s movement. These findings raise the hypothesis that observation of another’s movement might train the movement execution system of stroke patients who have severe paresis to bring them to the point at which they could actively participate in rehabilitation consisting of goal-directed activities. The point of providing an observation therapy would be to facilitate the voluntary production of movement; therefore, the condition of interest would be observation with intent to imitate. However, there is as yet insufficient evidence to enable the testing of this hypothesis in stroke patients. Studies in normal subjects are needed to determine which brain sites are activated in response to observation with intent to imitate. Studies in stroke subjects are needed to determine how activation is affected after damage to different brain areas. The information from such studies should aid identification of those stroke patients who might be most likely to benefit from observation to imitate and therefore guide phase I clinical studies.
Collapse
Affiliation(s)
- Valerie M Pomeroy
- Geriatric Medicine, St George's Hospital Medical School, Cranmer Terrace, London SW17 0RE, UK.
| | | | | | | | | | | |
Collapse
|
4
|
Herbort O, Koning A, van Uem J, G J Meulenbroek R. The end-state comfort effect facilitates joint action. Acta Psychol (Amst) 2012; 139:404-16. [PMID: 22321453 DOI: 10.1016/j.actpsy.2012.01.001] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2011] [Revised: 12/29/2011] [Accepted: 01/03/2012] [Indexed: 11/18/2022] Open
Abstract
Motor experts can accurately predict the future actions of others by observing their movements. This report describes three experiments that investigate such predictions in everyday object manipulations and test whether these predictions facilitate responses to the actions of others. Observing video excerpts showing an actor reaching for a vertically mounted dial, participants in Experiment 1 needed to predict how the actor would rotate it. Their predictions were specific to the direction and extent of the dial rotation and improved proportionate to the length of the video clip shown. Testing whether such predictions facilitate responses, in the subsequent experiments responders had to undo an actor's actions, back-rotating a dial (Exp 2) and a bar (Exp 3). The responders' actions were initiated faster when the actors' movements obeyed the so-called end-state comfort principle than when they did not. Our experiments show that humans exploit the end-state comfort effect to tweak their predictions of the future actions of others. The results moreover suggest that the precision of these predictions is mediated by perceptual learning rather than by motor simulation.
Collapse
Affiliation(s)
- Oliver Herbort
- University of Würzburg, Department of Psychology, Röntgenring 11, Würzburg, Germany.
| | | | | | | |
Collapse
|
5
|
Mental imagery of self-location during spontaneous and active self-other interactions: an electrical neuroimaging study. J Neurosci 2010; 30:7202-14. [PMID: 20505087 DOI: 10.1523/jneurosci.3403-09.2010] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Substantial data from the cognitive neurosciences point to the importance of bodily processing for the development of a comprehensive theory of the self. A key aspect of the bodily self is self-location, the experience that the self is localized at a specific position in space within one's bodily borders (embodied self-location). Although the neural mechanisms of self-location have been studied by manipulating the spatial location of one's visual perspective during mental imagery, such experiments were conducted in constrained, explicit, and unecological contexts such as explicit instructions in a prone/seated position, although most human interactions occur spontaneously while standing/walking. Using a motor paradigm, we investigated the behavioral and neural mechanisms of spontaneous self-location and mental body transformations during active human interaction. Using own-body imagery using spontaneous and explicit changes in self-location in standing participants, we report that spontaneous interactions with an avatar are neurally indistinguishable from explicit own-body transformation with disembodied self-location but differ from explicit own-body transformation with embodied self-location at 400-600 ms after stimulus onset. We discuss these findings with respect to the neural mechanisms of perspective-taking and self-location in spontaneous human interaction.
Collapse
|
6
|
Kappes J, Baumgaertner A, Peschke C, Goldenberg G, Ziegler W. Imitation of para-phonological detail following left hemisphere lesions. Neuropsychologia 2010; 48:1115-24. [DOI: 10.1016/j.neuropsychologia.2009.12.012] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2009] [Revised: 11/26/2009] [Accepted: 12/07/2009] [Indexed: 12/21/2022]
|
7
|
Thirioux B, Jorland G, Bret M, Tramus MH, Berthoz A. Walking on a line: a motor paradigm using rotation and reflection symmetry to study mental body transformations. Brain Cogn 2009; 70:191-200. [PMID: 19299062 DOI: 10.1016/j.bandc.2009.02.006] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2008] [Revised: 02/01/2009] [Accepted: 02/02/2009] [Indexed: 10/21/2022]
Abstract
Researchers have recently reintroduced the own-body in the center of the social interaction theory. From the discovery of the mirror neurons in the ventral premotor cortex of the monkey's brain, a human embodied model of interindividual relationship based on simulation processes has been advanced, according to which we tend to embody spontaneously the other individuals' behavior when interacting. Although the neurocognitive mechanisms of the embodiment process have started being described, the mechanisms of self-location during embodiment are still less known. Here, we designed a motor paradigm which allows investigating in ecologically more valid conditions whether we embody another person's intransitive action with an embodied or disembodied self-location. Accordingly, we propose a phenomenological model of self-other interaction showing how perspective-taking mechanisms may relate on mental body transformation and offering a promising way to investigate the different sorts of intersubjectivity.
Collapse
Affiliation(s)
- Bérangère Thirioux
- Laboratoire de Physiologie de la Perception et de l'Action, Collège de France, France; Ecole des Hautes Etudes en Sciences Sociales, Paris, France.
| | | | | | | | | |
Collapse
|
8
|
Porro CA, Facchin P, Fusi S, Dri G, Fadiga L. Enhancement of force after action observation: behavioural and neurophysiological studies. Neuropsychologia 2007; 45:3114-21. [PMID: 17681358 DOI: 10.1016/j.neuropsychologia.2007.06.016] [Citation(s) in RCA: 50] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2007] [Revised: 05/30/2007] [Accepted: 06/04/2007] [Indexed: 10/23/2022]
Abstract
We tested here the hypothesis that observing others' actions can facilitate basic aspects of motor performance, such as force production, even if subjects are not required to immediately reproduce the observed actions and if they are not aware that observation can form the basis for procedural training. To this end, we compared in healthy volunteers the effects of repeated actual execution (MOV) or observation (OBS) of a simple intransitive movement (abduction of the right index and middle fingers). In a first experiment, we found that both actual and observational training significantly increased the finger abduction force of both hands. In the MOV group, force increases over pre-training values were significantly higher in the trained than in the untrained hand (50% versus 33%), whereas they were similar for the two hands in the OBS group (32% versus 30%). No force change was found in the control, untrained group. In a second experiment, we found that both training conditions significantly increased the isometric force exerted during right index finger abduction, whereas no post-training change in isometric force was found during abduction of the right little finger. Actual performance, imagination and, to a lower extent, observation of fingers movement enhanced the excitability of the corticospinal system targeting the first dorsal interosseus muscle, as tested by transcranial magnetic stimulation; pre- and post-training effects were of similar magnitude. These results show a powerful, specific role of action observation in motor training, likely exerted through premotor areas, which may prove useful in physiological and rehabilitative conditions.
Collapse
Affiliation(s)
- Carlo A Porro
- Dipartimento di Scienze Biomediche, Sezione Fisiologia, University of Modena and Reggio Emilia, Via Campi 287, I-41100 Modena, Italy.
| | | | | | | | | |
Collapse
|
9
|
Pally R. Non-conscious prediction and a role for consciousness in correcting prediction errors. Cortex 2005; 41:643-62; discussion 731-4. [PMID: 16209328 DOI: 10.1016/s0010-9452(08)70282-x] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
As a result of the evolutionary pressure for survival, the brain relies on a number of non-conscious predictive neural mechanisms which allow for rapid, efficient behavioral responses to the environment. These predictive mechanisms enable the brain to recognize objects by sampling just a few sensory inputs, to anticipate what events are likely to occur and to prepare a response before events actually occur. Consciousness appears to play a role in the detection and correction of prediction errors. The author, a psychotherapist and psychoanalyst, proposes that this monitoring or oversight function of consciousness can be used to understand how conscious awareness facilitates change in the psychotherapeutic treatment of patients who repeat maladaptive patterns of behavior.
Collapse
Affiliation(s)
- Regina Pally
- Department of Psychiatry, UCLA, Los Angeles, CA 90049, USA.
| |
Collapse
|
10
|
Abstract
Human observers demonstrate impressive visual sensitivity to human movement. What defines this sensitivity? If motor experience influences the visual analysis of action, then observers should be most sensitive to their own movements. If view-dependent visual experience determines visual sensitivity to human movement, then observers should be most sensitive to the movements of their friends. To test these predictions, participants viewed sagittal displays of point-light depictions of themselves, their friends, and strangers performing various actions. In actor identification and discrimination tasks, sensitivity to one's own motion was highest. Visual sensitivity to friends', but not strangers', actions was above chance. Performance was action dependent. Control studies yielded chance performance with inverted and static displays, suggesting that form and low-motion cues did not define performance. These results suggest that both motor and visual experience define visual sensitivity to human action.
Collapse
|
11
|
Fukushima H, Hirai M, Arita A, Kamewari K, Hiraki K. Neural dynamics in human imitation revealed by ERP surface topography. Neuroreport 2005; 15:2129-32. [PMID: 15486495 DOI: 10.1097/00001756-200409150-00026] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
To clarify the neural dynamics in human motor imitation, we examined event-related potentials (ERP) for a reaction time task that required responses to an actor's finger motions with identical motions. Compared with a control task (reaction to an LED illumination), the ERP surface topography in the imitative reaction was differentiated at around 120-200 ms post-cueing, showing an early sensitivity to the response hand over the pre-central region. This result suggested that activities around the motor areas were facilitated in the imitative reaction, which is consistent with recent neuroimaging studies. However, taken together with that there were no differences in reaction times, the early ERP latency of conditional divergence indicated that neural activities related to imitation are visual responses and do not directly lead to motor acceleration.
Collapse
Affiliation(s)
- Hirokata Fukushima
- Department of General Systems Studies, Graduate School of Arts and Sciences, The University of Tokyo, c/o Dr. K Hiraki, 3-8-1 Komaba, Meguro-ku, Tokyo 153-8902, Japan.
| | | | | | | | | |
Collapse
|
12
|
Abstract
Accumulative empirical evidence has been reviewed in support of the notion that the production and perception of action as well as the interpretation of others' actions are functionally connected, and indeed, rely on common distributed neural systems in the premotor and parietal cortices. We suggest that these neural systems sustain shared representations between self and other that are crucial in social interactions. The inferior parietal cortex plays a special role in the sense of agency, which is a fundamental aspect to navigate within this neural network. The role of other brain areas that implement and regulate these shared representations remains to be specified.
Collapse
Affiliation(s)
- Philip L Jackson
- Social Cognitive Neuroscience, Institute for Learning and Brain Sciences, University of Washington, Box 357988, Seattle, Washington, USA
| | | |
Collapse
|