Additive Routes to Action Learning: Layering Experience Shapes Engagement of the Action Observation Network

The geometry of interpersonal synchrony in human dance

Collective synchronized behavior has powerful social-communicative functions observed across several animal taxa.1,2,3,4,5,6,7 Operationally, synchronized behavior can be explained by individuals responding to shared external cues (e.g., light, sound, or food) as well as by inter-individual adaptation.3,8,9,10,11 We contrasted these accounts in the context of a universal human practice-collective dance-by recording full-body kinematics from dyads of laypersons freely dancing to music in a "silent disco" setting. We orthogonally manipulated musical input (whether participants were dancing to the same, synchronous music) and visual contact (whether participants could see their dancing partner). Using a data-driven method, we decomposed full-body kinematics of 70 participants into 15 principal movement patterns, reminiscent of common dance moves, explaining over 95% of kinematic variance. We find that both music and partners drive synchrony, but through distinct dance moves. This leads to distinct kinds of synchrony that occur in parallel by virtue of a geometric organization: anteroposterior movements such as head bobs synchronize through music, while hand gestures and full-body lateral movements synchronize through visual contact. One specific dance move-vertical bounce-emerged as a supramodal pacesetter of coordination, synchronizing through both music and visual contact, and at the pace of the musical beat. These findings reveal that synchrony in human dance is independently supported by shared musical input and inter-individual adaptation. The independence between these drivers of synchrony hinges on a geometric organization, enabling dancers to synchronize to music and partners simultaneously by allocating distinct synchronies to distinct spatial axes and body parts.

The pain hidden in your hands: Facial expression of pain reduces the influence of goal-related information in action recognition

The involvement of the sensorimotor system in the perception of painful actions has been repeatedly demonstrated. Yet the cognitive processes corresponding to sensorimotor activations have not been identified. In particular, the respective role of higher-level and lower-level action representations such as goals and grips in the recognition of painful actions is not clear. Previous research has shown that in a neutral context, higher-level action representations (goals) are prioritized over lower-level action representations (grips) and guide action recognition. The present study evaluates to what extent the general priority given to goal-related information in the processing of visual actions can be modulated by a context of pain. We used the action violation paradigm developed by van Elk et al. (2008). In the present action tasks, participants had to judge whether the grip or the goal of object-directed actions displayed in photographs was correct or not. The actress in the photograph could show either a neutral facial expression or a facial expression of pain. In the control task, they had to judge whether the actress expressed pain. In the action tasks, goals influenced grip judgements more than grips influenced goal judgements overall, corroborating the priority given to goal-related information previously reported. Critically, the impact of irrelevant goal-related information on the identification of incorrect grips disappeared in the pain context. Moreover, judgements in the control task were similarly influenced by grip and goal-related information. Results suggest that a context of pain reduces the reliance on higher-level action for action judgments. Findings provide novel directions regarding the cognitive and brain mechanisms involved in action processing in painful situations and support pluralist views of action understanding.

The Neuroscience of Dance: A Conceptual Framework and Systematic Review

Ancient and culturally universal, dance pervades many areas of life and has multiple benefits. In this article, we provide a conceptual framework and systematic review, as a guide for researching the neuroscience of dance. We identified relevant articles following PRISMA guidelines, and summarised and evaluated all original results. We identified avenues for future research in: the interactive and collective aspects of dance; groove; dance performance; dance observation; and dance therapy. Furthermore, the interactive and collective aspects of dance constitute a vital part of the field but have received almost no attention from a neuroscientific perspective so far. Dance and music engage overlapping brain networks, including common regions involved in perception, action, and emotion. In music and dance, rhythm, melody, and harmony are processed in an active, sustained pleasure cycle giving rise to action, emotion, and learning, led by activity in specific hedonic brain networks. The neuroscience of dance is an exciting field, which may yield information concerning links between psychological processes and behaviour, human flourishing, and the concept of eudaimonia.

Behavioral and neural underpinnings of empathic characteristics in a Humanitude-care expert

Background

Humanitude approaches have shown positive effects in elderly care. However, the behavioral and neural underpinnings of empathic characteristics in Humanitude-care experts remain unknown.

Methods

We investigated the empathic characteristics of a Humanitude-care expert (YG) and those of age-, sex-, and race-matched controls (n = 13). In a behavioral study, we measured subjective valence and arousal ratings and facial electromyography (EMG) of the corrugator supercilii and zygomatic major muscles while participants passively observed dynamic facial expressions associated with anger and happiness and their randomized mosaic patterns. In a functional magnetic resonance imaging (MRI) study, we measured brain activity while participants passively observed the same dynamic facial expressions and mosaics. In a structural MRI study, we acquired structural MRI data and analyzed gray matter volume.

Results

Our behavioral data showed that YG experienced higher subjective arousal and showed stronger facial EMG activity congruent with stimulus facial expressions compared with controls. The functional MRI data demonstrated that YG showed stronger activity in the ventral premotor cortex (PMv; covering the precentral gyrus and inferior frontal gyrus) and posterior middle temporal gyrus in the right hemisphere in response to dynamic facial expressions versus dynamic mosaics compared with controls. The structural MRI data revealed higher regional gray matter volume in the right PMv in YG than in controls.

Conclusion

These results suggest that Humanitude-care experts have behavioral and neural characteristics associated with empathic social interactions.

The McNorm library: creating and validating a new library of emotionally expressive whole body dance movements

The ability to exchange affective cues with others plays a key role in our ability to create and maintain meaningful social relationships. We express our emotions through a variety of socially salient cues, including facial expressions, the voice, and body movement. While significant advances have been made in our understanding of verbal and facial communication, to date, understanding of the role played by human body movement in our social interactions remains incomplete. To this end, here we describe the creation and validation of a new set of emotionally expressive whole-body dance movement stimuli, named the Motion Capture Norming (McNorm) Library, which was designed to reconcile a number of limitations associated with previous movement stimuli. This library comprises a series of point-light representations of a dancer's movements, which were performed to communicate to observers neutrality, happiness, sadness, anger, and fear. Based on results from two validation experiments, participants could reliably discriminate the intended emotion expressed in the clips in this stimulus set, with accuracy rates up to 60% (chance = 20%). We further explored the impact of dance experience and trait empathy on emotion recognition and found that neither significantly impacted emotion discrimination. As all materials for presenting and analysing this movement library are openly available, we hope this resource will aid other researchers in further exploration of affective communication expressed by human bodily movement.

Trainability of novel person recognition based on brief exposure to form and motion cues

Fast and accurate recognition of teammates is crucial in contexts as varied as fast-moving sports, the military, and law enforcement engagements; misrecognition can result in lost scoring opportunities in sport or friendly fire in combat contexts. Initial studies on teammate recognition in sport suggests that athletes are adept at this perceptual ability but still susceptible to errors. The purpose of the current proof-of-concept study was to explore the trainability of teammate recognition from very brief exposure to vision of the whole-body form and motion of a previously unknown individual. Participants were divided into three groups: a 4-week training group who were also the actors for the test and training footage, a 2-week training group, and a no-training group. Findings revealed significant differences between the training groups and their improvement from the pre-to post-test on Response Accuracy and Movement Time. The current study found the best performance in the 4-week Training group. The biggest improvement was found in the 2-week training group, whilst no significant improvement was made in the Control group. These results suggest that training was effective, but also indicate that having initially performed the movements as actors may have led to improvements in baseline testing and ultimately the best results, thus physical performance of skills combined with video-based training may reduce the amount of time needed to improve teammate identification.

Exploring body consciousness of dancers, athletes, and lightly physically active adults

Body consciousness is associated with kinetic skills and various aspects of wellbeing. Physical activities have been shown to contribute to the development of body consciousness. Methodological studies are needed in improving the assessment of body consciousness in adults with distinct physical activity backgrounds. This study (1) examined whether dancers, athletes, and lightly physically active individuals differed regarding the level of their body consciousness, and (2) evaluated the usability of different methods in assessing body consciousness. Fifty-seven healthy adults (aged 20–37) were included in the study. Three experimental methods (aperture task, endpoint matching, and posture copying) and two self-report questionnaires (the Private Body Consciousness Scale, PBCS, and the Body Awareness Questionnaire, BAQ) were used in assessing body consciousness. Athletes outperformed the lightly physically active participants in the posture copying task with the aid of vision when copying leg postures. Dancers performed better than the athletes without the aid of vision when their back and upper body were involved, and better than the lightly active participants when copying leg postures. Dancers and athletes had higher self-reported cognitive and perceptual knowledge of their body than lightly physically active participants. To examine the role of different physical activities in developing body consciousness, experimental methods involving the use of the whole body might be most suitable. Subjective measures may provide complementary evidence for experimental testing.

Emergence of perceptuomotor relationships during paleolithic stone toolmaking learning: intersections of observation and practice

Stone toolmaking is a human motor skill which provides the earliest archeological evidence motor skill and social learning. Intentionally shaping a stone into a functional tool relies on the interaction of action observation and practice to support motor skill acquisition. The emergence of adaptive and efficient visuomotor processes during motor learning of such a novel motor skill requiring complex semantic understanding, like stone toolmaking, is not understood. Through the examination of eye movements and motor skill, the current study sought to evaluate the changes and relationship in perceptuomotor processes during motor learning and performance over 90 h of training. Participants' gaze and motor performance were assessed before, during and following training. Gaze patterns reveal a transition from initially high gaze variability during initial observation to lower gaze variability after training. Perceptual changes were strongly associated with motor performance improvements suggesting a coupling of perceptual and motor processes during motor learning.

Children do not distinguish efficient from inefficient actions during observation

Observation is a powerful way to learn efficient actions from others. However, the role of observers' motor skill in assessing efficiency of others is unknown. Preschoolers are notoriously poor at performing multi-step actions like grasping the handle of a tool. Preschoolers (N = 22) and adults (N = 22) watched video-recorded actors perform efficient and inefficient tool use. Eye tracking showed that preschoolers and adults looked equally long at the videos, but adults looked longer than children at how actors grasped the tool. Deep learning analyses of participants' eye gaze distinguished efficient from inefficient grasps for adults, but not for children. Moreover, only adults showed differential action-related pupil dilation and neural activity (suppressed oscillation power in the mu frequency) while observing efficient vs. inefficient grasps. Thus, children observe multi-step actions without "seeing" whether the initial step is efficient. Findings suggest that observer's own motor efficiency determines whether they can perceive action efficiency in others.

What modulates the Mirror Neuron System during action observation?: Multiple factors involving the action, the actor, the observer, the relationship between actor and observer, and the context

Seeing an agent perform an action typically triggers a motor simulation of that action in the observer's Mirror Neuron System (MNS). Over the past few years, it has become increasingly clear that during action observation the patterns and strengths of responses in the MNS are modulated by multiple factors. The first aim of this paper is therefore to provide the most comprehensive survey to date of these factors. To that end, 22 distinct factors are described, broken down into the following sets: six involving the action; two involving the actor; nine involving the observer; four involving the relationship between actor and observer; and one involving the context. The second aim is to consider the implications of these findings for four prominent theoretical models of the MNS: the Direct Matching Model; the Predictive Coding Model; the Value-Driven Model; and the Associative Model. These assessments suggest that although each model is supported by a wide range of findings, each one is also challenged by other findings and relatively unaffected by still others. Hence, there is now a pressing need for a richer, more inclusive model that is better able to account for all of the modulatory factors that have been identified so far.

Dissociating embodiment and emotional reactivity in motor responses to artworks

Perceiving art is known to elicit motor cortex activation in an observer's brain. This motor activation has often been attributed to a covert approach response associated with the emotional valence of an art piece (emotional reaction hypothesis). However, recent accounts have proposed that aesthetic experiences could be grounded in the motor simulation of actions required to produce an art piece and of the sensorimotor states embedded in its subject (embodied aesthetic hypothesis). Here, we aimed to test these two hypotheses by assessing whether motor facilitation during artwork perception mirrors emotional or motor simulation processes. To this aim, we capitalized on single pulse transcranial magnetic stimulation revealing a two-stage motor coding of emotional body postures: an early, non-specific activation related to emotion processing and a later action-specific activation reflecting motor simulation. We asked art-naïve individuals to rate how much they liked a series of pointillist and brushstroke canvases; photographs of artistic gardens served as control natural stimuli. After an early (150 ms) or a later (300 ms) post-stimulus delay, motor evoked potentials were recorded from wrist-extensor and finger muscles that were more involved in brushstroke- and pointillist-like painting, respectively. Results showed that observing the two canvas styles did not elicit differential motor activation in the early time window for either muscle, not supporting the emotional reaction hypothesis. However, in support of the embodied aesthetic hypothesis, we found in the later time window greater motor activation responses to brushstroke than pointillist canvases for the wrist-extensor, but not for the finger muscle. Furthermore, this muscle-selective facilitation was associated with lower liking ratings of brushstroke canvases and with greater empathy dispositions. These findings support the claim that simulation of the painter's movements is crucial for aesthetic experience, by documenting a link between motor simulation, dispositional empathy, and subjective appreciation in artwork perception.

Watch and Learn: The Cognitive Neuroscience of Learning from Others' Actions

The mirror neuron system has dominated understanding of observational learning from a cognitive neuroscience perspective. Our review highlights the value of observational learning frameworks that integrate a more diverse and distributed set of cognitive and brain systems, including those implicated in sensorimotor transformations, as well as in more general processes such as executive control, reward, and social cognition. We argue that understanding how observational learning occurs in the real world will require neuroscientific frameworks that consider how visuomotor processes interface with more general aspects of cognition, as well as how learning context and action complexity shape mechanisms supporting learning from watching others.

Review of computational neuroaesthetics: bridging the gap between neuroaesthetics and computer science

The mystery of aesthetics attracts scientists from various research fields. The topic of aesthetics, in combination with other disciplines such as neuroscience and computer science, has brought out the burgeoning fields of neuroaesthetics and computational aesthetics within less than two decades. Despite profound findings are carried out by experimental approaches in neuroaesthetics and by machine learning algorithms in computational neuroaesthetics, these two fields cannot be easily combined to benefit from each other and findings from each field are isolated. Computational neuroaesthetics, which inherits computational approaches from computational aesthetics and experimental approaches from neuroaesthetics, seems to be promising to bridge the gap between neuroaesthetics and computational aesthetics. Here, we review theoretical models and neuroimaging findings about brain activity in neuroaesthetics. Then machine learning algorithms and computational models in computational aesthetics are enumerated. Finally, we introduce studies in computational neuroaesthetics which combine computational models with neuroimaging data to analyze brain connectivity during aesthetic appreciation or give a prediction on aesthetic preference. This paper outlines the rich potential for computational neuroaesthetics to take advantages from both neuroaesthetics and computational aesthetics. We conclude by discussing some of the challenges and potential prospects in computational neuroaesthetics, and highlight issues for future consideration.

Towards a neurocognitive approach to dance movement therapy for mental health: A systematic review

Dance movement therapy (DMT) has become an increasingly recognized and used treatment, though primarily used to target psychological and physical well-being in individuals with physical, medical or neurological illnesses. To contribute to the relative lack of literature within the field of DMT for clinical mental health disorders, using a narrative synthesis, we review the scope of recent, controlled studies of DMT in samples with different psychiatric disorders including depression, schizophrenia, autism and somatoform disorder. A systematic search of electronic databases (PubMed, Science Direct, World of Science and Clinicaltrials.gov) was conducted to identify studies examining the effects of DMT in psychiatric populations. Fifteen studies were eligible for inclusion. After reviewing the principal results of the studies, we highlight strengths and weaknesses of this treatment approach and examine the potential efficacy of using bodily movements as a tool to reduce symptoms. We conclude by placing DMT within the context of contemporary cognitive neuroscience research, drawing out implications of such an orientation for future research and discussing potential mechanisms by which DMT might reduce psychiatric symptoms. DMT has clear potential as a treatment for a range of conditions and symptoms, and thus, further research on its utility is warranted.

Beyond action observation: Neurobehavioral mechanisms of memory for visually perceived bodies and actions

Examining the processing of others' body-related information in the perceivers' brain (action observation) is a key topic in cognitive neuroscience. However, what happens beyond the perceptual stage, when the body is not within view and it is transformed into an associative form that can be stored, updated, and later recalled, remains poorly understood. Here we examine neurobehavioural evidence on the memory processing of visually perceived bodily stimuli (dynamic actions and images of bodies). The reviewed studies indicate that encoding and maintaining bodily stimuli in memory recruits the sensorimotor system. This process arises when bodily stimuli are either recalled through action recognition or reproduction. Interestingly, the memory capacity for these stimuli is rather limited: only 2 or 3 bodily stimuli can be simultaneously held in memory. Moreover, this process is disrupted by increasing concurrent bodily operations; i.e., moving one's body, seeing or memorising additional bodies. Overall, the evidence suggests that the neural circuitry allowing us to move and feel ourselves supports the encoding, retention, and memory recall of others' visually perceived bodies.

Muscular effort coding in action representation in ballet dancers and controls: Electrophysiological evidence

The present electrophysiological (EEG) study investigated the neural correlates of perceiving effortful vs. effortless movements belonging to a specific repertoire (ballet). Previous evidence has shown an increased heart and respiratory rate during the observation and imagination of human actions that require a great muscular effort. In addition, TMS (transcranial magnetic stimulation) and EEG studies have evidenced a greater muscle-specific cortical excitability and an increase in late event-related potentials during the observation of effortful actions. In this investigation, fifteen professional female ballet dancers and 15 controls with no experience whatsoever with dance, gymnastics, or martial arts were recruited. They were shown 326 short videos displaying a male dancer performing standard ballet steps that could be either effortful or relatively effortless. Participants were instructed to observe each clip and imagine themselves physically executing the same movement. Importantly, they were blinded to the stimuli properties. The observation of effortful compared with effortless movements resulted in a larger P300 over frontal sites in dancers only, likely because of their visuomotor expertise with the specific steps. Moreover, an enhanced Late Positivity was identified over posterior sites in response to effortful stimuli in both groups, possibly reflecting the processing of larger quantities of visual kinematic information. The source reconstruction swLORETA performed on the Late Positivity component showed greater engagement of frontoparietal regions in dancers, while task-related frontal and occipitotemporal visual regions were more active in controls. It, therefore, appears that, in dancers, effort information was encoded in a more refined manner during action observation and in the absence of explicit instruction. Acquired motor knowledge seems to result in visuomotor resonance processes, which, in turn, underlies enhanced action representation of the observed movements.

A neurocognitive investigation of the impact of socializing with a robot on empathy for pain

To what extent can humans form social relationships with robots? In the present study, we combined functional neuroimaging with a robot socializing intervention to probe the flexibility of empathy, a core component of social relationships, towards robots. Twenty-six individuals underwent identical fMRI sessions before and after being issued a social robot to take home and interact with over the course of a week. While undergoing fMRI, participants observed videos of a human actor or a robot experiencing pain or pleasure in response to electrical stimulation. Repetition suppression of activity in the pain network, a collection of brain regions associated with empathy and emotional responding, was measured to test whether socializing with a social robot leads to greater overlap in neural mechanisms when observing human and robotic agents experiencing pain or pleasure. In contrast to our hypothesis, functional region-of-interest analyses revealed no change in neural overlap for agents after the socializing intervention. Similarly, no increase in activation when observing a robot experiencing pain emerged post-socializing. Whole-brain analysis showed that, before the socializing intervention, superior parietal and early visual regions are sensitive to novel agents, while after socializing, medial temporal regions show agent sensitivity. A region of the inferior parietal lobule was sensitive to novel emotions, but only during the pre-socializing scan session. Together, these findings suggest that a short socialization intervention with a social robot does not lead to discernible differences in empathy towards the robot, as measured by behavioural or brain responses. We discuss the extent to which long-term socialization with robots might shape social cognitive processes and ultimately our relationships with these machines. This article is part of the theme issue 'From social brains to social robots: applying neurocognitive insights to human-robot interaction'.

Fluid intelligence and working memory support dissociable aspects of learning by physical but not observational practice

Humans have a remarkable ability to learn by watching others, whether learning to tie an elaborate knot or play the piano. However, the mechanisms that translate visual input into motor skill execution remain unclear. It has been proposed that common cognitive and neural mechanisms underpin learning motor skills by physical and observational practice. Here we provide a novel test of the common mechanism hypothesis by testing the extent to which certain individual differences predict observational as well as physical learning. Participants (N = 92 per group) either physically practiced a five-element key-press sequence or watched videos of similar sequences before physically performing trained and untrained sequences in a test phase. We also measured cognitive abilities across participants that have previously been associated with rates of learning, including working memory and fluid intelligence. Our findings show that individual differences in working memory and fluid intelligence predict improvements in dissociable aspects of motor learning following physical practice, but not observational practice. Working memory predicts general learning gains from pre- to post-test that generalise to untrained sequences, whereas fluid intelligence predicts sequence-specific gains that are tied to trained sequences. However, neither working memory nor fluid intelligence predict training gains following observational learning. Therefore, these results suggest limits to the shared mechanism hypothesis of physical and observational learning. Indeed, models of observational learning need updating to reflect the extent to which such learning is based on shared as well as distinct processes compared to physical learning. We suggest that such differences could reflect the more intentional nature of learning during physical compared to observational practice, which relies to a greater extent on higher-order cognitive resources such as working memory and fluid intelligence.

Sensorimotor characteristics of sign translations modulate EEG when deaf signers read English

Bilingual individuals automatically translate written words from one language to another. While this process is established in spoken-language bilinguals, there is less known about its occurrence in deaf bilinguals who know signed and spoken languages. Since sign language uses motion and space to convey linguistic content, it is possible that action simulation in the brain's sensorimotor system plays a role in this process. We recorded EEG from deaf participants fluent in ASL as they read individual English words and found significant differences in alpha and beta EEG at central electrode sites during the reading of English words whose ASL translations use two hands, compared to English words whose ASL translations use one hand. Hearing non-signers did not show any differences between conditions. These results demonstrate the involvement of the sensorimotor system in cross-linguistic, cross-modal translation, and suggest that covert action simulation processes are involved when deaf signers read.

A neurocognitive investigation of the impact of socialising with a robot on empathy for pain.. [DOI: 10.1101/470534] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

To what extent can humans form social relationships with robots? In the present study, we combined functional neuroimaging with a robot socialising intervention to probe the flexibility of empathy, a core component of social relationships, toward robots. Twenty-six individuals underwent identical fMRI sessions before and after being issued a social robot to take home and interact with over the course of a week. While undergoing fMRI, participants observed videos of a human actor or a robot experiencing pain or pleasure in response to electrical stimulation. Repetition suppression of activity in the pain network, a collection of brain regions associated with empathy and emotional responding, was measured to test whether socialising with a social robot leads to greater overlap in neural mechanisms when observing human and robotic agents experiencing pain or pleasure. In contrast to our hypothesis, functional region-of-interest analyses revealed no change in neural overlap for agents after the socialising intervention. Similarly, no increase in activation when observing a robot experiencing pain emerged post-socialising. Whole-brain analysis showed that, before the socialising intervention, superior parietal and early visual regions are sensitive to novel agents, while after socialising, medial temporal regions show agent sensitivity. A region of the inferior parietal lobule was sensitive to novel emotions, but only during the pre-socialising scan session. Together, these findings suggest that a short socialisation intervention with a social robot does not lead to discernible differences in empathy toward the robot, as measured by behavioural or brain responses. We discuss the extent to which longer term socialisation with robots might shape social cognitive processes and ultimately our relationships with these machines.

Observing Action Sequences Elicits Sequence-Specific Neural Representations in Frontoparietal Brain Regions

Learning new skills by watching others is important for social and motor development throughout the lifespan. Prior research has suggested that observational learning shares common substrates with physical practice at both cognitive and brain levels. In addition, neuroimaging studies have used multivariate analysis techniques to understand neural representations in a variety of domains, including vision, audition, memory, and action, but few studies have investigated neural plasticity in representational space. Therefore, although movement sequences can be learned by observing other people's actions, a largely unanswered question in neuroscience is how experience shapes the representational space of neural systems. Here, across a sample of male and female participants, we combined pretraining and posttraining fMRI sessions with 6 d of observational practice to determine whether the observation of action sequences elicits sequence-specific representations in human frontoparietal brain regions and the extent to which these representations become more distinct with observational practice. Our results showed that observed action sequences are modeled by distinct patterns of activity in frontoparietal cortex and that such representations largely generalize to very similar, but untrained, sequences. These findings advance our understanding of what is modeled during observational learning (sequence-specific information), as well as how it is modeled (reorganization of frontoparietal cortex is similar to that previously shown following physical practice). Therefore, on a more fine-grained neural level than demonstrated previously, our findings reveal how the representational structure of frontoparietal cortex maps visual information onto motor circuits in order to enhance motor performance.

SIGNIFICANCE STATEMENT Learning by watching others is a cornerstone in the development of expertise and skilled behavior. However, it remains unclear how visual signals are mapped onto motor circuits for such learning to occur. Here, we show that observed action sequences are modeled by distinct patterns of activity in frontoparietal cortex and that such representations largely generalize to very similar, but untrained, sequences. These findings advance our understanding of what is modeled during observational learning (sequence-specific information), as well as how it is modeled (reorganization of frontoparietal cortex is similar to that previously shown following physical practice). More generally, these findings demonstrate how motor circuit involvement in the perception of action sequences shows high fidelity to prior work, which focused on physical performance of action sequences.

The dynamics of the interrelation of perception and action across the life span

Successful social interaction relies on the interaction partners' perception, anticipation and understanding of their respective actions. The perception of a particular action and the capability to produce this action share a common representational ground. So far, no study has explored the interrelation between action perception and production across the life span using the same tasks and the same measurement techniques. This study was designed to fill this gap. Participants between 3 and 80 years (N = 214) observed two multistep actions of different familiarities and then reproduced the according actions. Using eye tracking, we measured participants' action perception via their prediction of action goals during observation. To capture subtler perceptual processes, we additionally analysed the dynamics and recurrent patterns within participants' gaze behaviour. Action production was assessed via the accuracy of the participants' reproduction of the observed actions. No age-related differences were found for the perception of the familiar action, where participants of all ages could rely on previous experience. In the unfamiliar action, where participants had less experience, action goals were predicted more frequently with increasing age. The recurrence in participants' gaze behaviour was related to both, age and action production: gaze behaviour was more recurrent (i.e. less flexible) in very young and very old participants, and lower levels of recurrence (i.e. greater flexibility) were related to higher scores in action production across participants. Incorporating a life-span perspective, this study illustrates the dynamic nature of developmental differences in the associations of action production with action perception.

Dance Training Shapes Action Perception and Its Neural Implementation within the Young and Older Adult Brain

How we perceive others in action is shaped by our prior experience. Many factors influence brain responses when observing others in action, including training in a particular physical skill, such as sport or dance, and also general development and aging processes. Here, we investigate how learning a complex motor skill shapes neural and behavioural responses among a dance-naïve sample of 20 young and 19 older adults. Across four days, participants physically rehearsed one set of dance sequences, observed a second set, and a third set remained untrained. Functional MRI was obtained prior to and immediately following training. Participants' behavioural performance on motor and visual tasks improved across the training period, with younger adults showing steeper performance gains than older adults. At the brain level, both age groups demonstrated decreased sensorimotor cortical engagement after physical training, with younger adults showing more pronounced decreases in inferior parietal activity compared to older adults. Neural decoding results demonstrate that among both age groups, visual and motor regions contain experience-specific representations of new motor learning. By combining behavioural measures of performance with univariate and multivariate measures of brain activity, we can start to build a more complete picture of age-related changes in experience-dependent plasticity.

Perception as a Route for Motor Skill Learning: Perspectives from Neuroscience

Learning a motor skill requires physical practice that engages neural networks involved in movement. These networks have also been found to be engaged during perception of sensory signals associated with actions. Nonetheless, despite extensive evidence for the existence of such sensory-evoked neural activity in motor pathways, much less is known about their contribution to learning and actual changes in behavior. Primate studies usually involve an overlearned task while studies in humans have largely focused on characterizing activity of the action observation network (AON) in the context of action understanding, theory of mind, and social interactions. Relatively few studies examined neural plasticity induced by perception and its role in transfer of motor knowledge. Here, we review this body of literature and point to future directions for the development of alternative, physiologically grounded ways in which sensory signals could be harnessed to improve motor skills.

Anodal tDCS over Primary Motor Cortex Provides No Advantage to Learning Motor Sequences via Observation

When learning a new motor skill, we benefit from watching others. It has been suggested that observation of others' actions can build a motor representation in the observer, and as such, physical and observational learning might share a similar neural basis. If physical and observational learning share a similar neural basis, then motor cortex stimulation during observational practice should similarly enhance learning by observation as it does through physical practice. Here, we used transcranial direct-current stimulation (tDCS) to address whether anodal stimulation to M1 during observational training facilitates skill acquisition. Participants learned keypress sequences across four consecutive days of observational practice while receiving active or sham stimulation over M1. The results demonstrated that active stimulation provided no advantage to skill learning over sham stimulation. Further, Bayesian analyses revealed evidence in favour of the null hypothesis across our dependent measures. Our findings therefore provide no support for the hypothesis that excitatory M1 stimulation can enhance observational learning in a similar manner to physical learning. More generally, the results add to a growing literature that suggests that the effects of tDCS tend to be small, inconsistent, and hard to replicate. Future tDCS research should consider these factors when designing experimental procedures.

The Dancing Brain: Structural and Functional Signatures of Expert Dance Training

Dance - as a ritual, therapy, and leisure activity - has been known for thousands of years. Today, dance is increasingly used as therapy for cognitive and neurological disorders such as dementia and Parkinson's disease. Surprisingly, the effects of dance training on the healthy young brain are not well understood despite the necessity of such information for planning successful clinical interventions. Therefore, this study examined actively performing, expert-level trained college students as a model of long-term exposure to dance training. To study the long-term effects of dance training on the human brain, we compared 20 young expert female Dancers with normal body mass index with 20 age- and education-matched Non-Dancers with respect to brain structure and function. We used diffusion tensor, morphometric, resting state and task-related functional MRI, a broad cognitive assessment, and objective measures of selected dance skill (Dance Central video game and a balance task). Dancers showed superior performance in the Dance Central video game and balance task, but showed no differences in cognitive abilities. We found little evidence for training-related differences in brain volume in Dancers. Dancers had lower anisotropy in the corticospinal tract. They also activated the action observation network (AON) to greater extent than Non-Dancers when viewing dance sequences. Dancers showed altered functional connectivity of the AON, and of the general motor learning network. These functional connectivity differences were related to dance skill and balance and training-induced structural characteristics. Our findings have the potential to inform future study designs aiming to monitor dance training-induced plasticity in clinical populations.

Learning to tie the knot: The acquisition of functional object representations by physical and observational experience

Here we examined neural substrates for physically and observationally learning to construct novel objects, and characterized brain regions associated with each kind of learning using fMRI. Each participant was assigned a training partner, and for five consecutive days practiced tying one group of knots (“tied” condition) or watched their partner tie different knots (“watched” condition) while a third set of knots remained untrained. Functional MRI was obtained prior to and immediately following the week of training while participants performed a visual knot-matching task. After training, a portion of left superior parietal lobule demonstrated a training by scan session interaction. This means this parietal region responded selectively to knots that participants had physically learned to tie in the post-training scan session but not the pre-training scan session. A conjunction analysis on the post-training scan data showed right intraparietal sulcus and right dorsal premotor cortex to respond when viewing images of knots from the tied and watched conditions compared to knots that were untrained during the post-training scan session. This suggests that these brain areas track both physical and observational learning. Together, the data provide preliminary evidence of engagement of brain regions associated with hand-object interactions when viewing objects associated with physical experience, and with observational experience without concurrent physical practice.

Neural bases of action abstraction

There has been recent debate over whether actions are processed primarily by means of motor simulation or cognitive semantics. The current study investigated how abstract action concepts are processed in the brain, independent of the format in which they are presented. Eighteen healthy adult participants viewed different actions (e.g., diving, boxing) in the form of verbs and schematic action pictograms while functional magnetic resonance imaging (fMRI) was collected. We predicted that sensorimotor and semantic brain regions would show similar patterns of neural activity for different instances of the same action (e.g., diving pictogram and the word 'diving'). A representational similarity analysis revealed posterior temporal and sensorimotor regions where specific action concepts were encoded, independent of the format of presentation. These results reveal the neural instantiations of abstract action concepts, and demonstrate that both sensorimotor and semantic systems are involved in processing actions.

Joint action aesthetics

Synchronized movement is a ubiquitous feature of dance and music performance. Much research into the evolutionary origins of these cultural practices has focused on why humans perform rather than watch or listen to dance and music. In this study, we show that movement synchrony among a group of performers predicts the aesthetic appreciation of live dance performances. We developed a choreography that continuously manipulated group synchronization using a defined movement vocabulary based on arm swinging, walking and running. The choreography was performed live to four audiences, as we continuously tracked the performers' movements, and the spectators' affective responses. We computed dynamic synchrony among performers using cross recurrence analysis of data from wrist accelerometers, and implicit measures of arousal from spectators' heart rates. Additionally, a subset of spectators provided continuous ratings of enjoyment and perceived synchrony using tablet computers. Granger causality analyses demonstrate predictive relationships between synchrony, enjoyment ratings and spectator arousal, if audiences form a collectively consistent positive or negative aesthetic evaluation. Controlling for the influence of overall movement acceleration and visual change, we show that dance communicates group coordination via coupled movement dynamics among a group of performers. Our findings are in line with an evolutionary function of dance-and perhaps all performing arts-in transmitting social signals between groups of people. Human movement is the common denominator of dance, music and theatre. Acknowledging the time-sensitive and immediate nature of the performer-spectator relationship, our study makes a significant step towards an aesthetics of joint actions in the performing arts.

Unravelling the contributions of motor experience and conceptual knowledge in action perception: A training study

Prior knowledge affects how we perceive the world and the sensorimotor system actively guides our perception. An ongoing dispute regards the extent to which prior motor knowledge versus conceptual knowledge modulates the observation of others’ actions. Research indicates that motor experience increases motor activation during action perception. Other research, however, has shown that conceptual familiarity with actions also modulates motor activation, i.e., increased motor activation during observation of unfamiliar, compared to conceptually familiar, actions. To begin to disentangle motor from conceptual contributions to action perception, we uniquely combined motoric and conceptual interventions into one design. We experimentally manipulated participants’ experience with both motoric skills and conceptual knowledge, via motor training of kinematically challenging actions and contextual information about the action, respectively, in a week-long training session. Measurements of the effects on motor activity measured via electroencephalography (EEG) during pre- and post-training action observation were compared. We found distinct, non-interacting effects of both manipulations: Motor training increased motor activation, whereas additional conceptual knowledge decreased motor activation. The findings indicate that both factors influence action perception in a distinct and parallel manner. This research speaks to previously irreconcilable findings and provides novel insights about the distinct roles of motor and conceptual contributions to action perception.

Have I grooved to this before? Discriminating practised and observed actions in a novel context

Learning a new motor skill typically requires converting actions observed from a third-person perspective into fluid motor commands executed from a first-person perspective. In the present study, we test the hypothesis that during motor learning, the ability to discriminate between actions that have been observed and actions that have been executed is associated with learning aptitude, as assessed by a general measure of physical performance. Using a multi-day dance-training paradigm with a group of dance-naïve participants, we investigated whether actions that had been regularly observed could be discriminated from similar actions that had been physically practised over the course of three days, or a further set of similar actions that remained untrained. Training gains and performance scores at test were correlated with participants' ability to discriminate between observed and practised actions, suggesting that an individual's ability to differentiate between visual versus visuomotor action encoding is associated with general motor learning.

Visual Enhancement of Illusory Phenomenal Accents in Non-Isochronous Auditory Rhythms

Musical rhythms encompass temporal patterns that often yield regular metrical accents (e.g., a beat). There have been mixed results regarding perception as a function of metrical saliency, namely, whether sensitivity to a deviant was greater in metrically stronger or weaker positions. Besides, effects of metrical position have not been examined in non-isochronous rhythms, or with respect to multisensory influences. This study was concerned with two main issues: (1) In non-isochronous auditory rhythms with clear metrical accents, how would sensitivity to a deviant be modulated by metrical positions? (2) Would the effects be enhanced by multisensory information? Participants listened to strongly metrical rhythms with or without watching a point-light figure dance to the rhythm in the same meter, and detected a slight loudness increment. Both conditions were presented with or without an auditory interference that served to impair auditory metrical perception. Sensitivity to a deviant was found greater in weak beat than in strong beat positions, consistent with the Predictive Coding hypothesis and the idea of metrically induced illusory phenomenal accents. The visual rhythm of dance hindered auditory detection, but more so when the latter was itself less impaired. This pattern suggested that the visual and auditory rhythms were perceptually integrated to reinforce metrical accentuation, yielding more illusory phenomenal accents and thus lower sensitivity to deviants, in a manner consistent with the principle of inverse effectiveness. Results were discussed in the predictive framework for multisensory rhythms involving observed movements and possible mediation of the motor system.

Music Upper Limb Therapy-Integrated: An Enriched Collaborative Approach for Stroke Rehabilitation

Stroke is a leading cause of disability worldwide. It leads to a sudden and overwhelming disruption in one’s physical body, and alters the stroke survivors’ sense of self. Long-term recovery requires that bodily perception, social participation and sense of self are restored; this is challenging to achieve, particularly with a single intervention. However, rhythmic synchronization of movement to external stimuli facilitates sensorimotor coupling for movement recovery, enhances emotional engagement and has positive effects on interpersonal relationships. In this proof-of-concept study, we designed a group music-making intervention, Music Upper Limb Therapy-Integrated (MULT-I), to address the physical, psychological and social domains of rehabilitation simultaneously, and investigated its effects on long-term post-stroke upper limb recovery. The study used a mixed-method pre-post design with 1-year follow up. Thirteen subjects completed the 45-min intervention twice a week for 6 weeks. The primary outcome was reduced upper limb motor impairment on the Fugl-Meyer Scale (FMS). Secondary outcomes included sensory impairment (two-point discrimination test), activity limitation (Modified Rankin Scale, MRS), well-being (WHO well-being index), and participation (Stroke Impact Scale, SIS). Repeated measures analysis of variance (ANOVA) was used to test for differences between pre- and post-intervention, and 1-year follow up scores. Significant improvement was found in upper limb motor impairment, sensory impairment, activity limitation and well-being immediately post-intervention that persisted at 1 year. Activities of daily living and social participation improved only from post-intervention to 1-year follow up. The improvement in upper limb motor impairment was more pronounced in a subset of lower functioning individuals as determined by their pre-intervention wrist range of motion. Qualitatively, subjects reported new feelings of ownership of their impaired limb, more spontaneous movement, and enhanced emotional engagement. The results suggest that the MULT-I intervention may help stroke survivors re-create their sense of self by integrating sensorimotor, emotional and interoceptive information and facilitate long-term recovery across multiple domains of disability, even in the chronic stage post-stroke. Randomized controlled trials are warranted to confirm the efficacy of this approach. Clinical Trial Registration: National Institutes of Health, clinicaltrials.gov, NCT01586221.

Visual Timing of Structured Dance Movements Resembles Auditory Rhythm Perception

Temporal mechanisms for processing auditory musical rhythms are well established, in which a perceived beat is beneficial for timing purposes. It is yet unknown whether such beat-based timing would also underlie visual perception of temporally structured, ecological stimuli connected to music: dance. In this study, we investigated whether observers extracted a visual beat when watching dance movements to assist visual timing of these movements. Participants watched silent videos of dance sequences and reproduced the movement duration by mental recall. We found better visual timing for limb movements with regular patterns in the trajectories than without, similar to the beat advantage for auditory rhythms. When movements involved both the arms and the legs, the benefit of a visual beat relied only on the latter. The beat-based advantage persisted despite auditory interferences that were temporally incongruent with the visual beat, arguing for the visual nature of these mechanisms. Our results suggest that visual timing principles for dance parallel their auditory counterparts for music, which may be based on common sensorimotor coupling. These processes likely yield multimodal rhythm representations in the scenario of music and dance.

Sensorimotor Synchronization with Different Metrical Levels of Point-Light Dance Movements

Rhythm perception and synchronization have been extensively investigated in the auditory domain, as they underlie means of human communication such as music and speech. Although recent studies suggest comparable mechanisms for synchronizing with periodically moving visual objects, the extent to which it applies to ecologically relevant information, such as the rhythm of complex biological motion, remains unknown. The present study addressed this issue by linking rhythm of music and dance in the framework of action-perception coupling. As a previous study showed that observers perceived multiple metrical periodicities in dance movements that embodied this structure, the present study examined whether sensorimotor synchronization (SMS) to dance movements resembles what is known of auditory SMS. Participants watched a point-light figure performing two basic steps of Swing dance cyclically, in which the trunk bounced at every beat and the limbs moved at every second beat, forming two metrical periodicities. Participants tapped synchronously to the bounce of the trunk with or without the limbs moving in the stimuli (Experiment 1), or tapped synchronously to the leg movements with or without the trunk bouncing simultaneously (Experiment 2). Results showed that, while synchronization with the bounce (lower-level pulse) was not influenced by the presence or absence of limb movements (metrical accent), synchronization with the legs (beat) was improved by the presence of the bounce (metrical subdivision) across different movement types. The latter finding parallels the “subdivision benefit” often demonstrated in auditory tasks, suggesting common sensorimotor mechanisms for visual rhythms in dance and auditory rhythms in music.

Visual tuning and metrical perception of realistic point-light dance movements

Humans move to music spontaneously, and this sensorimotor coupling underlies musical rhythm perception. The present research proposed that, based on common action representation, different metrical levels as in auditory rhythms could emerge visually when observing structured dance movements. Participants watched a point-light figure performing basic steps of Swing dance cyclically in different tempi, whereby the trunk bounced vertically at every beat and the limbs moved laterally at every second beat, yielding two possible metrical periodicities. In Experiment 1, participants freely identified a tempo of the movement and tapped along. While some observers only tuned to the bounce and some only to the limbs, the majority tuned to one level or the other depending on the movement tempo, which was also associated with individuals' preferred tempo. In Experiment 2, participants reproduced the tempo of leg movements by four regular taps, and showed a slower perceived leg tempo with than without the trunk bouncing simultaneously in the stimuli. This mirrors previous findings of an auditory 'subdivision effect', suggesting the leg movements were perceived as beat while the bounce as subdivisions. Together these results support visual metrical perception of dance movements, which may employ similar action-based mechanisms to those underpinning auditory rhythm perception.

Constructing Visual Perception of Body Movement with the Motor Cortex

The human brain readily perceives fluent movement from static input. Using functional magnetic resonance imaging, we investigated brain mechanisms that mediate fluent apparent biological motion (ABM) perception from sequences of body postures. We presented body and nonbody stimuli varying in objective sequence duration and fluency of apparent movement. Three body postures were ordered to produce a fluent (ABC) or a nonfluent (ACB) apparent movement. This enabled us to identify brain areas involved in the perceptual reconstruction of body movement from identical lower-level static input. Participants judged the duration of a rectangle containing body/nonbody sequences, as an implicit measure of movement fluency. For body stimuli, fluent apparent motion sequences produced subjectively longer durations than nonfluent sequences of the same objective duration. This difference was reduced for nonbody stimuli. This body-specific bias in duration perception was associated with increased blood oxygen level-dependent responses in the primary (M1) and supplementary motor areas. Moreover, fluent ABM was associated with increased functional connectivity between M1/SMA and right fusiform body area. We show that perceptual reconstruction of fluent movement from static body postures does not merely enlist areas traditionally associated with visual body processing, but involves cooperative recruitment of motor areas, consistent with a "motor way of seeing".