1
|
Christensen JF, Fernández A, Smith RA, Michalareas G, Yazdi SHN, Farahi F, Schmidt EM, Bahmanian N, Roig G. EMOKINE: A software package and computational framework for scaling up the creation of highly controlled emotional full-body movement datasets. Behav Res Methods 2024; 56:7498-7542. [PMID: 38918315 DOI: 10.3758/s13428-024-02433-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/15/2024] [Indexed: 06/27/2024]
Abstract
EMOKINE is a software package and dataset creation suite for emotional full-body movement research in experimental psychology, affective neuroscience, and computer vision. A computational framework, comprehensive instructions, a pilot dataset, observer ratings, and kinematic feature extraction code are provided to facilitate future dataset creations at scale. In addition, the EMOKINE framework outlines how complex sequences of movements may advance emotion research. Traditionally, often emotional-'action'-based stimuli are used in such research, like hand-waving or walking motions. Here instead, a pilot dataset is provided with short dance choreographies, repeated several times by a dancer who expressed different emotional intentions at each repetition: anger, contentment, fear, joy, neutrality, and sadness. The dataset was simultaneously filmed professionally, and recorded using XSENS® motion capture technology (17 sensors, 240 frames/second). Thirty-two statistics from 12 kinematic features were extracted offline, for the first time in one single dataset: speed, acceleration, angular speed, angular acceleration, limb contraction, distance to center of mass, quantity of motion, dimensionless jerk (integral), head angle (with regards to vertical axis and to back), and space (convex hull 2D and 3D). Average, median absolute deviation (MAD), and maximum value were computed as applicable. The EMOKINE software is appliable to other motion-capture systems and is openly available on the Zenodo Repository. Releases on GitHub include: (i) the code to extract the 32 statistics, (ii) a rigging plugin for Python for MVNX file-conversion to Blender format (MVNX=output file XSENS® system), and (iii) a Python-script-powered custom software to assist with blurring faces; latter two under GPLv3 licenses.
Collapse
Affiliation(s)
- Julia F Christensen
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt/M, Germany.
| | - Andrés Fernández
- Methods of Machine Learning, University of Tübingen, Tübingen, Germany
- International Max Planck Research School for Intelligent Systems, Tübingen, Germany
| | - Rebecca A Smith
- Department of Psychology, University of Glasgow, Glasgow, Scotland
| | - Georgios Michalareas
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt/M, Germany
| | | | | | - Eva-Madeleine Schmidt
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt/M, Germany
- Max Planck School of Cognition, Leipzig, Germany
- Center for Humans and Machines, Max Planck Institute for Human Development, Berlin, Germany
| | - Nasimeh Bahmanian
- Department of Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt/M, Germany
- Department of Modern Languages, Goethe University, Frankfurt/M, Germany
| | - Gemma Roig
- Computer Science Department, Goethe University, Frankfurt/M, Germany
- The Hessian Center for Artificial Intelligence (hessian.AI), Darmstadt, Germany
| |
Collapse
|
2
|
Christensen JF, Khorsandi S, Wald-Fuhrmann M. Iranian classical dance as a subject for empirical research: An elusive genre. Ann N Y Acad Sci 2024; 1533:51-72. [PMID: 38319099 DOI: 10.1111/nyas.15098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2024]
Abstract
Dance has entered mainstream empirical research: dance as an experimental stimulus, and dancers as movement experts. Informed by several sources, including primary sources (original, historical documents, and oral reports, such as interviews with practitioners and academic scholars of Iranian dance genres) and secondary sources (research literature), we describe what we label "Iranian classical dance" within this paper as an important resource for empirical research, not only in humanities scholarship but also, and importantly, for empirical aesthetics, emotion psychology, cross-cultural psychology, and affective neuroscience. For this purpose, we (1) describe the aesthetics, characteristics, and history of Iranian classical dance; (2) outline issues of definition and systematization; and (3) give an overview of the cultural complexities and sociopolitical issues regarding Iranian classical dance in the past 40 years, which have shaped its current form. After the political revolution of 1979 (Iranian solar calendar year: 1358), dance in Iran-both as everyday practice and as a cultural heritage-was first forbidden, and now remains heavily restricted. International, interdisciplinary research teams can contribute to safeguarding Iranian classical dance in the future by firmly enshrining it into empirical research on human dance. We outline empirical research perspectives on Iranian classical dance, dataset resources, and expert communities.
Collapse
Affiliation(s)
- Julia F Christensen
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt/M, Germany
| | | | - Melanie Wald-Fuhrmann
- Department of Music, Max Planck Institute for Empirical Aesthetics, Frankfurt/M, Germany
| |
Collapse
|
3
|
Schmidt EM, Smith RA, Fernández A, Emmermann B, Christensen JF. Mood induction through imitation of full-body movements with different affective intentions. Br J Psychol 2024; 115:148-180. [PMID: 37740117 DOI: 10.1111/bjop.12681] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2021] [Accepted: 07/05/2023] [Indexed: 09/24/2023]
Abstract
Theories of human emotion, including some emotion embodiment theories, suggest that our moods and affective states are reflected in the movements of our bodies. We used the reverse process for mood regulation; modulate body movements to regulate mood. Dancing is a type of full-body movement characterized by affective expressivity and, hence, offers the possibility to express different affective states through the same movement sequences. We tested whether the repeated imitation of a dancer performing two simple full-body dance movement sequences with different affective expressivity (happy or sad) could change mood states. Computer-based systems, using avatars as dance models to imitate, offer a series of advantages such as independence from physical contact and location. Therefore, we compared mood induction effects in two conditions: participants were asked to imitate dance movements from one of the two avatars showing: (a) videos of a human dancer model or (b) videos of a robot dancer model. The mood induction was successful for both happy and sad imitations, regardless of condition (human vs. robot avatar dance model). Moreover, the magnitude of happy mood induction and how much participants liked the task predicted work-related motivation after the mood induction. We conclude that mood regulation through dance movements is possible and beneficial in the work context.
Collapse
Affiliation(s)
- Eva-Madeleine Schmidt
- Department of Cognitive Neuropsychology, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Department of Language and Literature, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Max Planck School of Cognition, Leipzig, Germany
| | - Rebecca A Smith
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
| | - Andrés Fernández
- Centre for Vision, Speech and Signal Processing, University of Surrey, Guildford, UK
| | - Birte Emmermann
- Chair of Ergonomics, Technical University of Munich, Munich, Germany
| | - Julia F Christensen
- Department of Cognitive Neuropsychology, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Department of Language and Literature, Max-Planck-Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| |
Collapse
|
4
|
Stutesman MG, Frye DA. Affective Theory of Mind in Late Adulthood: The Role of Emotion Complexity and Social Relatedness. Exp Aging Res 2023; 49:472-500. [PMID: 36284488 DOI: 10.1080/0361073x.2022.2137359] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Accepted: 10/12/2022] [Indexed: 11/04/2022]
Abstract
BACKGROUND Age-related declines in adult affective theory of mind (AToM) have been discovered. However, AToM measures have not accounted for emotional state complexity involved in AToM. Measures have also not accounted for different types of relationships - friends versus strangers - for which AToM is employed, which is important considering the limited social networks of aging adults. OBJECTIVE We address these issues and examine the emotion complexity, social-relatedness, and contextual relevance in AToM across adult ages (18-89 years) using a new task and two well-established measures. RESULTS The new task displayed good structural fit and internal construct validity. Overall, an age-related decline in AToM was found along with an interaction between age and emotion complexity. For all ages, AToM performance was best for complex emotions. However, as age increased, there was more rapid decline in AToM for more complex emotions than for less complex ones. Surprisingly, AToM performance for strangers was better than for social companions. CONCLUSION The findings suggest age-related AToM declines are more nuanced than previously understood given that adult age differences are related to emotional state complexity. They indicate that the emotion complexity levels of basic, complex, and self-conscious should be included in AToM assessments. Implications for AToM tasks and development are discussed.
Collapse
Affiliation(s)
- Megan G Stutesman
- Department of Psychology, 3F5, George Mason University, Fairfax, Virginia, 22030, USA
| | - Douglas A Frye
- Department of Psychology, 3F5, George Mason University, Fairfax, Virginia, 22030, USA
| |
Collapse
|
5
|
Christensen JF, Bruhn L, Schmidt EM, Bahmanian N, Yazdi SHN, Farahi F, Sancho-Escanero L, Menninghaus W. A 5-emotions stimuli set for emotion perception research with full-body dance movements. Sci Rep 2023; 13:8757. [PMID: 37253770 DOI: 10.1038/s41598-023-33656-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 04/17/2023] [Indexed: 06/01/2023] Open
Abstract
Ekman famously contended that there are different channels of emotional expression (face, voice, body), and that emotion recognition ability confers an adaptive advantage to the individual. Yet, still today, much emotion perception research is focussed on emotion recognition from the face, and few validated emotionally expressive full-body stimuli sets are available. Based on research on emotional speech perception, we created a new, highly controlled full-body stimuli set. We used the same-sequence approach, and not emotional actions (e.g., jumping of joy, recoiling in fear): One professional dancer danced 30 sequences of (dance) movements five times each, expressing joy, anger, fear, sadness or a neutral state, one at each repetition. We outline the creation of a total of 150, 6-s-long such video stimuli, that show the dancer as a white silhouette on a black background. Ratings from 90 participants (emotion recognition, aesthetic judgment) showed that intended emotion was recognized above chance (chance: 20%; joy: 45%, anger: 48%, fear: 37%, sadness: 50%, neutral state: 51%), and that aesthetic judgment was sensitive to the intended emotion (beauty ratings: joy > anger > fear > neutral state, and sad > fear > neutral state). The stimuli set, normative values and code are available for download.
Collapse
Affiliation(s)
- Julia F Christensen
- Department of Language and Literature, Max-Planck-Institute for Empirical Aesthetics, Frankfurt/M, Germany.
- Department of Cognitive Neuropsychology, Max Planck Institute for Empirical Aesthetics, Frankfurt/M, Germany.
| | - Laura Bruhn
- Department of Language and Literature, Max-Planck-Institute for Empirical Aesthetics, Frankfurt/M, Germany
| | - Eva-Madeleine Schmidt
- Department of Language and Literature, Max-Planck-Institute for Empirical Aesthetics, Frankfurt/M, Germany
- Max Planck School of Cognition, Max Planck Institute, Leipzig, Germany
| | - Nasimeh Bahmanian
- Department of Language and Literature, Max-Planck-Institute for Empirical Aesthetics, Frankfurt/M, Germany
- Department of Modern Languages, Goethe University, Frankfurt, Germany
| | | | | | | | - Winfried Menninghaus
- Department of Language and Literature, Max-Planck-Institute for Empirical Aesthetics, Frankfurt/M, Germany
| |
Collapse
|
6
|
Smith RA, Cross ES. The McNorm library: creating and validating a new library of emotionally expressive whole body dance movements. PSYCHOLOGICAL RESEARCH 2023; 87:484-508. [PMID: 35385989 PMCID: PMC8985749 DOI: 10.1007/s00426-022-01669-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Accepted: 02/23/2022] [Indexed: 11/28/2022]
Abstract
The ability to exchange affective cues with others plays a key role in our ability to create and maintain meaningful social relationships. We express our emotions through a variety of socially salient cues, including facial expressions, the voice, and body movement. While significant advances have been made in our understanding of verbal and facial communication, to date, understanding of the role played by human body movement in our social interactions remains incomplete. To this end, here we describe the creation and validation of a new set of emotionally expressive whole-body dance movement stimuli, named the Motion Capture Norming (McNorm) Library, which was designed to reconcile a number of limitations associated with previous movement stimuli. This library comprises a series of point-light representations of a dancer's movements, which were performed to communicate to observers neutrality, happiness, sadness, anger, and fear. Based on results from two validation experiments, participants could reliably discriminate the intended emotion expressed in the clips in this stimulus set, with accuracy rates up to 60% (chance = 20%). We further explored the impact of dance experience and trait empathy on emotion recognition and found that neither significantly impacted emotion discrimination. As all materials for presenting and analysing this movement library are openly available, we hope this resource will aid other researchers in further exploration of affective communication expressed by human bodily movement.
Collapse
Affiliation(s)
- Rebecca A. Smith
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, Scotland
| | - Emily S. Cross
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, Scotland ,Department of Cognitive Science, Macquarie University, Sydney, Australia
| |
Collapse
|
7
|
Zardi A, Carlotti EG, Pontremoli A, Morese R. Dancing in Your Head: An Interdisciplinary Review. Front Psychol 2021; 12:649121. [PMID: 34002113 PMCID: PMC8123236 DOI: 10.3389/fpsyg.2021.649121] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2021] [Accepted: 03/24/2021] [Indexed: 12/19/2022] Open
Abstract
The aim of this review is to highlight the most relevant contributions on dance in neuroscientific research. Neuroscience has analyzed the mirror system through neuroimaging techniques, testing its role in imitative learning, in the recognition of other people's emotions and especially in the understanding of the motor behavior of others. This review analyses the literature related to five general areas: (I) breakthrough studies on the mirror system, and subsequent studies on its involvement in the prediction, the execution, the control of movement, and in the process of "embodied simulation" within the intersubjective relationship; (II) research focused on investigating the neural networks in action observation, and the neural correlates of motor expertise highlighted by comparative studies on different dance styles; (III) studies dealing with the viewer's experience of dance according to specific dance repertoires, which revealed the relevance of choreographic choices for aesthetic appreciation; (IV) studies focused on dance as an aesthetic experience, where both the emotional and the cultural dimension play a significant role, and whose investigation paves the way to further progress both in empirical and in phenomenological research methodologies; (V) collaboration-based experiments, in which neuroscientists and choreographers developed expertise-related questions, especially focusing on the multiple phenomena that underlie motor imagery.
Collapse
Affiliation(s)
- Andrea Zardi
- Department of Humanities, School of Human Sciences, University of Turin, Turin, Italy
| | | | - Alessandro Pontremoli
- Department of Humanities, School of Human Sciences, University of Turin, Turin, Italy
| | - Rosalba Morese
- Faculty of Communication, Culture and Society, Università della Svizzera Italiana, Lugano, Switzerland
- Faculty of Biomedical Sciences, Institute of Public Health, Università della Svizzera Italiana, Lugano, Switzerland
| |
Collapse
|
8
|
Christensen JF, Vartanian M, Sancho-Escanero L, Khorsandi S, Yazdi SHN, Farahi F, Borhani K, Gomila A. A Practice-Inspired Mindset for Researching the Psychophysiological and Medical Health Effects of Recreational Dance (Dance Sport). Front Psychol 2021; 11:588948. [PMID: 33716840 PMCID: PMC7950321 DOI: 10.3389/fpsyg.2020.588948] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Accepted: 12/11/2020] [Indexed: 11/13/2022] Open
Abstract
“Dance” has been associated with many psychophysiological and medical health effects. However, varying definitions of what constitute “dance” have led to a rather heterogenous body of evidence about such potential effects, leaving the picture piecemeal at best. It remains unclear what exact parameters may be driving positive effects. We believe that this heterogeneity of evidence is partly due to a lack of a clear definition of dance for such empirical purposes. A differentiation is needed between (a) the effects on the individual when the activity of “dancing” is enjoyed as a dancer within different dance domains (e.g., professional/”high-art” type of dance, erotic dance, religious dance, club dancing, Dance Movement Therapy (DMT), and what is commonly known as hobby, recreational or social dance), and (b) the effects on the individual within these different domains, as a dancer of the different dance styles (solo dance, partnering dance, group dance; and all the different styles within these). Another separate category of dance engagement is, not as a dancer, but as a spectator of all of the above. “Watching dance” as part of an audience has its own set of psychophysiological and neurocognitive effects on the individual, and depends on the context where dance is witnessed. With the help of dance professionals, we first outline some different dance domains and dance styles, and outline aspects that differentiate them, and that may, therefore, cause differential empirical findings when compared regardless (e.g., amount of interpersonal contact, physical exertion, context, cognitive demand, type of movements, complexity of technique and ratio of choreography/improvisation). Then, we outline commonalities between all dance styles. We identify six basic components that are part of any dance practice, as part of a continuum, and review and discuss available research for each of them concerning the possible health and wellbeing effects of each of these components, and how they may relate to the psychophysiological and health effects that are reported for “dancing”: (1) rhythm and music, (2) sociality, (3) technique and fitness, (4) connection and connectedness (self-intimation), (5) flow and mindfulness, (6) aesthetic emotions and imagination. Future research efforts might take into account the important differences between types of dance activities, as well as the six components, for a more targeted assessment of how “dancing” affects the human body.
Collapse
Affiliation(s)
- Julia F Christensen
- Department for Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| | | | | | | | - S H N Yazdi
- 3Fish Corporate Filmmaking, Istanbul, Turkey
| | | | - Khatereh Borhani
- Institute for Cognitive and Brain Sciences, Shahid Beheshti University, Tehran, Iran
| | - Antoni Gomila
- Department of Psychology, University of the Balearic Islands, Palma, Spain
| |
Collapse
|
9
|
Nath K, Dwivedi R. Aesthetic Exploration of Organizational Theatrics: a Case of Tata Motors’ Jaguar Land Rover Acquisition. PHILOSOPHY OF MANAGEMENT 2021. [DOI: 10.1007/s40926-020-00160-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
10
|
Orlandi A, Cross ES, Orgs G. Timing is everything: Dance aesthetics depend on the complexity of movement kinematics. Cognition 2020; 205:104446. [PMID: 32932073 DOI: 10.1016/j.cognition.2020.104446] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2019] [Revised: 06/26/2020] [Accepted: 08/20/2020] [Indexed: 12/31/2022]
Abstract
What constitutes a beautiful action? Research into dance aesthetics has largely focussed on subjective features like familiarity with the observed movement, but has rarely studied objective features like speed or acceleration. We manipulated the kinematic complexity of observed actions by creating dance sequences that varied in movement timing, but not in movement trajectory. Dance-naïve participants rated the dance videos on speed, effort, reproducibility, and enjoyment. Using linear mixed-effects modeling, we show that faster, more predictable movement sequences with varied velocity profiles are judged to be more effortful, less reproducible, and more aesthetically pleasing than slower sequences with more uniform velocity profiles. Accordingly, dance aesthetics depend not only on which movements are being performed but on how movements are executed and linked into sequences. The aesthetics of movement timing may apply across culturally-specific dance styles and predict both preference for and perceived difficulty of dance, consistent with information theory and effort heuristic accounts of aesthetic appreciation.
Collapse
Affiliation(s)
- Andrea Orlandi
- Neuro-MI, Milan Center for Neuroscience, Dept. of Psychology, University of Milano - Bicocca, Italy; Department of Psychology, Sapienza University of Rome, Italy.
| | - Emily S Cross
- Institute of Cognitive Neuroscience, School of Psychology, University of Glasgow, UK; Department of Cognitive Science, Macquarie University, Australia
| | - Guido Orgs
- Department of Psychology, Goldsmiths, University of London, UK
| |
Collapse
|