1
|
Sandulescu T, Deuschle E, Mätz-Rensing K, Voigt T, Naumova EA, Arnold WH. Histomorphological analysis of the superficial musculoaponeurotic system in Macaca mulatta species. Ann Anat 2023; 250:152161. [PMID: 37741583 DOI: 10.1016/j.aanat.2023.152161] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Revised: 06/09/2023] [Accepted: 09/09/2023] [Indexed: 09/25/2023]
Abstract
INTRODUCTION The superficial musculoaponeurotic system (SMAS) is a well described facial functional unit in humans. SMAS connects mimic musculature to the skin having many implication in facial mimic expression. One of the various morphological and physiological analogies in human and Macaca mulatta species is the facial mimic. The present study analyzed Macaca mulatta species SMAS morphology and its facial topographical differences and compared this with human SMAS tissue morphology. MATERIAL AND METHODS Macaca mulatta full-graft tissue blocks of skin, subcutaneous tissue and mimic muscles from five topographical different facial regions (Regio Temporalis, Regio Buccalis, Regio Infraorbitalis, Regio Angulus Oris and Regio Mandibularis) were collected postmortem from eight individuals (n = 8) at the German Primate Center, Leibniz Institute for Primate Research in Göttingen (DPZ) and studied histologically. Haematoxylin-eosin and azan stained histological serial sections of full-graft tissue blocks were analyzed and SMAS topographical differences evaluated. RESULTS SMAS typical tissue morphology was recognized in all Macaca mulatta histological serial sections (n = 780). Regio Infraorbitalis Macaca mulatta SMAS (MmSMAS) morphology was similar to human infraorbital SMAS morphology (type I SMAS). Suborbicularis oculi fat pad was recognized in Macaca mulatta samples. Human type I similar SMAS morphology was demonstrated over Macaca mulatta Regio Temporalis and Regio Buccalis. Regio Angulus Oris and the cranial area of the Regio Mandibularis presented human type II similar SMAS morphology. Type IV MmSMAS was closely related to the parotid gland tissue presence. The cervical area of the Regio Mandibularis presented human type V similar SMAS morphology. CONCLUSIONS SMAS is a complex fibro-musculo-adipose tissue network and probably an important pivot in Macaca mulatta facial system supporting mimic expression. This study provided insights into MmSMAS typology and similarity with human SMAS tissue morphology.
Collapse
Affiliation(s)
- Tudor Sandulescu
- Department of Biological and Material Sciences in Dentistry, School of Dentistry, Faculty of Health, Witten/Herdecke University, Germany.
| | - Elias Deuschle
- Department of Biological and Material Sciences in Dentistry, School of Dentistry, Faculty of Health, Witten/Herdecke University, Germany
| | - Kerstin Mätz-Rensing
- Deutsches Primatenzentrum GmbH (DPZ), Leibniz-Institut für Primatenforschung, Leitung Serviceeinheit Pathologie, Göttingen, Germany
| | - Tilman Voigt
- Chair of Anatomy and Clinical Morphology, School of Medicine, Faculty of Health, Witten/Herdecke University, Germany
| | - Ella A Naumova
- Department of Biological and Material Sciences in Dentistry, School of Dentistry, Faculty of Health, Witten/Herdecke University, Germany
| | - Wolfgang H Arnold
- Department of Biological and Material Sciences in Dentistry, School of Dentistry, Faculty of Health, Witten/Herdecke University, Germany
| |
Collapse
|
2
|
Pistoia F, Picasso R, Zaottini F, Sanguinetti S, Caprioli S, Tovt L, Pansecchi M, Martinoli C. High-Resolution Ultrasound of Facial Muscles: Sonoanatomy, Scanning Technique, and Pathological Cases. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2023; 42:547-557. [PMID: 35670279 DOI: 10.1002/jum.16036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Revised: 05/12/2022] [Accepted: 05/22/2022] [Indexed: 06/15/2023]
Abstract
The aim of the present work is to review the sonographic appearance of facial muscles with high-frequency transducers and to illustrate a step-by-step scanning technique that enables an effective evaluation of them. In addition, we highlighted the clinical application showing some pathological cases demonstrated with ultrasound (US). The recent technological advances have greatly enlarged the potential of high-resolution US in the evaluation of the face. Furthermore, the clinical indications of this technique are expected to increase in the near future.
Collapse
Affiliation(s)
- Federico Pistoia
- Department of Experimental Medicine (DIMES), University of Genova, Via Leon Battista Alberti 2, Genoa, Italy
| | - Riccardo Picasso
- IRCCS Ospedale Policlinico San Martino, Largo Rosanna Benzi, 10, Genoa, Italy
| | - Federico Zaottini
- IRCCS Ospedale Policlinico San Martino, Largo Rosanna Benzi, 10, Genoa, Italy
| | - Sara Sanguinetti
- Department of Experimental Medicine (DIMES), University of Genova, Via Leon Battista Alberti 2, Genoa, Italy
| | - Simone Caprioli
- Department of Internal Medicine (DIMI), University of Genova, Viale Benedetto XV 6, Genoa, Italy
| | - Luca Tovt
- Department of Health Sciences (DISSAL), Radiology Section, University of Genova, Via Pastore 1, Genoa, Italy
| | - Michelle Pansecchi
- Department of Health Sciences (DISSAL), Radiology Section, University of Genova, Via Pastore 1, Genoa, Italy
| | - Carlo Martinoli
- IRCCS Ospedale Policlinico San Martino, Largo Rosanna Benzi, 10, Genoa, Italy
- Department of Health Sciences (DISSAL), Radiology Section, University of Genova, Via Pastore 1, Genoa, Italy
| |
Collapse
|
3
|
Correia-Caeiro C, Burrows A, Wilson DA, Abdelrahman A, Miyabe-Nishiwaki T. CalliFACS: The common marmoset Facial Action Coding System. PLoS One 2022; 17:e0266442. [PMID: 35580128 PMCID: PMC9113598 DOI: 10.1371/journal.pone.0266442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Accepted: 03/21/2022] [Indexed: 11/19/2022] Open
Abstract
Facial expressions are subtle cues, central for communication and conveying emotions in mammals. Traditionally, facial expressions have been classified as a whole (e.g. happy, angry, bared-teeth), due to automatic face processing in the human brain, i.e., humans categorise emotions globally, but are not aware of subtle or isolated cues such as an eyebrow raise. Moreover, the same facial configuration (e.g. lip corners pulled backwards exposing teeth) can convey widely different information depending on the species (e.g. humans: happiness; chimpanzees: fear). The Facial Action Coding System (FACS) is considered the gold standard for investigating human facial behaviour and avoids subjective interpretations of meaning by objectively measuring independent movements linked to facial muscles, called Action Units (AUs). Following a similar methodology, we developed the CalliFACS for the common marmoset. First, we determined the facial muscular plan of the common marmoset by examining dissections from the literature. Second, we recorded common marmosets in a variety of contexts (e.g. grooming, feeding, play, human interaction, veterinary procedures), and selected clips from online databases (e.g. YouTube) to identify their facial movements. Individual facial movements were classified according to appearance changes produced by the corresponding underlying musculature. A diverse repertoire of 33 facial movements was identified in the common marmoset (15 Action Units, 15 Action Descriptors and 3 Ear Action Descriptors). Although we observed a reduced range of facial movement when compared to the HumanFACS, the common marmoset's range of facial movements was larger than predicted according to their socio-ecology and facial morphology, which indicates their importance for social interactions. CalliFACS is a scientific tool to measure facial movements, and thus, allows us to better understand the common marmoset's expressions and communication. As common marmosets have become increasingly popular laboratory animal models, from neuroscience to cognition, CalliFACS can be used as an important tool to evaluate their welfare, particularly in captivity.
Collapse
Affiliation(s)
| | - Anne Burrows
- Department of Physical Therapy, Duquesne University, Pittsburgh, Pennsylvania, United States of America
- Department of Anthropology, University of Pittsburgh, Pittsburgh, Pennsylvania, United States of America
| | - Duncan Andrew Wilson
- Primate Research Institute, Kyoto University, Inuyama, Japan
- Graduate School of Letters, Kyoto University, Kyoto, Japan
| | - Abdelhady Abdelrahman
- School of Health and Life Sciences, Glasgow Caledonian University, Glasgow, United Kingdom
| | | |
Collapse
|
4
|
May CA, Mätz-Rensing K, Aschoff D, Bramke S. Muscle spindles in the rhesus monkey platysma. J Anat 2021; 240:936-940. [PMID: 34893983 PMCID: PMC9005687 DOI: 10.1111/joa.13604] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Revised: 11/15/2021] [Accepted: 11/22/2021] [Indexed: 11/28/2022] Open
Abstract
The platysma of the rhesus monkey consists of two parts: a platysma myoides located similar to the human platysma, and a platysma cervicale passing the dorsal cervical region and being in contact with the cheek pouch. Our investigation showed that the muscle fiber morphology was comparable in both parts. Muscle spindles were only present in regions connected to the cheek pouch and contained only nuclear chain fibers. It is tempting to speculate that they sense the filling of the cheek pouch rather than mimic activities.
Collapse
Affiliation(s)
| | - Kerstin Mätz-Rensing
- Pathology Unit, German Primate Center, Leibniz Institute für Primate Research, Göttingen, Germany
| | - Daniel Aschoff
- Pathology Unit, German Primate Center, Leibniz Institute für Primate Research, Göttingen, Germany
| | - Silvia Bramke
- Department of Anatomy, Medical Faculty Carl Gustav Carus, TU Dresden, Dresden, Germany
| |
Collapse
|
5
|
Colman K, Andrews RN, Atkins H, Boulineau T, Bradley A, Braendli-Baiocco A, Capobianco R, Caudell D, Cline M, Doi T, Ernst R, van Esch E, Everitt J, Fant P, Gruebbel MM, Mecklenburg L, Miller AD, Nikula KJ, Satake S, Schwartz J, Sharma A, Shimoi A, Sobry C, Taylor I, Vemireddi V, Vidal J, Wood C, Vahle JL. International Harmonization of Nomenclature and Diagnostic Criteria (INHAND): Non-proliferative and Proliferative Lesions of the Non-human Primate ( M. fascicularis). J Toxicol Pathol 2021; 34:1S-182S. [PMID: 34712008 PMCID: PMC8544165 DOI: 10.1293/tox.34.1s] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
The INHAND (International Harmonization of Nomenclature and Diagnostic Criteria for
Lesions Project (www.toxpath.org/inhand.asp) is a joint initiative of the Societies of
Toxicologic Pathology from Europe (ESTP), Great Britain (BSTP), Japan (JSTP) and North
America (STP) to develop an internationally accepted nomenclature for proliferative and
nonproliferative lesions in laboratory animals. The purpose of this publication is to
provide a standardized nomenclature for classifying microscopic lesions observed in most
tissues and organs from the nonhuman primate used in nonclinical safety studies. Some of
the lesions are illustrated by color photomicrographs. The standardized nomenclature
presented in this document is also available electronically on the internet
(http://www.goreni.org/). Sources of material included histopathology databases from
government, academia, and industrial laboratories throughout the world. Content includes
spontaneous lesions as well as lesions induced by exposure to test materials. Relevant
infectious and parasitic lesions are included as well. A widely accepted and utilized
international harmonization of nomenclature for lesions in laboratory animals will provide
a common language among regulatory and scientific research organizations in different
countries and increase and enrich international exchanges of information among
toxicologists and pathologists.
Collapse
Affiliation(s)
- Karyn Colman
- Novartis Institutes for BioMedical Research, Cambridge, MA, USA
| | - Rachel N Andrews
- Wake Forest School of Medicine, Department of Radiation Oncology, Winston-Salem, NC, USA
| | - Hannah Atkins
- Penn State College of Medicine, Department of Comparative Medicine, Hershey, PA, USA
| | | | - Alys Bradley
- Charles River Laboratories Edinburgh Ltd., Tranent, Scotland, UK
| | - Annamaria Braendli-Baiocco
- Roche Pharma Research and Early Development, Pharmaceutical Sciences, Roche Innovation Center Basel, Switzerland
| | - Raffaella Capobianco
- Janssen Research & Development, a Division of Janssen Pharmaceutica NV, Beerse, Belgium
| | - David Caudell
- Department of Pathology, Section on Comparative Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Mark Cline
- Department of Pathology, Section on Comparative Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Takuya Doi
- LSIM Safety Institute Corporation, Ibaraki, Japan
| | | | | | - Jeffrey Everitt
- Department of Pathology, Duke University School of Medicine, Durham, NC, USA
| | | | | | | | - Andew D Miller
- Cornell University College of Veterinary Medicine, Ithaca, NY, USA
| | | | - Shigeru Satake
- Shin Nippon Biomedical Laboratories, Ltd., Kagoshima and Tokyo, Japan
| | | | - Alok Sharma
- Covance Laboratories, Inc., Madison, WI, USA
| | | | | | | | | | | | - Charles Wood
- Boehringer Ingelheim Pharmaceuticals, Inc., Ridgefield, CT, USA
| | - John L Vahle
- Lilly Research Laboratories, Indianapolis IN, USA
| |
Collapse
|
6
|
Cerrito P, DeCasien AR. The expression of care: Alloparental care frequency predicts neural control of facial muscles in primates. Evolution 2021; 75:1727-1737. [PMID: 34019303 DOI: 10.1111/evo.14275] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 05/02/2021] [Accepted: 05/04/2021] [Indexed: 11/30/2022]
Abstract
The adaptive value of facial expressions has been debated in evolutionary biology ever since Darwin's seminal work. Among mammals, primates, including humans, exhibit the most intricate facial displays. Although previous work has focused on the role of sociality in the evolution of primate facial expressions, this relationship has not been verified in a wide sample of species. Here, we examine the relationship between allomaternal care (paternal or alloparental) and the morphology of three orofacial brainstem nuclei (facial; trigeminal motor; hypoglossal) across primates to test the hypothesis that allomaternal care explains variation in the complexity of facial expressions, proxied by relative facial nucleus size and neuropil fraction. The latter represents the proportion of synaptically dense tissue and may, therefore, correlate with dexterity. We find that alloparental care frequency predicts relative neuropil fraction of the facial nucleus, even after controlling for social system organization, whereas allomaternal care is not associated with the trigeminal motor or hypoglossal nuclei. Overall, this work suggests that alloparenting requires increased facial dexterity to facilitate nonverbal communication between infants and their nonparent caregivers and/or between caregivers. Accordingly, alloparenting and complex facial expressions are likely to have coevolved in primates.
Collapse
Affiliation(s)
- Paola Cerrito
- Department of Anthropology, New York University, New York, New York, 10003.,New York Consortium in Evolutionary Primatology, New York, New York, 10024.,Department of Molecular Pathobiology, New York University College of Dentistry, New York, New York, 10010
| | - Alex R DeCasien
- Department of Anthropology, New York University, New York, New York, 10003.,New York Consortium in Evolutionary Primatology, New York, New York, 10024
| |
Collapse
|
7
|
Andersen PH, Broomé S, Rashid M, Lundblad J, Ask K, Li Z, Hernlund E, Rhodin M, Kjellström H. Towards Machine Recognition of Facial Expressions of Pain in Horses. Animals (Basel) 2021; 11:1643. [PMID: 34206077 PMCID: PMC8229776 DOI: 10.3390/ani11061643] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2021] [Revised: 05/26/2021] [Accepted: 05/28/2021] [Indexed: 01/30/2023] Open
Abstract
Automated recognition of human facial expressions of pain and emotions is to a certain degree a solved problem, using approaches based on computer vision and machine learning. However, the application of such methods to horses has proven difficult. Major barriers are the lack of sufficiently large, annotated databases for horses and difficulties in obtaining correct classifications of pain because horses are non-verbal. This review describes our work to overcome these barriers, using two different approaches. One involves the use of a manual, but relatively objective, classification system for facial activity (Facial Action Coding System), where data are analyzed for pain expressions after coding using machine learning principles. We have devised tools that can aid manual labeling by identifying the faces and facial keypoints of horses. This approach provides promising results in the automated recognition of facial action units from images. The second approach, recurrent neural network end-to-end learning, requires less extraction of features and representations from the video but instead depends on large volumes of video data with ground truth. Our preliminary results suggest clearly that dynamics are important for pain recognition and show that combinations of recurrent neural networks can classify experimental pain in a small number of horses better than human raters.
Collapse
Affiliation(s)
- Pia Haubro Andersen
- Department of Anatomy, Physiology and Biochemistry, Swedish University of Agricultural Sciences, SE 75007 Uppsala, Sweden; (J.L.); (K.A.); (E.H.); (M.R.)
| | - Sofia Broomé
- Division of Robotics, Perception and Learning, KTH Royal Institute of Technology, SE 100044 Stockholm, Sweden; (S.B.); (Z.L.)
| | - Maheen Rashid
- Department of Computer Science, University of California at Davis, California, CA 95616, USA;
| | - Johan Lundblad
- Department of Anatomy, Physiology and Biochemistry, Swedish University of Agricultural Sciences, SE 75007 Uppsala, Sweden; (J.L.); (K.A.); (E.H.); (M.R.)
| | - Katrina Ask
- Department of Anatomy, Physiology and Biochemistry, Swedish University of Agricultural Sciences, SE 75007 Uppsala, Sweden; (J.L.); (K.A.); (E.H.); (M.R.)
| | - Zhenghong Li
- Division of Robotics, Perception and Learning, KTH Royal Institute of Technology, SE 100044 Stockholm, Sweden; (S.B.); (Z.L.)
- Department of Computer Science, Stony Brook University, New York, NY 11794, USA
| | - Elin Hernlund
- Department of Anatomy, Physiology and Biochemistry, Swedish University of Agricultural Sciences, SE 75007 Uppsala, Sweden; (J.L.); (K.A.); (E.H.); (M.R.)
| | - Marie Rhodin
- Department of Anatomy, Physiology and Biochemistry, Swedish University of Agricultural Sciences, SE 75007 Uppsala, Sweden; (J.L.); (K.A.); (E.H.); (M.R.)
| | - Hedvig Kjellström
- Division of Robotics, Perception and Learning, KTH Royal Institute of Technology, SE 100044 Stockholm, Sweden; (S.B.); (Z.L.)
| |
Collapse
|
8
|
Correia-Caeiro C, Holmes K, Miyabe-Nishiwaki T. Extending the MaqFACS to measure facial movement in Japanese macaques (Macaca fuscata) reveals a wide repertoire potential. PLoS One 2021; 16:e0245117. [PMID: 33411716 PMCID: PMC7790396 DOI: 10.1371/journal.pone.0245117] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Accepted: 12/23/2020] [Indexed: 02/01/2023] Open
Abstract
Facial expressions are complex and subtle signals, central for communication and emotion in social mammals. Traditionally, facial expressions have been classified as a whole, disregarding small but relevant differences in displays. Even with the same morphological configuration different information can be conveyed depending on the species. Due to a hardwired processing of faces in the human brain, humans are quick to attribute emotion, but have difficulty in registering facial movement units. The well-known human FACS (Facial Action Coding System) is the gold standard for objectively measuring facial expressions, and can be adapted through anatomical investigation and functional homologies for cross-species systematic comparisons. Here we aimed at developing a FACS for Japanese macaques, following established FACS methodology: first, we considered the species' muscular facial plan; second, we ascertained functional homologies with other primate species; and finally, we categorised each independent facial movement into Action Units (AUs). Due to similarities in the rhesus and Japanese macaques' facial musculature, the MaqFACS (previously developed for rhesus macaques) was used as a basis to extend the FACS tool to Japanese macaques, while highlighting the morphological and appearance changes differences between the two species. We documented 19 AUs, 15 Action Descriptors (ADs) and 3 Ear Action Units (EAUs) in Japanese macaques, with all movements of MaqFACS found in Japanese macaques. New movements were also observed, indicating a slightly larger repertoire than in rhesus or Barbary macaques. Our work reported here of the MaqFACS extension for Japanese macaques, when used together with the MaqFACS, comprises a valuable objective tool for the systematic and standardised analysis of facial expressions in Japanese macaques. The MaqFACS extension for Japanese macaques will now allow the investigation of the evolution of communication and emotion in primates, as well as contribute to improving the welfare of individuals, particularly in captivity and laboratory settings.
Collapse
Affiliation(s)
| | - Kathryn Holmes
- School of Psychology, University of Lincoln, Lincoln, Lincolnshire, United Kingdom
| | | |
Collapse
|
9
|
Strauss DJ, Corona-Strauss FI, Schroeer A, Flotho P, Hannemann R, Hackley SA. Vestigial auriculomotor activity indicates the direction of auditory attention in humans. eLife 2020; 9:54536. [PMID: 32618268 PMCID: PMC7334025 DOI: 10.7554/elife.54536] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2020] [Accepted: 05/28/2020] [Indexed: 01/21/2023] Open
Abstract
Unlike dogs and cats, people do not point their ears as they focus attention on novel, salient, or task-relevant stimuli. Our species may nevertheless have retained a vestigial pinna-orienting system that has persisted as a 'neural fossil’ within in the brain for about 25 million years. Consistent with this hypothesis, we demonstrate that the direction of auditory attention is reflected in sustained electrical activity of muscles within the vestigial auriculomotor system. Surface electromyograms (EMGs) were taken from muscles that either move the pinna or alter its shape. To assess reflexive, stimulus-driven attention we presented novel sounds from speakers at four different lateral locations while the participants silently read a boring text in front of them. To test voluntary, goal-directed attention we instructed participants to listen to a short story coming from one of these speakers, while ignoring a competing story from the corresponding speaker on the opposite side. In both experiments, EMG recordings showed larger activity at the ear on the side of the attended stimulus, but with slightly different patterns. Upward movement (perking) differed according to the lateral focus of attention only during voluntary orienting; rearward folding of the pinna’s upper-lateral edge exhibited such differences only during reflexive orienting. The existence of a pinna-orienting system in humans, one that is experimentally accessible, offers opportunities for basic as well as applied science. Dogs, cats, monkeys and other animals perk their ears in the direction of sounds they are interested in. Humans and their closest ape relatives, however, appear to have lost this ability. Some humans are able to wiggle their ears, suggesting that some of the brain circuits and muscles that allow automatic ear movements towards sounds are still present. This may be a ‘vestigial feature’, an ability that is maintained even though it no longer serves its original purpose. Now, Strauss et al. show that vestigial movements of muscles around the ear indicate the direction of sounds a person is paying attention to. In the experiments, human volunteers tried to read a boring text while surprising sounds like a traffic jam, a baby crying, or footsteps played. During this exercise, Strauss et al. recorded the electrical activity in the muscles of their ears to see if they moved in response to the direction the sound came from. In a second set of experiments, the same electrical recordings were made as participants listened to a podcast while a second podcast was playing from a different direction. The individuals’ ears were also recorded using high resolution video. Both sets of experiments revealed tiny involuntary movements in muscles surrounding the ear closest to the direction of a sound the person is listening to. When the participants tried to listen to one podcast and tune out another, they also made ear ‘perking’ movements in the direction of their preferred podcast. The results suggest that movements of the vestigial muscles in the human ear indicate the direction of sounds a person is paying attention to. These tiny movements could be used to develop better hearing aids that sense the electrical activity in the ear muscles and amplify sounds the person is trying to focus on, while minimizing other sounds.
Collapse
Affiliation(s)
- Daniel J Strauss
- Systems Neuroscience and Neurotechnology Unit, Faculty of Medicine, Saarland University & School of Engineering, htw saar, Homburg/Saar, Germany
| | - Farah I Corona-Strauss
- Systems Neuroscience and Neurotechnology Unit, Faculty of Medicine, Saarland University & School of Engineering, htw saar, Homburg/Saar, Germany
| | - Andreas Schroeer
- Systems Neuroscience and Neurotechnology Unit, Faculty of Medicine, Saarland University & School of Engineering, htw saar, Homburg/Saar, Germany
| | - Philipp Flotho
- Systems Neuroscience and Neurotechnology Unit, Faculty of Medicine, Saarland University & School of Engineering, htw saar, Homburg/Saar, Germany
| | - Ronny Hannemann
- Audiological Research Unit, Sivantos GmbH, Erlangen, Germany
| | - Steven A Hackley
- Clinical and Cognitive Neuroscience Laboratory, Department of Psychological Sciences, University of Missouri, Columbia, United States
| |
Collapse
|
10
|
Measuring the evolution of facial ‘expression’ using multi-species FACS. Neurosci Biobehav Rev 2020; 113:1-11. [DOI: 10.1016/j.neubiorev.2020.02.031] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2019] [Revised: 01/30/2020] [Accepted: 02/23/2020] [Indexed: 11/24/2022]
|
11
|
Tactile Stimulation of the Face and the Production of Facial Expressions Activate Neurons in the Primate Amygdala. eNeuro 2016; 3:eN-NWR-0182-16. [PMID: 27752543 PMCID: PMC5054305 DOI: 10.1523/eneuro.0182-16.2016] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2016] [Revised: 09/12/2016] [Accepted: 09/26/2016] [Indexed: 01/16/2023] Open
Abstract
The majority of neurophysiological studies that have explored the role of the primate amygdala in the evaluation of social signals have relied on visual stimuli such as images of facial expressions. Vision, however, is not the only sensory modality that carries social signals. Both humans and nonhuman primates exchange emotionally meaningful social signals through touch. Indeed, social grooming in nonhuman primates and caressing touch in humans is critical for building lasting and reassuring social bonds. To determine the role of the amygdala in processing touch, we recorded the responses of single neurons in the macaque amygdala while we applied tactile stimuli to the face. We found that one-third of the recorded neurons responded to tactile stimulation. Although we recorded exclusively from the right amygdala, the receptive fields of 98% of the neurons were bilateral. A fraction of these tactile neurons were monitored during the production of facial expressions and during facial movements elicited occasionally by touch stimuli. Firing rates arising during the production of facial expressions were similar to those elicited by tactile stimulation. In a subset of cells, combining tactile stimulation with facial movement further augmented the firing rates. This suggests that tactile neurons in the amygdala receive input from skin mechanoceptors that are activated by touch and by compressions and stretches of the facial skin during the contraction of the underlying muscles. Tactile neurons in the amygdala may play a role in extracting the valence of touch stimuli and/or monitoring the facial expressions of self during social interactions.
Collapse
|
12
|
Corneanu CA, Simon MO, Cohn JF, Guerrero SE. Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2016; 38:1548-68. [PMID: 26761193 PMCID: PMC7426891 DOI: 10.1109/tpami.2016.2515606] [Citation(s) in RCA: 90] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Facial expressions are an important way through which humans interact socially. Building a system capable of automatically recognizing facial expressions from images and video has been an intense field of study in recent years. Interpreting such expressions remains challenging and much research is needed about the way they relate to human affect. This paper presents a general overview of automatic RGB, 3D, thermal and multimodal facial expression analysis. We define a new taxonomy for the field, encompassing all steps from face detection to facial expression recognition, and describe and classify the state of the art methods accordingly. We also present the important datasets and the bench-marking of most influential methods. We conclude with a general discussion about trends, important questions and future lines of research.
Collapse
|
13
|
Burrows AM, Waller BM, Micheletta J. Mimetic Muscles in a Despotic Macaque (Macaca mulatta) Differ from Those in a Closely Related Tolerant Macaque (M. nigra). Anat Rec (Hoboken) 2016; 299:1317-24. [DOI: 10.1002/ar.23393] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2015] [Revised: 03/14/2016] [Accepted: 04/19/2016] [Indexed: 01/14/2023]
Affiliation(s)
- Anne M. Burrows
- Department of Physical Therapy; Duquesne University; Pittsburgh Pennsylvania
- Department of Anthropology; University of Pittsburgh; Pittsburgh Pennsylvania
| | | | | |
Collapse
|
14
|
Julle-Danière É, Micheletta J, Whitehouse J, Joly M, Gass C, Burrows AM, Waller BM. MaqFACS (Macaque Facial Action Coding System) can be used to document facial movements in Barbary macaques (Macaca sylvanus). PeerJ 2015; 3:e1248. [PMID: 26401458 PMCID: PMC4579026 DOI: 10.7717/peerj.1248] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2015] [Accepted: 08/27/2015] [Indexed: 11/20/2022] Open
Abstract
Human and non-human primates exhibit facial movements or displays to communicate with one another. The evolution of form and function of those displays could be better understood through multispecies comparisons. Anatomically based coding systems (Facial Action Coding Systems: FACS) are developed to enable such comparisons because they are standardized and systematic and aid identification of homologous expressions underpinned by similar muscle contractions. To date, FACS has been developed for humans, and subsequently modified for chimpanzees, rhesus macaques, orangutans, hylobatids, dogs, and cats. Here, we wanted to test whether the MaqFACS system developed in rhesus macaques (Macaca mulatta) could be used to code facial movements in Barbary macaques (M. sylvanus), a species phylogenetically close to the rhesus macaques. The findings show that the facial movement capacity of Barbary macaques can be reliably coded using the MaqFACS. We found differences in use and form of some movements, most likely due to specializations in the communicative repertoire of each species, rather than morphological differences.
Collapse
Affiliation(s)
- Églantine Julle-Danière
- Department of Psychology, Centre for Comparative and Evolutionary Psychology, University of Portsmouth , UK
| | - Jérôme Micheletta
- Department of Psychology, Centre for Comparative and Evolutionary Psychology, University of Portsmouth , UK
| | - Jamie Whitehouse
- Department of Psychology, Centre for Comparative and Evolutionary Psychology, University of Portsmouth , UK
| | - Marine Joly
- Department of Psychology, Centre for Comparative and Evolutionary Psychology, University of Portsmouth , UK
| | - Carolin Gass
- Department of Psychology, Centre for Comparative and Evolutionary Psychology, University of Portsmouth , UK
| | - Anne M Burrows
- Department of Physical Therapy, Duquesne University , PA , USA ; Department of Anthropology, University of Pittsburgh , PA , USA
| | - Bridget M Waller
- Department of Psychology, Centre for Comparative and Evolutionary Psychology, University of Portsmouth , UK
| |
Collapse
|
15
|
Abstract
Although some people can voluntarily move their ears, overt reflexive control of the pinnae has been lost during the course of primate evolution. Humans and apes do not move their ears to express emotion, they do not defensively retract them when startled, and they do not point them at novel, salient, or task-relevant stimuli. Nevertheless, it is the thesis of this review that neural circuits for pinna orienting have survived in a purely vestigial state for over 25 million years. There are three lines of evidence: (1) Shifting the eyes hard to one side is accompanied by electromyographic (EMG) activity in certain ear muscles and by a barely visible (2-3 mm) curling of the dorsal edge of the pinna. (2) The capture of attention by a novel, unexpected sound emanating from behind and to one side has been found to trigger a weak EMG response in the muscle behind the corresponding ear. (3) Reflexive EMG bursts recorded during a selective attention task suggested that subjects were unconsciously attempting to orient their ears toward the relevant sounds. In addition to pinna orienting, the possibility that pinna startle might have survived in a vestigial state is also considered. It is suggested that the postauricular reflex to sudden, intense sounds constitutes a vestigial startle response, but that the reflex arc is dominated by a pathway that bypasses the main organizing center for startle.
Collapse
Affiliation(s)
- Steven A Hackley
- Department of Psychological Sciences, University of Missouri, Columbia, Columbia, Missouri, USA
| |
Collapse
|
16
|
Franklin RG, Zebrowitz LA, Fellous JM, Lee A. Generalizing from human facial sexual dimorphism to sex-differentiate macaques: Accuracy and cultural variation. JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY 2013. [DOI: 10.1016/j.jesp.2012.12.008] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
17
|
Abstract
Many nonhuman animals produce facial expressions which sometimes bear clear resemblance to the facial expressions seen in humans. An understanding of this evolutionary continuity between species, and how this relates to social and ecological variables, can help elucidate the meaning, function, and evolution of facial expression. This aim, however, requires researchers to overcome the theoretical and methodological differences in how human and nonhuman facial expressions are approached. Here, we review the literature relating to nonhuman facial expressions and suggest future directions that could facilitate a better understanding of facial expression within an evolutionary context.
Collapse
Affiliation(s)
- Bridget M. Waller
- Centre for Comparative and Evolutionary Psychology, Department of Psychology, University of Portsmouth, UK
| | - Jérôme Micheletta
- Centre for Comparative and Evolutionary Psychology, Department of Psychology, University of Portsmouth, UK
| |
Collapse
|
18
|
Caeiro CC, Waller BM, Zimmermann E, Burrows AM, Davila-Ross M. OrangFACS: A Muscle-Based Facial Movement Coding System for Orangutans (Pongo spp.). INT J PRIMATOL 2012. [DOI: 10.1007/s10764-012-9652-x] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
19
|
Bethell EJ, Holmes A, Maclarnon A, Semple S. Evidence that emotion mediates social attention in rhesus macaques. PLoS One 2012; 7:e44387. [PMID: 22952968 PMCID: PMC3431396 DOI: 10.1371/journal.pone.0044387] [Citation(s) in RCA: 75] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2012] [Accepted: 08/03/2012] [Indexed: 02/02/2023] Open
Abstract
BACKGROUND Recent work on non-human primates indicates that the allocation of social attention is mediated by characteristics of the attending animal, such as social status and genotype, as well as by the value of the target to which attention is directed. Studies of humans indicate that an individual's emotion state also plays a crucial role in mediating their social attention; for example, individuals look for longer towards aggressive faces when they are feeling more anxious, and this bias leads to increased negative arousal and distraction from other ongoing tasks. To our knowledge, no studies have tested for an effect of emotion state on allocation of social attention in any non-human species. METHODOLOGY We presented captive adult male rhesus macaques with pairs of adult male conspecific face images - one with an aggressive expression, one with a neutral expression - and recorded gaze towards these images. Each animal was tested twice, once during a putatively stressful condition (i.e. following a veterinary health check), and once during a neutral (or potentially positive) condition (i.e. a period of environmental enrichment). Initial analyses revealed that behavioural indicators of anxiety and stress were significantly higher after the health check than during enrichment, indicating that the former caused a negative shift in emotional state. PRINCIPLE FINDINGS The macaques showed initial vigilance for aggressive faces across both conditions, but subsequent responses differed between conditions. Following the health check, initial vigilance was followed by rapid and sustained avoidance of aggressive faces. By contrast, during the period of enrichment, the macaques showed sustained attention towards the same aggressive faces. CONCLUSIONS/SIGNIFICANCE These data provide, to our knowledge, the first evidence that shifts in emotion state mediate social attention towards and away from facial cues of emotion in a non-human animal. This work provides novel insights into the evolution of emotion-attention interactions in humans, and mechanisms of social behaviour in non-human primates, and may have important implications for understanding animal psychological wellbeing.
Collapse
Affiliation(s)
- Emily J Bethell
- Centre for Research in Evolutionary and Environmental Anthropology, University of Roehampton, London, United Kingdom.
| | | | | | | |
Collapse
|
20
|
Facial muscle coordination in monkeys during rhythmic facial expressions and ingestive movements. J Neurosci 2012; 32:6105-16. [PMID: 22553017 DOI: 10.1523/jneurosci.6136-11.2012] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Evolutionary hypotheses regarding the origins of communication signals generally suggest, particularly for the case of primate orofacial signals, that they derive by ritualization of noncommunicative behaviors, notably including ingestive behaviors such as chewing and nursing. These theories are appealing in part because of the prominent periodicities in both types of behavior. Despite their intuitive appeal, however, there are little or no data with which to evaluate these theories because the coordination of muscles innervated by the facial nucleus has not been carefully compared between communicative and ingestive movements. Such data are especially crucial for reconciling neurophysiological assumptions regarding facial motor control in communication and ingestion. We here address this gap by contrasting the coordination of facial muscles during different types of rhythmic orofacial behavior in macaque monkeys, finding that the perioral muscles innervated by the facial nucleus are rhythmically coordinated during lipsmacks and that this coordination appears distinct from that observed during ingestion.
Collapse
|
21
|
Waller BM, Lembeck M, Kuchenbuch P, Burrows AM, Liebal K. GibbonFACS: A Muscle-Based Facial Movement Coding System for Hylobatids. INT J PRIMATOL 2012. [DOI: 10.1007/s10764-012-9611-6] [Citation(s) in RCA: 53] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
22
|
DOBSON SETHD. Coevolution of Facial Expression and Social Tolerance in Macaques. Am J Primatol 2012; 74:229-35. [DOI: 10.1002/ajp.21991] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
23
|
Brecht M, Freiwald WA. The many facets of facial interactions in mammals. Curr Opin Neurobiol 2011; 22:259-66. [PMID: 22209040 DOI: 10.1016/j.conb.2011.12.003] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2011] [Revised: 11/27/2011] [Accepted: 12/04/2011] [Indexed: 11/26/2022]
Abstract
Facial interactions are prominent behaviors in primates. Primate facial signaling, which includes the expression of emotions, mimicking of facial movements, and gaze interactions, is visually dominated. Correspondingly, in primate brains an elaborate network of face processing areas exists within visual cortex. But other mammals also communicate through facial interactions using additional sensory modalities. In rodents, multisensory facial interactions are involved in aggressive behaviors and social transmission of food preferences. The eusocial naked mole-rat, whose face is dominated by prominent incisors, uses facial aggression to enforce reproductive suppression. In burrow-living mammals like the naked mole-rat in particular, and in rodents in general, somatosensory face representations in cortex are enlarged. Diversity of sensory domains mediating facial communication might belie underlying common mechanisms. As a case in point, neurogenetics has revealed strongly heritable traits in face processing and identified gene defects that disrupt facial interactions both in humans and rodents.
Collapse
Affiliation(s)
- Michael Brecht
- Bernstein Center for Computational Neuroscience Berlin, Humboldt University, 10115 Berlin, Philippstr. 13 Haus 6, Germany.
| | | |
Collapse
|
24
|
Diogo R, Wood B. Soft-tissue anatomy of the primates: phylogenetic analyses based on the muscles of the head, neck, pectoral region and upper limb, with notes on the evolution of these muscles. J Anat 2011; 219:273-359. [PMID: 21689100 PMCID: PMC3171772 DOI: 10.1111/j.1469-7580.2011.01403.x] [Citation(s) in RCA: 129] [Impact Index Per Article: 9.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/12/2011] [Indexed: 02/01/2023] Open
Abstract
Apart from molecular data, nearly all the evidence used to study primate relationships comes from hard tissues. Here, we provide details of the first parsimony and Bayesian cladistic analyses of the order Primates based exclusively on muscle data. The most parsimonious tree obtained from the cladistic analysis of 166 characters taken from the head, neck, pectoral and upper limb musculature is fully congruent with the most recent evolutionary molecular tree of Primates. That is, this tree recovers not only the relationships among the major groups of primates, i.e. Strepsirrhini {Tarsiiformes [Platyrrhini (Cercopithecidae, Hominoidea)]}, but it also recovers the relationships within each of these inclusive groups. Of the 301 character state changes occurring in this tree, ca. 30% are non-homoplasic evolutionary transitions; within the 220 changes that are unambiguously optimized in the tree, ca. 15% are reversions. The trees obtained by using characters derived from the muscles of the head and neck are more similar to the most recent evolutionary molecular tree than are the trees obtained by using characters derived from the pectoral and upper limb muscles. It was recently argued that since the Pan/Homo split, chimpanzees accumulated more phenotypic adaptations than humans, but our results indicate that modern humans accumulated more muscle character state changes than chimpanzees, and that both these taxa accumulated more changes than gorillas. This overview of the evolution of the primate head, neck, pectoral and upper limb musculature suggests that the only muscle groups for which modern humans have more muscles than most other extant primates are the muscles of the face, larynx and forearm.
Collapse
Affiliation(s)
- R Diogo
- Center for the Advanced Study of Hominid Paleobiology, Department of Anthropology, George Washington University, Washington, DC, USA.
| | | |
Collapse
|
25
|
Mosher CP, Zimmerman PE, Gothard KM. Videos of conspecifics elicit interactive looking patterns and facial expressions in monkeys. Behav Neurosci 2011; 125:639-52. [PMID: 21688888 PMCID: PMC4184141 DOI: 10.1037/a0024264] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
A broader understanding of the neural basis of social behavior in primates requires the use of species-specific stimuli that elicit spontaneous, but reproducible and tractable behaviors. In this context of natural behaviors, individual variation can further inform about the factors that influence social interactions. To approximate natural social interactions similar to those documented by field studies, we used unedited video footage to induce in viewer monkeys spontaneous facial expressions and looking patterns in the laboratory setting. Three adult male monkeys (Macaca mulatta), previously behaviorally and genetically (5-HTTLPR) characterized, were monitored while they watched 10 s video segments depicting unfamiliar monkeys (movie monkeys) displaying affiliative, neutral, and aggressive behaviors. The gaze and head orientation of the movie monkeys alternated between "averted" and "directed" at the viewer. The viewers were not reinforced for watching the movies, thus their looking patterns indicated their interest and social engagement with the stimuli. The behavior of the movie monkey accounted for differences in the looking patterns and facial expressions displayed by the viewers. We also found multiple significant differences in the behavior of the viewers that correlated with their interest in these stimuli. These socially relevant dynamic stimuli elicited spontaneous social behaviors, such as eye-contact induced reciprocation of facial expression, gaze aversion, and gaze following, that were previously not observed in response to static images. This approach opens a unique opportunity to understanding the mechanisms that trigger spontaneous social behaviors in humans and nonhuman primates.
Collapse
Affiliation(s)
- Clayton P Mosher
- Department of Physiology, The University of Arizona, College of Medicine, 1501 North Campbell Avenue, Tucson, AZ 85724, USA
| | | | | |
Collapse
|
26
|
Shackman AJ, Salomons TV, Slagter HA, Fox AS, Winter JJ, Davidson RJ. The integration of negative affect, pain and cognitive control in the cingulate cortex. Nat Rev Neurosci 2011; 12:154-67. [PMID: 21331082 DOI: 10.1038/nrn2994] [Citation(s) in RCA: 1385] [Impact Index Per Article: 106.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
It has been argued that emotion, pain and cognitive control are functionally segregated in distinct subdivisions of the cingulate cortex. However, recent observations encourage a fundamentally different view. Imaging studies demonstrate that negative affect, pain and cognitive control activate an overlapping region of the dorsal cingulate--the anterior midcingulate cortex (aMCC). Anatomical studies reveal that the aMCC constitutes a hub where information about reinforcers can be linked to motor centres responsible for expressing affect and executing goal-directed behaviour. Computational modelling and other kinds of evidence suggest that this intimacy reflects control processes that are common to all three domains. These observations compel a reconsideration of the dorsal cingulate's contribution to negative affect and pain.
Collapse
Affiliation(s)
- Alexander J Shackman
- Department of Psychology, University of Wisconsin, Madison, Wisconsin, WI 53706, USA.
| | | | | | | | | | | |
Collapse
|
27
|
Parr LA, Waller BM, Burrows AM, Gothard KM, Vick SJ. Brief communication: MaqFACS: A muscle-based facial movement coding system for the rhesus macaque. AMERICAN JOURNAL OF PHYSICAL ANTHROPOLOGY 2011; 143:625-30. [PMID: 20872742 DOI: 10.1002/ajpa.21401] [Citation(s) in RCA: 86] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Over 125 years ago, Charles Darwin (1872) suggested that the only way to fully understand the form and function of human facial expression was to make comparisons with other species. Nevertheless, it has been only recently that facial expressions in humans and related primate species have been compared using systematic, anatomically based techniques. Through this approach, large-scale evolutionary and phylogenetic analyses of facial expressions, including their homology, can now be addressed. Here, the development of a muscular-based system for measuring facial movement in rhesus macaques (Macaca mulatta) is described based on the well-known FACS (Facial Action Coding System) and ChimpFACS. These systems describe facial movement according to the action of the underlying facial musculature, which is highly conserved across primates. The coding systems are standardized; thus, their use is comparable across laboratories and study populations. In the development of MaqFACS, several species differences in the facial movement repertoire of rhesus macaques were observed in comparison with chimpanzees and humans, particularly with regard to brow movements, puckering of the lips, and ear movements. These differences do not seem to be the result of constraints imposed by morphological differences in the facial structure of these three species. It is more likely that they reflect unique specializations in the communicative repertoire of each species.
Collapse
Affiliation(s)
- L A Parr
- Department of Psychiatry and Behavioral Science and Yerkes National Primate Research Center, Emory University, Atlanta, GA, USA.
| | | | | | | | | |
Collapse
|
28
|
Leopold DA, Rhodes G. A comparative view of face perception. ACTA ACUST UNITED AC 2011; 124:233-51. [PMID: 20695655 DOI: 10.1037/a0019460] [Citation(s) in RCA: 156] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Face perception serves as the basis for much of human social exchange. Diverse information can be extracted about an individual from a single glance at their face, including their identity, emotional state, and direction of attention. Neuropsychological and functional magnetic resonance imaging (fMRI) experiments reveal a complex network of specialized areas in the human brain supporting these face-reading skills. Here we consider the evolutionary roots of human face perception by exploring the manner in which different animal species view and respond to faces. We focus on behavioral experiments collected from both primates and nonprimates, assessing the types of information that animals are able to extract from the faces of their conspecifics, human experimenters, and natural predators. These experiments reveal that faces are an important category of visual stimuli for animals in all major vertebrate taxa, possibly reflecting the early emergence of neural specialization for faces in vertebrate evolution. At the same time, some aspects of facial perception are only evident in primates and a few other social mammals, and may therefore have evolved to suit the needs of complex social communication. Because the human brain likely utilizes both primitive and recently evolved neural specializations for the processing of faces, comparative studies may hold the key to understanding how these parallel circuits emerged during human evolution.
Collapse
Affiliation(s)
- David A Leopold
- Unit on Cognitive Neurophysiology and Imaging, Laboratory of Neuropsychology, National Institute of Mental Health, Bethesda, MD 20892, USA.
| | | |
Collapse
|
29
|
Ghazanfar AA, Chandrasekaran C, Morrill RJ. Dynamic, rhythmic facial expressions and the superior temporal sulcus of macaque monkeys: implications for the evolution of audiovisual speech. Eur J Neurosci 2010; 31:1807-17. [PMID: 20584185 DOI: 10.1111/j.1460-9568.2010.07209.x] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
Abstract
Audiovisual speech has a stereotypical rhythm that is between 2 and 7 Hz, and deviations from this frequency range in either modality reduce intelligibility. Understanding how audiovisual speech evolved requires investigating the origins of this rhythmic structure. One hypothesis is that the rhythm of speech evolved through the modification of some pre-existing cyclical jaw movements in a primate ancestor. We tested this hypothesis by investigating the temporal structure of lipsmacks and teeth-grinds of macaque monkeys and the neural responses to these facial gestures in the superior temporal sulcus (STS), a region implicated in the processing of audiovisual communication signals in both humans and monkeys. We found that both lipsmacks and teeth-grinds have consistent but distinct peak frequencies and that both fall well within the 2-7 Hz range of mouth movements associated with audiovisual speech. Single neurons and local field potentials of the STS of monkeys readily responded to such facial rhythms, but also responded just as robustly to yawns, a nonrhythmic but dynamic facial expression. All expressions elicited enhanced power in the delta (0-3Hz), theta (3-8Hz), alpha (8-14Hz) and gamma (> 60 Hz) frequency ranges, and suppressed power in the beta (20-40Hz) range. Thus, STS is sensitive to, but not selective for, rhythmic facial gestures. Taken together, these data provide support for the idea that that audiovisual speech evolved (at least in part) from the rhythmic facial gestures of an ancestral primate and that the STS was sensitive to and thus 'prepared' for the advent of rhythmic audiovisual communication.
Collapse
Affiliation(s)
- Asif A Ghazanfar
- Neuroscience Institute, Princeton University, Princeton, NJ 08540, USA.
| | | | | |
Collapse
|
30
|
Steckenfinger SA, Ghazanfar AA. Monkey visual behavior falls into the uncanny valley. Proc Natl Acad Sci U S A 2009; 106:18362-6. [PMID: 19822765 PMCID: PMC2760490 DOI: 10.1073/pnas.0910063106] [Citation(s) in RCA: 96] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2009] [Indexed: 11/18/2022] Open
Abstract
Very realistic human-looking robots or computer avatars tend to elicit negative feelings in human observers. This phenomenon is known as the "uncanny valley" response. It is hypothesized that this uncanny feeling is because the realistic synthetic characters elicit the concept of "human," but fail to live up to it. That is, this failure generates feelings of unease due to character traits falling outside the expected spectrum of everyday social experience. These unsettling emotions are thought to have an evolutionary origin, but tests of this hypothesis have not been forthcoming. To bridge this gap, we presented monkeys with unrealistic and realistic synthetic monkey faces, as well as real monkey faces, and measured whether they preferred looking at one type versus the others (using looking time as a measure of preference). To our surprise, monkey visual behavior fell into the uncanny valley: They looked longer at real faces and unrealistic synthetic faces than at realistic synthetic faces.
Collapse
Affiliation(s)
- Shawn A. Steckenfinger
- Neuroscience Institute, Departments of Psychology and Ecology and Evolutionary Biology, Princeton University, Princeton, NJ 08540
| | - Asif A. Ghazanfar
- Neuroscience Institute, Departments of Psychology and Ecology and Evolutionary Biology, Princeton University, Princeton, NJ 08540
| |
Collapse
|
31
|
Diogo R, Wood BA, Aziz MA, Burrows A. On the origin, homologies and evolution of primate facial muscles, with a particular focus on hominoids and a suggested unifying nomenclature for the facial muscles of the Mammalia. J Anat 2009; 215:300-19. [PMID: 19531159 PMCID: PMC2750763 DOI: 10.1111/j.1469-7580.2009.01111.x] [Citation(s) in RCA: 72] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/15/2009] [Indexed: 11/30/2022] Open
Abstract
The mammalian facial muscles are a subgroup of hyoid muscles (i.e. muscles innervated by cranial nerve VII). They are usually attached to freely movable skin and are responsible for facial expressions. In this study we provide an account of the origin, homologies and evolution of the primate facial muscles, based on dissections of various primate and non-primate taxa and a review of the literature. We provide data not previously reported, including photographs showing in detail the facial muscles of primates such as gibbons and orangutans. We show that the facial muscles usually present in strepsirhines are basically the same muscles that are present in non-primate mammals such as tree-shrews. The exceptions are that strepsirhines often have a muscle that is usually not differentiated in tree-shrews, the depressor supercilii, and lack two muscles that are usually differentiated in these mammals, the zygomatico-orbicularis and sphincter colli superficialis. Monkeys such as macaques usually lack two muscles that are often present in strepsirhines, the sphincter colli profundus and mandibulo-auricularis, but have some muscles that are usually absent as distinct structures in non-anthropoid primates, e.g. the levator labii superioris alaeque nasi, levator labii superioris, nasalis, depressor septi nasi, depressor anguli oris and depressor labii inferioris. In turn, macaques typically lack a risorius, auricularis anterior and temporoparietalis, which are found in hominoids such as humans, but have muscles that are usually not differentiated in members of some hominoid taxa, e.g. the platysma cervicale (usually not differentiated in orangutans, panins and humans) and auricularis posterior (usually not differentiated in orangutans). Based on our observations, comparisons and review of the literature, we propose a unifying, coherent nomenclature for the facial muscles of the Mammalia as a whole and provide a list of more than 300 synonyms that have been used in the literature to designate the facial muscles of primates and other mammals. A main advantage of this nomenclature is that it combines, and thus creates a bridge between, those names used by human anatomists and the names often employed in the literature dealing with non-human primates and non-primate mammals.
Collapse
Affiliation(s)
- R Diogo
- Center for the Advanced Study of Hominid Paleobiology, Department of Anthropology, George Washington University, Washington, DC 20052, USA.
| | | | | | | |
Collapse
|
32
|
Burrows AM, Waller BM, Parr LA. Facial musculature in the rhesus macaque (Macaca mulatta): evolutionary and functional contexts with comparisons to chimpanzees and humans. J Anat 2009; 215:320-34. [PMID: 19563473 PMCID: PMC2750044 DOI: 10.1111/j.1469-7580.2009.01113.x] [Citation(s) in RCA: 43] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/15/2009] [Indexed: 12/01/2022] Open
Abstract
Facial expression is a common mode of visual communication in mammals but especially so in primates. Rhesus macaques (Macaca mulatta) have a well-documented facial expression repertoire that is controlled by the facial/mimetic musculature as in all mammals. However, little is known about the musculature itself and how it compares with those of other primates. Here we present a detailed description of the facial musculature in rhesus macaques in behavioral, evolutionary and comparative contexts. Formalin-fixed faces from six adult male specimens were dissected using a novel technique. The morphology, attachments, three-dimensional relationships and variability of muscles were noted and compared with chimpanzees (Pan troglodytes) and with humans. The results showed that there was a greater number of facial muscles in rhesus macaques than previously described (24 muscles), including variably present (and previously unmentioned) zygomaticus minor, levator labii superioris alaeque nasi, depressor septi, anterior auricularis, inferior auricularis and depressor supercilii muscles. The facial muscles of the rhesus macaque were very similar to those in chimpanzees and humans but M. mulatta did not possess a risorius muscle. These results support previous studies that describe a highly graded and intricate facial expression repertoire in rhesus macaques. Furthermore, these results indicate that phylogenetic position is not the primary factor governing the structure of primate facial musculature and that other factors such as social behavior are probably more important. The results from the present study may provide valuable input to both biomedical studies that use rhesus macaques as a model for human disease and disorder that includes assessment of facial movement and studies into the evolution of primate societies and communication.
Collapse
Affiliation(s)
- Anne M Burrows
- Department of Physical Therapy, Duquesne University, Pittsburgh, PA 15282, USA.
| | | | | |
Collapse
|
33
|
Rogers CR, Mooney MP, Smith TD, Weinberg SM, Waller BM, Parr LA, Docherty BA, Bonar CJ, Reinholt LE, Deleyiannis FWB, Siegel MI, Marazita ML, Burrows AM. Comparative microanatomy of the orbicularis oris muscle between chimpanzees and humans: evolutionary divergence of lip function. J Anat 2009; 214:36-44. [PMID: 19166471 PMCID: PMC2631558 DOI: 10.1111/j.1469-7580.2008.01004.x] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/19/2008] [Indexed: 12/01/2022] Open
Abstract
The orbicularis oris muscle plays a role in the production of primate facial expressions and vocalizations, nutrient intake, and in some non-human primates it is used as a prehensile, manipulative tool. As the chimpanzee (Pan troglodytes) is the closest living relative of humans, a comparison of the orbicularis oris muscle between these species may increase our understanding of the morphological specializations related to the differing functional demands of their lips and the factors responsible for their divergent evolution. To this end, this study compares the microanatomy of the mid-line upper fibers of the orbicularis oris muscle between chimpanzees and humans. A mid-line portion of the orbicularis oris muscle was harvested from the upper lips of three chimpanzee and five human cadavers. The sampled blocks included the area between the lateral borders of the nasal alar cartilages in both species. Each sample was processed for paraffin histology, sectioned and stained with a variety of protocols. Sections were examined for fiber direction and relative thickness of muscle layers. Ratios of cross-sectional connective tissue area vs. cross-sectional muscle tissue area, muscle fiber diameter and relative dermal thickness were calculated for each species. In both species, a clear pars marginalis layer was recognized, contrary to previous reports that only humans possess this layer. In chimpanzees, the relative fiber diameter and relative amount of muscle tissue (i.e. based on ratio of connective tissue area : muscle tissue area) were significantly (P < 0.05) greater than in humans. In contrast, measurements of relative dermal thickness showed that humans have a greater average dermal thickness of the upper lip than chimpanzees. Taken together, these results suggest that both human and chimpanzee orbicularis oris muscle upper fibers meet the specific functional demands associated with their divergent vocal and facial display repertoires, the development of human speech, and the use of the upper lip as a prehensile tool in chimpanzees.
Collapse
Affiliation(s)
- Carolyn R Rogers
- Division of Plastic Surgery, Department of Surgery, School of Medicine, University of Wisconsin Hospital and Clinics, USA
| | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|