1
|
Jeschke L, Mathias B, von Kriegstein K. Inhibitory TMS over Visual Area V5/MT Disrupts Visual Speech Recognition. J Neurosci 2023; 43:7690-7699. [PMID: 37848284 PMCID: PMC10634547 DOI: 10.1523/jneurosci.0975-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 07/26/2023] [Accepted: 09/04/2023] [Indexed: 10/19/2023] Open
Abstract
During face-to-face communication, the perception and recognition of facial movements can facilitate individuals' understanding of what is said. Facial movements are a form of complex biological motion. Separate neural pathways are thought to processing (1) simple, nonbiological motion with an obligatory waypoint in the motion-sensitive visual middle temporal area (V5/MT); and (2) complex biological motion. Here, we present findings that challenge this dichotomy. Neuronavigated offline transcranial magnetic stimulation (TMS) over V5/MT on 24 participants (17 females and 7 males) led to increased response times in the recognition of simple, nonbiological motion as well as visual speech recognition compared with TMS over the vertex, an active control region. TMS of area V5/MT also reduced practice effects on response times, that are typically observed in both visual speech and motion recognition tasks over time. Our findings provide the first indication that area V5/MT causally influences the recognition of visual speech.SIGNIFICANCE STATEMENT In everyday face-to-face communication, speech comprehension is often facilitated by viewing a speaker's facial movements. Several brain areas contribute to the recognition of visual speech. One area of interest is the motion-sensitive visual medial temporal area (V5/MT), which has been associated with the perception of simple, nonbiological motion such as moving dots, as well as more complex, biological motion such as visual speech. Here, we demonstrate using noninvasive brain stimulation that area V5/MT is causally relevant in recognizing visual speech. This finding provides new insights into the neural mechanisms that support the perception of human communication signals, which will help guide future research in typically developed individuals and populations with communication difficulties.
Collapse
Affiliation(s)
- Lisa Jeschke
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technische Universität Dresden, 01069 Dresden, Germany
| | - Brian Mathias
- School of Psychology, University of Aberdeen, Aberdeen AB243FX, United Kingdom
| | - Katharina von Kriegstein
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technische Universität Dresden, 01069 Dresden, Germany
| |
Collapse
|
2
|
Narganes-Pineda C, Paz-Alonso PM, Marotta A, Lupiáñez J, Chica AB. Neural basis of social attention: common and distinct mechanisms for social and nonsocial orienting stimuli. Cereb Cortex 2023; 33:11010-11024. [PMID: 37782936 DOI: 10.1093/cercor/bhad339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 08/22/2023] [Accepted: 08/24/2023] [Indexed: 10/04/2023] Open
Abstract
Social and nonsocial directional stimuli (such as gaze and arrows, respectively) share their ability to trigger attentional processes, although the issue of whether social stimuli generate other additional (and unique) attentional effects is still under debate. In this study, we used the spatial interference paradigm to explore, using functional magnetic resonance imaging, shared and dissociable brain activations produced by gaze and arrows. Results showed a common set of regions (right parieto-temporo-occipital) similarly involved in conflict resolution for gaze and arrows stimuli, which showed stronger co-activation for incongruent than congruent trials. The frontal eye field showed stronger functional connectivity with occipital regions for congruent as compared with incongruent trials, and this effect was enhanced for gaze as compared with arrow stimuli in the right hemisphere. Moreover, spatial interference produced by incongruent (as compared with congruent) arrows was associated with increased functional coupling between the right frontal eye field and a set of regions in the left hemisphere. This result was not observed for incongruent (as compared with congruent) gaze stimuli. The right frontal eye field also showed greater coupling with left temporo-occipital regions for those conditions in which larger conflict was observed (arrow incongruent vs. gaze incongruent trials, and gaze congruent vs. arrow congruent trials). These findings support the view that social and nonsocial stimuli share some attentional mechanisms, while at the same time highlighting other differential effects. Highlights Attentional orienting triggered by social (gaze) and nonsocial (arrow) cues is comparable. When social and nonsocial stimuli are used as targets, qualitatively different behavioral effects are observed. This study explores the neural bases of shared and dissociable neural mechanisms for social and nonsocial stimuli. Shared mechanisms were found in the functional coupling between right parieto-temporo-occipital regions. Dissociable mechanisms were found in the functional coupling between right frontal eye field and ipsilateral and contralateral occipito-temporal regions.
Collapse
Affiliation(s)
- Cristina Narganes-Pineda
- Department of Experimental Psychology and Mind, Brain, and Behavior Research Center (CIMCYC), University of Granada, Campus de Cartuja S/N, 18071, Granada, Spain
| | - Pedro M Paz-Alonso
- BCBL, Basque Center on Cognition, Brain, and Language, Mikeletegi Pasealekua 69, 20009 Donostia, Gipuzkoa, Spain
- IKERBASQUE, Basque Foundation for Science, 48013 Bilbo, Bizkaia, Spain
| | - Andrea Marotta
- Department of Experimental Psychology and Mind, Brain, and Behavior Research Center (CIMCYC), University of Granada, Campus de Cartuja S/N, 18071, Granada, Spain
| | - Juan Lupiáñez
- Department of Experimental Psychology and Mind, Brain, and Behavior Research Center (CIMCYC), University of Granada, Campus de Cartuja S/N, 18071, Granada, Spain
| | - Ana B Chica
- Department of Experimental Psychology and Mind, Brain, and Behavior Research Center (CIMCYC), University of Granada, Campus de Cartuja S/N, 18071, Granada, Spain
| |
Collapse
|
3
|
Xu M, Morimoto S, Hoshino E, Suzuki K, Minagawa Y. Two-in-one system and behavior-specific brain synchrony during goal-free cooperative creation: an analytical approach combining automated behavioral classification and the event-related generalized linear model. NEUROPHOTONICS 2023; 10:013511. [PMID: 36789283 PMCID: PMC9917717 DOI: 10.1117/1.nph.10.1.013511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 01/13/2023] [Indexed: 06/18/2023]
Abstract
SIGNIFICANCE In hyperscanning studies of natural social interactions, behavioral coding is usually necessary to extract brain synchronizations specific to a particular behavior. The more natural the task is, the heavier the coding effort is. We propose an analytical approach to resolve this dilemma, providing insights and avenues for future work in interactive social neuroscience. AIM The objective is to solve the laborious coding problem for naturalistic hyperscanning by proposing a convenient analytical approach and to uncover brain synchronization mechanisms related to human cooperative behavior when the ultimate goal is highly free and creative. APPROACH This functional near-infrared spectroscopy hyperscanning study challenged a cooperative goal-free creative game in which dyads can communicate freely without time constraints and developed an analytical approach that combines automated behavior classification (computer vision) with a generalized linear model (GLM) in an event-related manner. Thirty-nine dyads participated in this study. RESULTS Conventional wavelet-transformed coherence (WTC) analysis showed that joint play induced robust between-brain synchronization (BBS) among the hub-like superior and middle temporal regions and the frontopolar and dorsomedial/dorsolateral prefrontal cortex (PFC) in the right hemisphere, in contrast to sparse within-brain synchronization (WBS). Contrarily, similar regions within a single brain showed strong WBS with similar connection patterns during independent play. These findings indicate a two-in-one system for performing creative problem-solving tasks. Further, WTC-GLM analysis combined with computer vision successfully extracted BBS, which was specific to the events when one of the participants raised his/her face to the other. This brain-to-brain synchrony between the right dorsolateral PFC and the right temporo-parietal junction suggests joint functioning of these areas when mentalization is necessary under situations with restricted social signals. CONCLUSIONS Our proposed analytical approach combining computer vision and WTC-GLM can be applied to extract inter-brain synchrony associated with social behaviors of interest.
Collapse
Affiliation(s)
- Mingdi Xu
- Keio University, Center for Life-span Development of Communication Skills, Yokohama, Japan
- Keio University, Global Research Institute, Tokyo, Japan
| | - Satoshi Morimoto
- Keio University, Center for Life-span Development of Communication Skills, Yokohama, Japan
- Keio University, Global Research Institute, Tokyo, Japan
| | - Eiichi Hoshino
- Keio University, Center for Life-span Development of Communication Skills, Yokohama, Japan
- Keio University, Global Research Institute, Tokyo, Japan
| | - Kenji Suzuki
- University of Tsukuba, Faculty of Engineering, Information and Systems, Tsukuba, Japan
| | - Yasuyo Minagawa
- Keio University, Center for Life-span Development of Communication Skills, Yokohama, Japan
- Keio University, Department of Psychology, Faculty of Letters, Tokyo, Japan
| |
Collapse
|
4
|
Nagashima K, Nakata H, Harada T, Kato I, Sadato N. Differences in the neural networks of thermal sensation with and without evaluation process. IBRO Neurosci Rep 2022; 13:274-283. [PMID: 36176319 PMCID: PMC9513600 DOI: 10.1016/j.ibneur.2022.09.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Accepted: 09/17/2022] [Indexed: 11/01/2022] Open
Abstract
Several neuroimaging studies have analyzed the neural networks involved in thermal sensation. In some of these studies, participants were instructed to evaluate and report the thermal sensation using a point scale, visual analog scale, or other psychophysical rating tool while the imaging data were obtained. Therefore, the imaging data may reflect signals involved in the processes of both sensation and evaluation. The present study aimed to discriminate the neural networks involved in identifying different temperature stimuli and the two different processes by using functional magnetic resonance imaging (fMRI). We applied four different thermal stimuli (“hot,” 40C; “warm,” 36 °C, “cool,” 27 °C; and “cold,” 22 °C) to the left forearm using Peltier apparatus. During the stimuli, participants were instructed to either evaluate (evaluation task) or not evaluate (no-evaluation task) and report the thermal sensation. We found brain activation in the medial prefrontal cortex/anterior cingulate gyrus, inferior frontal gyrus, bilateral insula, and posterior parietal cortex during the four thermal stimuli both with and without the evaluation task. Additionally, the stimuli with the evaluation task induced stronger and broader activation, including the right fronto-parietal and anterior insula regions. These results indicate that thermal stimulation activates the common neural networks, independent of the thermal conditions and evaluation process. Moreover, the evaluation process may increase the attention to the thermal stimuli, resulting in the activation of the right lateralized ventral attentional network. Neural networks involved in thermal sensation were assessed by functional MRI. Warm or cold stimulation was applied to the left forearm. The stimulation was conducted with or without the evaluation of the sensation. Greater activation of a right-lateralized attention network was induced by the evaluation process. A common neural network was found, which was activated by both warm and cold stimuli.
Collapse
|
5
|
Zuberer A, Schwarz L, Kreifelts B, Wildgruber D, Erb M, Fallgatter A, Scheffler K, Ethofer T. Neural Basis of Impaired Emotion Recognition in Adult Attention-Deficit/Hyperactivity Disorder. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2022; 7:680-687. [PMID: 33551283 DOI: 10.1016/j.bpsc.2020.11.013] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 11/23/2020] [Accepted: 11/23/2020] [Indexed: 12/28/2022]
Abstract
BACKGROUND Deficits in emotion recognition have been repeatedly documented in patients diagnosed with attention-deficit/hyperactivity disorder (ADHD), but their neural basis is unknown so far. METHODS In the current study, adult patients with ADHD (n = 44) and healthy control subjects (n = 43) underwent functional magnetic resonance imaging during explicit emotion recognition of stimuli expressing affective information in face, voice, or face-voice combinations. The employed experimental paradigm allowed us to delineate areas for processing audiovisual information based on their functional activation profile, including the bilateral posterior superior temporal gyrus/middle temporal gyrus, amygdala, medial prefrontal cortex, and precuneus, as well as the right posterior thalamus. RESULTS As expected, unbiased hit rates for correct classification of the expressed emotions were lower in patients with ADHD than in healthy control subjects irrespective of the presented sensory modality. This deficit at a behavioral level was accompanied by lower activation in patients with ADHD versus healthy control subjects in the cortex adjacent to the right superior temporal gyrus/middle temporal gyrus and the right posterior thalamus, which represent key areas for processing socially relevant signals and their integration across modalities. A cortical region adjacent to the right posterior superior temporal gyrus was the only brain region that showed a significant correlation between brain activation and emotion identification performance. CONCLUSIONS Altogether, these results provide the first evidence for a potential neural substrate of the observed impairments in emotion recognition in adults with ADHD.
Collapse
Affiliation(s)
- Agnieszka Zuberer
- Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany; Department of Psychiatry and Psychotherapy, Jena University Hospital, Jena, Germany.
| | - Lena Schwarz
- Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany
| | - Benjamin Kreifelts
- Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany
| | - Dirk Wildgruber
- Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany
| | - Michael Erb
- Department of Biomedical Magnetic Resonance, University of Tübingen, Tübingen, Germany
| | - Andreas Fallgatter
- Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany
| | - Klaus Scheffler
- Department of Biomedical Magnetic Resonance, University of Tübingen, Tübingen, Germany; Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Thomas Ethofer
- Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany; Department of Biomedical Magnetic Resonance, University of Tübingen, Tübingen, Germany
| |
Collapse
|
6
|
Guglielmini S, Bopp G, Marcar VL, Scholkmann F, Wolf M. Systemic physiology augmented functional near-infrared spectroscopy hyperscanning: a first evaluation investigating entrainment of spontaneous activity of brain and body physiology between subjects. NEUROPHOTONICS 2022; 9:026601. [PMID: 35449706 PMCID: PMC9016073 DOI: 10.1117/1.nph.9.2.026601] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Accepted: 03/18/2022] [Indexed: 05/27/2023]
Abstract
Significance: Functional near-infrared spectroscopy (fNIRS) enables measuring the brain activity of two subjects while they interact, i.e., the hyperscanning approach. Aim: In our exploratory study, we extended classical fNIRS hyperscanning by adding systemic physiological measures to obtain systemic physiology augmented fNIRS (SPA-fNIRS) hyperscanning while blocking and not blocking the visual communication between the subjects. This approach enables access brain-to-brain, brain-to-body, and body-to-body coupling between the subjects simultaneously. Approach: Twenty-four pairs of subjects participated in the experiment. The paradigm consisted of two subjects that sat in front of each other and had their eyes closed for 10 min, followed by a phase of 10 min where they made eye contact. Brain and body activity was measured continuously by SPA-fNIRS. Results: Our study shows that making eye contact for a prolonged time causes significant changes in brain-to-brain, brain-to-body, and body-to-body coupling, indicating that eye contact is followed by entrainment of the physiology between subjects. Subjects that knew each other generally showed a larger trend to change between the two conditions. Conclusions: The main point of this study is to introduce a new framework to investigate brain-to-brain, body-to-body, and brain-to-body coupling through a simple social experimental paradigm. The study revealed that eye contact leads to significant synchronization of spontaneous activity of the brain and body physiology. Our study is the first that employed the SPA-fNIRS approach and showed its usefulness to investigate complex interpersonal physiological changes.
Collapse
Affiliation(s)
- Sabino Guglielmini
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zurich, Switzerland
| | - Gino Bopp
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zurich, Switzerland
| | - Valentine L. Marcar
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zurich, Switzerland
- University Hospital Zürich, Comprehensive Cancer Center Zürich, Zürich, Switzerland
| | - Felix Scholkmann
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zurich, Switzerland
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
| | - Martin Wolf
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zurich, Switzerland
| |
Collapse
|
7
|
A methodological scoping review of the integration of fMRI to guide dMRI tractography. What has been done and what can be improved: A 20-year perspective. J Neurosci Methods 2022; 367:109435. [PMID: 34915047 DOI: 10.1016/j.jneumeth.2021.109435] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 11/30/2021] [Accepted: 12/02/2021] [Indexed: 11/23/2022]
Abstract
Combining MRI modalities is a growing trend in neurosciences. It provides opportunities to investigate the brain architecture supporting cognitive functions. Integrating fMRI activation to guide dMRI tractography offers potential advantages over standard tractography methods. A quick glimpse of the literature on this topic reveals that this technique is challenging, and no consensus or "best practices" currently exist, at least not within a single document. We present the first attempt to systematically analyze and summarize the literature of 80 studies that integrated task-based fMRI results to guide tractography, over the last two decades. We report 19 findings that cover challenges related to sample size, microstructure modelling, seeding methods, multimodal space registration, false negatives/positives, specificity/validity, gray/white matter interface and more. These findings will help the scientific community (1) understand the strengths and limitations of the approaches, (2) design studies using this integrative framework, and (3) motivate researchers to fill the gaps identified. We provide references toward best practices, in order to improve the overall result's replicability, sensitivity, specificity, and validity.
Collapse
|
8
|
Zhang Y, Hu Q, Lai X, Hu Z, Gao S. Fear-specific leftward bias in gaze direction judgment. Sci Rep 2021; 11:17574. [PMID: 34475474 PMCID: PMC8413379 DOI: 10.1038/s41598-021-97039-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2020] [Accepted: 08/06/2021] [Indexed: 02/07/2023] Open
Abstract
Previous studies have shown that humans have a left spatial attention bias in cognition and behaviour. However, whether there exists a leftward perception bias of gaze direction has not been investigated. To address this gap, we conducted three behavioural experiments using a forced-choice gaze direction judgment task. The point of subjective equality (PSE) was employed to measure whether there was a leftward perception bias of gaze direction, and if there was, whether this bias was modulated by face emotion. The results of experiment 1 showed that the PSE of fearful faces was significantly positive as compared to zero and this effect was not found in angry, happy, and neutral faces, indicating that participants were more likely to judge the gaze direction of fearful faces as directed to their left-side space, namely a leftward perception bias. With the response keys counterbalanced between participants, experiment 2a replicated the findings in experiment 1. To further investigate whether the gaze direction perception variation was contributed by emotional or low-level features of faces, experiment 2b and 3 used inverted faces and inverted eyes, respectively. The results revealed similar leftward perception biases of gaze direction in all types of faces, indicating that gaze direction perception was biased by emotional information in faces rather than low-level facial features. Overall, our study demonstrates that there a fear-specific leftward perception bias in processing gaze direction. These findings shed new light on the cerebral lateralization in humans.
Collapse
Affiliation(s)
- Yue Zhang
- grid.412600.10000 0000 9479 9538Institute of Brain and Psychological Sciences, Sichuan Normal University, Chengdu, 610068 People’s Republic of China ,grid.440818.10000 0000 8664 1765Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, People’s Republic of China
| | - Qiqi Hu
- grid.440818.10000 0000 8664 1765Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, People’s Republic of China
| | - Xinwei Lai
- grid.412600.10000 0000 9479 9538Institute of Brain and Psychological Sciences, Sichuan Normal University, Chengdu, 610068 People’s Republic of China
| | - Zhonghua Hu
- grid.412600.10000 0000 9479 9538Institute of Brain and Psychological Sciences, Sichuan Normal University, Chengdu, 610068 People’s Republic of China
| | - Shan Gao
- grid.54549.390000 0004 0369 4060School of Foreign Languages, University of Electronic Science and Technology of China, Chengdu, 611731 People’s Republic of China ,grid.54549.390000 0004 0369 4060The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Laboratory for NeuroInformation, University of Electronic Science and Technology of China, Chengdu, People’s Republic of China
| |
Collapse
|
9
|
Babo-Rebelo M, Puce A, Bullock D, Hugueville L, Pestilli F, Adam C, Lehongre K, Lambrecq V, Dinkelacker V, George N. Visual Information Routes in the Posterior Dorsal and Ventral Face Network Studied with Intracranial Neurophysiology and White Matter Tract Endpoints. Cereb Cortex 2021; 32:342-366. [PMID: 34339495 PMCID: PMC8754371 DOI: 10.1093/cercor/bhab212] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2020] [Revised: 05/03/2021] [Accepted: 06/02/2021] [Indexed: 11/13/2022] Open
Abstract
Occipitotemporal regions within the face network process perceptual and socioemotional information, but the dynamics and information flow between different nodes of this network are still debated. Here, we analyzed intracerebral EEG from 11 epileptic patients viewing a stimulus sequence beginning with a neutral face with direct gaze. The gaze could avert or remain direct, while the emotion changed to fearful or happy. N200 field potential peak latencies indicated that face processing begins in inferior occipital cortex and proceeds anteroventrally to fusiform and inferior temporal cortices, in parallel. The superior temporal sulcus responded preferentially to gaze changes with augmented field potential amplitudes for averted versus direct gaze, and large effect sizes relative to other network regions. An overlap analysis of posterior white matter tractography endpoints (from 1066 healthy brains) relative to active intracerebral electrodes in the 11 patients showed likely involvement of both dorsal and ventral posterior white matter pathways. Overall, our data provide new insight into the timing of face and social cue processing in the occipitotemporal brain and anchor the superior temporal cortex in dynamic gaze processing.
Collapse
Affiliation(s)
- M Babo-Rebelo
- Institut du Cerveau-Paris Brain Institute, ICM, Inserm U 1127, CNRS UMR 7225, Sorbonne Université, Centre de Neuroimagerie de Recherche, CENIR, Centre MEG-EEG and STIM Platform, Paris F-75013, France.,Sorbonne Université, Institut du Cerveau-Paris Brain Institute, ICM, Inserm U 1127, CNRS UMR 7225, Experimental Neurosurgery Team, Paris F-75013, France.,Institute of Cognitive Neuroscience, University College London, WC1N 3AZ, London, UK
| | - A Puce
- Department of Psychological and Brain Sciences, Programs in Neuroscience, Cognitive Science, Indiana University, Bloomington, IN 47401, USA
| | - D Bullock
- Department of Psychological and Brain Sciences, Programs in Neuroscience, Cognitive Science, Indiana University, Bloomington, IN 47401, USA
| | - L Hugueville
- Institut du Cerveau-Paris Brain Institute, ICM, Inserm U 1127, CNRS UMR 7225, Sorbonne Université, Centre de Neuroimagerie de Recherche, CENIR, Centre MEG-EEG and STIM Platform, Paris F-75013, France
| | - F Pestilli
- Department of Psychological and Brain Sciences, Programs in Neuroscience, Cognitive Science, Indiana University, Bloomington, IN 47401, USA
| | - C Adam
- Neurophysiology Department, AP-HP, GH Pitié-Salpêtrière-Charles Foix, Paris F-75013, France
| | - K Lehongre
- Institut du Cerveau-Paris Brain Institute, ICM, Inserm U 1127, CNRS UMR 7225, Sorbonne Université, Centre de Neuroimagerie de Recherche, CENIR, Centre MEG-EEG and STIM Platform, Paris F-75013, France
| | - V Lambrecq
- Institut du Cerveau-Paris Brain Institute, ICM, Inserm U 1127, CNRS UMR 7225, Sorbonne Université, Centre de Neuroimagerie de Recherche, CENIR, Centre MEG-EEG and STIM Platform, Paris F-75013, France.,Neurophysiology Department, AP-HP, GH Pitié-Salpêtrière-Charles Foix, Paris F-75013, France
| | - V Dinkelacker
- Department of Neurology, Rothschild Foundation, Paris F-75019, France
| | - N George
- Institut du Cerveau-Paris Brain Institute, ICM, Inserm U 1127, CNRS UMR 7225, Sorbonne Université, Centre de Neuroimagerie de Recherche, CENIR, Centre MEG-EEG and STIM Platform, Paris F-75013, France.,Sorbonne Université, Institut du Cerveau-Paris Brain Institute, ICM, Inserm U 1127, CNRS UMR 7225, Experimental Neurosurgery Team, Paris F-75013, France
| |
Collapse
|
10
|
Karimi-Rouzbahani H, Ramezani F, Woolgar A, Rich A, Ghodrati M. Perceptual difficulty modulates the direction of information flow in familiar face recognition. Neuroimage 2021; 233:117896. [PMID: 33667671 PMCID: PMC7614447 DOI: 10.1016/j.neuroimage.2021.117896] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2020] [Revised: 02/10/2021] [Accepted: 02/17/2021] [Indexed: 02/07/2023] Open
Abstract
Humans are fast and accurate when they recognize familiar faces. Previous neurophysiological studies have shown enhanced representations for the dichotomy of familiar vs. unfamiliar faces. As familiarity is a spectrum, however, any neural correlate should reflect graded representations for more vs. less familiar faces along the spectrum. By systematically varying familiarity across stimuli, we show a neural familiarity spectrum using electroencephalography. We then evaluated the spatiotemporal dynamics of familiar face recognition across the brain. Specifically, we developed a novel informational connectivity method to test whether peri-frontal brain areas contribute to familiar face recognition. Results showed that feed-forward flow dominates for the most familiar faces and top-down flow was only dominant when sensory evidence was insufficient to support face recognition. These results demonstrate that perceptual difficulty and the level of familiarity influence the neural representation of familiar faces and the degree to which peri-frontal neural networks contribute to familiar face recognition.
Collapse
Affiliation(s)
- Hamid Karimi-Rouzbahani
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, United Kingdom; Perception in Action Research Centre and Department of Cognitive Science Macquarie University, Australia.
| | - Farzad Ramezani
- Department of Computer Science, School of Mathematics, Statistics, and Computer Science, University of Tehran, Iran
| | - Alexandra Woolgar
- Medical Research Council Cognition and Brain Sciences Unit, University of Cambridge, United Kingdom; Perception in Action Research Centre and Department of Cognitive Science Macquarie University, Australia
| | - Anina Rich
- Perception in Action Research Centre and Department of Cognitive Science Macquarie University, Australia
| | - Masoud Ghodrati
- Neuroscience Program, Biomedicine Discovery Institute, Monash University, Australia.
| |
Collapse
|
11
|
Quinones Sanchez JF, Liu X, Zhou C, Hildebrandt A. Nature and nurture shape structural connectivity in the face processing brain network. Neuroimage 2021; 229:117736. [PMID: 33486123 DOI: 10.1016/j.neuroimage.2021.117736] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 12/23/2020] [Accepted: 01/05/2021] [Indexed: 01/12/2023] Open
Abstract
Face processing is a key ability facilitating social cognition. Only a few studies explored how nature and nurture shape face processing ontogeny at the behavioral and neural level. Also, very little is known about the contributions of nature and nurture to the establishment of white matter fibers supporting this specific human ability. The main purpose of this study was to assess genetic and environmental influences on white matter bundles connecting atlas-defined and functionally-defined face-responsive areas in the brain. Diffusion weighted images from 408 twins (monozygotic = 264, dizygotic = 144) were obtained from the WU-Minn Human Connectome Project. Fractional anisotropy - a widely used measure of fiber quality - of seven white matter tracts in the face network and ten global white matter tracts was analyzed by means of Structural Equation Modeling for twin data. Results revealed small and moderate genetic effects on face network fiber quality in addition to their shared variance with global brain white matter integrity. Furthermore, a theoretically expected common latent factor accounted for limited genetic and larger environmental variance in multiple face network fibers. The findings suggest that both genetic and environmental factors explain individual differences in fiber quality within the face network, as compared with much larger genetic effects on global brain white matter quality. In addition to heritability, individual-specific environmental influences on the face processing brain network are large, a finding that suggests to connect nature and nurture views on this remarkably specific human ability.
Collapse
Affiliation(s)
| | - Xinyang Liu
- Department of Psychology, Carl von Ossietzky Universität Oldenburg, Germany; Department of Physics, Centre for Nonlinear Studies and Beijing-Hong Kong-Singapore Joint Centre for Nonlinear and Complex Systems (Hong Kong), Institute of Computational and Theoretical Studies, Hong Kong Baptist University, Hong Kong
| | - Changsong Zhou
- Department of Physics, Centre for Nonlinear Studies and Beijing-Hong Kong-Singapore Joint Centre for Nonlinear and Complex Systems (Hong Kong), Institute of Computational and Theoretical Studies, Hong Kong Baptist University, Hong Kong; Department of Physics, Zhejiang University, Hangzhou, China
| | - Andrea Hildebrandt
- Department of Psychology, Carl von Ossietzky Universität Oldenburg, Germany; Research Center Neurosensory Science, Carl von Ossietzky Universität Oldenburg, Germany.
| |
Collapse
|
12
|
Yen C, Chiang MC. Examining the effect of online advertisement cues on human responses using eye-tracking, EEG, and MRI. Behav Brain Res 2021; 402:113128. [PMID: 33460680 DOI: 10.1016/j.bbr.2021.113128] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Revised: 12/07/2020] [Accepted: 01/04/2021] [Indexed: 11/29/2022]
Abstract
This study sought to emphasize how disciplines such as neuroscience and marketing can be applied in advertising and consumer behavior. The application of neuroscience methods in analyzing and understanding human behavior related to the Elaboration Likelihood Model (ELM) and brain activity has recently garnered attention. This study examines brain processes while participants attempted to elicit preferences for a product, and demonstrates factors that influence consumer behavior using eye-tracking, electroencephalography (EEG), and magnetic resonance imaging (MRI) from a neuroscience approach. We planned two conditions of online advertising, namely, peripheral cues without argument and central cues with argument strength. Thirty respondents participated in the experiment, consisting of eye-tracking, EEG, and MRI instruments to explore brain activity in central cue conditions. We investigated whether diffusion tensor imaging (DTI) analysis could detect regional brain changes. Using eye-tracking, we found that the responses were mainly in the mean fixation duration, number of fixations, mean saccade duration, and number of saccade durations for the central cue condition. Moreover, the findings show that the fusiform gyrus and frontal cortex are significantly associated with building a relationship by inferring central cues in the EEG assay. The MRI images show that the fusiform gyrus and frontal cortex are significantly active in the central cue condition. DTI analysis indicates that the corpus callosum has changed in the central cue condition. We used eye-tracking, EEG, MRI, and DTI to understand that these connections may apprehend responses when viewing advertisements, especially in the fusiform gyrus, frontal cortex, and corpus callosum.
Collapse
Affiliation(s)
- Chiahui Yen
- Department of International Business, Ming Chuan University, Taipei 111, Taiwan
| | - Ming-Chang Chiang
- Department of Life Science, College of Science and Engineering, Fu Jen Catholic University, New Taipei City 242, Taiwan.
| |
Collapse
|
13
|
Jiang J, von Kriegstein K, Jiang J. Brain mechanisms of eye contact during verbal communication predict autistic traits in neurotypical individuals. Sci Rep 2020; 10:14602. [PMID: 32884087 PMCID: PMC7471895 DOI: 10.1038/s41598-020-71547-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2017] [Accepted: 08/12/2020] [Indexed: 11/16/2022] Open
Abstract
Atypical eye contact in communication is a common characteristic in autism spectrum disorders. Autistic traits vary along a continuum extending into the neurotypical population. The relation between autistic traits and brain mechanisms underlying spontaneous eye contact during verbal communication remains unexplored. Here, we used simultaneous functional magnetic resonance imaging and eye tracking to investigate this relation in neurotypical people within a naturalistic verbal context. Using multiple regression analyses, we found that brain response in the posterior superior temporal sulcus (pSTS) and its connectivity with the fusiform face area (FFA) during eye contact with a speaker predicted the level of autistic traits measured by Autism-spectrum Quotient (AQ). Further analyses for different AQ subclusters revealed that these two predictors were negatively associated with attention to detail. The relation between FFA–pSTS connectivity and the attention to detail ability was mediated by individuals’ looking preferences for speaker’s eyes. This study identified the role of an individual eye contact pattern in the relation between brain mechanisms underlying natural eye contact during verbal communication and autistic traits in neurotypical people. The findings may help to increase our understanding of the mechanisms of atypical eye contact behavior during natural communication.
Collapse
Affiliation(s)
- Jing Jiang
- Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, 94305, USA. .,Max Planck Institute for Human Cognitive and Brain Sciences, 04103, Leipzig, Germany. .,Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, 10117, Berlin, Germany. .,Institute of Psychology, Humboldt-Universität zu Berlin, 12489, Berlin, Germany.
| | - Katharina von Kriegstein
- Max Planck Institute for Human Cognitive and Brain Sciences, 04103, Leipzig, Germany.,Institute of Psychology, Humboldt-Universität zu Berlin, 12489, Berlin, Germany.,Faculty of Psychology, Technische Universität Dresden, 01187, Dresden, Germany
| | - Jiefeng Jiang
- Department of Psychological and Brain Sciences, University of Iowa, Iowa City, IA, 52242, USA
| |
Collapse
|
14
|
Grady CL, Rieck JR, Nichol D, Garrett DD. Functional Connectivity within and beyond the Face Network Is Related to Reduced Discrimination of Degraded Faces in Young and Older Adults. Cereb Cortex 2020; 30:6206-6223. [DOI: 10.1093/cercor/bhaa179] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2020] [Revised: 05/08/2020] [Accepted: 05/26/2020] [Indexed: 11/14/2022] Open
Abstract
Abstract
Degrading face stimuli reduces face discrimination in both young and older adults, but the brain correlates of this decline in performance are not fully understood. We used functional magnetic resonance imaging to examine the effects of degraded face stimuli on face and nonface brain networks and tested whether these changes would predict the linear declines seen in performance. We found decreased activity in the face network (FN) and a decrease in the similarity of functional connectivity (FC) in the FN across conditions as degradation increased but no effect of age. FC in whole-brain networks also changed with increasing degradation, including increasing FC between the visual network and cognitive control networks. Older adults showed reduced modulation of this whole-brain FC pattern. The strongest predictors of within-participant decline in accuracy were changes in whole-brain network FC and FC similarity of the FN. There was no influence of age on these brain-behavior relations. These results suggest that a systems-level approach beyond the FN is required to understand the brain correlates of performance decline when faces are obscured with noise. In addition, the association between brain and behavior changes was maintained into older age, despite the dampened FC response to face degradation seen in older adults.
Collapse
Affiliation(s)
- Cheryl L Grady
- Rotman Research Institute, Baycrest, Toronto, ON M6A2E1, Canada
- Departments of Psychiatry and Psychology, University of Toronto, Toronto, ON, Canada
| | - Jenny R Rieck
- Rotman Research Institute, Baycrest, Toronto, ON M6A2E1, Canada
| | - Daniel Nichol
- Rotman Research Institute, Baycrest, Toronto, ON M6A2E1, Canada
| | - Douglas D Garrett
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Max Planck Institute for Human Development, Berlin, Germany
| |
Collapse
|
15
|
Skiba RM, Vuilleumier P. Brain Networks Processing Temporal Information in Dynamic Facial Expressions. Cereb Cortex 2020; 30:6021-6038. [DOI: 10.1093/cercor/bhaa176] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2019] [Revised: 04/30/2020] [Accepted: 05/22/2020] [Indexed: 11/14/2022] Open
Abstract
Abstract
This fMRI study examines the role of local and global motion information in facial movements during exposure to novel dynamic face stimuli. We found that synchronous expressions distinctively engaged medial prefrontal areas in the rostral and caudal sectors of anterior cingulate cortex (r/cACC) extending to inferior supplementary motor areas, as well as motor cortex and bilateral superior frontal gyrus (global temporal-spatial processing). Asynchronous expressions in which one part of the face unfolded before the other activated more the right superior temporal sulcus (STS) and inferior frontal gyrus (local temporal-spatial processing). These differences in temporal dynamics had no effect on visual face-responsive areas. Dynamic causal modeling analysis further showed that processing of asynchronous expression features was associated with a differential information flow, centered on STS, which received direct input from occipital cortex and projected to the amygdala. Moreover, STS and amygdala displayed selective interactions with cACC where the integration of both local and global motion cues could take place. These results provide new evidence for a role of local and global temporal dynamics in emotional expressions, extracted in partly separate brain pathways. Importantly, we show that dynamic expressions with synchronous movement cues may distinctively engage brain areas responsible for motor execution of expressions.
Collapse
Affiliation(s)
- Rafal M Skiba
- Laboratory for Behavioural Neurology and Imaging of Cognition, Department of Basic Neuroscience, University of Geneva, 1211 Geneva, Switzerland
- Swiss Center for Affective Science, University of Geneva, Campus Biotech, 1202 Geneva, Switzerland
| | - Patrik Vuilleumier
- Laboratory for Behavioural Neurology and Imaging of Cognition, Department of Basic Neuroscience, University of Geneva, 1211 Geneva, Switzerland
- Swiss Center for Affective Science, University of Geneva, Campus Biotech, 1202 Geneva, Switzerland
| |
Collapse
|
16
|
Koike T, Tanabe HC, Adachi-Abe S, Okazaki S, Nakagawa E, Sasaki AT, Shimada K, Sugawara SK, Takahashi HK, Yoshihara K, Sadato N. Role of the right anterior insular cortex in joint attention-related identification with a partner. Soc Cogn Affect Neurosci 2020; 14:1131-1145. [PMID: 31919530 DOI: 10.1093/scan/nsz087] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2019] [Revised: 09/04/2019] [Accepted: 09/30/2019] [Indexed: 12/30/2022] Open
Abstract
Understanding others as intentional agents is critical in social interactions. We perceive others' intentions through identification, a categorical judgment that others should work like oneself. The most primitive form of understanding others' intentions is joint attention (JA). During JA, an initiator selects a shared object through gaze (initiative joint attention, IJA), and the responder follows the direction of the initiator's gaze (reactive joint attention, RJA). Therefore, both participants share the intention of object selection. However, the neural underpinning of shared intention through JA remains unknown. In this study, we hypothesized that JA is represented by inter-individual neural synchronization of the intention-related activity. Additionally, JA requires eye contact that activates the limbic mirror system; therefore, we hypothesized that this system is involved in shared attention through JA. To test these hypotheses, participants underwent hyperscanning fMRI while performing JA tasks. We found that IJA-related activation of the right anterior insular cortex of participants was positively correlated with RJA-related activation of homologous regions in their partners. This area was activated by volitional selection of the target during IJA. Therefore, identification with others by JA is likely accomplished by the shared intentionality of target selection represented by inter-individual synchronization of the right anterior insular cortex.
Collapse
Affiliation(s)
- Takahiko Koike
- Division of Cerebral Integration, Department of System Neuroscience, National Institute for Physiological Sciences (NIPS), 444-8585, Okazaki, Japan
| | - Hiroki C Tanabe
- Division of Cerebral Integration, Department of System Neuroscience, National Institute for Physiological Sciences (NIPS), 444-8585, Okazaki, Japan.,Division of Psychology, Department of Cognitive and Psychological Sciences, Graduate School of Informatics, Nagoya University, 464-8601, Nagoya, Japan
| | - Saori Adachi-Abe
- Department of Medicine, Tokyo Medical and Dental University, 113-8510, Tokyo, Japan
| | - Shuntaro Okazaki
- Division of Cerebral Integration, Department of System Neuroscience, National Institute for Physiological Sciences (NIPS), 444-8585, Okazaki, Japan.,Research Center for Child Mental Development, University of Fukui, 910-1193, Fukui, Japan
| | - Eri Nakagawa
- Division of Cerebral Integration, Department of System Neuroscience, National Institute for Physiological Sciences (NIPS), 444-8585, Okazaki, Japan.,Graduate School of Intercultural Studies School of Languages and Communication, Kobe University, 657-8501, Kobe, Japan
| | - Akihiro T Sasaki
- Pathophysiological and Health Science Team, RIKEN Center for Life Science Technologies, 650-0047, Kobe, Japan.,Department of Physiology, Osaka City University Graduate School of Medicine, 558-8585, Osaka, Japan
| | - Koji Shimada
- Division of Cerebral Integration, Department of System Neuroscience, National Institute for Physiological Sciences (NIPS), 444-8585, Okazaki, Japan.,Graduate School of Intercultural Studies School of Languages and Communication, Kobe University, 657-8501, Kobe, Japan
| | - Sho K Sugawara
- Division of Cerebral Integration, Department of System Neuroscience, National Institute for Physiological Sciences (NIPS), 444-8585, Okazaki, Japan.,Japan Society for the Promotion of Science
| | - Haruka K Takahashi
- Division of Cerebral Integration, Department of System Neuroscience, National Institute for Physiological Sciences (NIPS), 444-8585, Okazaki, Japan.,Department of Physiological Sciences, School of Life Sciences, The Graduate University for Advanced Studies, 240-0193, Kanagawa, Japan
| | - Kazufumi Yoshihara
- Division of Cerebral Integration, Department of System Neuroscience, National Institute for Physiological Sciences (NIPS), 444-8585, Okazaki, Japan.,Department of Psychosomatic Medicine, Graduate School of Medical Sciences, Kyushu University, 819-0395, Fukuoka, Japan
| | - Norihiro Sadato
- Division of Cerebral Integration, Department of System Neuroscience, National Institute for Physiological Sciences (NIPS), 444-8585, Okazaki, Japan.,Biomedical Imaging Research Center (BIRC), University of Fukui, 910-1193, Fukui, Japan.,Department of Physiological Sciences, School of Life Sciences, The Graduate University for Advanced Studies, 240-0193, Kanagawa, Japan
| |
Collapse
|
17
|
Vinçon-Leite A, Saitovitch A, Lemaitre H, Rechtman E, Fillon L, Grevent D, Calmon R, Brunelle F, Boddaert N, Zilbovicius M. Neural basis of interindividual variability in social perception in typically developing children and adolescents using diffusion tensor imaging. Sci Rep 2020; 10:6379. [PMID: 32286406 PMCID: PMC7156418 DOI: 10.1038/s41598-020-63273-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2019] [Accepted: 03/05/2020] [Indexed: 11/09/2022] Open
Abstract
Humans show great interindividual variability in the degree they engage in social relationship. The neural basis of this variability is still poorly understood, particularly in children. In this study, we aimed to investigate the neural basis of interindividual variability in the first step of social behavior, that is social perception, in typically developing children. For that purpose, we first used eye-tracking to objectively measure eye-gaze processing during passive visualization of social movie clips in 24 children and adolescents (10.5 ± 2.9 y). Secondly, we correlated eye-tracking data with measures of fractional anisotropy, an index of white matter microstructure, obtained using diffusion tensor imaging MRI. The results showed a large interindividual variability in the number of fixations to the eyes of characters during visualization of social scenes. In addition, whole-brain analysis showed a significant positive correlation between FA and number of fixations to the eyes,mainly in the temporal part of the superior longitudinal fasciculi bilaterally, adjacent to the posterior superior temporal cortex. Our results indicate the existence of a neural signature associated with the interindividual variability in social perception in children, contributing for better understanding the neural basis of typical and atypical development of a broader social expertise.
Collapse
Affiliation(s)
- A Vinçon-Leite
- INSERM UA10, University René Descartes, PRES Sorbonne Paris Cité and UMR 1163, Institut Imagine, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, Paris, France.
| | - A Saitovitch
- INSERM UA10, University René Descartes, PRES Sorbonne Paris Cité and UMR 1163, Institut Imagine, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, Paris, France
| | - H Lemaitre
- INSERM UA10, University René Descartes, PRES Sorbonne Paris Cité and UMR 1163, Institut Imagine, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, Paris, France.,Paris-Saclay University, Paris Sud University, Faculté de médecine, Paris, France
| | - E Rechtman
- INSERM UA10, University René Descartes, PRES Sorbonne Paris Cité and UMR 1163, Institut Imagine, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, Paris, France
| | - L Fillon
- INSERM UA10, University René Descartes, PRES Sorbonne Paris Cité and UMR 1163, Institut Imagine, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, Paris, France
| | - D Grevent
- INSERM UA10, University René Descartes, PRES Sorbonne Paris Cité and UMR 1163, Institut Imagine, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, Paris, France
| | - R Calmon
- INSERM UA10, University René Descartes, PRES Sorbonne Paris Cité and UMR 1163, Institut Imagine, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, Paris, France
| | - F Brunelle
- INSERM UA10, University René Descartes, PRES Sorbonne Paris Cité and UMR 1163, Institut Imagine, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, Paris, France
| | - N Boddaert
- INSERM UA10, University René Descartes, PRES Sorbonne Paris Cité and UMR 1163, Institut Imagine, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, Paris, France
| | - M Zilbovicius
- INSERM UA10, University René Descartes, PRES Sorbonne Paris Cité and UMR 1163, Institut Imagine, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, Paris, France
| |
Collapse
|
18
|
Borowiak K, Maguinness C, von Kriegstein K. Dorsal-movement and ventral-form regions are functionally connected during visual-speech recognition. Hum Brain Mapp 2020; 41:952-972. [PMID: 31749219 PMCID: PMC7267922 DOI: 10.1002/hbm.24852] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2019] [Revised: 09/03/2019] [Accepted: 10/21/2019] [Indexed: 01/17/2023] Open
Abstract
Faces convey social information such as emotion and speech. Facial emotion processing is supported via interactions between dorsal-movement and ventral-form visual cortex regions. Here, we explored, for the first time, whether similar dorsal-ventral interactions (assessed via functional connectivity), might also exist for visual-speech processing. We then examined whether altered dorsal-ventral connectivity is observed in adults with high-functioning autism spectrum disorder (ASD), a disorder associated with impaired visual-speech recognition. We acquired functional magnetic resonance imaging (fMRI) data with concurrent eye tracking in pairwise matched control and ASD participants. In both groups, dorsal-movement regions in the visual motion area 5 (V5/MT) and the temporal visual speech area (TVSA) were functionally connected to ventral-form regions (i.e., the occipital face area [OFA] and the fusiform face area [FFA]) during the recognition of visual speech, in contrast to the recognition of face identity. Notably, parts of this functional connectivity were decreased in the ASD group compared to the controls (i.e., right V5/MT-right OFA, left TVSA-left FFA). The results confirmed our hypothesis that functional connectivity between dorsal-movement and ventral-form regions exists during visual-speech processing. Its partial dysfunction in ASD might contribute to difficulties in the recognition of dynamic face information relevant for successful face-to-face communication.
Collapse
Affiliation(s)
- Kamila Borowiak
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technische Universität DresdenDresdenGermany
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
- Berlin School of Mind and Brain, Humboldt University of BerlinBerlinGermany
| | - Corrina Maguinness
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technische Universität DresdenDresdenGermany
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| | - Katharina von Kriegstein
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technische Universität DresdenDresdenGermany
- Max Planck Institute for Human Cognitive and Brain SciencesLeipzigGermany
| |
Collapse
|
19
|
Cohen AL, Soussand L, Corrow SL, Martinaud O, Barton JJS, Fox MD. Looking beyond the face area: lesion network mapping of prosopagnosia. Brain 2019; 142:3975-3990. [PMID: 31740940 PMCID: PMC6906597 DOI: 10.1093/brain/awz332] [Citation(s) in RCA: 66] [Impact Index Per Article: 13.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2019] [Revised: 08/29/2019] [Accepted: 09/09/2019] [Indexed: 12/31/2022] Open
Abstract
Damage to the right fusiform face area can disrupt the ability to recognize faces, a classic example of how damage to a specialized brain region can disrupt a specialized brain function. However, similar symptoms can arise from damage to other brain regions, and face recognition is now thought to depend on a distributed brain network. The extent of this network and which regions are critical for facial recognition remains unclear. Here, we derive this network empirically based on lesion locations causing clinically significant impairments in facial recognition. Cases of acquired prosopagnosia were identified through a systematic literature search and lesion locations were mapped to a common brain atlas. The network of brain regions connected to each lesion location was identified using resting state functional connectivity from healthy participants (n = 1000), a technique termed lesion network mapping. Lesion networks were overlapped to identify connections common to lesions causing prosopagnosia. Reproducibility was assessed using split-half replication. Specificity was assessed through comparison with non-specific control lesions (n = 135) and with control lesions associated with symptoms other than prosopagnosia (n = 155). Finally, we tested whether our facial recognition network derived from clinically evident cases of prosopagnosia could predict subclinical facial agnosia in an independent lesion cohort (n = 31). Our systematic literature search identified 44 lesions causing prosopagnosia, only 29 of which intersected the right fusiform face area. However, all 44 lesion locations fell within a single brain network defined by connectivity to the right fusiform face area. Less consistent connectivity was found to other face-selective regions. Surprisingly, all 44 lesion locations were also functionally connected, through negative correlation, with regions in the left frontal cortex. This connectivity pattern was highly reproducible and specific to lesions causing prosopagnosia. Positive connectivity to the right fusiform face area and negative connectivity to left frontal regions were independent predictors of prosopagnosia and predicted subclinical facial agnosia in an independent lesion cohort. We conclude that lesions causing prosopagnosia localize to a single functionally connected brain network defined by connectivity to the right fusiform face area and to left frontal regions. Implications of these findings for models of facial recognition deficits are discussed.
Collapse
Affiliation(s)
- Alexander L Cohen
- Department of Neurology, Boston Children’s Hospital, Harvard Medical School, Boston, MA, USA
- Berenson-Allen Center for Non-Invasive Brain Stimulation and Division of Cognitive Neurology, Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
- Computational Radiology Laboratory, Department of Radiology, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA
| | - Louis Soussand
- Berenson-Allen Center for Non-Invasive Brain Stimulation and Division of Cognitive Neurology, Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | | | - Olivier Martinaud
- Department of Neurology Neuropsychology and Imaging of Human Memory, Caen-Normandy University, PSL Research University, EPHE, INSERM, Caen University Hospital, Caen, France
| | - Jason J S Barton
- Departments of Medicine (Neurology), Ophthalmology and Visual Sciences, Psychology, University of British Columbia, Canada
| | - Michael D Fox
- Berenson-Allen Center for Non-Invasive Brain Stimulation and Division of Cognitive Neurology, Department of Neurology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
- Athinoula A. Martinos Centre for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Charlestown, MA, USA
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
20
|
Ethofer T, Stegmaier S, Koch K, Reinl M, Kreifelts B, Schwarz L, Erb M, Scheffler K, Wildgruber D. Are you laughing at me? Neural correlates of social intent attribution to auditory and visual laughter. Hum Brain Mapp 2019; 41:353-361. [PMID: 31642167 PMCID: PMC7268062 DOI: 10.1002/hbm.24806] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Revised: 08/30/2019] [Accepted: 09/15/2019] [Indexed: 01/17/2023] Open
Abstract
Laughter is a multifaceted signal, which can convey social acceptance facilitating social bonding as well as social rejection inflicting social pain. In the current study, we addressed the neural correlates of social intent attribution to auditory or visual laughter within an fMRI study to identify brain areas showing linear increases of activation with social intent ratings. Negative social intent attributions were associated with activation increases within the medial prefrontal cortex/anterior cingulate cortex (mPFC/ACC). Interestingly, negative social intent attributions of auditory laughter were represented more rostral than visual laughter within this area. Our findings corroborate the role of the mPFC/ACC as key node for processing “social pain” with distinct modality‐specific subregions. Other brain areas that showed an increase of activation included bilateral inferior frontal gyrus and right superior/middle temporal gyrus (STG/MTG) for visually presented laughter and bilateral STG for auditory presented laughter with no overlap across modalities. Similarly, positive social intent attributions were linked to hemodynamic responses within the right inferior parietal lobe and right middle frontal gyrus, but there was no overlap of activity for visual and auditory laughter. Our findings demonstrate that social intent attribution to auditory and visual laughter is located in neighboring, but spatially distinct neural structures.
Collapse
Affiliation(s)
- Thomas Ethofer
- Department of General Psychiatry, University of Tuebingen, Tuebingen, Germany.,Department of Biomedical Resonance, University of Tuebingen, Tuebingen, Germany
| | - Sophia Stegmaier
- Department of General Psychiatry, University of Tuebingen, Tuebingen, Germany
| | - Katharina Koch
- Department of General Psychiatry, University of Tuebingen, Tuebingen, Germany
| | - Maren Reinl
- Department of General Psychiatry, University of Tuebingen, Tuebingen, Germany
| | - Benjamin Kreifelts
- Department of General Psychiatry, University of Tuebingen, Tuebingen, Germany
| | - Lena Schwarz
- Department of General Psychiatry, University of Tuebingen, Tuebingen, Germany
| | - Michael Erb
- Department of Biomedical Resonance, University of Tuebingen, Tuebingen, Germany
| | - Klaus Scheffler
- Department of Biomedical Resonance, University of Tuebingen, Tuebingen, Germany.,Max-Planck-Institute for Biological Cybernetics, University of Tuebingen, Tuebingen, Germany
| | - Dirk Wildgruber
- Department of General Psychiatry, University of Tuebingen, Tuebingen, Germany
| |
Collapse
|
21
|
Pathways for smiling, disgust and fear recognition in blindsight patients. Neuropsychologia 2019; 128:6-13. [DOI: 10.1016/j.neuropsychologia.2017.08.028] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2017] [Revised: 08/03/2017] [Accepted: 08/28/2017] [Indexed: 01/08/2023]
|
22
|
Schwarz L, Kreifelts B, Wildgruber D, Erb M, Scheffler K, Ethofer T. Properties of face localizer activations and their application in functional magnetic resonance imaging (fMRI) fingerprinting. PLoS One 2019; 14:e0214997. [PMID: 31013276 PMCID: PMC6478291 DOI: 10.1371/journal.pone.0214997] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2018] [Accepted: 03/25/2019] [Indexed: 11/18/2022] Open
Abstract
Functional localizers are particularly prevalent in functional magnetic resonance imaging (fMRI) studies concerning face processing. In this study, we extend the knowledge on face localizers regarding four important aspects: First, activation differences in occipital and fusiform face areas (OFA/FFA) and amygdala are characterized by increased activation while precuneus and medial prefrontal cortex show decreased deactivation to faces versus control stimuli. The face-selective posterior superior temporal sulcus is a hybrid area exhibiting increased activation within its inferior and decreased deactivation within its superior part. Second, the employed control stimuli can impact on whether a region is classified in group analyses as face-selective or not. We specifically investigated this for recently described cytoarchitectonic subregions of the fusiform cortex (FG-2/FG-4). Averaged activity across voxels in FG-4 was stronger for faces than objects, houses, or landscapes. In FG-2, averaged activity was only significantly stronger in comparison with landscapes, but small peaks within this area were detected for comparison versus objects and houses. Third, reproducibility of individual peak activations is excellent for right FFA and quite good for right OFA, whereas within all other areas it was too low to provide valid information on time-invariant individual peaks. Finally, the fine-grained spatial activation patterns in right OFA and FFA are both time-invariant within each individual and sufficiently different between individuals to enable identification of individual participants with near-perfect precision (fMRI fingerprinting).
Collapse
Affiliation(s)
- Lena Schwarz
- University Department of Psychiatry and Psychotherapy, University Hospital Tuebingen, Tuebingen, Germany
- Department for Biomedical Magnetic Resonance, University Hospital Tuebingen, Tuebingen, Germany
- * E-mail:
| | - Benjamin Kreifelts
- University Department of Psychiatry and Psychotherapy, University Hospital Tuebingen, Tuebingen, Germany
| | - Dirk Wildgruber
- University Department of Psychiatry and Psychotherapy, University Hospital Tuebingen, Tuebingen, Germany
| | - Michael Erb
- Department for Biomedical Magnetic Resonance, University Hospital Tuebingen, Tuebingen, Germany
| | - Klaus Scheffler
- Department for Biomedical Magnetic Resonance, University Hospital Tuebingen, Tuebingen, Germany
- Magnetic Resonance Centre, Max-Planck-Institute for Biological Cybernetics, Tuebingen, Germany
| | - Thomas Ethofer
- University Department of Psychiatry and Psychotherapy, University Hospital Tuebingen, Tuebingen, Germany
- Department for Biomedical Magnetic Resonance, University Hospital Tuebingen, Tuebingen, Germany
| |
Collapse
|
23
|
Thompson SJ, Foulsham T, Leekam SR, Jones CR. Attention to the face is characterised by a difficult to inhibit first fixation to the eyes. Acta Psychol (Amst) 2019; 193:229-238. [PMID: 30690268 DOI: 10.1016/j.actpsy.2019.01.006] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2018] [Revised: 12/21/2018] [Accepted: 01/07/2019] [Indexed: 10/27/2022] Open
Abstract
The eyes are preferentially attended over other facial features and recent evidence suggests this bias is difficult to suppress. To further examine the automatic and volitional nature of this bias for eye information, we used a novel prompting face recognition paradigm in 41 adults and measured the location of their first fixations, overall dwell time and behavioural responses. First, patterns of eye gaze were measured during a free-viewing forced choice face recognition paradigm. Second, the task was repeated but with prompts to look to either the eyes or the mouth. Participants showed significantly more first fixations to the eyes than mouth, both when prompted to look at the eyes and when prompted to look at the mouth. The pattern of looking to the eyes when prompted was indistinguishable from the unprompted condition in which participants were free to look where they chose. Notably, the dwell time data demonstrated that the eye bias did not persist over the entire presentation period. Our results suggest a difficult-to-inhibit bias to initially orient to the eyes, which is superseded by volitional, top-down control of eye gaze. Further, the amount of looking to the eyes is at a maximum level spontaneously and cannot be enhanced by explicit instructions.
Collapse
|
24
|
Ho PK, Woods A, Newell FN. Temporal shifts in eye gaze and facial expressions independently contribute to the perceived attractiveness of unfamiliar faces. VISUAL COGNITION 2019. [DOI: 10.1080/13506285.2018.1564807] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
- Pik Ki Ho
- School of Psychology and Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland
| | | | - Fiona N. Newell
- School of Psychology and Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland
| |
Collapse
|
25
|
Sokolov AA, Zeidman P, Erb M, Ryvlin P, Pavlova MA, Friston KJ. Linking structural and effective brain connectivity: structurally informed Parametric Empirical Bayes (si-PEB). Brain Struct Funct 2019; 224:205-217. [PMID: 30302538 PMCID: PMC6373362 DOI: 10.1007/s00429-018-1760-8] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2018] [Accepted: 09/21/2018] [Indexed: 12/13/2022]
Abstract
Despite the potential for better understanding functional neuroanatomy, the complex relationship between neuroimaging measures of brain structure and function has confounded integrative, multimodal analyses of brain connectivity. This is particularly true for task-related effective connectivity, which describes the causal influences between neuronal populations. Here, we assess whether measures of structural connectivity may usefully inform estimates of effective connectivity in larger scale brain networks. To this end, we introduce an integrative approach, capitalising on two recent statistical advances: Parametric Empirical Bayes, which provides group-level estimates of effective connectivity, and Bayesian model reduction, which enables rapid comparison of competing models. Crucially, we show that structural priors derived from high angular resolution diffusion imaging on a dynamic causal model of a 12-region network-based on functional MRI data from the same subjects-substantially improve model evidence (posterior probability 1.00). This provides definitive evidence that structural and effective connectivity depend upon each other in mediating distributed, large-scale interactions in the brain. Furthermore, this work offers novel perspectives for understanding normal brain architecture and its disintegration in clinical conditions.
Collapse
Affiliation(s)
- Arseny A Sokolov
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London (UCL), London, WC1N 3BG, UK.
- Service de Neurologie, Département des Neurosciences Cliniques, Centre Hospitalier Universitaire Vaudois (CHUV), 1011, Lausanne, Switzerland.
| | - Peter Zeidman
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London (UCL), London, WC1N 3BG, UK
| | - Michael Erb
- Department of Biomedical Magnetic Resonance, Department of Radiology, University of Tübingen Medical School, 72076, Tübingen, Germany
| | - Philippe Ryvlin
- Service de Neurologie, Département des Neurosciences Cliniques, Centre Hospitalier Universitaire Vaudois (CHUV), 1011, Lausanne, Switzerland
| | - Marina A Pavlova
- Department of Psychiatry and Psychotherapy, University of Tübingen Medical School, 72076, Tübingen, Germany
| | - Karl J Friston
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London (UCL), London, WC1N 3BG, UK
| |
Collapse
|
26
|
Structural and effective brain connectivity underlying biological motion detection. Proc Natl Acad Sci U S A 2018; 115:E12034-E12042. [PMID: 30514816 DOI: 10.1073/pnas.1812859115] [Citation(s) in RCA: 49] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
The perception of actions underwrites a wide range of socio-cognitive functions. Previous neuroimaging and lesion studies identified several components of the brain network for visual biological motion (BM) processing, but interactions among these components and their relationship to behavior remain little understood. Here, using a recently developed integrative analysis of structural and effective connectivity derived from high angular resolution diffusion imaging (HARDI) and functional magnetic resonance imaging (fMRI), we assess the cerebro-cerebellar network for processing of camouflaged point-light BM. Dynamic causal modeling (DCM) informed by probabilistic tractography indicates that the right superior temporal sulcus (STS) serves as an integrator within the temporal module. However, the STS does not appear to be a "gatekeeper" in the functional integration of the occipito-temporal and frontal regions: The fusiform gyrus (FFG) and middle temporal cortex (MTC) are also connected to the right inferior frontal gyrus (IFG) and insula, indicating multiple parallel pathways. BM-specific loops of effective connectivity are seen between the left lateral cerebellar lobule Crus I and right STS, as well as between the left Crus I and right insula. The prevalence of a structural pathway between the FFG and STS is associated with better BM detection. Moreover, a canonical variate analysis shows that the visual sensitivity to BM is best predicted by BM-specific effective connectivity from the FFG to STS and from the IFG, insula, and STS to the early visual cortex. Overall, the study characterizes the architecture of the cerebro-cerebellar network for BM processing and offers prospects for assessing the social brain.
Collapse
|
27
|
Schobert AK, Corradi-Dell’Acqua C, Frühholz S, van der Zwaag W, Vuilleumier P. Functional organization of face processing in the human superior temporal sulcus: a 7T high-resolution fMRI study. Soc Cogn Affect Neurosci 2018; 13:102-113. [PMID: 29140527 PMCID: PMC5793830 DOI: 10.1093/scan/nsx119] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2016] [Accepted: 10/16/2017] [Indexed: 11/14/2022] Open
Abstract
The superior temporal sulcus (STS) is a major component of the human face perception network, implicated in processing dynamic changeable aspects of faces. However, it remains unknown whether STS holds functionally segregated subdivisions for different categories of facial movements. We used high-resolution functional magnetic resonance imaging (fMRI) at 7T in 16 volunteers to compare STS activation with faces displaying angry or happy expressions, eye-gaze shifts and lip-speech movements. Combining univariate and multivariate analyses, we show a systematic topological organization within STS, with gaze-related activity predominating in the most posterior and superior sector, speech-related activity in the anterior sector and emotional expressions represented in the intermediate middle STS. Right STS appeared to hold a finer functional segregation between all four types of facial movements, and best discriminative abilities within the face-selective posterior STS (pSTS). Conversely, left STS showed greater overlap between conditions, with a lack of distinction between mouth movements associated to speech or happy expression and better discriminative abilities (for gaze and speech vs emotion conditions) outside pSTS. Differential sensitivity to upper (eye) or lower (mouth) facial features may contribute to, but does not appear to fully account for, these response patterns.
Collapse
Affiliation(s)
- Anne-Kathrin Schobert
- Department of Neurosciences and Clinic of Neurology, University Medical Center, CH-1211 Geneva, Switzerland
- Swiss Centre for Affective Sciences
| | - Corrado Corradi-Dell’Acqua
- Department of Neurosciences and Clinic of Neurology, University Medical Center, CH-1211 Geneva, Switzerland
- Swiss Centre for Affective Sciences
- Department of Psychology, FPSE, University of Geneva, CH-1211 Geneva, Switzerland
| | - Sascha Frühholz
- Swiss Centre for Affective Sciences
- Department of Psychology, University of Zurich, Zurich, Switzerland
- Neuroscience Center Zurich, Zurich, Switzerland
- Zurich Center for Integrative Human Physiology (ZIHP), Zurich, Switzerland
| | - Wietske van der Zwaag
- CIBM, EPFL, Lausanne, VD, Switzerland
- Spinoza Centre for Neuroimaging, Amsterdam, The Netherlands
| | - Patrik Vuilleumier
- Department of Neurosciences and Clinic of Neurology, University Medical Center, CH-1211 Geneva, Switzerland
- Swiss Centre for Affective Sciences
- Correspondence should be addressed to Patrik Vuilleumier, Laboratory for Neurology and Imaging of Cognition, Department of Neurosciences, 1 rue Michel-Servet, 1211 Geneva, Switzerland. E-mail:
| |
Collapse
|
28
|
Pinti P, Aichelburg C, Gilbert S, Hamilton A, Hirsch J, Burgess P, Tachtsidis I. A Review on the Use of Wearable Functional Near-Infrared Spectroscopy in Naturalistic Environments . JAPANESE PSYCHOLOGICAL RESEARCH 2018; 60:347-373. [PMID: 30643322 PMCID: PMC6329605 DOI: 10.1111/jpr.12206] [Citation(s) in RCA: 135] [Impact Index Per Article: 22.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2017] [Accepted: 05/07/2018] [Indexed: 02/05/2023]
Abstract
The development of novel miniaturized wireless and wearable functional Near-Infrared Spectroscopy (fNIRS) devices have paved the way to new functional brain imaging that can revolutionize the cognitive research fields. Over the past few decades, several studies have been conducted with conventional fNIRS systems that have demonstrated the suitability of this technology for a wide variety of populations and applications, to investigate both the healthy brain and the diseased brain. However, what makes wearable fNIRS even more appealing is its capability to allow measurements in everyday life scenarios that are not possible with other gold-standard neuroimaging modalities, such as functional Magnetic Resonance Imaging. This can have a huge impact on the way we explore the neural bases and mechanisms underpinning human brain functioning. The aim of this review is to provide an overview of studies conducted with wearable fNIRS in naturalistic settings in the field of cognitive neuroscience. In addition, we present the challenges associated with the use of wearable fNIRS in unrestrained contexts, discussing solutions that will allow accurate inference of functional brain activity. Finally, we provide an overview of the future perspectives in cognitive neuroscience that we believe would benefit the most by using wearable fNIRS.
Collapse
Affiliation(s)
- Paola Pinti
- Department of Medical Physics and Biomedical Engineering, University College London, UK
- Institute of Cognitive Neuroscience, University College London, UK
| | | | - Sam Gilbert
- Institute of Cognitive Neuroscience, University College London, UK
| | - Antonia Hamilton
- Institute of Cognitive Neuroscience, University College London, UK
| | - Joy Hirsch
- Department of Medical Physics and Biomedical Engineering, University College London, UK
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
- Department of Neuroscience, Yale School of Medicine, New Haven, CT, USA
- Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, USA
| | - Paul Burgess
- Institute of Cognitive Neuroscience, University College London, UK
| | - Ilias Tachtsidis
- Department of Medical Physics and Biomedical Engineering, University College London, UK
| |
Collapse
|
29
|
Borowiak K, Schelinski S, von Kriegstein K. Recognizing visual speech: Reduced responses in visual-movement regions, but not other speech regions in autism. Neuroimage Clin 2018; 20:1078-1091. [PMID: 30368195 PMCID: PMC6202694 DOI: 10.1016/j.nicl.2018.09.019] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2018] [Revised: 09/19/2018] [Accepted: 09/21/2018] [Indexed: 12/23/2022]
Abstract
Speech information inherent in face movements is important for understanding what is said in face-to-face communication. Individuals with autism spectrum disorders (ASD) have difficulties in extracting speech information from face movements, a process called visual-speech recognition. Currently, it is unknown what dysfunctional brain regions or networks underlie the visual-speech recognition deficit in ASD. We conducted a functional magnetic resonance imaging (fMRI) study with concurrent eye tracking to investigate visual-speech recognition in adults diagnosed with high-functioning autism and pairwise matched typically developed controls. Compared to the control group (n = 17), the ASD group (n = 17) showed decreased Blood Oxygenation Level Dependent (BOLD) response during visual-speech recognition in the right visual area 5 (V5/MT) and left temporal visual speech area (TVSA) - brain regions implicated in visual-movement perception. The right V5/MT showed positive correlation with visual-speech task performance in the ASD group, but not in the control group. Psychophysiological interaction analysis (PPI) revealed that functional connectivity between the left TVSA and the bilateral V5/MT and between the right V5/MT and the left IFG was lower in the ASD than in the control group. In contrast, responses in other speech-motor regions and their connectivity were on the neurotypical level. Reduced responses and network connectivity of the visual-movement regions in conjunction with intact speech-related mechanisms indicate that perceptual mechanisms might be at the core of the visual-speech recognition deficit in ASD. Communication deficits in ASD might at least partly stem from atypical sensory processing and not higher-order cognitive processing of socially relevant information.
Collapse
Affiliation(s)
- Kamila Borowiak
- Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, 04103 Leipzig, Germany; Berlin School of Mind and Brain, Humboldt University of Berlin, Luisenstraße 56, 10117 Berlin, Germany; Technische Universität Dresden, Bamberger Straße 7, 01187 Dresden, Germany.
| | - Stefanie Schelinski
- Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, 04103 Leipzig, Germany; Technische Universität Dresden, Bamberger Straße 7, 01187 Dresden, Germany
| | - Katharina von Kriegstein
- Max Planck Institute for Human Cognitive and Brain Sciences, Stephanstraße 1a, 04103 Leipzig, Germany; Technische Universität Dresden, Bamberger Straße 7, 01187 Dresden, Germany
| |
Collapse
|
30
|
Abstract
In recent years, many studies have shown that perceiving other individuals' direct gaze has robust effects on various attentional and cognitive processes. However, considerably less attention has been devoted to investigating the affective effects triggered by eye contact. This article reviews research concerning the effects of others' gaze direction on observers' affective responses. The review focuses on studies in which affective reactions have been investigated in well-controlled laboratory experiments, and in which contextual factors possibly influencing perceivers' affects have been controlled. Two important themes emerged from this review. First, explicit affective evaluations of seeing another's direct versus averted gaze have resulted in rather inconsistent findings; some studies report more positive subjective feelings to direct compared to averted gaze, whereas others report the opposite pattern. These contradictory findings may be related, for example, to differences between studies in terms of the capability of direct-gaze stimuli to elicit feelings of self-involvement. Second, studies relying on various implicit measures have reported more consistent results; they indicate that direct gaze increases affective arousal, and more importantly, that eye contact automatically evokes a positively valenced affective reaction. Based on the review, possible psychological mechanisms for the positive affective reactions elicited by eye contact are described.
Collapse
Affiliation(s)
- Jari K. Hietanen
- Human Information Processing Laboratory, Faculty of Social Sciences, University of Tampere, Tampere, Finland
| |
Collapse
|
31
|
Jimenez AM, Lee J, Reavis EA, Wynn JK, Green MF. Aberrant patterns of neural activity when perceiving emotion from biological motion in schizophrenia. NEUROIMAGE-CLINICAL 2018; 20:380-387. [PMID: 30128276 PMCID: PMC6095949 DOI: 10.1016/j.nicl.2018.08.014] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/01/2018] [Revised: 07/12/2018] [Accepted: 08/08/2018] [Indexed: 11/30/2022]
Abstract
Social perceptual deficits in schizophrenia are well established. Recent work suggests that the ability to extract social information from bodily cues is reduced in patients. However, little is known about the neurobiological mechanisms underlying this deficit. In the current study, 20 schizophrenia patients and 16 controls completed two tasks using point-light animations during fMRI: a basic biological motion task and an emotion in biological motion task. The basic biological motion task was used to localize activity in posterior superior temporal sulcus (pSTS), a critical region for biological motion perception. During the emotion in biological motion task, participants viewed brief videos depicting happiness, fear, anger, or neutral emotions and were asked to decide which emotion was portrayed. Activity in pSTS and amygdala was interrogated during this task. Results indicated that patients showed overall reduced activation compared to controls in pSTS and at a trend level in amygdala across emotions, despite similar task performance. Further, a functional connectivity analysis revealed that controls, but not patients, showed significant positive connectivity between pSTS and left frontal regions as well as bilateral angular gyrus during the emotion in biological motion task. These findings indicate that schizophrenia patients show aberrant neural activity and functional connectivity when extracting complex social information from simple motion stimuli, which may contribute to social perception deficits in this disorder. Perception of social information from bodily cues is impaired in schizophrenia. We examined neural correlates of perception of emotion from biological motion. Activity in amygdala and posterior superior temporal sulcus was reduced in patients. pSTS functional connectivity with frontal and parietal regions was reduced in patients. Aberrant neural responses may contribute to social perceptual deficits in schizophrenia.
Collapse
Affiliation(s)
- Amy M Jimenez
- Desert Pacific MIRECC, VA Greater Los Angeles Healthcare System, 11301 Wilshire Blvd., Los Angeles, CA 90073, USA; Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, 405 Hilgard Ave., Los Angeles, CA 90095, USA.
| | - Junghee Lee
- Desert Pacific MIRECC, VA Greater Los Angeles Healthcare System, 11301 Wilshire Blvd., Los Angeles, CA 90073, USA; Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, 405 Hilgard Ave., Los Angeles, CA 90095, USA
| | - Eric A Reavis
- Desert Pacific MIRECC, VA Greater Los Angeles Healthcare System, 11301 Wilshire Blvd., Los Angeles, CA 90073, USA; Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, 405 Hilgard Ave., Los Angeles, CA 90095, USA
| | - Jonathan K Wynn
- Desert Pacific MIRECC, VA Greater Los Angeles Healthcare System, 11301 Wilshire Blvd., Los Angeles, CA 90073, USA; Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, 405 Hilgard Ave., Los Angeles, CA 90095, USA
| | - Michael F Green
- Desert Pacific MIRECC, VA Greater Los Angeles Healthcare System, 11301 Wilshire Blvd., Los Angeles, CA 90073, USA; Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, 405 Hilgard Ave., Los Angeles, CA 90095, USA
| |
Collapse
|
32
|
Wang Y, Metoki A, Alm KH, Olson IR. White matter pathways and social cognition. Neurosci Biobehav Rev 2018; 90:350-370. [PMID: 29684403 PMCID: PMC5993647 DOI: 10.1016/j.neubiorev.2018.04.015] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2017] [Revised: 03/02/2018] [Accepted: 04/15/2018] [Indexed: 12/13/2022]
Abstract
There is a growing consensus that social cognition and behavior emerge from interactions across distributed regions of the "social brain". Researchers have traditionally focused their attention on functional response properties of these gray matter networks and neglected the vital role of white matter connections in establishing such networks and their functions. In this article, we conduct a comprehensive review of prior research on structural connectivity in social neuroscience and highlight the importance of this literature in clarifying brain mechanisms of social cognition. We pay particular attention to three key social processes: face processing, embodied cognition, and theory of mind, and their respective underlying neural networks. To fully identify and characterize the anatomical architecture of these networks, we further implement probabilistic tractography on a large sample of diffusion-weighted imaging data. The combination of an in-depth literature review and the empirical investigation gives us an unprecedented, well-defined landscape of white matter pathways underlying major social brain networks. Finally, we discuss current problems in the field, outline suggestions for best practice in diffusion-imaging data collection and analysis, and offer new directions for future research.
Collapse
Affiliation(s)
- Yin Wang
- Department of Psychology, Temple University, Philadelphia, 19107, USA.
| | - Athanasia Metoki
- Department of Psychology, Temple University, Philadelphia, 19107, USA
| | - Kylie H Alm
- Department of Psychology, Temple University, Philadelphia, 19107, USA
| | - Ingrid R Olson
- Department of Psychology, Temple University, Philadelphia, 19107, USA.
| |
Collapse
|
33
|
The Original Social Network: White Matter and Social Cognition. Trends Cogn Sci 2018; 22:504-516. [PMID: 29628441 DOI: 10.1016/j.tics.2018.03.005] [Citation(s) in RCA: 62] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2017] [Revised: 03/06/2018] [Accepted: 03/12/2018] [Indexed: 01/24/2023]
Abstract
Social neuroscience has traditionally focused on the functionality of gray matter regions, ignoring the critical role played by axonal fiber pathways in supporting complex social processes. In this paper, we argue that research on white matter is essential for understanding a range of topics in social neuroscience, such as face processing, theory of mind, empathy, and imitation, as well as clinical disorders defined by aberrant social behavior, such as prosopagnosia, autism, and schizophrenia. We provide practical advice on how best to carry out these studies, which ultimately will substantially deepen our understanding of the neurobiological basis of social behavior.
Collapse
|
34
|
Mares I, Smith ML, Johnson MH, Senju A. Revealing the neural time-course of direct gaze processing via spatial frequency manipulation of faces. Biol Psychol 2018; 135:76-83. [PMID: 29510183 DOI: 10.1016/j.biopsycho.2018.03.001] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2017] [Revised: 12/21/2017] [Accepted: 03/01/2018] [Indexed: 10/17/2022]
Abstract
Direct gaze is a powerful social cue signalling the attention of another person toward oneself. Here we investigated the relevance of low spatial frequency (LSF) and high spatial frequency (HSF) in facial cues for direct gaze processing. We identified two distinct peaks in the ERP response, the N170 and N240 components. These two components were related to different stimulus conditions and influenced by different spatial frequencies. In particular, larger N170 and N240 amplitudes were observed for direct gaze than for averted gaze, but only in the N240 component was this effect modulated by spatial frequency, where it was reliant in LSF information. By contrast, larger N170 and N240 components were observed for faces than for non-facial stimuli, but this effect was only modulated by spatial frequency in the N170 component, where it relied on HSF information. The present study highlights the existence of two functionally distinct components related to direct gaze processing.
Collapse
Affiliation(s)
- Inês Mares
- Centre for Brain and Cognitive Development, Department of Psychological Sciences, Birkbeck, University of London, Henry Wellcome Building, Malet Street, London WC1E 7HX, United Kingdom; Department of Psychological Sciences, Birkbeck, University of London, Birkbeck College, Malet Street, London WC1E 7HX, United Kingdom.
| | - Marie L Smith
- Centre for Brain and Cognitive Development, Department of Psychological Sciences, Birkbeck, University of London, Henry Wellcome Building, Malet Street, London WC1E 7HX, United Kingdom; Department of Psychological Sciences, Birkbeck, University of London, Birkbeck College, Malet Street, London WC1E 7HX, United Kingdom.
| | - Mark H Johnson
- Centre for Brain and Cognitive Development, Department of Psychological Sciences, Birkbeck, University of London, Henry Wellcome Building, Malet Street, London WC1E 7HX, United Kingdom.
| | - Atsushi Senju
- Centre for Brain and Cognitive Development, Department of Psychological Sciences, Birkbeck, University of London, Henry Wellcome Building, Malet Street, London WC1E 7HX, United Kingdom.
| |
Collapse
|
35
|
Raschle NM, Becker BLC, Smith S, Fehlbaum LV, Wang Y, Gaab N. Investigating the Influences of Language Delay and/or Familial Risk for Dyslexia on Brain Structure in 5-Year-Olds. Cereb Cortex 2018; 27:764-776. [PMID: 26585334 DOI: 10.1093/cercor/bhv267] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Early language delay has often been associated with atypical language/literacy development. Neuroimaging studies further indicate functional disruptions during language and print processing in school-age children with a retrospective report of early language delay. Behavioral data of 114 5-year-olds with a retrospective report of early language delay in infancy (N = 34) and those without (N = 80) and with a familial risk for dyslexia and those without are presented. Behaviorally, children with a retrospective report of early language delay exhibited reduced performance in language/reading-related measures. A voxel-based morphometry analysis in a subset (N = 46) demonstrated an association between reduced gray matter volume and early language delay in left-hemispheric middle temporal, occipital, and frontal regions. Alterations in middle temporal cortex in children with a retrospective report of early language delay were observed regardless of familial risk for dyslexia. Additionally, while children with isolated familial risk for dyslexia showed gray matter reductions in temporoparietal and occipitotemporal regions, these effects were most profound in children with both risk factors. An interaction effect of early language delay and familial risk was revealed in temporoparietal, occipital, and frontal cortex. Our findings support a cumulative effect of early behavioral and genetic risk factors on brain development and may ultimately inform diagnosis/treatment.
Collapse
Affiliation(s)
- Nora Maria Raschle
- Laboratories of Cognitive Neuroscience, Division of Developmental Medicine, Department of Medicine, Boston Children's Hospital, Boston, MA, USA.,Harvard Medical School Boston, Boston, MA 02115, USA.,Department of Child and Adolescent Psychiatry, Psychiatric University Clinics Basel, Basel, Switzerland
| | - Bryce Larkin Chessell Becker
- Laboratories of Cognitive Neuroscience, Division of Developmental Medicine, Department of Medicine, Boston Children's Hospital, Boston, MA, USA
| | - Sara Smith
- Laboratories of Cognitive Neuroscience, Division of Developmental Medicine, Department of Medicine, Boston Children's Hospital, Boston, MA, USA
| | - Lynn Valérie Fehlbaum
- Department of Child and Adolescent Psychiatry, Psychiatric University Clinics Basel, Basel, Switzerland
| | - Yingying Wang
- Laboratories of Cognitive Neuroscience, Division of Developmental Medicine, Department of Medicine, Boston Children's Hospital, Boston, MA, USA
| | - Nadine Gaab
- Laboratories of Cognitive Neuroscience, Division of Developmental Medicine, Department of Medicine, Boston Children's Hospital, Boston, MA, USA.,Harvard Medical School Boston, Boston, MA 02115, USA.,Harvard Graduate School of Education, Cambridge, MA 02138, USA
| |
Collapse
|
36
|
Chauvigné LAS, Belyk M, Brown S. Taking two to tango: fMRI analysis of improvised joint action with physical contact. PLoS One 2018; 13:e0191098. [PMID: 29324862 PMCID: PMC5764359 DOI: 10.1371/journal.pone.0191098] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2017] [Accepted: 12/28/2017] [Indexed: 11/18/2022] Open
Abstract
Many forms of joint action involve physical coupling between the participants, such as when moving a sofa together or dancing a tango. We report the results of a novel two-person functional MRI study in which trained couple dancers engaged in bimanual contact with an experimenter standing next to the bore of the magnet, and in which the two alternated between being the leader and the follower of joint improvised movements. Leading showed a general pattern of self-orientation, being associated with brain areas involved in motor planning, navigation, sequencing, action monitoring, and error correction. In contrast, following showed a far more sensory, externally-oriented pattern, revealing areas involved in somatosensation, proprioception, motion tracking, social cognition, and outcome monitoring. We also had participants perform a "mutual" condition in which the movement patterns were pre-learned and the roles were symmetric, thereby minimizing any tendency toward either leading or following. The mutual condition showed greater activity in brain areas involved in mentalizing and social reward than did leading or following. Finally, the analysis of improvisation revealed the dual importance of motor-planning and working-memory areas. We discuss these results in terms of theories of both joint action and improvisation.
Collapse
Affiliation(s)
- Léa A. S. Chauvigné
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, ON, Canada
| | - Michel Belyk
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, ON, Canada
| | - Steven Brown
- Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
37
|
Association between Neuroticism and Emotional Face Processing. Sci Rep 2017; 7:17669. [PMID: 29247161 PMCID: PMC5732281 DOI: 10.1038/s41598-017-17706-2] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2017] [Accepted: 11/29/2017] [Indexed: 12/15/2022] Open
Abstract
Neuroticism is one of the “Big Five” personality factors and is characterized by a tendency to experience negative affect. We aimed to investigate how neuroticism influences the neural correlates for processing of emotional facial expressions. 68 healthy participants were presented with emotional dynamic facial stimuli, i.e. happy, neutral or angry, during functional MRI. Brain activations for the contrasts emotional vs. neutral, happy vs. neutral and angry vs. neutral were correlated with individuals’ neuroticism scores as obtained by the NEO Five Factor Inventory questionnaire and additionally investigated for gender differences. The bilateral medial temporal gyrus (MTG) was identified as key region in the processing of emotional faces and activations within this region correlated with individual neuroticism scores. Although female participants showed significantly stronger activation differences between emotional and neutral facial expressions in the left MTG, the correlation between activation and neuroticism scores did not show any significant gender differences. Our results offer for the first time a biological correlate within the face processing network for enhanced reactivity of neurotic individuals to emotional facial expressions which occurs similarly for both male and female participants.
Collapse
|
38
|
The neural network for face recognition: Insights from an fMRI study on developmental prosopagnosia. Neuroimage 2017; 169:151-161. [PMID: 29242103 DOI: 10.1016/j.neuroimage.2017.12.023] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2017] [Revised: 11/23/2017] [Accepted: 12/10/2017] [Indexed: 12/18/2022] Open
Abstract
Face recognition is supported by collaborative work of multiple face-responsive regions in the brain. Based on findings from individuals with normal face recognition ability, a neural model has been proposed with the occipital face area (OFA), fusiform face area (FFA), and face-selective posterior superior temporal sulcus (pSTS) as the core face network (CFN) and the rest of the face-responsive regions as the extended face network (EFN). However, little is known about how these regions work collaboratively for face recognition in our daily life. Here we focused on individuals suffering developmental prosopagnosia (DP), a neurodevelopmental disorder specifically impairing face recognition, to shed light on the infrastructure of the neural model of face recognition. Specifically, we used a variant of global brain connectivity method to comprehensively explore resting-state functional connectivity (FC) among face-responsive regions in a large sample of DPs (N = 64). We found that both the FCs within the CFN and those between the CFN and EFN were largely reduced in DP. Importantly, the right OFA and FFA served as the dysconnectivity hubs within the CFN, i.e., FCs concerning these two regions within the CFN were largely disrupted. In addition, DPs' right FFA also showed reduced FCs with the EFN. Moreover, these disrupted FCs were related to DP's behavioral deficit in face recognition, with the FCs from the FFA to the anterior temporal lobe (ATL) and pSTS the most predictive. Based on these findings, we proposed a revised neural model of face recognition demonstrating the relatedness of interactions among face-responsive regions to face recognition.
Collapse
|
39
|
Jiang J, Borowiak K, Tudge L, Otto C, von Kriegstein K. Neural mechanisms of eye contact when listening to another person talking. Soc Cogn Affect Neurosci 2017; 12:319-328. [PMID: 27576745 PMCID: PMC5390711 DOI: 10.1093/scan/nsw127] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2016] [Accepted: 08/24/2016] [Indexed: 11/14/2022] Open
Abstract
Eye contact occurs frequently and voluntarily during face-to-face verbal communication. However, the neural mechanisms underlying eye contact when it is accompanied by spoken language remain unexplored to date. Here we used a novel approach, fixation-based event-related functional magnetic resonance imaging (fMRI), to simulate the listener making eye contact with a speaker during verbal communication. Participants’ eye movements and fMRI data were recorded simultaneously while they were freely viewing a pre-recorded speaker talking. The eye tracking data were then used to define events for the fMRI analyses. The results showed that eye contact in contrast to mouth fixation involved visual cortical areas (cuneus, calcarine sulcus), brain regions related to theory of mind/intentionality processing (temporoparietal junction, posterior superior temporal sulcus, medial prefrontal cortex) and the dorsolateral prefrontal cortex. In addition, increased effective connectivity was found between these regions for eye contact in contrast to mouth fixations. The results provide first evidence for neural mechanisms underlying eye contact when watching and listening to another person talking. The network we found might be well suited for processing the intentions of communication partners during eye contact in verbal communication.
Collapse
Affiliation(s)
- Jing Jiang
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany.,Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin 10117, Germany.,Institute of Psychology, Humboldt-Universität zu Berlin, Berlin 12489, Germany
| | - Kamila Borowiak
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany.,Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin 10117, Germany
| | - Luke Tudge
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin 10117, Germany
| | - Carolin Otto
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - Katharina von Kriegstein
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany.,Institute of Psychology, Humboldt-Universität zu Berlin, Berlin 12489, Germany
| |
Collapse
|
40
|
Hirsch J, Zhang X, Noah JA, Ono Y. Frontal temporal and parietal systems synchronize within and across brains during live eye-to-eye contact. Neuroimage 2017; 157:314-330. [PMID: 28619652 PMCID: PMC5863547 DOI: 10.1016/j.neuroimage.2017.06.018] [Citation(s) in RCA: 106] [Impact Index Per Article: 15.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2017] [Revised: 06/02/2017] [Accepted: 06/07/2017] [Indexed: 02/03/2023] Open
Abstract
Human eye-to-eye contact is a primary source of social cues and communication. In spite of the biological significance of this interpersonal interaction, the underlying neural processes are not well-understood. This knowledge gap, in part, reflects limitations of conventional neuroimaging methods, including solitary confinement in the bore of a scanner and minimal tolerance of head movement that constrain investigations of natural, two-person interactions. However, these limitations are substantially resolved by recent technical developments in functional near-infrared spectroscopy (fNIRS), a non-invasive spectral absorbance technique that detects changes in blood oxygen levels in the brain by using surface-mounted optical sensors. Functional NIRS is tolerant of limited head motion and enables simultaneous acquisitions of neural signals from two interacting partners in natural conditions. We employ fNIRS to advance a data-driven theoretical framework for two-person neuroscience motivated by the Interactive Brain Hypothesis which proposes that interpersonal interaction between individuals evokes neural mechanisms not engaged during solo, non-interactive, behaviors. Within this context, two specific hypotheses related to eye-to-eye contact, functional specificity and functional synchrony, were tested. The functional specificity hypothesis proposes that eye-to-eye contact engages specialized, within-brain, neural systems; and the functional synchrony hypothesis proposes that eye-to-eye contact engages specialized, across-brain, neural processors that are synchronized between dyads. Signals acquired during eye-to-eye contact between partners (interactive condition) were compared to signals acquired during mutual gaze at the eyes of a picture-face (non-interactive condition). In accordance with the specificity hypothesis, responses during eye-to-eye contact were greater than eye-to-picture gaze for a left frontal cluster that included pars opercularis (associated with canonical language production functions known as Broca's region), pre- and supplementary motor cortices (associated with articulatory systems), as well as the subcentral area. This frontal cluster was also functionally connected to a cluster located in the left superior temporal gyrus (associated with canonical language receptive functions known as Wernicke's region), primary somatosensory cortex, and the subcentral area. In accordance with the functional synchrony hypothesis, cross-brain coherence during eye-to-eye contact relative to eye-to-picture gaze increased for signals originating within left superior temporal, middle temporal, and supramarginal gyri as well as the pre- and supplementary motor cortices of both interacting brains. These synchronous cross-brain regions are also associated with known language functions, and were partner-specific (i.e., disappeared with randomly assigned partners). Together, both within and across-brain neural correlates of eye-to-eye contact included components of previously established productive and receptive language systems. These findings reveal a left frontal, temporal, and parietal long-range network that mediates neural responses during eye-to-eye contact between dyads, and advance insight into elemental mechanisms of social and interpersonal interactions.
Collapse
Affiliation(s)
- Joy Hirsch
- Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA; Department of Neuroscience, Yale School of Medicine, New Haven, CT 06511, USA; Department of Comparative Medicine, Yale School of Medicine, New Haven, CT 06511, USA; Department of Medical Physics and Biomedical Engineering, University College London, UK.
| | - Xian Zhang
- Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
| | - J Adam Noah
- Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
| | - Yumie Ono
- Department of Electronics and Bioinformatics, School of Science and Technology, Meiji University, Kawasaki, Kanagawa, Japan
| |
Collapse
|
41
|
McGettigan C, Jasmin K, Eisner F, Agnew ZK, Josephs OJ, Calder AJ, Jessop R, Lawson RP, Spielmann M, Scott SK. You talkin' to me? Communicative talker gaze activates left-lateralized superior temporal cortex during perception of degraded speech. Neuropsychologia 2017; 100:51-63. [PMID: 28400328 PMCID: PMC5446325 DOI: 10.1016/j.neuropsychologia.2017.04.013] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2016] [Revised: 04/05/2017] [Accepted: 04/07/2017] [Indexed: 11/13/2022]
Abstract
Neuroimaging studies of speech perception have consistently indicated a left-hemisphere dominance in the temporal lobes’ responses to intelligible auditory speech signals (McGettigan and Scott, 2012). However, there are important communicative cues that cannot be extracted from auditory signals alone, including the direction of the talker's gaze. Previous work has implicated the superior temporal cortices in processing gaze direction, with evidence for predominantly right-lateralized responses (Carlin & Calder, 2013). The aim of the current study was to investigate whether the lateralization of responses to talker gaze differs in an auditory communicative context. Participants in a functional MRI experiment watched and listened to videos of spoken sentences in which the auditory intelligibility and talker gaze direction were manipulated factorially. We observed a left-dominant temporal lobe sensitivity to the talker's gaze direction, in which the left anterior superior temporal sulcus/gyrus and temporal pole showed an enhanced response to direct gaze – further investigation revealed that this pattern of lateralization was modulated by auditory intelligibility. Our results suggest flexibility in the distribution of neural responses to social cues in the face within the context of a challenging speech perception task. Talker gaze is an important social cue during speech comprehension. Neural responses to gaze were measured during perception of degraded sentences. Gaze direction modulated activation in left-lateralized superior temporal cortex. Left lateralization became stronger when speech was less intelligible. Results suggest task-dependent flexibility in cortical responses to gaze.
Collapse
Affiliation(s)
- Carolyn McGettigan
- Department of Psychology, Royal Holloway University of London, Egham Hill, Egham TW20 0EX, UK; Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AR, UK.
| | - Kyle Jasmin
- Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AR, UK
| | - Frank Eisner
- Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AR, UK; Donders Institute, Radboud University, Montessorilaan 3, 6525 HR Nijmegen, Netherlands
| | - Zarinah K Agnew
- Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AR, UK; Department of Otolaryngology, University of California, San Francisco, 513 Parnassus Avenue, San Francisco, CA, USA
| | - Oliver J Josephs
- Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AR, UK; Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK
| | - Andrew J Calder
- MRC Cognition and Brain Sciences Unit, 15 Chaucer Road, Cambridge CB2 7EF, UK
| | - Rosemary Jessop
- Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AR, UK
| | - Rebecca P Lawson
- Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AR, UK; Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London WC1N 3BG, UK
| | - Mona Spielmann
- Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AR, UK
| | - Sophie K Scott
- Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AR, UK
| |
Collapse
|
42
|
Burra N, Kerzel D, Ramon M. Gaze-cueing requires intact face processing - Insights from acquired prosopagnosia. Brain Cogn 2017; 113:125-132. [PMID: 28193545 DOI: 10.1016/j.bandc.2017.01.008] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2016] [Revised: 01/16/2017] [Accepted: 01/17/2017] [Indexed: 11/28/2022]
Abstract
Gaze-cueing is the automatic spatial orienting of attention in the direction of perceived gaze. Participants respond faster to targets located at positions congruent with the direction of gaze, compared to incongruent ones (gaze cueing effect, GCE). However, it still remains unclear whether its occurrence depends on intact integration of information from the entire eye region or face, rather than simply the presence of the eyes per se. To address this question, we investigated the GCE in PS, an extensively studied case of pure acquired prosopagnosia. In our gaze-cueing paradigm, we manipulated the duration at which cues were presented (70ms vs. 400ms) and the availability of facial information (full-face vs. eyes-only). For 70ms cue duration, we found a context-dependent dissociation between PS and controls: PS showed a GCE for eyes-only stimuli, whereas controls showed a GCE only for full-face stimuli. For 400ms cue duration, PS showed gaze-cueing independently of stimulus context, whereas in healthy controls a GCE again emerged only for full-face stimuli. Our findings suggest that attentional deployment based on the gaze direction of briefly presented faces requires intact processing of facial information, which affords salience to the eye region.
Collapse
Affiliation(s)
- Nicolas Burra
- Université de Genève, Faculté de Psychologie et des Sciences de I'Education, Geneva, Switzerland.
| | - Dirk Kerzel
- Université de Genève, Faculté de Psychologie et des Sciences de I'Education, Geneva, Switzerland
| | - Meike Ramon
- University of Fribourg, Department of Psychology, Fribourg, Switzerland.
| |
Collapse
|
43
|
Blakemore RL, Neveu R, Vuilleumier P. How emotion context modulates unconscious goal activation during motor force exertion. Neuroimage 2016; 146:904-917. [PMID: 27833013 DOI: 10.1016/j.neuroimage.2016.11.002] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2016] [Revised: 10/12/2016] [Accepted: 11/04/2016] [Indexed: 11/29/2022] Open
Abstract
Priming participants with emotional or action-related concepts influences goal formation and motor force output during effort exertion tasks, even without awareness of priming information. However, little is known about neural processes underpinning how emotional cues interact with action (or inaction) goals to motivate (or demotivate) motor behaviour. In a novel functional neuroimaging paradigm, visible emotional images followed by subliminal action or inaction word primes were presented before participants performed a maximal force exertion. In neutral emotional contexts, maximum force was lower following inaction than action primes. However, arousing emotional images had interactive motivational effects on the motor system: Unpleasant images prior to inaction primes increased force output (enhanced effort exertion) relative to control primes, and engaged a motivation-related network involving ventral striatum, extended amygdala, as well as right inferior frontal cortex. Conversely, pleasant images presented before action (versus control) primes decreased force and activated regions of the default-mode network, including inferior parietal lobule and medial prefrontal cortex. These findings show that emotional context can determine how unconscious goal representations influence motivational processes and are transformed into actual motor output, without direct rewarding contingencies. Furthermore, they provide insight into altered motor behaviour in psychopathological disorders with dysfunctional motivational processes.
Collapse
Affiliation(s)
- Rebekah L Blakemore
- Laboratory for Behavioral Neurology and Imaging of Cognition, Department of Neuroscience, University Medical Center, University of Geneva, Geneva, Switzerland; Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland.
| | - Rémi Neveu
- Laboratory for Behavioral Neurology and Imaging of Cognition, Department of Neuroscience, University Medical Center, University of Geneva, Geneva, Switzerland; Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland; Geneva Neuroscience Center, University of Geneva, Geneva, Switzerland.
| | - Patrik Vuilleumier
- Laboratory for Behavioral Neurology and Imaging of Cognition, Department of Neuroscience, University Medical Center, University of Geneva, Geneva, Switzerland; Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland; Geneva Neuroscience Center, University of Geneva, Geneva, Switzerland; Department of Neurology, University Hospitals of Geneva, Geneva, Switzerland.
| |
Collapse
|
44
|
Meaux E, Vuilleumier P. Facing mixed emotions: Analytic and holistic perception of facial emotion expressions engages separate brain networks. Neuroimage 2016; 141:154-173. [DOI: 10.1016/j.neuroimage.2016.07.004] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2015] [Revised: 06/26/2016] [Accepted: 07/02/2016] [Indexed: 11/27/2022] Open
|
45
|
de C Hamilton AF. Gazing at me: the importance of social meaning in understanding direct-gaze cues. Philos Trans R Soc Lond B Biol Sci 2016; 371:20150080. [PMID: 26644598 DOI: 10.1098/rstb.2015.0080] [Citation(s) in RCA: 81] [Impact Index Per Article: 10.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023] Open
Abstract
Direct gaze is an engaging and important social cue, but the meaning of direct gaze depends heavily on the surrounding context. This paper reviews some recent studies of direct gaze, to understand more about what neural and cognitive systems are engaged by this social cue and why. The data show that gaze can act as an arousal cue and can modulate actions, and can activate brain regions linked to theory of mind and self-related processing. However, all these results are strongly modulated by the social meaning of a gaze cue and by whether participants believe that another person is really watching them. The implications of these contextual effects and audience effects for our theories of gaze are considered.
Collapse
|
46
|
Saitovitch A, Popa T, Lemaitre H, Rechtman E, Lamy JC, Grévent D, Calmon R, Meunier S, Brunelle F, Samson Y, Boddaert N, Zilbovicius M. Tuning Eye-Gaze Perception by Transitory STS Inhibition. Cereb Cortex 2016; 26:2823-31. [PMID: 26946130 PMCID: PMC4869819 DOI: 10.1093/cercor/bhw045] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Processing eye-gaze information is a key step to human social interaction. Neuroimaging studies have shown that superior temporal sulcus (STS) is highly implicated in eye-gaze perception. In autism, a lack of preference for the eyes, as well as anatomo-functional abnormalities within the STS, has been described. To date, there are no experimental data in humans showing whether it is possible to interfere with eye-gaze processing by modulating STS neural activity. Here, we measured eye-gaze perception before and after inhibitory transcranial magnetic stimulation (TMS) applied over the posterior STS (pSTS) in young healthy volunteers. Eye-gaze processing, namely overt orienting toward the eyes, was measured using eye tracking during passive visualization of social movies. Inhibition of the right pSTS led participants to look less to the eyes of characters during visualization of social movies. Such effect was specific for the eyes and was not observed after inhibition of the left pSTS nor after placebo TMS. These results indicate for the first time that interfering with the right pSTS neural activity transitorily disrupts the behavior of orienting toward the eyes and thus indirectly gaze perception, a fundamental process for human social cognition. These results could open up new perspectives in therapeutic interventions in autism.
Collapse
Affiliation(s)
- Ana Saitovitch
- INSERM U1000, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, University René Descartes, PRES Sorbonne Paris Cité, UMR 1163, Institut Imagine, Paris, France
| | - Traian Popa
- Inserm U1127, CNRS UMR 7225, Sorbonne Universités, UPMC Univ. Paris 06, UMR S 1127, Institut du Cerveau et de la Moelle épinière, ICM, Centre de Neuro-imagerie de Recherche, CENIR, Paris, France
| | - Hervé Lemaitre
- INSERM U1000, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, University René Descartes, PRES Sorbonne Paris Cité, UMR 1163, Institut Imagine, Paris, France Faculté de Médecine, Université Paris-Sud, Paris, France
| | - Elza Rechtman
- INSERM U1000, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, University René Descartes, PRES Sorbonne Paris Cité, UMR 1163, Institut Imagine, Paris, France
| | - Jean-Charles Lamy
- Inserm U1127, CNRS UMR 7225, Sorbonne Universités, UPMC Univ. Paris 06, UMR S 1127, Institut du Cerveau et de la Moelle épinière, ICM, Centre de Neuro-imagerie de Recherche, CENIR, Paris, France
| | - David Grévent
- INSERM U1000, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, University René Descartes, PRES Sorbonne Paris Cité, UMR 1163, Institut Imagine, Paris, France
| | - Raphael Calmon
- INSERM U1000, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, University René Descartes, PRES Sorbonne Paris Cité, UMR 1163, Institut Imagine, Paris, France
| | - Sabine Meunier
- Inserm U1127, CNRS UMR 7225, Sorbonne Universités, UPMC Univ. Paris 06, UMR S 1127, Institut du Cerveau et de la Moelle épinière, ICM, Centre de Neuro-imagerie de Recherche, CENIR, Paris, France
| | - Francis Brunelle
- INSERM U1000, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, University René Descartes, PRES Sorbonne Paris Cité, UMR 1163, Institut Imagine, Paris, France
| | - Yves Samson
- Stroke Center, Groupe Hospitalier Pitié-Salpêtrière, AP-HP, Université Pierre et Marie Curie, Paris, France
| | - Nathalie Boddaert
- INSERM U1000, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, University René Descartes, PRES Sorbonne Paris Cité, UMR 1163, Institut Imagine, Paris, France
| | - Monica Zilbovicius
- INSERM U1000, Department of Pediatric Radiology, Hôpital Necker Enfants Malades, AP-HP, University René Descartes, PRES Sorbonne Paris Cité, UMR 1163, Institut Imagine, Paris, France
| |
Collapse
|
47
|
van Pelt S, Heil L, Kwisthout J, Ondobaka S, van Rooij I, Bekkering H. Beta- and gamma-band activity reflect predictive coding in the processing of causal events. Soc Cogn Affect Neurosci 2016; 11:973-80. [PMID: 26873806 DOI: 10.1093/scan/nsw017] [Citation(s) in RCA: 52] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2015] [Accepted: 02/04/2016] [Indexed: 11/12/2022] Open
Abstract
In daily life, complex events are perceived in a causal manner, suggesting that the brain relies on predictive processes to model them. Within predictive coding theory, oscillatory beta-band activity has been linked to top-down predictive signals and gamma-band activity to bottom-up prediction errors. However, neurocognitive evidence for predictive coding outside lower-level sensory areas is scarce. We used magnetoencephalography to investigate neural activity during probability-dependent action perception in three areas pivotal for causal inference, superior temporal sulcus, temporoparietal junction and medial prefrontal cortex, using bowling action animations. Within this network, Granger-causal connectivity in the beta-band was found to be strongest for backward top-down connections and gamma for feed-forward bottom-up connections. Moreover, beta-band power in TPJ increased parametrically with the predictability of the action kinematics-outcome sequences. Conversely, gamma-band power in TPJ and MPFC increased with prediction error. These findings suggest that the brain utilizes predictive-coding-like computations for higher-order cognition such as perception of causal events.
Collapse
Affiliation(s)
- Stan van Pelt
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands and
| | - Lieke Heil
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands and
| | - Johan Kwisthout
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands and
| | - Sasha Ondobaka
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands and Wellcome Trust Centre for Neuroimaging and Sobell Department, University College London, London, UK
| | - Iris van Rooij
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands and
| | - Harold Bekkering
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands and
| |
Collapse
|
48
|
Zhang Q, Alexander M, Ryner L. Multimodality Neurological Data Visualization With Multi-VOI-Based DTI Fiber Dynamic Integration. IEEE J Biomed Health Inform 2016; 20:293-303. [DOI: 10.1109/jbhi.2014.2367026] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
49
|
Abstract
Gaze direction and especially direct gaze is a powerful nonverbal cue that plays an important role in social interactions. Here we studied the neural mechanisms underlying the privileged access of direct gaze to visual awareness. We performed functional magnetic resonance imaging in healthy human volunteers who were exposed to faces with direct or averted gaze under continuous flash suppression, thereby manipulating their awareness of the faces. A gaze processing network comprising fusiform face area (FFA), superior temporal sulcus, amygdala, and intraparietal sulcus showed overall reduced neural responses when participants reported to be unaware of the faces. Interestingly, direct gaze elicited greater responses than averted gaze when participants were aware of the faces, but smaller responses when they were unaware. Additional between-subject correlation and single-trial analyses indicated that this pattern of results was due to a modulation of the relationship between neural responses and awareness by gaze direction: with increasing neural activation in the FFA, direct-gaze faces entered awareness more readily than averted-gaze faces. These findings suggest that for direct gaze, lower levels of neural activity are sufficient to give rise to awareness than for averted gaze, thus providing a neural basis for privileged access of direct gaze to awareness. Significance statement: Another person's eye gaze directed at oneself is a powerful social signal acting as a catalyst for further communication. Here, we studied the neural mechanisms underlying the prioritized access of direct gaze to visual awareness in healthy human volunteers and show that with increasing neural activation, direct-gaze faces enter awareness more readily than averted-gaze faces. This suggests that for a socially highly relevant cue like direct gaze, lower levels of neural activity are sufficient to give rise to awareness compared with averted gaze, possibly because the human brain is attuned to the efficient neural processing of direct gaze due to the biological importance of eye contact for social interactions.
Collapse
|
50
|
Abstract
Face perception relies on computations carried out in face-selective cortical areas. These areas have been intensively investigated for two decades, and this work has been guided by an influential neural model suggested by Haxby and colleagues in 2000. Here, we review new findings about face-selective areas that suggest the need for modifications and additions to the Haxby model. We suggest a revised framework based on (a) evidence for multiple routes from early visual areas into the face-processing system, (b) information about the temporal characteristics of these areas, (c) indications that the fusiform face area contributes to the perception of changeable aspects of faces, (d) the greatly elevated responses to dynamic compared with static faces in dorsal face-selective brain areas, and (e) the identification of three new anterior face-selective areas. Together, these findings lead us to suggest that face perception depends on two separate pathways: a ventral stream that represents form information and a dorsal stream driven by motion and form information.
Collapse
Affiliation(s)
- Brad Duchaine
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire 03755;
| | - Galit Yovel
- School of Psychological Sciences & Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel 69987;
| |
Collapse
|