1
|
McGarry ME, Midgley KJ, Holcomb PJ, Emmorey K. An ERP investigation of perceptual vs motoric iconicity in sign production. Neuropsychologia 2024; 203:108966. [PMID: 39098388 PMCID: PMC11462866 DOI: 10.1016/j.neuropsychologia.2024.108966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2023] [Revised: 07/06/2024] [Accepted: 08/01/2024] [Indexed: 08/06/2024]
Abstract
The type of form-meaning mapping for iconic signs can vary. For perceptually-iconic signs there is a correspondence between visual features of a referent (e.g., the beak of a bird) and the form of the sign (e.g., extended thumb and index finger at the mouth for the American Sign Language (ASL) sign BIRD). For motorically-iconic signs there is a correspondence between how an object is held/manipulated and the form of the sign (e.g., the ASL sign FLUTE depicts how a flute is played). Previous studies have found that iconic signs are retrieved faster in picture-naming tasks, but type of iconicity has not been manipulated. We conducted an ERP study in which deaf signers and a control group of English speakers named pictures that targeted perceptually-iconic, motorically-iconic, or non-iconic ASL signs. For signers (unlike the control group), naming latencies varied by iconicity type: perceptually-iconic < motorically-iconic < non-iconic signs. A reduction in the N400 amplitude was only found for the perceptually-iconic signs, compared to both non-iconic and motorically-iconic signs. No modulations of N400 amplitudes were observed for the control group. We suggest that this pattern of results arises because pictures eliciting perceptually-iconic signs can more effectively prime lexical access due to greater alignment between features of the picture and the semantic and phonological features of the sign. We speculate that naming latencies are facilitated for motorically-iconic signs due to later processes (e.g., faster phonological encoding via cascading activation from semantic features). Overall, the results indicate that type of iconicity plays role in sign production when elicited by picture-naming tasks.
Collapse
Affiliation(s)
- Meghan E McGarry
- Joint Doctoral Program in Language and Communicative Disorders, San Diego State University and University of California, San Diego, San Diego, CA, USA
| | | | - Phillip J Holcomb
- Department of Psychology, San Diego State University, San Diego, CA, USA
| | - Karen Emmorey
- School of Speech, Language and Hearing Sciences, San Diego State University, San Diego, CA, USA.
| |
Collapse
|
2
|
McGarry ME, Midgley KJ, Holcomb PJ, Emmorey K. How (and why) does iconicity effect lexical access: An electrophysiological study of American sign language. Neuropsychologia 2023; 183:108516. [PMID: 36796720 PMCID: PMC10576952 DOI: 10.1016/j.neuropsychologia.2023.108516] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Revised: 12/17/2022] [Accepted: 02/13/2023] [Indexed: 02/16/2023]
Abstract
Prior research has found that iconicity facilitates sign production in picture-naming paradigms and has effects on ERP components. These findings may be explained by two separate hypotheses: (1) a task-specific hypothesis that suggests these effects occur because visual features of the iconic sign form can map onto the visual features of the pictures, and (2) a semantic feature hypothesis that suggests that the retrieval of iconic signs results in greater semantic activation due to the robust representation of sensory-motor semantic features compared to non-iconic signs. To test these two hypotheses, iconic and non-iconic American Sign Language (ASL) signs were elicited from deaf native/early signers using a picture-naming task and an English-to-ASL translation task, while electrophysiological recordings were made. Behavioral facilitation (faster response times) and reduced negativities were observed for iconic signs (both prior to and within the N400 time window), but only in the picture-naming task. No ERP or behavioral differences were found between iconic and non-iconic signs in the translation task. This pattern of results supports the task-specific hypothesis and provides evidence that iconicity only facilitates sign production when the eliciting stimulus and the form of the sign can visually overlap (a picture-sign alignment effect).
Collapse
Affiliation(s)
- Meghan E McGarry
- Joint Doctoral Program in Language and Communication Disorders, San Diego State University and University of California, San Diego, San Diego, CA, USA
| | | | - Phillip J Holcomb
- Department of Psychology, San Diego State University, San Diego, CA, USA
| | - Karen Emmorey
- School of Speech, Language and Hearing Sciences, San Diego State University, San Diego, CA, USA.
| |
Collapse
|
3
|
Zhang X, Pan X, Yang X, Yang Y. Conventionality determines the time course of indirect replies comprehension: An ERP study. BRAIN AND LANGUAGE 2023; 239:105253. [PMID: 37001318 DOI: 10.1016/j.bandl.2023.105253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Revised: 01/22/2023] [Accepted: 03/20/2023] [Indexed: 05/10/2023]
Abstract
Indirect language comprehension requires decoding both the literal meaning and the intended meaning of an utterance, in which pragmatic inference is involved. This study tests the role of conventionality in the time course of indirect reply processing by comparing conventional and non-conventional indirect replies with direct reply, respectively. We constructed discourses which consist of a context and a dialogue with one question (e.g., May I buy a necklace for you) and one reply (e.g., I really have too many). The reply utterance was segmented into three phrases and presented orderly for EEG recording, e.g., with the subject as the first phrase (e.g., I), the adverbial as the second phrase (e.g., really), and the predicate as the third phrase (e.g., have too many). Our results showed that for conventional indirect replies, the second phrase elicited a larger anterior negativity, and the third phrase elicited a larger anterior N400 compared with those in direct replies. By contrast, for the non-conventional indirect reply, only the third phrase elicited a larger late negativity than the direct replies. These findings suggest that conventionality determines the time course of the pragmatic inferences for the most relevant interpretation during indirect replies comprehension.
Collapse
Affiliation(s)
- Xiuping Zhang
- School of Psychology, Beijing Language and Culture University, Beijing 100083, China
| | - Xiaoxi Pan
- School of Psychology, Beijing Language and Culture University, Beijing 100083, China
| | - Xiaohong Yang
- Department of Psychology, Renmin University of China, Beijing 100872, China; Jiangsu Collaborative Innovation Center for Language Ability, Jiangsu Normal University, Xuzhou, China.
| | - Yufang Yang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing 100101, China.
| |
Collapse
|
4
|
Syrov N, Yakovlev L, Miroshnikov A, Kaplan A. Beyond passive observation: feedback anticipation and observation activate the mirror system in virtual finger movement control via P300-BCI. Front Hum Neurosci 2023; 17:1180056. [PMID: 37213933 PMCID: PMC10192585 DOI: 10.3389/fnhum.2023.1180056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 04/13/2023] [Indexed: 05/23/2023] Open
Abstract
Action observation (AO) is widely used as a post-stroke therapy to activate sensorimotor circuits through the mirror neuron system. However, passive observation is often considered to be less effective and less interactive than goal-directed movement observation, leading to the suggestion that observation of goal-directed actions may have stronger therapeutic potential, as goal-directed AO has been shown to activate mechanisms for monitoring action errors. Some studies have also suggested the use of AO as a form of Brain-computer interface (BCI) feedback. In this study, we investigated the potential for observation of virtual hand movements within a P300-based BCI as a feedback system to activate the mirror neuron system. We also explored the role of feedback anticipation and estimation mechanisms during movement observation. Twenty healthy subjects participated in the study. We analyzed event-related desynchronization and synchronization (ERD/S) of sensorimotor EEG rhythms and Error-related potentials (ErrPs) during observation of virtual hand finger flexion presented as feedback in the P300-BCI loop and compared the dynamics of ERD/S and ErrPs during observation of correct feedback and errors. We also analyzed these EEG markers during passive AO under two conditions: when subjects anticipated the action demonstration and when the action was unexpected. A pre-action mu-ERD was found both before passive AO and during action anticipation within the BCI loop. Furthermore, a significant increase in beta-ERS was found during AO within incorrect BCI feedback trials. We suggest that the BCI feedback may exaggerate the passive-AO effect, as it engages feedback anticipation and estimation mechanisms as well as movement error monitoring simultaneously. The results of this study provide insights into the potential of P300-BCI with AO-feedback as a tool for neurorehabilitation.
Collapse
Affiliation(s)
- Nikolay Syrov
- V. Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
- *Correspondence: Nikolay Syrov,
| | - Lev Yakovlev
- V. Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
| | - Andrei Miroshnikov
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
| | - Alexander Kaplan
- V. Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
- Baltic Center for Neurotechnology and Artificial Intelligence, Immanuel Kant Baltic Federal University, Kaliningrad, Russia
- Department of Human and Animal Physiology, Faculty of Biology, Lomonosov Moscow State University, Moscow, Russia
| |
Collapse
|
5
|
Al-Azary H, Yu T, McRae K. Can you touch the N400? The interactive effects of body-object interaction and task demands on N400 amplitudes and decision latencies. BRAIN AND LANGUAGE 2022; 231:105147. [PMID: 35728448 DOI: 10.1016/j.bandl.2022.105147] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Revised: 06/04/2022] [Accepted: 06/06/2022] [Indexed: 06/15/2023]
Abstract
The effects of semantic richness on N400 amplitudes remain unclear. Some studies have reported semantic richness evoking greater N400s, whereas others have reported the opposite effect. Moreover, N400 effects of some semantic richness variables, such as body-object interaction (BOI), have yet to be demonstrated. BOI quantifies the degree to which a word's referent is easy to interact with; words such as bicycle are high-BOI whereas words such as butterfly are low-BOI. We examined BOI effects on N400 amplitudes and decision latencies in two semantic tasks. We found that in a touchable/untouchable task, low-BOI words (e.g., butterfly) evoked greater N400s than high-BOI words (e.g., bicycle), but there was no difference in decision latencies. Conversely, in a concrete/abstract task, high and low-BOI words evoked similar N400s, but decision latencies were shorter for high-BOI than for low-BOI words. Our results show that semantic richness upstream and downstream effects are dissociable and task dependent.
Collapse
Affiliation(s)
- Hamad Al-Azary
- Department of Humanities, Social Sciences and Communication, Lawrence Technological University, 21000 West Ten Mile Road, Southfield, MI 48075-1058, USA; Department of Psychology, The University of Western Ontario, 1151 Richmond St, London, ON N6A 3K7, Canada.
| | - Tina Yu
- Department of Psychology, The University of Western Ontario, 1151 Richmond St, London, ON N6A 3K7, Canada
| | - Ken McRae
- Department of Psychology, The University of Western Ontario, 1151 Richmond St, London, ON N6A 3K7, Canada
| |
Collapse
|
6
|
Alekseeva M, Myachykov A, Bermudez-Margaretto B, Shtyrov Y. Neurophysiological correlates of automatic integration of voice and gender information during grammatical processing. Sci Rep 2022; 12:13114. [PMID: 35908074 PMCID: PMC9339001 DOI: 10.1038/s41598-022-14478-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Accepted: 06/07/2022] [Indexed: 11/09/2022] Open
Abstract
During verbal communication, interlocutors rely on both linguistic (e.g., words, syntax) and extralinguistic (e.g., voice quality) information. The neural mechanisms of extralinguistic information processing are particularly poorly understood. To address this, we used EEG and recorded event-related brain potentials while participants listened to Russian pronoun-verb phrases presented in either male or female voice. Crucially, we manipulated congruency between the grammatical gender signaled by the verbs' ending and the speakers' apparent gender. To focus on putative automatic integration of extralinguistic information into syntactic processing and avoid confounds arising from secondary top-down processes, we used passive non-attend auditory presentation with visual distraction and no stimulus-related task. Most expressed neural responses were found at both early (150 ms, ELAN-like) and late (400 ms, N400-like) phrase processing stages. Crucially, both of these brain responses exhibited sensitivity to extralinguistic information and were significantly enhanced for phrases whose voice and grammatical gender were incongruent, similar to what is known for ERPs effects related to overt grammatical violations. Our data suggest a high degree of automaticity in processing extralinguistic information during spoken language comprehension which indicates existence of a rapid automatic syntactic integration mechanism sensitive to both linguistic and extralinguistic information.
Collapse
Affiliation(s)
- Maria Alekseeva
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, Higher School of Economics, Moscow, Russian Federation.
| | - Andriy Myachykov
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, Higher School of Economics, Moscow, Russian Federation.,Department of Psychology, Northumbria University, Newcastle-upon-Tyne, UK
| | - Beatriz Bermudez-Margaretto
- Departamento de Psicología Básica, Psicobiología y Metodología de las Ciencias del Comportamiento, Instituto de Integración en la Comunidad - INICO, Facultad de Psicología, Universidad de Salamanca, Salamanca, Spain.
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| |
Collapse
|
7
|
Zhao Q, Wang Y, Chen Y, Wang Y, Zhou C, Lu Y. Expertise Influences Congruency Monitoring During Action Observation at the Motor Level. Soc Cogn Affect Neurosci 2021; 16:1288-1298. [PMID: 34195838 PMCID: PMC8717064 DOI: 10.1093/scan/nsab078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2020] [Revised: 05/01/2021] [Accepted: 06/23/2021] [Indexed: 11/25/2022] Open
Abstract
Congruency monitoring of action occurs in individuals with relevant motor experience while observing actions. However, it remains unclear whether congruency monitoring can occur at the motor level and the extent to which expertise contributes. Here, we examined the behavioral performance and electrophysiological brain activity of individuals with and without domain-specific expertise when judging the action congruency of occluded video clips of a snowboard halfpipe trick and normal walking. For the halfpipe trick, experts exhibited better task performance and greater midline theta oscillations before possible incongruency compared with controls. Source reconstruction for the theta oscillation revealed a stronger activation in the middle and superior frontal gyrus for experts in response to incongruency compared with controls. Incongruent halfpipe actions elicited a higher N400 amplitude in experts compared with congruent actions, while no such differences were observed in controls. Source reconstruction revealed the activation in the board frontal regions and middle temporal gyrus for experts. These findings suggest that congruency monitoring can occur at the motor level during action observations and is modulated by individual expertise. The modulation of expertise reflects in the special N400 effect and midline theta oscillation.
Collapse
Affiliation(s)
- Qiwei Zhao
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Yixuan Wang
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Yifan Chen
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Yingying Wang
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Chenglin Zhou
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Yingzhi Lu
- School of Psychology, Shanghai University of Sport, Shanghai, China
| |
Collapse
|
8
|
McGarry ME, Mott M, Midgley KJ, Holcomb PJ, Emmorey K. Picture-naming in American Sign Language: an electrophysiological study of the effects of iconicity and structured alignment. LANGUAGE, COGNITION AND NEUROSCIENCE 2020; 36:199-210. [PMID: 33732747 PMCID: PMC7959108 DOI: 10.1080/23273798.2020.1804601] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/22/2020] [Accepted: 07/25/2020] [Indexed: 06/12/2023]
Abstract
A picture-naming task and ERPs were used to investigate effects of iconicity and visual alignment between signs and pictures in American Sign Language (ASL). For iconic signs, half the pictures visually overlapped with phonological features of the sign (e.g., the fingers of CAT align with a picture of a cat with prominent whiskers), while half did not (whiskers are not shown). Iconic signs were produced numerically faster than non-iconic signs and were associated with larger N400 amplitudes, akin to concreteness effects. Pictures aligned with iconic signs were named faster than non-aligned pictures, and there was a reduction in N400 amplitude. No behavioral effects were observed for the control group (English speakers). We conclude that sensory-motoric semantic features are represented more robustly for iconic than non-iconic signs (eliciting a concreteness-like N400 effect) and visual overlap between pictures and the phonological form of iconic signs facilitates lexical retrieval (eliciting a reduced N400).
Collapse
Affiliation(s)
- Meghan E. McGarry
- Joint Doctoral Program in Language and Communication Disorders, San Diego State University and University of California, San Diego, San Diego, CA USA
| | - Megan Mott
- Department of Psychology, San Diego State University, San Diego, CA USA
| | | | | | - Karen Emmorey
- School of Speech, Language and Hearing Sciences, San Diego State University, San Diego, CA USA
| |
Collapse
|
9
|
Katsumi Y, Dolcos F, Moore M, Bartholow BD, Fabiani M, Dolcos S. Electrophysiological Correlates of Racial In-group Bias in Observing Nonverbal Social Encounters. J Cogn Neurosci 2019; 32:167-186. [PMID: 31560271 DOI: 10.1162/jocn_a_01475] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Despite evidence identifying the role of group membership in social cognition, the neural mechanisms associated with the perception and evaluation of nonverbal behaviors displayed by in-group versus out-group members remain unclear. Here, 42 white participants underwent electroencephalographic recording while observing social encounters involving dynamic displays of nonverbal behaviors by racial in-group and out-group avatar characters. Dynamic behaviors included approach and avoidance poses and expressions, followed by the participants' ratings of the avatars displaying them. Behaviorally, participants showed longer RTs when evaluating in-group approach behavior compared with other behaviors, possibly suggesting increased interest and attention devoted to processing positive social encounters with their in-group members. Analyses of ERPs revealed differential sensitivity of the N450 and late positivity components to social cues, with the former showing initial sensitivity to the presence of a humanoid avatar character at the beginning of social encounters and the latter showing sensitivity to dynamic nonverbal behaviors displayed by the avatars. Moreover, time-frequency analysis of electroencephalography data also identified suppression of beta-range power linked to the observation of dynamic nonverbal behaviors. Notably, the magnitude of these responses was modulated by the degree of behavioral racial in-group bias. This suggests that differential neural sensitivity to nonverbal cues while observing social encounters is associated with subsequent in-group bias manifested in the evaluation of such encounters. Collectively, these findings shed light on the mechanisms of racial in-group bias in social cognition and have implications for understanding factors related to successful interactions with individuals from diverse racial backgrounds.
Collapse
|
10
|
The Role of Attention and Saccades on Parietofrontal Encoding of Contextual and Grasp-specific Affordances of Tools: An ERP Study. Neuroscience 2018; 394:243-266. [PMID: 30347278 DOI: 10.1016/j.neuroscience.2018.10.019] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2018] [Revised: 10/02/2018] [Accepted: 10/10/2018] [Indexed: 11/23/2022]
Abstract
The ability to recognize a tool's affordances (how a spoon should be appropriately grasped and used), is vital for daily life. Prior research has identified parietofrontal circuits, including mirror neurons, to be critical in understanding affordances. However, parietofrontal action-encoding regions receive extensive visual input and are adjacent to parietofrontal attention control networks. It is unclear how eye movements and attention modulate parietofrontal encoding of affordances. To address this issue, scenes depicting tools in different use-contexts and grasp-postures were presented to healthy subjects across two experiments, with stimuli durations of 100 ms or 500 ms. The 100-ms experiment automatically restricted saccades and required covert attention, while the 500-ms experiment allowed overt attention. The two experiments elicited similar behavioral decisions on tool-use correctness and isolated the influence of attention on parietofrontal activity. Parietofrontal ERPs (P600) distinguishing tool-use contexts (e.g., spoon-yogurt vs. spoon-ball) were similar in both experiments. Conversely, parietofrontal ERPs distinguishing tool-grasps were characterized by posterior to frontal N130-N200 ERPs in the 100-ms experiment and by saccade-perturbed N130-N200 ERPs, frontal N400 and parietal P500 in the 500-ms experiment. Particularly, only overt gaze toward the hand-tool interaction engaged mirror neurons (frontal N400) when discerning grasps that manipulate but not functionally use a tool - (grasp bowl rather than stem of spoon). Results here detail the first human electrophysiological evidence on how attention selectively modulates multiple parietofrontal grasp-perception circuits, especially the mirror neuron system, while unaffecting parietofrontal encoding of tool-use contexts. These results are pertinent to neurophysiological models of affordances that typically neglect the role of attention in action perception.
Collapse
|
11
|
Lee CL, Huang HW, Federmeier KD, Buxbaum LJ. Sensory and semantic activations evoked by action attributes of manipulable objects: Evidence from ERPs. Neuroimage 2017; 167:331-341. [PMID: 29183777 DOI: 10.1016/j.neuroimage.2017.11.045] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2017] [Revised: 10/26/2017] [Accepted: 11/21/2017] [Indexed: 01/15/2023] Open
Abstract
"Two route" theories of object-related action processing posit different temporal activation profiles of grasp-to-move actions (rapidly evoked based on object structure) versus skilled use actions (more slowly activated based on semantic knowledge). We capitalized on the exquisite temporal resolution and multidimensionality of Event-Related Potentials (ERPs) to directly test this hypothesis. Participants viewed manipulable objects (e.g., calculator) preceded by objects sharing either "grasp", "use", or no action attributes (e.g., bar of soap, keyboard, earring, respectively), as well as by action-unrelated but taxonomically-related objects (e.g., abacus); participants judged whether the two objects were related. The results showed more positive responses to "grasp-to-move" primed objects than "skilled use" primed objects or unprimed objects starting in the P1 (0-150 ms) time window and continuing onto the subsequent N1 and P2 components (150-300 ms), suggesting that only "grasp-to-move", but not "skilled use", actions may facilitate visual attention to object attributes. Furthermore, reliably reduced N400s (300-500 ms), an index of semantic processing, were observed to taxonomically primed and "skilled use" primed objects relative to unprimed objects, suggesting that "skilled use" action attributes are a component of distributed, multimodal semantic representations of objects. Together, our findings provide evidence supporting two-route theories by demonstrating that "grasp-to-move" and "skilled use" actions impact different aspects of object processing and highlight the relationship of "skilled use" information to other aspects of semantic memory.
Collapse
Affiliation(s)
- Chia-Lin Lee
- Graduate Institute of Linguistics, National Taiwan University, Taiwan, ROC; Department of Psychology, National Taiwan University, Taiwan, ROC; Graduate Institute of Brain and Mind Sciences, National Taiwan University, Taiwan, ROC; Neurobiology and Cognitive Neuroscience Center, National Taiwan University, Taiwan, ROC; Moss Rehabilitation Research Institute, Elkins Park, PA, USA.
| | - Hsu-Wen Huang
- Department of Linguistics and Translation, City University of Hong Kong, Hong Kong; Department of Psychology, University of Illinois, USA
| | - Kara D Federmeier
- Department of Psychology, University of Illinois, USA; Neuroscience Program, University of Illinois, USA; The Beckman Institute for Advanced Science and Technology, University of Illinois, USA
| | | |
Collapse
|
12
|
Faster native vowel discrimination learning in musicians is mediated by an optimization of mnemonic functions. Neuropsychologia 2017; 104:64-75. [DOI: 10.1016/j.neuropsychologia.2017.08.001] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2017] [Revised: 07/11/2017] [Accepted: 08/02/2017] [Indexed: 11/22/2022]
|
13
|
Desmarais G, Lane B, LeBlanc KA, Hiltz J, Richards ED. What’s in a name? The influence of verbal labels on action production in novel object/action associations. VISUAL COGNITION 2017. [DOI: 10.1080/13506285.2017.1308451] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
| | - Breanna Lane
- Department of Psychology, Memorial University of Newfoundland, St. John's, Canada
| | - Kevin A. LeBlanc
- Department of Psychology and Neuroscience, Dalhousie University, Halifax Canada
| | - Justin Hiltz
- Department of Psychology, Mount Allison University, Sackville, Canada
| | - Eric D. Richards
- Department of Psychology, Mount Allison University, Sackville, Canada
| |
Collapse
|
14
|
Koester D, Schack T. Action Priority: Early Neurophysiological Interaction of Conceptual and Motor Representations. PLoS One 2016; 11:e0165882. [PMID: 27973539 PMCID: PMC5156427 DOI: 10.1371/journal.pone.0165882] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2015] [Accepted: 10/19/2016] [Indexed: 11/18/2022] Open
Abstract
Handling our everyday life, we often react manually to verbal requests or instruction, but the functional interrelations of motor control and language are not fully understood yet, especially their neurophysiological basis. Here, we investigated whether specific motor representations for grip types interact neurophysiologically with conceptual information, that is, when reading nouns. Participants performed lexical decisions and, for words, executed a grasp-and-lift task on objects of different sizes involving precision or power grips while the electroencephalogram was recorded. Nouns could denote objects that require either a precision or a power grip and could, thus, be (in)congruent with the performed grasp. In a control block, participants pointed at the objects instead of grasping them. The main result revealed an event-related potential (ERP) interaction of grip type and conceptual information which was not present for pointing. Incongruent compared to congruent conditions elicited an increased positivity (100–200 ms after noun onset). Grip type effects were obtained in response-locked analyses of the grasping ERPs (100–300 ms at left anterior electrodes). These findings attest that grip type and conceptual information are functionally related when planning a grasping action but such an interaction could not be detected for pointing. Generally, the results suggest that control of behaviour can be modulated by task demands; conceptual noun information (i.e., associated action knowledge) may gain processing priority if the task requires a complex motor response.
Collapse
Affiliation(s)
- Dirk Koester
- Neurocognition and Action Research Group–Biomechanics, Faculty of Psychology and Sport Science, Bielefeld University, Bielefeld, Germany
- Cluster of Excellence–Cognitive Interaction Technology (CITEC), Bielefeld University, Bielefeld, Germany
- * E-mail:
| | - Thomas Schack
- Neurocognition and Action Research Group–Biomechanics, Faculty of Psychology and Sport Science, Bielefeld University, Bielefeld, Germany
- Cluster of Excellence–Cognitive Interaction Technology (CITEC), Bielefeld University, Bielefeld, Germany
- Research Institute for Cognition and Robotics (CoR lab), Bielefeld University, Bielefeld, Germany
| |
Collapse
|
15
|
Müller BCN, Tsalas NRH, van Schie HT, Meinhardt J, Proust J, Sodian B, Paulus M. Neural correlates of judgments of learning - An ERP study on metacognition. Brain Res 2016; 1652:170-177. [PMID: 27720854 DOI: 10.1016/j.brainres.2016.10.005] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2016] [Revised: 08/28/2016] [Accepted: 10/05/2016] [Indexed: 11/24/2022]
Abstract
Metacognitive assessment of performance has been revealed to be one of the most powerful predictors of human learning success and academic achievement. Yet, little is known about the functional nature of cognitive processes supporting judgments of learning (JOLs). The present study investigated the neural underpinnings of JOLs, using event-related brain potentials. Participants were presented with picture pairs and instructed to learn these pairs. After each pair, participants received a task cue, which instructed them to make a JOL (the likelihood of remembering the target when only presented with the cue) or to make a control judgment. Results revealed that JOLs were accompanied by a positive slow wave over medial frontal areas and a bilateral negative slow wave over occipital areas between 350ms and 700ms following the task cue. The results are discussed with respect to recent accounts on the neural correlates of judgments of learning.
Collapse
Affiliation(s)
- Barbara C N Müller
- Behavioural Science Institute, Radboud University Nijmegen, Department for Social and Cultural Psychology, PO Box 9104, 6500 HE Nijmegen, The Netherlands.
| | - Nike R H Tsalas
- Ludwig Maximilian University, Department for Psychology, Leopoldstrasse 13, 80802 München, Germany
| | - Hein T van Schie
- Behavioural Science Institute, Radboud University Nijmegen, Department for Social and Cultural Psychology, PO Box 9104, 6500 HE Nijmegen, The Netherlands
| | - Jörg Meinhardt
- Ludwig Maximilian University, Department for Psychology, Leopoldstrasse 13, 80802 München, Germany
| | - Joëlle Proust
- Ecole Normale Supérieure, 29, Rue d'Ulm, Paviollon Jardin, 75005 Paris, France
| | - Beate Sodian
- Ludwig Maximilian University, Department for Psychology, Leopoldstrasse 13, 80802 München, Germany
| | - Markus Paulus
- Ludwig Maximilian University, Department for Psychology, Leopoldstrasse 13, 80802 München, Germany
| |
Collapse
|
16
|
Balconi M, Cortesi L. Brain Activity (fNIRS) in Control State Differs from the Execution and Observation of Object-Related and Object-Unrelated Actions. J Mot Behav 2015; 48:289-96. [PMID: 26675979 DOI: 10.1080/00222895.2015.1092936] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
The authors explored cortical correlates of action execution and observation, directly comparing control condition condition and execution-observation, using functional near-infrared spectroscopy. Transitive actions (meaningful gestures produced in presence of an object) or intransitive actions (meaningful gestures produced in absence of an object) were performed. Increased oxygenated hemoglobin levels were revealed for both action execution and action observation in premotor cortex, and sensorimotor cortex compared to control condition. However, a higher activity in motor areas was observed for action execution than motor observation. In contrast the posterior parietal cortex was similarly activated in case of both execution and observation task. Finally, it was shown that action execution and observation of transitive more than intransitive gestures was supported by similar parietal posterior areas. These findings support the hypothesis of a partial common network for observation and execution of action, and significant implications related to action types (transitive vs. intransitive).
Collapse
Affiliation(s)
- Michela Balconi
- a Research Unit in Affective and Social Neuroscience, Catholic University of the Sacred Heart , Milan , Italy.,b Department of Psychology , Catholic University of the Sacred Heart , Milan , Italy
| | - Livia Cortesi
- a Research Unit in Affective and Social Neuroscience, Catholic University of the Sacred Heart , Milan , Italy
| |
Collapse
|
17
|
Mollo G, Pulvermüller F, Hauk O. Movement priming of EEG/MEG brain responses for action-words characterizes the link between language and action. Cortex 2015; 74:262-76. [PMID: 26706997 PMCID: PMC4729318 DOI: 10.1016/j.cortex.2015.10.021] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2014] [Revised: 08/06/2015] [Accepted: 10/24/2015] [Indexed: 12/20/2022]
Abstract
Activation in sensorimotor areas of the brain following perception of linguistic stimuli referring to objects and actions has been interpreted as evidence for strong theories of embodied semantics. Although a large number of studies have demonstrated this “language-to-action” link, important questions about how activation in the sensorimotor system affects language performance (“action-to-language” link) are yet unanswered. As several authors have recently pointed out, the debate should move away from an “embodied or not” focus, and rather aim to characterize the functional contributions of sensorimotor systems to language processing in more detail. For this purpose, we here introduce a novel movement priming paradigm in combination with electro- and magnetoencephalography (EEG/MEG), which allows investigating effects of motor cortex pre-activation on the spatio-temporal dynamics of action-word evoked brain activation. Participants initiated experimental trials by either finger- or foot-movements before executing a two alternative forced choice task employing action-words. We found differential brain activation during the early stages of subsequent hand- and leg-related word processing, respectively, albeit in the absence of behavioral effects. Distributed source estimation based on combined EEG/MEG measurements revealed that congruency effects between effector type used for response initiation (hand or foot) and action-word category (hand- or foot-related) occurred not only in motor cortex, but also in a classical language comprehension area, posterior superior temporal cortex, already 150 msec after the visual presentation of the word stimulus. This suggests that pre-activation of hand- and leg-motor networks may differentially facilitate the ignition of semantic cell assemblies for hand- and leg-related words, respectively. Our results demonstrate the usefulness of movement priming in combination with neuroimaging to functionally characterize the link between language and sensorimotor systems.
Collapse
Affiliation(s)
- Giovanna Mollo
- Medical Research Council Cognition and Brain Sciences Unit, Cambridge, UK; University of York, Department of Psychology, York, UK; Institute for Advanced Biomedical Technologies, G D'Annunzio University, Chieti, Italy
| | - Friedemann Pulvermüller
- Medical Research Council Cognition and Brain Sciences Unit, Cambridge, UK; Brain Language Laboratory, Department of Philosophy, Freie Universität Berlin, Germany
| | - Olaf Hauk
- Medical Research Council Cognition and Brain Sciences Unit, Cambridge, UK.
| |
Collapse
|
18
|
Desmarais G, Hudson P, Richards ED. Influences of visual and action information on object identification and action production. Conscious Cogn 2015; 34:124-39. [PMID: 25929215 DOI: 10.1016/j.concog.2015.04.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2013] [Revised: 04/09/2015] [Accepted: 04/10/2015] [Indexed: 11/16/2022]
Abstract
To evaluate the impact of semantic information elicited by labels, participants learned to identify or use novel graspable objects associated with novel actions. We identified each object/action pair with labels that elicited visual form or action semantics and varied the congruence between the label's information and the visual form or action of novel objects. In Experiment 1, participants named objects, and in Experiment 2 they produced the action associated with objects. Generally, congruent labels facilitated performance. Furthermore, for participants who learned incongruent associations, the visual form and semantic information elicited by labels influenced performance in opposite patterns. These findings support the notion that naming may be required before actions are produced when object/action associations are novel. Our findings further support the notion that links between the structural properties of objects and their actions may already be stronger than the links between verbal labels and actions in novel object/action associations.
Collapse
Affiliation(s)
| | - Pamela Hudson
- Department of Psychology, Mount Allison University, Canada
| | | |
Collapse
|
19
|
Balconi M, Canavesio Y. Feedback-Related Negativity (FRN) and P300 Are Sensitive to Temporal-Order Violation in Transitive Action Representation. J PSYCHOPHYSIOL 2015. [DOI: 10.1027/0269-8803/a000128] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Coherent representation of action sequences implies that the logical temporal order of each action can be correctly represented. Violation of this logical order may induce a sort of expectancies disruption of the temporal structure. Thus the present study explored the event-related potential (ERP) effect related to the cortical response to this violation. Action sequence composed by four frames with final congruous or incongruous endings was submitted to 28 subjects. Two distinct ERP effects, feedback-related negativity (FRN), and P300, were found in response to incongruous endings, with also significant increased RTs. The functional significance of these two ERP deflections was related respectively to the perception of an erroneous action outcome as the ending of an illogical sequence (FRN) and to the necessity to updating the relationship action-context by changing the cognitive model which supports the cognitive expectancies (P300). The significant correlation between the RTs and the ERP measures, especially in case of FRN effect, supported this interpretation. Indeed increased cognitive costs are supposed in case of expectancies violations which require further processes of reanalysis of the coherence between the action and the background (the temporal background) where the action was produced. Two different cortical localizations were found for FRN and P300, respectively a more fronto-central (dorsolateral prefrontal cortex) and posterior (superior temporal gyrus) site. The significance of these results for the temporal order effect for action comprehension was discussed.
Collapse
Affiliation(s)
- Michela Balconi
- Research Unit in Affective and Social Neuroscience, Catholic University of Milan, Italy
- Department of Psychology, Catholic University of the Sacred Heart, Milan, Italy
| | - Ylenia Canavesio
- Department of Psychology, Catholic University of the Sacred Heart, Milan, Italy
| |
Collapse
|
20
|
Wamain Y, Pluciennicka E, Kalénine S. Temporal dynamics of action perception: Differences on ERP evoked by object-related and non-object-related actions. Neuropsychologia 2014; 63:249-58. [DOI: 10.1016/j.neuropsychologia.2014.08.034] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2014] [Revised: 08/25/2014] [Accepted: 08/29/2014] [Indexed: 10/24/2022]
|
21
|
Balconi M, Canavesio Y. The contribution of dorsolateral prefrontal cortex and temporoparietal areas in processing instrumental versus functional semantic violations in action representation. J Clin Exp Neuropsychol 2014; 36:701-15. [DOI: 10.1080/13803395.2014.929093] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
22
|
van Elk M, van Schie H, Bekkering H. Action semantics: A unifying conceptual framework for the selective use of multimodal and modality-specific object knowledge. Phys Life Rev 2014; 11:220-50. [DOI: 10.1016/j.plrev.2013.11.005] [Citation(s) in RCA: 100] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2013] [Accepted: 11/11/2013] [Indexed: 12/21/2022]
|
23
|
Activation of the Prefrontal Cortex and Posterior Parietal Cortex Increases the Recognition of Semantic Violations in Action Representation. Brain Stimul 2014; 7:435-42. [DOI: 10.1016/j.brs.2014.01.011] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2013] [Revised: 01/18/2014] [Accepted: 01/24/2014] [Indexed: 11/17/2022] Open
|
24
|
N400 Effect When a Semantic Anomaly is Detected in Action Representation. A Source Localization Analysis. J Clin Neurophysiol 2014; 31:58-64. [PMID: 24492448 DOI: 10.1097/wnp.0000000000000017] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
|
25
|
Balconi M, Vitaloni S. Dorsolateral pFC and the Representation of the Incorrect Use of an Object: The Transcranial Direct Current Stimulation Effect on N400 for Visual and Linguistic Stimuli. J Cogn Neurosci 2014; 26:305-18. [DOI: 10.1162/jocn_a_00500] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
In this study, we explored the representation of an incongruent action (instrumentally incorrect use of an object) in comparison with sentences ending with an incongruent action word, taking into account the role of the activation of the left dorsolateral pFC (DLPFC). This activity was appositely modulated by transcranial direct current stimulation (tDCS). The effect of tDCS when participants processed congruent/incongruent object-related actions (Experiment 1) or sentences (Experiment 2) was verified by measuring changes in the ERP N400, error rates (ERs), and RTs. In Experiment 1, 30 participants performed the detection task within a dynamic context (video tapes representing a sequence of four action frames). In Experiment 2, 28 participants read sentences that represented object-related actions. The stimulation effect (a cathode applied to the DLPFC and an anode to the right supraorbital region) was analyzed by comparing the ER, RT, and ERP profiles before and after stimulation (or sham treatment). A significant reduction of the N400 was observed for incongruent stimuli in the case of cathodal (inhibitory) stimulation of the DLPFC in comparison with prestimulation conditions for Experiment 1, but not Experiment 2. Moreover, ERs were increased, and RTs were reduced in response to incongruent conditions after tDCS, but not after sham stimulation in Experiment 1. It is suggested that perturbation of the DLPFC may limit the ability to analyze a semantically anomalous action sequence as a reduced N400 ERP effect and increased random responses was observed. Finally, the contribution of the frontal area to the semantic processing of actions is discussed.
Collapse
|
26
|
Elmer S, Sollberger S, Meyer M, Jäncke L. An Empirical Reevaluation of Absolute Pitch: Behavioral and Electrophysiological Measurements. J Cogn Neurosci 2013; 25:1736-53. [DOI: 10.1162/jocn_a_00410] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
Here, we reevaluated the “two-component” model of absolute pitch (AP) by combining behavioral and electrophysiological measurements. This specific model postulates that AP is driven by a perceptual encoding ability (i.e., pitch memory) plus an associative memory component (i.e., pitch labeling). To test these predictions, during EEG measurements AP and non-AP (NAP) musicians were passively exposed to piano tones (first component of the model) and additionally instructed to judge whether combinations of tones and labels were conceptually associated or not (second component of the model). Auditory-evoked N1/P2 potentials did not reveal differences between the two groups, thus indicating that AP is not necessarily driven by a differential pitch encoding ability at the processing level of the auditory cortex. Otherwise, AP musicians performed the conceptual association task with an order of magnitude better accuracy and shorter RTs than NAP musicians did, this result clearly pointing to distinctive conceptual associations in AP possessors. Most notably, this behavioral superiority was reflected by an increased N400 effect and accompanied by a subsequent late positive component, the latter not being distinguishable in NAP musicians.
Collapse
Affiliation(s)
| | | | - Martin Meyer
- 1University of Zurich
- 2Center for Integrative Human Physiology, Zurich, Switzerland
- 3International Normal Aging and Plasticity Imaging Center, Zurich, Switzerland
| | - Lutz Jäncke
- 1University of Zurich
- 2Center for Integrative Human Physiology, Zurich, Switzerland
- 3International Normal Aging and Plasticity Imaging Center, Zurich, Switzerland
| |
Collapse
|
27
|
Amoruso L, Gelormini C, Aboitiz F, Alvarez González M, Manes F, Cardona JF, Ibanez A. N400 ERPs for actions: building meaning in context. Front Hum Neurosci 2013; 7:57. [PMID: 23459873 PMCID: PMC3586681 DOI: 10.3389/fnhum.2013.00057] [Citation(s) in RCA: 75] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2012] [Accepted: 02/12/2013] [Indexed: 11/13/2022] Open
Abstract
Converging neuroscientific evidence suggests the existence of close links between language and sensorimotor cognition. Accordingly, during the comprehension of meaningful actions, our brain would recruit semantic-related operations similar to those associated with the processing of language information. Consistent with this view, electrophysiological findings show that the N400 component, traditionally linked to the semantic processing of linguistic material, can also be elicited by action-related material. This review outlines recent data from N400 studies that examine the understanding of action events. We focus on three specific domains, including everyday action comprehension, co-speech gesture integration, and the semantics involved in motor planning and execution. Based on the reviewed findings, we suggest that both negativities (the N400 and the action-N400) reflect a common neurocognitive mechanism involved in the construction of meaning through the expectancies created by previous experiences and current contextual information. To shed light on how this process is instantiated in the brain, a testable contextual fronto-temporo-parietal model is proposed.
Collapse
Affiliation(s)
- Lucía Amoruso
- Laboratory of Experimental Psychology and Neuroscience, Institute of Cognitive Neurology, Favaloro UniversityBuenos Aires, Argentina
- Institute of Neuroscience, Favaloro UniversityBuenos Aires, Argentina
- National Scientific and Technical Research CouncilBuenos Aires, Argentina
| | - Carlos Gelormini
- Laboratory of Experimental Psychology and Neuroscience, Institute of Cognitive Neurology, Favaloro UniversityBuenos Aires, Argentina
- National Scientific and Technical Research CouncilBuenos Aires, Argentina
| | - Francisco Aboitiz
- Department of Psychiatry, Medical School, Interdisciplinary Center of Neuroscience, Pontificia Universidad CatólicaSantiago, Chile
| | | | - Facundo Manes
- Laboratory of Experimental Psychology and Neuroscience, Institute of Cognitive Neurology, Favaloro UniversityBuenos Aires, Argentina
- Institute of Neuroscience, Favaloro UniversityBuenos Aires, Argentina
- National Scientific and Technical Research CouncilBuenos Aires, Argentina
| | - Juan F. Cardona
- Laboratory of Experimental Psychology and Neuroscience, Institute of Cognitive Neurology, Favaloro UniversityBuenos Aires, Argentina
- Institute of Neuroscience, Favaloro UniversityBuenos Aires, Argentina
- National Scientific and Technical Research CouncilBuenos Aires, Argentina
| | - Agustín Ibanez
- Laboratory of Experimental Psychology and Neuroscience, Institute of Cognitive Neurology, Favaloro UniversityBuenos Aires, Argentina
- Institute of Neuroscience, Favaloro UniversityBuenos Aires, Argentina
- National Scientific and Technical Research CouncilBuenos Aires, Argentina
- Laboratory of Cognitive and Social Neuroscience, Universidad Diego PortalesSantiago, Chile
| |
Collapse
|
28
|
Debruille JB, Brodeur MB, Franco Porras C. N300 and social affordances: a study with a real person and a dummy as stimuli. PLoS One 2012; 7:e47922. [PMID: 23118908 PMCID: PMC3485319 DOI: 10.1371/journal.pone.0047922] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2011] [Accepted: 09/21/2012] [Indexed: 11/25/2022] Open
Abstract
Pictures of objects have been shown to automatically activate affordances, that is, actions that could be performed with the object. Similarly, pictures of faces are likely to activate social affordances, that is, interactions that would be possible with the person whose face is being presented. Most interestingly, if it is the face of a real person that is shown, one particular type of social interactions can even be carried out while event-related potentials (ERPs) are recorded. Indeed, subtle eye movements can be made to achieve an eye contact with the person with minimal artefacts on the EEG. The present study thus used the face of a real person to explore the electrophysiological correlates of affordances in a situation where some of them (i.e., eye contacts) are actually performed. The ERPs this person elicited were compared to those evoked by another 3D stimulus: a real dummy, and thus by a stimulus that should also automatically activate eye contact affordances but with which such affordances could then be inhibited since they cannot be carried out with an object. The photos of the person and of the dummy were used as matching stimuli that should not activate social affordances as strongly as the two 3D stimuli and for which social affordances cannot be carried out. The fronto-central N300s to the real dummy were found of greater amplitudes than those to the photos and to the real person. We propose that these greater N300s index the greater inhibition needed after the stronger activations of affordances induced by this 3D stimulus than by the photos. Such an inhibition would not have occurred in the case of the real person because eye contacts were carried out.
Collapse
Affiliation(s)
- J Bruno Debruille
- Douglas Mental Health University Institute, Montréal, Québec, Canada.
| | | | | |
Collapse
|
29
|
Abstract
Acronyms are an idiosyncratic part of our everyday vocabulary. Research in word processing has used acronyms as a tool to answer fundamental questions such as the nature of the word superiority effect (WSE) or which is the best way to account for word-reading processes. In this study, acronym naming was assessed by looking at the influence that a number of variables known to affect mainstream word processing has had in acronym naming. The nature of the effect of these factors on acronym naming was examined using a multilevel regression analysis. First, 146 acronyms were described in terms of their age of acquisition, bigram and trigram frequencies, imageability, number of orthographic neighbors, frequency, orthographic and phonological length, print-to-pronunciation patterns, and voicing characteristics. Naming times were influenced by lexical and sublexical factors, indicating that acronym naming is a complex process affected by more variables than those previously considered.
Collapse
Affiliation(s)
- Cristina Izura
- Department of Psychology, Swansea University, Singleton Park, Swansea SA2 8PP, Wales, UK.
| | | |
Collapse
|
30
|
Balconi M, Vitaloni S. The tDCS effect on alpha brain oscillation for correct vs. incorrect object use. The contribution of the left DLPFC. Neurosci Lett 2012; 517:25-9. [DOI: 10.1016/j.neulet.2012.04.010] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2012] [Revised: 03/22/2012] [Accepted: 04/03/2012] [Indexed: 10/28/2022]
|
31
|
Pouring or chilling a bottle of wine: an fMRI study on the prospective planning of object-directed actions. Exp Brain Res 2012; 218:189-200. [DOI: 10.1007/s00221-012-3016-9] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2011] [Accepted: 01/25/2012] [Indexed: 10/28/2022]
|
32
|
Balconi M, Caldiroli C. Semantic violation effect on object-related action comprehension. N400-like event-related potentials for unusual and incorrect use. Neuroscience 2011; 197:191-9. [PMID: 21958866 DOI: 10.1016/j.neuroscience.2011.09.026] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2011] [Accepted: 09/12/2011] [Indexed: 11/16/2022]
Affiliation(s)
- M Balconi
- Laboratory of Cognitive Psychology, Department of Psychology, Catholic University of the Sacred Heart, Milan, Italy.
| | | |
Collapse
|
33
|
|
34
|
Hald LA, Marshall JA, Janssen DP, Garnham A. Switching Modalities in A Sentence Verification Task: ERP Evidence for Embodied Language Processing. Front Psychol 2011; 2:45. [PMID: 21779254 PMCID: PMC3132671 DOI: 10.3389/fpsyg.2011.00045] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2010] [Accepted: 03/03/2011] [Indexed: 12/02/2022] Open
Abstract
In an event related potential (ERP) experiment using written language materials only, we investigated a potential modulation of the N400 by the modality switch effect. The modality switch effect occurs when a first sentence, describing a fact grounded in one modality, is followed by a second sentence describing a second fact grounded in a different modality. For example, “A cellar is dark” (visual), was preceded by either another visual property “Ham is pink” or by a tactile property “A mitten is soft.” We also investigated whether the modality switch effect occurs for false sentences (“A cellar is light”). We found that, for true sentences, the ERP at the critical word “dark” elicited a significantly greater frontal, early N400-like effect (270–370 ms) when there was a modality mismatch than when there was a modality-match. This pattern was not found for the critical word “light” in false sentences. Results similar to the frontal negativity were obtained in a late time window (500–700 ms). The obtained ERP effect is similar to one previously obtained for pictures. We conclude that in this paradigm we obtained fast access to conceptual properties for modality-matched pairs, which leads to embodiment effects similar to those previously obtained with pictorial stimuli.
Collapse
Affiliation(s)
- Lea A Hald
- Department of Applied Social Sciences, Canterbury Christ Church University Canterbury, UK
| | | | | | | |
Collapse
|