1
|
Zhao S, Ma F, Xie J, Zhou Y, Feng C, Feng W. The stimulus-driven and representation-driven cross-modal attentional spreading are both modulated by audiovisual temporal synchrony. Psychophysiology 2024; 61:e14527. [PMID: 38243583 DOI: 10.1111/psyp.14527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 11/18/2023] [Accepted: 01/03/2024] [Indexed: 01/21/2024]
Abstract
Multisensory integration and attention can interact in a way that attention to the visual constituent of a multisensory object results in an attentional spreading to its ignored auditory constituent, which can be either stimulus-driven or representation-driven depending on whether the object's visual constituent receives extra representation-based selective attention. Previous research using simple unrelated audiovisual combinations has shown that the stimulus-driven attentional spreading is contingent on audiovisual temporal simultaneity. However, little is known about whether this temporal constraint applies also to the representation-driven attentional spreading, and whether it holds for the stimulus-driven process elicited by real-life multisensory objects. The current event-related potential study investigated these questions by systematically manipulating the visual-to-auditory stimulus onset asynchrony (SOA: 0/100/300 ms) in an object-selective visual recognition task wherein the representation-driven and stimulus-driven spreading processes, measured as two distinct auditory negative difference (Nd) components, could be isolated independently. Our results showed that both the representation-driven and stimulus-driven Nds decreased as the SOA increased. Interestingly, the representation-driven Nd was completely absent, whereas the stimulus-driven Nd was still robust, when the auditory constituents were delayed by 300 ms. These findings not only indicate that the role of audiovisual simultaneity in the representation-driven attentional spreading has been underestimated, but also suggest that learned associations between the unisensory constituents of real-life objects render the stimulus-driven attentional spreading more tolerant of audiovisual asynchrony.
Collapse
Affiliation(s)
- Song Zhao
- Department of Psychology, School of Education, Soochow University, Suzhou, Jiangsu, China
| | - Fangfang Ma
- Department of Psychology, School of Education, Soochow University, Suzhou, Jiangsu, China
| | - Jimei Xie
- Department of Psychology, School of Education, Soochow University, Suzhou, Jiangsu, China
| | - Yuxin Zhou
- Department of Psychology, School of Education, Soochow University, Suzhou, Jiangsu, China
| | - Chengzhi Feng
- Department of Psychology, School of Education, Soochow University, Suzhou, Jiangsu, China
| | - Wenfeng Feng
- Department of Psychology, School of Education, Soochow University, Suzhou, Jiangsu, China
- Research Center for Psychology and Behavioral Sciences, Soochow University, Suzhou, Jiangsu, China
| |
Collapse
|
2
|
Children with autism spectrum disorder show atypical electroencephalographic response to processing contextual incongruencies. Sci Rep 2022; 12:8948. [PMID: 35624226 PMCID: PMC9142591 DOI: 10.1038/s41598-022-12475-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Accepted: 05/03/2022] [Indexed: 11/08/2022] Open
Abstract
Children with autism spectrum disorder (ASD) experience difficulties with social communication, making it challenging to interpret contextual information that aids in accurately interpreting language. To investigate how the brain processes the contextual information and how this is different in ASD, we compared event-related potentials (ERPs) in response to processing visual and auditory congruent and incongruent information. Two groups of children participated in the study: 37 typically developing children and 15 children with ASD (age range = 6 to 12). We applied a language task involving auditory sentences describing congruent or incongruent images. We investigated two ERP components associated with language processing: the N400 and P600. Our results showed how children with ASD present significant differences in their neural responses in comparison with the TD group, even when their reaction times and correct trials are not significantly different from the TD group.
Collapse
|
3
|
Silveira MV, Silvestrin M, Vilela EC, de Rose JC, Arntzen E, Caetano MS. Equivalence relations do exist before they are tested: Confirmatory evidence revealed by EEG measurements. J Exp Anal Behav 2021; 115:284-295. [PMID: 33482044 DOI: 10.1002/jeab.662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2020] [Revised: 11/16/2020] [Accepted: 11/30/2020] [Indexed: 11/06/2022]
Abstract
We examined equivalence-based N400 effects by comparing EEG data from participants with different experiences with equivalence testing. Before a priming task used in EEG measurement, Group 1 was given only matching-to-sample training trials whereas Group 2 was exposed to matching-to-sample training and equivalence probe trials. We asked whether exposure to the reinforcement contingency was sufficient to bring about an N400 outcome that might indicate potentially emergent equivalence relations or if such a response depended on experience with equivalence tests. Results showed robust N400 in both groups. Experience with equivalence tests did not further increase the N400 effects. Our findings add confirmatory evidence that equivalence relations may originate via the reinforcement contingency alone. Furthermore, complementary EEG data collected from priming tasks involving words from natural language showed functional overlap between laboratory-defined equivalence and natural word-based N400 effects.
Collapse
Affiliation(s)
- Marcelo V Silveira
- Universidade Federal do ABC - Center for Mathematics, Computing and Cognition (UFABC-CMCC), São Bernardo do Campo, Brazil.,Oslo Metropolitan University, Oslo, Norway.,National Institute of Science and Technology on Behavior, Cognition and Teaching (INCT-ECCE), Brazil
| | - Mateus Silvestrin
- Universidade Federal do ABC - Center for Mathematics, Computing and Cognition (UFABC-CMCC), São Bernardo do Campo, Brazil
| | - Eduardo C Vilela
- Instituto de Psicologia da Universidade de São Paulo (IP-USP), São Paulo, Brazil.,National Institute of Science and Technology on Behavior, Cognition and Teaching (INCT-ECCE), Brazil
| | - Julio C de Rose
- Universidade Federal de São Carlos - Departamento de Psicologia (UFSCar-DPsi), São Carlos, Brazil.,National Institute of Science and Technology on Behavior, Cognition and Teaching (INCT-ECCE), Brazil
| | | | - Marcelo S Caetano
- Universidade Federal do ABC - Center for Mathematics, Computing and Cognition (UFABC-CMCC), São Bernardo do Campo, Brazil.,National Institute of Science and Technology on Behavior, Cognition and Teaching (INCT-ECCE), Brazil
| |
Collapse
|
4
|
Male AG, Gouldthorp B. Perceptual elaboration paradigm (PEP): A new approach for investigating mental representations of language. MethodsX 2020; 7:100925. [PMID: 32528862 PMCID: PMC7276422 DOI: 10.1016/j.mex.2020.100925] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2020] [Accepted: 05/12/2020] [Indexed: 11/30/2022] Open
Abstract
To examine hemispheric differences in accessing a mental representation that embodies perceptual elements and their spatial relationships (i.e., perceptual elaboration and integration), we developed a cross-modal perceptual elaboration paradigm (PEP) in which an imagined percept, rather than a propositional concept, determined congruency. Three target image conditions allow researchers to test which mental representation is primarily accessed when the target is laterally presented. For example, the “Integrated” condition is congruent with either propositional or perceptual mental representations; therefore, results from both hemifield conditions (RVF/LH vs. LVF/RH) should be comparable. Similarly, the “Unrelated” condition is incongruent with either propositional or perceptual mental representations; therefore, results from both hemifield conditions should be comparable as well. However, the “Unintegrated” condition is congruent with the propositional mental representation but not the perceptual mental representation. Should either hemisphere access one representation initially, differences will be revealed in either behavioural or electroencephalography results. This paradigm:is distinct from existing paired paradigms that emphasize semantic associations. is important given increasing evidence that discourse comprehension involves accessing perceptual information. allows researchers to examine the extent to which a mental representation of discourse can embody perceptual elaboration and integration.
Collapse
|
5
|
Brunyé TT, Eddy MD, Cain MS, Hepfinger LB, Rock K. Masked priming for the comparative evaluation of camouflage conspicuity. APPLIED ERGONOMICS 2017; 62:259-267. [PMID: 28411736 DOI: 10.1016/j.apergo.2017.03.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2016] [Revised: 03/20/2017] [Accepted: 03/20/2017] [Indexed: 06/07/2023]
Abstract
Human observer test and evaluation of camouflage patterns is critical for understanding relative pattern conspicuity against a range of background scenes. However, very few validated methodologies exist for this purpose, and those that do carry several limitations. Five experiments examined whether masked priming with a dot probe could be used to reliably differentiate camouflage patterns. In each experiment, participants were primed with a camouflaged target appearing on the left or right of the screen, and then made a speeded response to a dot probe appearing on the same (congruent) or different (incongruent) side. Across experiments we parametrically varied prime duration between 35, 42, 49, 56, and 63 ms. Results demonstrated that as prime duration increased, a response time disadvantage for incongruent trials emerged with certain camouflage patterns. Interestingly, the most conspicuous patterns showed behavioral differences at a relatively brief (49 ms) prime duration, whereas behavioral differences were only found at longer prime durations for less conspicuous patterns; this overall results pattern matched that predicted by a visual salience model. Together, we demonstrate the viability of masked priming for the test and evaluation of camouflage patterns, and correlated outcomes for saliency models and primed object processing.
Collapse
Affiliation(s)
- Tad T Brunyé
- Center for Applied Brain and Cognitive Sciences, Medford, MA, USA; U.S. Army Natick Soldier Research, Development, and Engineering Center, Natick, MA, USA; Tufts University, Department of Psychology, Medford, MA, USA.
| | - Marianna D Eddy
- Center for Applied Brain and Cognitive Sciences, Medford, MA, USA; U.S. Army Natick Soldier Research, Development, and Engineering Center, Natick, MA, USA
| | - Matthew S Cain
- Center for Applied Brain and Cognitive Sciences, Medford, MA, USA; U.S. Army Natick Soldier Research, Development, and Engineering Center, Natick, MA, USA
| | - Lisa B Hepfinger
- U.S. Army Natick Soldier Research, Development, and Engineering Center, Natick, MA, USA
| | - Kathryn Rock
- U.S. Army Natick Soldier Research, Development, and Engineering Center, Natick, MA, USA
| |
Collapse
|
6
|
Influence of auditory spatial attention on cross-modal semantic priming effect: evidence from N400 effect. Exp Brain Res 2016; 235:331-339. [PMID: 27722788 DOI: 10.1007/s00221-016-4792-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2016] [Accepted: 09/28/2016] [Indexed: 10/20/2022]
Abstract
Semantic priming is an important research topic in the field of cognitive neuroscience. Previous studies have shown that the uni-modal semantic priming effect can be modulated by attention. However, the influence of attention on cross-modal semantic priming is unclear. To investigate this issue, the present study combined a cross-modal semantic priming paradigm with an auditory spatial attention paradigm, presenting the visual pictures as the prime stimuli and the semantically related or unrelated sounds as the target stimuli. Event-related potentials results showed that when the target sound was attended to, the N400 effect was evoked. The N400 effect was also observed when the target sound was not attended to, demonstrating that the cross-modal semantic priming effect persists even though the target stimulus is not focused on. Further analyses revealed that the N400 effect evoked by the unattended sound was significantly lower than the effect evoked by the attended sound. This contrast provides new evidence that the cross-modal semantic priming effect can be modulated by attention.
Collapse
|