1
|
Sun Q, Wang SY, Zhan LZ, You FH, Sun Q. A Bayesian inference model can predict the effects of attention on the serial dependence in heading estimation from optic flow. J Vis 2024; 24:11. [PMID: 39269364 PMCID: PMC11407482 DOI: 10.1167/jov.24.9.11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/15/2024] Open
Abstract
It has been demonstrated that observers can accurately estimate their self-motion direction (i.e., heading) from optic flow, which can be affected by attention. However, it remains unclear how attention affects the serial dependence in the estimation. In the current study, participants conducted two experiments. The results showed that the estimation accuracy decreased when attentional resources allocated to the heading estimation task were reduced. Additionally, the estimates of currently presented headings were biased toward the headings of previously seen headings, showing serial dependence. Especially, this effect decreased (increased) when the attentional resources allocated to the previously (currently) seen headings were reduced. Furthermore, importantly, we developed a Bayesian inference model, which incorporated attention-modulated likelihoods and qualitatively predicted changes in the estimation accuracy and serial dependence. In summary, the current study shows that attention affects the serial dependence in heading estimation from optic flow and reveals the Bayesian computational mechanism behind the heading estimation.
Collapse
Affiliation(s)
- Qi Sun
- Department of Psychology, Zhejiang Normal University, Jinhua, P. R. China
- Intelligent Laboratory of Zhejiang Province in Mental Health and Crisis Intervention for Children and Adolescents, Jinhua, P. R. China
- Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, P. R. China
| | - Si-Yu Wang
- Department of Psychology, Zhejiang Normal University, Jinhua, P. R. China
| | - Lin-Zhe Zhan
- Department of Psychology, Zhejiang Normal University, Jinhua, P. R. China
| | - Fan-Huan You
- Department of Psychology, Zhejiang Normal University, Jinhua, P. R. China
| | - Qian Sun
- Department of Psychology, Zhejiang Normal University, Jinhua, P. R. China
- Intelligent Laboratory of Zhejiang Province in Mental Health and Crisis Intervention for Children and Adolescents, Jinhua, P. R. China
| |
Collapse
|
2
|
Szaszkó B, Stolte M, Bachmann L, Ansorge U. New Evidence for Retrospectively Cued Perception. Vision (Basel) 2024; 8:5. [PMID: 38391086 PMCID: PMC10885105 DOI: 10.3390/vision8010005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Revised: 02/02/2024] [Accepted: 02/03/2024] [Indexed: 02/24/2024] Open
Abstract
Past research suggests a continuity between perception and memory, as reflected in influences of orienting of spatial attention by cues presented after a visual target offset (post-target cues) on target perception. Conducting two experiments, we tested and confirmed this claim. Our study revealed an elevated reliance on post-target cues for target detection with diminishing target visibility, leading to better performance in validly versus invalidly cued trials, indicative of contrast gain. We demonstrated this post-target cueing impact on target perception without a postcue response prompt, meaning that our results truly reflected a continuity between perception and memory rather than a task-specific impact of having to memorize the target due to a response prompt. While previous studies found an improvement in accuracy through valid compared to invalid cues using liminal targets, in Experiment 1, we further showed an influence of attention on participants' response time by the post-target cues with cues presented away from a clearly visible target. This suggests that visual interactions at the target location provided no better explanation of post-target cueing effects. Our results generalize prior research with liminal targets and confirm the view of a perception-memory continuum so that visual target processing is not shielded against visuospatial orienting of attention elicited by events following the offset of the visual target.
Collapse
Affiliation(s)
- Bence Szaszkó
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, 1010 Vienna, Austria
| | - Moritz Stolte
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, 1010 Vienna, Austria
| | - Lea Bachmann
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, 1010 Vienna, Austria
| | - Ulrich Ansorge
- Department of Cognition, Emotion, and Methods in Psychology, University of Vienna, 1010 Vienna, Austria
- Vienna Cognitive Science Hub, University of Vienna, 1090 Vienna, Austria
- Research Platform Mediatised Lifeworlds, University of Vienna, 1090 Vienna, Austria
| |
Collapse
|
3
|
Wang SY, Gong XM, Zhan LZ, You FH, Sun Q. Attention influences the effects of the previous form orientation on the current motion direction estimation. Sci Rep 2024; 14:1394. [PMID: 38228771 PMCID: PMC10791700 DOI: 10.1038/s41598-024-52069-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Accepted: 01/12/2024] [Indexed: 01/18/2024] Open
Abstract
Recent studies have found that the estimates of motion directions are biased toward the previous form orientations, showing serial dependence, and the serial dependence does not involve cognitive abilities. In the current study, we conducted two experiments to investigate whether and how attention-a cognitive ability-affected the serial dependence. The results showed that serial dependence was present in the current study, reproducing the previous findings. Importantly, when the attentional load reduced the reliability (i.e., estimation accuracy and precision) of previous form orientations (Experiment 1), the serial dependence decreased, meaning that the biases of motion direction estimates toward previous form orientations were reduced; in contrast, when the attentional load reduced the reliability of current motion directions (Experiment 2), the serial dependence increased, meaning that the biases of motion direction estimates toward previous form orientations were increased. These trends were well consistent with the prediction of the Bayesian inference theory. Therefore, the current study revealed the involvement of attention in the serial dependence of current motion direction estimation on the previous form orientation, demonstrating that the serial dependence was cognitive and the attentional effect can be a Bayesian inference process, initially revealing its computational mechanism.
Collapse
Affiliation(s)
- Si-Yu Wang
- School of Psychology, Zhejiang Normal University, Jinhua, People's Republic of China
| | - Xiu-Mei Gong
- School of Psychology, Zhejiang Normal University, Jinhua, People's Republic of China
| | - Lin-Zhe Zhan
- School of Psychology, Zhejiang Normal University, Jinhua, People's Republic of China
| | - Fan-Huan You
- School of Psychology, Zhejiang Normal University, Jinhua, People's Republic of China
| | - Qi Sun
- School of Psychology, Zhejiang Normal University, Jinhua, People's Republic of China.
- Intelligent Laboratory of Zhejiang Province in Mental Health and Crisis Intervention for Children and Adolescents, Jinhua, People's Republic of China.
- Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, People's Republic of China.
| |
Collapse
|
4
|
Nambiar K, Bhargava P. An Exploration of the Effects of Cross-Modal Tasks on Selective Attention. Behav Sci (Basel) 2023; 13:bs13010051. [PMID: 36661623 PMCID: PMC9854760 DOI: 10.3390/bs13010051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 12/23/2022] [Accepted: 12/31/2022] [Indexed: 01/09/2023] Open
Abstract
Successful performance of a task relies on selectively attending to the target, while ignoring distractions. Studies on perceptual load theory (PLT), conducted involving independent tasks with visual and auditory modalities, have shown that if a task is low-load, distractors and the target are both processed. If the task is high-load, distractions are not processed. The current study expands these findings by considering the effect of cross-modality (target and distractor from separate modalities) and congruency (similarity of target and distractor) on selective attention, using a word-identification task. Parameters were analysed, including response time, accuracy rates, congruency of distractions, and subjective report of load. In contrast to past studies on PLT, the results of the current study show that modality (congruency of the distractors) had a significant effect and load had no effect on selective attention. This study demonstrates that subjective measurement of load is important when studying perceptual load and selective attention.
Collapse
|
5
|
Fisher VL, Dean CL, Nave CS, Parkins EV, Kerkhoff WG, Kwakye LD. Increases in sensory noise predict attentional disruptions to audiovisual speech perception. Front Hum Neurosci 2023; 16:1027335. [PMID: 36684833 PMCID: PMC9846366 DOI: 10.3389/fnhum.2022.1027335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Accepted: 12/05/2022] [Indexed: 01/06/2023] Open
Abstract
We receive information about the world around us from multiple senses which combine in a process known as multisensory integration. Multisensory integration has been shown to be dependent on attention; however, the neural mechanisms underlying this effect are poorly understood. The current study investigates whether changes in sensory noise explain the effect of attention on multisensory integration and whether attentional modulations to multisensory integration occur via modality-specific mechanisms. A task based on the McGurk Illusion was used to measure multisensory integration while attention was manipulated via a concurrent auditory or visual task. Sensory noise was measured within modality based on variability in unisensory performance and was used to predict attentional changes to McGurk perception. Consistent with previous studies, reports of the McGurk illusion decreased when accompanied with a secondary task; however, this effect was stronger for the secondary visual (as opposed to auditory) task. While auditory noise was not influenced by either secondary task, visual noise increased with the addition of the secondary visual task specifically. Interestingly, visual noise accounted for significant variability in attentional disruptions to the McGurk illusion. Overall, these results strongly suggest that sensory noise may underlie attentional alterations to multisensory integration in a modality-specific manner. Future studies are needed to determine whether this finding generalizes to other types of multisensory integration and attentional manipulations. This line of research may inform future studies of attentional alterations to sensory processing in neurological disorders, such as Schizophrenia, Autism, and ADHD.
Collapse
Affiliation(s)
- Victoria L. Fisher
- Department of Neuroscience, Oberlin College, Oberlin, OH, United States
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, United States
| | - Cassandra L. Dean
- Department of Neuroscience, Oberlin College, Oberlin, OH, United States
- Roche/Genentech Neurodevelopment & Psychiatry Teams Product Development, Neuroscience, South San Francisco, CA, United States
| | - Claire S. Nave
- Department of Neuroscience, Oberlin College, Oberlin, OH, United States
| | - Emma V. Parkins
- Department of Neuroscience, Oberlin College, Oberlin, OH, United States
- Neuroscience Graduate Program, University of Cincinnati, Cincinnati, OH, United States
| | - Willa G. Kerkhoff
- Department of Neuroscience, Oberlin College, Oberlin, OH, United States
- Department of Neurobiology, University of Pittsburgh, Pittsburgh, PA, United States
| | - Leslie D. Kwakye
- Department of Neuroscience, Oberlin College, Oberlin, OH, United States
| |
Collapse
|
6
|
Attention and Capacity Limits in Perception: A Cellular Metabolism Account. J Neurosci 2020; 40:6801-6811. [PMID: 32747442 PMCID: PMC7455219 DOI: 10.1523/jneurosci.2368-19.2020] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2019] [Revised: 06/10/2020] [Accepted: 06/18/2020] [Indexed: 01/19/2023] Open
Abstract
Limits on perceptual capacity result in various phenomena of inattentional blindness. Here we propose a neurophysiological account attributing these perceptual capacity limits directly to limits on cerebral cellular metabolism. We hypothesized that overall cerebral energy supply remains constant, regardless of overall mental processing demands; therefore, an attention mechanism is required to regulate limited cellular metabolism levels in line with attended task demands. Increased perceptual load in a task (imposing a greater demand on neural computations) should thus result in increased metabolism underlying attended processing, and reduced metabolism mediating unattended processing. We tested this prediction measuring oxidation states of cytochrome c oxidase (oxCCO), an intracellular marker of cellular metabolism. Broadband near-infrared spectroscopy was used to record oxCCO levels from human visual cortex while participants (both sexes) performed a rapid sequential visual search task under either high perceptual load (complex feature-conjunction search) or low load (feature pop-out search). A task-irrelevant, peripheral checkerboard was presented on a random half of trials. Our findings showed that oxCCO levels in visual cortex regions responsive to the attended-task stimuli were increased in high versus low perceptual load, whereas oxCCO levels related to unattended processing were significantly reduced. A negative temporal correlation of these load effects further supported our metabolism trade-off account. These results demonstrate an attentional compensation mechanism that regulates cellular metabolism levels according to processing demands. Moreover, they provide novel evidence for the widely held stipulation that overall cerebral metabolism levels remain constant regardless of mental task demand and establish a neurophysiological account for capacity limits in perception. SIGNIFICANCE STATEMENT We investigated whether capacity limits in perception can be explained by the effects of attention on the allocation of limited cellular metabolic energy for perceptual processing. We measured the oxidation state of cytochrome c oxidase, an intracellular measure of metabolism, in human visual cortex during task performance. The results showed increased levels of cellular metabolism associated with attended processing and reduced levels of metabolism underlying unattended processing when the task was more demanding. A temporal correlation between these effects supported an attention-directed metabolism trade-off. These findings support an account for inattentional blindness grounded in cellular biochemistry. They also provide novel evidence for the claim that cerebral processing is limited by a constant energy supply, which thus requires attentional regulation.
Collapse
|
7
|
How context alters value: The brain's valuation and affective regulation system link price cues to experienced taste pleasantness. Sci Rep 2017; 7:8098. [PMID: 28808246 PMCID: PMC5556089 DOI: 10.1038/s41598-017-08080-0] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2017] [Accepted: 07/06/2017] [Indexed: 12/31/2022] Open
Abstract
Informational cues such as the price of a wine can trigger expectations about its taste quality and thereby modulate the sensory experience on a reported and neural level. Yet it is unclear how the brain translates such expectations into sensory pleasantness. We used a whole-brain multilevel mediation approach with healthy participants who tasted identical wines cued with different prices while their brains were scanned using fMRI. We found that the brain’s valuation system (BVS) in concert with the anterior prefrontal cortex played a key role in implementing the effect of price cues on taste pleasantness ratings. The sensitivity of the BVS to monetary rewards outside the taste domain moderated the strength of these effects. These findings provide novel evidence for the fundamental role that neural pathways linked to motivation and affective regulation play for the effect of informational cues on sensory experiences.
Collapse
|
8
|
Dean CL, Eggleston BA, Gibney KD, Aligbe E, Blackwell M, Kwakye LD. Auditory and visual distractors disrupt multisensory temporal acuity in the crossmodal temporal order judgment task. PLoS One 2017; 12:e0179564. [PMID: 28723907 PMCID: PMC5516972 DOI: 10.1371/journal.pone.0179564] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2017] [Accepted: 05/30/2017] [Indexed: 12/15/2022] Open
Abstract
The ability to synthesize information across multiple senses is known as multisensory integration and is essential to our understanding of the world around us. Sensory stimuli that occur close in time are likely to be integrated, and the accuracy of this integration is dependent on our ability to precisely discriminate the relative timing of unisensory stimuli (crossmodal temporal acuity). Previous research has shown that multisensory integration is modulated by both bottom-up stimulus features, such as the temporal structure of unisensory stimuli, and top-down processes such as attention. However, it is currently uncertain how attention alters crossmodal temporal acuity. The present study investigated whether increasing attentional load would decrease crossmodal temporal acuity by utilizing a dual-task paradigm. In this study, participants were asked to judge the temporal order of a flash and beep presented at various temporal offsets (crossmodal temporal order judgment (CTOJ) task) while also directing their attention to a secondary distractor task in which they detected a target stimulus within a stream visual or auditory distractors. We found decreased performance on the CTOJ task as well as increases in both the positive and negative just noticeable difference with increasing load for both the auditory and visual distractor tasks. This strongly suggests that attention promotes greater crossmodal temporal acuity and that reducing the attentional capacity to process multisensory stimuli results in detriments to multisensory temporal processing. Our study is the first to demonstrate changes in multisensory temporal processing with decreased attentional capacity using a dual task paradigm and has strong implications for developmental disorders such as autism spectrum disorders and developmental dyslexia which are associated with alterations in both multisensory temporal processing and attention.
Collapse
Affiliation(s)
- Cassandra L. Dean
- Department of Neuroscience, Oberlin College, Oberlin, Ohio, United States of America
| | - Brady A. Eggleston
- Department of Neuroscience, Oberlin College, Oberlin, Ohio, United States of America
| | - Kyla David Gibney
- Department of Neuroscience, Oberlin College, Oberlin, Ohio, United States of America
| | - Enimielen Aligbe
- Department of Neuroscience, Oberlin College, Oberlin, Ohio, United States of America
| | - Marissa Blackwell
- Department of Neuroscience, Oberlin College, Oberlin, Ohio, United States of America
| | - Leslie Dowell Kwakye
- Department of Neuroscience, Oberlin College, Oberlin, Ohio, United States of America
- * E-mail:
| |
Collapse
|
9
|
Gibney KD, Aligbe E, Eggleston BA, Nunes SR, Kerkhoff WG, Dean CL, Kwakye LD. Visual Distractors Disrupt Audiovisual Integration Regardless of Stimulus Complexity. Front Integr Neurosci 2017; 11:1. [PMID: 28163675 PMCID: PMC5247431 DOI: 10.3389/fnint.2017.00001] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2016] [Accepted: 01/04/2017] [Indexed: 11/30/2022] Open
Abstract
The intricate relationship between multisensory integration and attention has been extensively researched in the multisensory field; however, the necessity of attention for the binding of multisensory stimuli remains contested. In the current study, we investigated whether diverting attention from well-known multisensory tasks would disrupt integration and whether the complexity of the stimulus and task modulated this interaction. A secondary objective of this study was to investigate individual differences in the interaction of attention and multisensory integration. Participants completed a simple audiovisual speeded detection task and McGurk task under various perceptual load conditions: no load (multisensory task while visual distractors present), low load (multisensory task while detecting the presence of a yellow letter in the visual distractors), and high load (multisensory task while detecting the presence of a number in the visual distractors). Consistent with prior studies, we found that increased perceptual load led to decreased reports of the McGurk illusion, thus confirming the necessity of attention for the integration of speech stimuli. Although increased perceptual load led to longer response times for all stimuli in the speeded detection task, participants responded faster on multisensory trials than unisensory trials. However, the increase in multisensory response times violated the race model for no and low perceptual load conditions only. Additionally, a geometric measure of Miller’s inequality showed a decrease in multisensory integration for the speeded detection task with increasing perceptual load. Surprisingly, we found diverging changes in multisensory integration with increasing load for participants who did not show integration for the no load condition: no changes in integration for the McGurk task with increasing load but increases in integration for the detection task. The results of this study indicate that attention plays a crucial role in multisensory integration for both highly complex and simple multisensory tasks and that attention may interact differently with multisensory processing in individuals who do not strongly integrate multisensory information.
Collapse
Affiliation(s)
- Kyla D Gibney
- Department of Neuroscience, Oberlin College, Oberlin OH, USA
| | | | | | - Sarah R Nunes
- Department of Neuroscience, Oberlin College, Oberlin OH, USA
| | | | | | - Leslie D Kwakye
- Department of Neuroscience, Oberlin College, Oberlin OH, USA
| |
Collapse
|
10
|
Abstract
High perceptual load in a task is known to reduce the visual perception of unattended items (e.g., Lavie, Beck, & Konstantinou, 2014). However, it remains an open question whether perceptual load in one modality (e.g., vision) can affect the detection of stimuli in another modality (e.g., hearing). We report four experiments that establish that high visual perceptual load leads to reduced detection sensitivity in hearing. Participants were requested to detect a tone that was presented during performance of a visual search task of either low or high perceptual load (varied through item similarity). The findings revealed that auditory detection sensitivity was consistently reduced with higher load, and that this effect persisted even when the auditory detection response was made first (before the search response) and when the auditory stimulus was highly expected (50 % present). These findings demonstrate a phenomenon of load-induced deafness and provide evidence for shared attentional capacity across vision and hearing.
Collapse
Affiliation(s)
- Dana Raveh
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom,
| | | |
Collapse
|