1
|
Cutler A, Rivest J, Cavanagh P. The role of memory color in visual attention. Atten Percept Psychophys 2024; 86:28-35. [PMID: 37217821 DOI: 10.3758/s13414-023-02714-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/15/2023] [Indexed: 05/24/2023]
Abstract
The expected color of an object influences how it is perceived. For example, a banana in a greyscale photo may appear slightly yellow because bananas are expected to be yellow. This phenomenon is known as the memory color effect (MCE), and the objects with a memory color are called "color-diagnostic." The MCE is theorized to be a top-down influence of color knowledge on visual perception. However, its validity has been questioned because most evidence for the MCE is based on subjective reports. Here a change detection task is used as an objective measure of the effect and the results show that change detection differs for color-diagnostic objects. Specifically, it was predicted and found that unnaturally colored color-diagnostic objects (e.g., a blue banana) would attract attention and thus be discovered more quickly and accurately. In the experiment, two arrays alternated with the target present in one array and absent in the other while all other objects remained unchanged. Participants had to find the target as quickly and accurately as possible. In the experimental condition, the targets were color-diagnostic objects (e.g., a banana) presented in either their natural (yellow) or an unnatural (blue) color. In the control condition, non-color-diagnostic objects (e.g., a mug) were presented with the same colors as the color-diagnostic objects. Unnaturally colored color-diagnostic objects were found more quickly, which suggests that the MCE is a top-down, preattentive process that can influence a nonsubjective visual perceptual task such as change detection.
Collapse
Affiliation(s)
- Anson Cutler
- Department of Psychology, Glendon College, Toronto, ON, Canada.
- Centre for Vision Research, York University, Toronto, ON, Canada.
| | - Josée Rivest
- Department of Psychology, Glendon College, Toronto, ON, Canada
- Centre for Vision Research, York University, Toronto, ON, Canada
| | - Patrick Cavanagh
- Department of Psychology, Glendon College, Toronto, ON, Canada
- Centre for Vision Research, York University, Toronto, ON, Canada
| |
Collapse
|
2
|
Kardosh R, Sklar AY, Goldstein A, Pertzov Y, Hassin RR. Minority salience and the overestimation of individuals from minority groups in perception and memory. Proc Natl Acad Sci U S A 2022; 119:e2116884119. [PMID: 35286213 PMCID: PMC8944588 DOI: 10.1073/pnas.2116884119] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Accepted: 01/17/2022] [Indexed: 11/18/2022] Open
Abstract
Our cognitive system is tuned toward spotting the uncommon and unexpected. We propose that individuals coming from minority groups are, by definition, just that—uncommon and often unexpected. Consequently, they are psychologically salient in perception, memory, and visual awareness. This minority salience creates a tendency to overestimate the prevalence of minorities, leading to an erroneous picture of our social environments—an illusion of diversity. In 12 experiments with 942 participants, we found evidence that the presence of minority group members is indeed overestimated in memory and perception and that masked images of minority group members are prioritized for visual awareness. These findings were consistent when participants were members of both the majority group and the minority group. Moreover, this overestimated prevalence of minorities led to decreased support for diversity-promoting policies. We discuss the theoretical implications of the illusion of diversity and how it may inform more equitable and inclusive decision-making.
Collapse
Affiliation(s)
- Rasha Kardosh
- Psychology Department, The Hebrew University of Jerusalem, Jerusalem 91905, Israel
| | - Asael Y. Sklar
- Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| | - Alon Goldstein
- Psychology Department, The Hebrew University of Jerusalem, Jerusalem 91905, Israel
| | - Yoni Pertzov
- Psychology Department, The Hebrew University of Jerusalem, Jerusalem 91905, Israel
| | - Ran R. Hassin
- James Marshall Chair of Psychology, Psychology Department, The Federmann Center for the Study of Rationality, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| |
Collapse
|
3
|
Jensen O, Pan Y, Frisson S, Wang L. An oscillatory pipelining mechanism supporting previewing during visual exploration and reading. Trends Cogn Sci 2021; 25:1033-1044. [PMID: 34544653 PMCID: PMC7615059 DOI: 10.1016/j.tics.2021.08.008] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Revised: 08/24/2021] [Accepted: 08/25/2021] [Indexed: 11/15/2022]
Abstract
Humans have a remarkable ability to efficiently explore visual scenes and text using eye movements. Humans typically make eye movements (saccades) every ~250 ms. Since saccade initiation and execution take 100 ms, this leaves only ~150 ms to recognize the fixated object (or word) while simultaneously previewing candidates for the next saccade goal. We propose a pipelining mechanism where serial processing occurs within a specific brain region, whereas parallel processing occurs across different brain regions. The mechanism is timed by alpha oscillations that coordinate the saccades, visual recognition, and previewing in the cortical hierarchy. Consequently, the neuronal mechanism supporting natural vision and saccades must be studied in unison to uncover the brain mechanisms supporting visual exploration and reading.
Collapse
Affiliation(s)
- Ole Jensen
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, UK.
| | - Yali Pan
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, UK
| | - Steven Frisson
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, UK
| | - Lin Wang
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129, USA; Department of Psychology, Tufts University, Medford, MA 02155, USA
| |
Collapse
|
4
|
Morita A, Kambara T. Bizarreness and Typicality Effects of Color on Object Recognition Memory. Percept Mot Skills 2021; 128:2469-2489. [PMID: 34605317 DOI: 10.1177/00315125211048391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The bizarreness effect on object recognition is a strong phenomenon, but its influence has been inconsistent for bizarre object color. In this study, we manipulated three factors in separate experiments to determine whether a color bizarreness effect on object recognition memory would occur and, if not, why. Participants first saw (i.e., learned) object pictures that were either bizarrely or typically colored; they then completed a recognition memory test. In three experiments, we then manipulated (a) degree of color bizarreness (Experiment 1), (b) the orientation task (Experiment 2), and (c) additional demands for object identification (Experiment 3). In Experiment 1, we provided 49 undergraduate participants with object pictures whose colors were typical, moderately atypical, or bizarre and found no color bizarreness effect on recognition memory even for extremely bizarre colors. In Experiment 2, we manipulated the orientation task in that 28 young adult participants expressed their preferences for the pictures on a three-point scale while another 28 participants judged how natural the pictures were. Each orientation task group better recognized typically-colored rather than bizarrely-colored objects (typicality effect). In Experiment 3, we asked 27 young adults to identify the objects during the learning phase to ensure that they paid attention to the objects' bizarre colors; recognition memory was then unaffected by either color bizarreness or typicality. Thus, despite a general bizarreness effect in recognition memory, bizarre colors are less likely to influence object recognition memory.
Collapse
Affiliation(s)
- Aiko Morita
- Department of Psychology, Graduate School of Humanities and Social Sciences, Hiroshima University, Hiroshima, Japan
| | - Toshimune Kambara
- Department of Psychology, Graduate School of Humanities and Social Sciences, Hiroshima University, Hiroshima, Japan
| |
Collapse
|
5
|
Gronau N. To Grasp the World at a Glance: The Role of Attention in Visual and Semantic Associative Processing. J Imaging 2021; 7:jimaging7090191. [PMID: 34564117 PMCID: PMC8470651 DOI: 10.3390/jimaging7090191] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2021] [Revised: 08/30/2021] [Accepted: 09/15/2021] [Indexed: 11/16/2022] Open
Abstract
Associative relations among words, concepts and percepts are the core building blocks of high-level cognition. When viewing the world ‘at a glance’, the associative relations between objects in a scene, or between an object and its visual background, are extracted rapidly. The extent to which such relational processing requires attentional capacity, however, has been heavily disputed over the years. In the present manuscript, I review studies investigating scene–object and object–object associative processing. I then present a series of studies in which I assessed the necessity of spatial attention to various types of visual–semantic relations within a scene. Importantly, in all studies, the spatial and temporal aspects of visual attention were tightly controlled in an attempt to minimize unintentional attention shifts from ‘attended’ to ‘unattended’ regions. Pairs of stimuli—either objects, scenes or a scene and an object—were briefly presented on each trial, while participants were asked to detect a pre-defined target category (e.g., an animal, a nonsense shape). Response times (RTs) to the target detection task were registered when visual attention spanned both stimuli in a pair vs. when attention was focused on only one of two stimuli. Among non-prioritized stimuli that were not defined as to-be-detected targets, findings consistently demonstrated rapid associative processing when stimuli were fully attended, i.e., shorter RTs to associated than unassociated pairs. Focusing attention on a single stimulus only, however, largely impaired this relational processing. Notably, prioritized targets continued to affect performance even when positioned at an unattended location, and their associative relations with the attended items were well processed and analyzed. Our findings portray an important dissociation between unattended task-irrelevant and task-relevant items: while the former require spatial attentional resources in order to be linked to stimuli positioned inside the attentional focus, the latter may influence high-level recognition and associative processes via feature-based attentional mechanisms that are largely independent of spatial attention.
Collapse
Affiliation(s)
- Nurit Gronau
- Department of Psychology and Department of Cognitive Science Studies, The Open University of Israel, Raanana 4353701, Israel
| |
Collapse
|
6
|
Almadori E, Mastroberardino S, Botta F, Brunetti R, Lupiáñez J, Spence C, Santangelo V. Crossmodal Semantic Congruence Interacts with Object Contextual Consistency in Complex Visual Scenes to Enhance Short-Term Memory Performance. Brain Sci 2021; 11:brainsci11091206. [PMID: 34573227 PMCID: PMC8467083 DOI: 10.3390/brainsci11091206] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2021] [Revised: 08/30/2021] [Accepted: 09/09/2021] [Indexed: 11/17/2022] Open
Abstract
Object sounds can enhance the attentional selection and perceptual processing of semantically-related visual stimuli. However, it is currently unknown whether crossmodal semantic congruence also affects the post-perceptual stages of information processing, such as short-term memory (STM), and whether this effect is modulated by the object consistency with the background visual scene. In two experiments, participants viewed everyday visual scenes for 500 ms while listening to an object sound, which could either be semantically related to the object that served as the STM target at retrieval or not. This defined crossmodal semantically cued vs. uncued targets. The target was either in- or out-of-context with respect to the background visual scene. After a maintenance period of 2000 ms, the target was presented in isolation against a neutral background, in either the same or different spatial position as in the original scene. The participants judged the same vs. different position of the object and then provided a confidence judgment concerning the certainty of their response. The results revealed greater accuracy when judging the spatial position of targets paired with a semantically congruent object sound at encoding. This crossmodal facilitatory effect was modulated by whether the target object was in- or out-of-context with respect to the background scene, with out-of-context targets reducing the facilitatory effect of object sounds. Overall, these findings suggest that the presence of the object sound at encoding facilitated the selection and processing of the semantically related visual stimuli, but this effect depends on the semantic configuration of the visual scene.
Collapse
Affiliation(s)
- Erika Almadori
- Neuroimaging Laboratory, IRCCS Santa Lucia Foundation, Via Ardeatina 306, 00179 Rome, Italy;
| | - Serena Mastroberardino
- Department of Psychology, School of Medicine & Psychology, Sapienza University of Rome, Via dei Marsi 78, 00185 Rome, Italy;
| | - Fabiano Botta
- Department of Experimental Psychology and Mind, Brain, and Behavior Research Center (CIMCYC), University of Granada, 18071 Granada, Spain; (F.B.); (J.L.)
| | - Riccardo Brunetti
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, Università Europea di Roma, 00163 Roma, Italy;
| | - Juan Lupiáñez
- Department of Experimental Psychology and Mind, Brain, and Behavior Research Center (CIMCYC), University of Granada, 18071 Granada, Spain; (F.B.); (J.L.)
| | - Charles Spence
- Department of Experimental Psychology, Oxford University, Oxford OX2 6GG, UK;
| | - Valerio Santangelo
- Neuroimaging Laboratory, IRCCS Santa Lucia Foundation, Via Ardeatina 306, 00179 Rome, Italy;
- Department of Philosophy, Social Sciences & Education, University of Perugia, Piazza G. Ermini, 1, 06123 Perugia, Italy
- Correspondence:
| |
Collapse
|
7
|
Türkan BN, İyilikci O, Amado S. Ways of processing semantic information during different change detection tasks. VISUAL COGNITION 2021. [DOI: 10.1080/13506285.2021.1927276] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
| | - Osman İyilikci
- Department of Psychology, Manisa Celal Bayar University, Manisa, Turkey
| | - Sonia Amado
- Department of Psychology, Ege University, Izmir, Turkey
| |
Collapse
|
8
|
The interplay between gaze and consistency in scene viewing: Evidence from visual search by young and older adults. Atten Percept Psychophys 2021; 83:1954-1970. [PMID: 33748905 PMCID: PMC8213592 DOI: 10.3758/s13414-021-02242-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/04/2021] [Indexed: 11/08/2022]
Abstract
Searching for an object in a complex scene is influenced by high-level factors such as how much the item would be expected in that setting (semantic consistency). There is also evidence that a person gazing at an object directs our attention towards it. However, there has been little previous research that has helped to understand how we integrate top-down cues such as semantic consistency and gaze to direct attention when searching for an object. Also, there are separate lines of evidence to suggest that older adults may be more influenced by semantic factors and less by gaze cues compared to younger counterparts, but this has not been investigated before in an integrated task. In the current study we analysed eye-movements of 34 younger and 30 older adults as they searched for a target object in complex visual scenes. Younger adults were influenced by semantic consistency in their attention to objects, but were more influenced by gaze cues. In contrast, older adults were more guided by semantic consistency in directing their attention, and showed less influence from gaze cues. These age differences in use of high-level cues were apparent early in processing (time to first fixation and probability of immediate fixation) but not in later processing (total time looking at objects and time to make a response). Overall, this pattern of findings indicates that people are influenced by both social cues and prior expectations when processing a complex scene, and the relative importance of these factors depends on age.
Collapse
|
9
|
Võ MLH. The meaning and structure of scenes. Vision Res 2021; 181:10-20. [PMID: 33429218 DOI: 10.1016/j.visres.2020.11.003] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2019] [Revised: 10/31/2020] [Accepted: 11/03/2020] [Indexed: 01/09/2023]
Abstract
We live in a rich, three dimensional world with complex arrangements of meaningful objects. For decades, however, theories of visual attention and perception have been based on findings generated from lines and color patches. While these theories have been indispensable for our field, the time has come to move on from this rather impoverished view of the world and (at least try to) get closer to the real thing. After all, our visual environment consists of objects that we not only look at, but constantly interact with. Having incorporated the meaning and structure of scenes, i.e. its "grammar", then allows us to easily understand objects and scenes we have never encountered before. Studying this grammar provides us with the fascinating opportunity to gain new insights into the complex workings of attention, perception, and cognition. In this review, I will discuss how the meaning and the complex, yet predictive structure of real-world scenes influence attention allocation, search, and object identification.
Collapse
Affiliation(s)
- Melissa Le-Hoa Võ
- Department of Psychology, Johann Wolfgang-Goethe-Universität, Frankfurt, Germany. https://www.scenegrammarlab.com/
| |
Collapse
|
10
|
Coco MI, Nuthmann A, Dimigen O. Fixation-related Brain Potentials during Semantic Integration of Object–Scene Information. J Cogn Neurosci 2020; 32:571-589. [DOI: 10.1162/jocn_a_01504] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
Abstract
In vision science, a particularly controversial topic is whether and how quickly the semantic information about objects is available outside foveal vision. Here, we aimed at contributing to this debate by coregistering eye movements and EEG while participants viewed photographs of indoor scenes that contained a semantically consistent or inconsistent target object. Linear deconvolution modeling was used to analyze the ERPs evoked by scene onset as well as the fixation-related potentials (FRPs) elicited by the fixation on the target object (t) and by the preceding fixation (t − 1). Object–scene consistency did not influence the probability of immediate target fixation or the ERP evoked by scene onset, which suggests that object–scene semantics was not accessed immediately. However, during the subsequent scene exploration, inconsistent objects were prioritized over consistent objects in extrafoveal vision (i.e., looked at earlier) and were more effortful to process in foveal vision (i.e., looked at longer). In FRPs, we demonstrate a fixation-related N300/N400 effect, whereby inconsistent objects elicit a larger frontocentral negativity than consistent objects. In line with the behavioral findings, this effect was already seen in FRPs aligned to the pretarget fixation t − 1 and persisted throughout fixation t, indicating that the extraction of object semantics can already begin in extrafoveal vision. Taken together, the results emphasize the usefulness of combined EEG/eye movement recordings for understanding the mechanisms of object–scene integration during natural viewing.
Collapse
Affiliation(s)
- Moreno I. Coco
- The University of East London
- CICPSI, Faculdade de Psicologia, Universidade de Lisboa
| | | | | |
Collapse
|
11
|
Cimminella F, Sala SD, Coco MI. Extra-foveal Processing of Object Semantics Guides Early Overt Attention During Visual Search. Atten Percept Psychophys 2020; 82:655-670. [PMID: 31792893 PMCID: PMC7246246 DOI: 10.3758/s13414-019-01906-1] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/05/2022]
Abstract
Eye-tracking studies using arrays of objects have demonstrated that some high-level processing of object semantics can occur in extra-foveal vision, but its role on the allocation of early overt attention is still unclear. This eye-tracking visual search study contributes novel findings by examining the role of object-to-object semantic relatedness and visual saliency on search responses and eye-movement behaviour across arrays of increasing size (3, 5, 7). Our data show that a critical object was looked at earlier and for longer when it was semantically unrelated than related to the other objects in the display, both when it was the search target (target-present trials) and when it was a target's semantically related competitor (target-absent trials). Semantic relatedness effects manifested already during the very first fixation after array onset, were consistently found for increasing set sizes, and were independent of low-level visual saliency, which did not play any role. We conclude that object semantics can be extracted early in extra-foveal vision and capture overt attention from the very first fixation. These findings pose a challenge to models of visual attention which assume that overt attention is guided by the visual appearance of stimuli, rather than by their semantics.
Collapse
Affiliation(s)
- Francesco Cimminella
- Human Cognitive Neuroscience, Psychology, University of Edinburgh, Edinburgh, UK.
- Laboratory of Experimental Psychology, Suor Orsola Benincasa University, Naples, Italy.
| | - Sergio Della Sala
- Human Cognitive Neuroscience, Psychology, University of Edinburgh, Edinburgh, UK
| | - Moreno I Coco
- Human Cognitive Neuroscience, Psychology, University of Edinburgh, Edinburgh, UK.
- School of Psychology, The University of East London, London, UK.
- Faculdade de Psicologia, Universidade de Lisboa, Lisbon, Portugal.
| |
Collapse
|
12
|
Williams CC. Looking for your keys: The interaction of attention, memory, and eye movements in visual search. PSYCHOLOGY OF LEARNING AND MOTIVATION 2020. [DOI: 10.1016/bs.plm.2020.06.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
13
|
Borges MT, Fernandes EG, Coco MI. Age-related differences during visual search: the role of contextual expectations and cognitive control mechanisms. AGING NEUROPSYCHOLOGY AND COGNITION 2019; 27:489-516. [DOI: 10.1080/13825585.2019.1632256] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Miguel T. Borges
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | | | - Moreno I. Coco
- School of Psychology, University of East London, London, United Kingdom of Great Britain and Northern Ireland
| |
Collapse
|
14
|
Williams CC, Castelhano MS. The Changing Landscape: High-Level Influences on Eye Movement Guidance in Scenes. Vision (Basel) 2019; 3:E33. [PMID: 31735834 PMCID: PMC6802790 DOI: 10.3390/vision3030033] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2019] [Revised: 06/20/2019] [Accepted: 06/24/2019] [Indexed: 11/16/2022] Open
Abstract
The use of eye movements to explore scene processing has exploded over the last decade. Eye movements provide distinct advantages when examining scene processing because they are both fast and spatially measurable. By using eye movements, researchers have investigated many questions about scene processing. Our review will focus on research performed in the last decade examining: (1) attention and eye movements; (2) where you look; (3) influence of task; (4) memory and scene representations; and (5) dynamic scenes and eye movements. Although typically addressed as separate issues, we argue that these distinctions are now holding back research progress. Instead, it is time to examine the intersections of these seemingly separate influences and examine the intersectionality of how these influences interact to more completely understand what eye movements can tell us about scene processing.
Collapse
Affiliation(s)
- Carrick C. Williams
- Department of Psychology, California State University San Marcos, San Marcos, CA 92069, USA
| | | |
Collapse
|
15
|
Nuthmann A, de Groot F, Huettig F, Olivers CNL. Extrafoveal attentional capture by object semantics. PLoS One 2019; 14:e0217051. [PMID: 31120948 PMCID: PMC6532879 DOI: 10.1371/journal.pone.0217051] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2018] [Accepted: 05/03/2019] [Indexed: 11/19/2022] Open
Abstract
There is ongoing debate on whether object meaning can be processed outside foveal vision, making semantics available for attentional guidance. Much of the debate has centred on whether objects that do not fit within an overall scene draw attention, in complex displays that are often difficult to control. Here, we revisited the question by reanalysing data from three experiments that used displays consisting of standalone objects from a carefully controlled stimulus set. Observers searched for a target object, as per auditory instruction. On the critical trials, the displays contained no target but objects that were semantically related to the target, visually related, or unrelated. Analyses using (generalized) linear mixed-effects models showed that, although visually related objects attracted most attention, semantically related objects were also fixated earlier in time than unrelated objects. Moreover, semantic matches affected the very first saccade in the display. The amplitudes of saccades that first entered semantically related objects were larger than 5° on average, confirming that object semantics is available outside foveal vision. Finally, there was no semantic capture of attention for the same objects when observers did not actively look for the target, confirming that it was not stimulus-driven. We discuss the implications for existing models of visual cognition.
Collapse
Affiliation(s)
- Antje Nuthmann
- Psychology Department, School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, United Kingdom
- Institute of Psychology, University of Kiel, Kiel, Germany
| | - Floor de Groot
- Department of Experimental and Applied Psychology & Institute for Brain and Behaviour, Vrije Universiteit, Amsterdam, The Netherlands
| | - Falk Huettig
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Centre for Language Studies, Radboud University, Nijmegen, The Netherlands
| | - Christian N. L. Olivers
- Department of Experimental and Applied Psychology & Institute for Brain and Behaviour, Vrije Universiteit, Amsterdam, The Netherlands
- * E-mail:
| |
Collapse
|
16
|
Gong M, Xuan Y, Xu X, Fu X. The Effect of Consistency on Short-Term Memory for Scenes. Front Psychol 2017; 8:1712. [PMID: 29046654 PMCID: PMC5632670 DOI: 10.3389/fpsyg.2017.01712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2017] [Accepted: 09/19/2017] [Indexed: 11/13/2022] Open
Abstract
Which is more detectable, the change of a consistent or an inconsistent object in a scene? This question has been debated for decades. We noted that the change of objects in scenes might simultaneously be accompanied with gist changes. In the present study we aimed to examine how the alteration of gist, as well as the consistency of the changed objects, modulated change detection. In Experiment 1, we manipulated the semantic content by either keeping or changing the consistency of the scene. Results showed that the changes of consistent and inconsistent scenes were equally detected. More importantly, the changes were more accurately detected when scene consistency changed than when the consistency remained unchanged, regardless of the consistency of the memory scenes. A phase-scrambled version of stimuli was adopted in Experiment 2 to decouple the possible confounding effect of low-level factors. The results of Experiment 2 demonstrated that the effect found in Experiment 1 was indeed due to the change of high-level semantic consistency rather than the change of low-level physical features. Together, the study suggests that the change of consistency plays an important role in scene short-term memory, which might be attributed to the sensitivity to the change of semantic content.
Collapse
Affiliation(s)
- Mingliang Gong
- State Key Laboratory of Brain and Cognitive Sciences, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, Miami University, Oxford, OH, United States
| | - Yuming Xuan
- State Key Laboratory of Brain and Cognitive Sciences, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of the Chinese Academy of Sciences, Beijing, China
| | - Xinwen Xu
- State Key Laboratory of Brain and Cognitive Sciences, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of the Chinese Academy of Sciences, Beijing, China
| | - Xiaolan Fu
- State Key Laboratory of Brain and Cognitive Sciences, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of the Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
17
|
Ortiz-Tudela J, Martín-Arévalo E, Chica AB, Lupiáñez J. Semantic incongruity attracts attention at a pre-conscious level: Evidence from a TMS study. Cortex 2017; 102:96-106. [PMID: 28969900 DOI: 10.1016/j.cortex.2017.08.035] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2017] [Revised: 07/19/2017] [Accepted: 08/31/2017] [Indexed: 11/27/2022]
Abstract
Unpredicted objects, i.e., those that do not fit in a specific context, have been shown to quickly attract attention as a mean of extracting more information about potentially relevant items. Whether the required semantic processing triggering the attraction of attention can occur independently of participants' awareness of the object is still a highly debated topic. In the present study we make use of a change detection task in which we manipulate the semantic congruity between the to-be-detected object and the background scene. We applied inhibitory repetitive transcranial magnetic stimulation (rTMS) over the right temporo-parietal junction (right TPJ) and a control location (vertex) to test the causal role of the former in the processing of objects at a pre-conscious level. Our results clearly show that semantic congruity can impact detection and identification processes in opposite ways, even when low-level features are controlled for. Incongruent objects are quickly detected but poorly identified. rTMS over the right TPJ effectively diminishes semantic effects on object detection. These results suggest that at least some high order category processing takes place before conscious detection to direct attention towards the most informative regions of space. Moreover, rTMS over right TPJ also impacts object identification, which calls for a re-evaluation of right TPJ's role on object processing.
Collapse
Affiliation(s)
- Javier Ortiz-Tudela
- Department of Experimental Psychology, Centro de Investigación Mente, Cerebro y Comportamiento (CIMCYC), Universidad de Granada, Spain.
| | - Elisa Martín-Arévalo
- Department of Experimental Psychology, Centro de Investigación Mente, Cerebro y Comportamiento (CIMCYC), Universidad de Granada, Spain
| | - Ana B Chica
- Department of Experimental Psychology, Centro de Investigación Mente, Cerebro y Comportamiento (CIMCYC), Universidad de Granada, Spain
| | - Juan Lupiáñez
- Department of Experimental Psychology, Centro de Investigación Mente, Cerebro y Comportamiento (CIMCYC), Universidad de Granada, Spain
| |
Collapse
|