1
|
Tal A, Sar-Shalom M, Krawitz T, Biderman D, Mudrik L. Awareness is needed for contextual effects in ambiguous object recognition. Cortex 2024; 173:49-60. [PMID: 38367591 DOI: 10.1016/j.cortex.2024.01.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2023] [Revised: 01/04/2024] [Accepted: 01/10/2024] [Indexed: 02/19/2024]
Abstract
Despite its centrality to human experience, the functional role of conscious awareness is not yet known. One hypothesis suggests that consciousness is necessary for allowing high-level information to refine low-level processing in a "top-down" manner. To test this hypothesis, in this work we examined whether consciousness is needed for integrating contextual information with sensory information during visual object recognition, a case of top-down processing that is automatic and ubiquitous to our daily visual experience. In three experiments, 137 participants were asked to determine the identity of an ambiguous object presented to them. Crucially, a scene biasing the interpretation of the object towards one option over another (e.g., a picture of a tree when the object could equally be perceived as a fish or a leaf) was presented either before, after, or alongside the ambiguous object. In all three experiments, the scene biased perception of the ambiguous object when it was consciously perceived, but not when it was processed unconsciously. The results therefore suggest that conscious awareness may be needed for top-down contextual processes.
Collapse
Affiliation(s)
- Amir Tal
- School of Psychological Sciences, Tel Aviv University, Israel; Department of Psychology, Columbia University, New York, NY, USA.
| | - May Sar-Shalom
- School of Psychological Sciences, Tel Aviv University, Israel
| | - Tzahi Krawitz
- School of Psychological Sciences, Tel Aviv University, Israel
| | - Dan Biderman
- Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, USA
| | - Liad Mudrik
- School of Psychological Sciences, Tel Aviv University, Israel; Sagol School of Neuroscience, Tel Aviv University, Israel
| |
Collapse
|
2
|
Peelen MV, Berlot E, de Lange FP. Predictive processing of scenes and objects. NATURE REVIEWS PSYCHOLOGY 2024; 3:13-26. [PMID: 38989004 PMCID: PMC7616164 DOI: 10.1038/s44159-023-00254-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/25/2023] [Indexed: 07/12/2024]
Abstract
Real-world visual input consists of rich scenes that are meaningfully composed of multiple objects which interact in complex, but predictable, ways. Despite this complexity, we recognize scenes, and objects within these scenes, from a brief glance at an image. In this review, we synthesize recent behavioral and neural findings that elucidate the mechanisms underlying this impressive ability. First, we review evidence that visual object and scene processing is partly implemented in parallel, allowing for a rapid initial gist of both objects and scenes concurrently. Next, we discuss recent evidence for bidirectional interactions between object and scene processing, with scene information modulating the visual processing of objects, and object information modulating the visual processing of scenes. Finally, we review evidence that objects also combine with each other to form object constellations, modulating the processing of individual objects within the object pathway. Altogether, these findings can be understood by conceptualizing object and scene perception as the outcome of a joint probabilistic inference, in which "best guesses" about objects act as priors for scene perception and vice versa, in order to concurrently optimize visual inference of objects and scenes.
Collapse
Affiliation(s)
- Marius V Peelen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Eva Berlot
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Floris P de Lange
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|
3
|
Li C, Ficco L, Trapp S, Rostalski SM, Korn L, Kovács G. The effect of context congruency on fMRI repetition suppression for objects. Neuropsychologia 2023; 188:108603. [PMID: 37270029 DOI: 10.1016/j.neuropsychologia.2023.108603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 05/31/2023] [Accepted: 05/31/2023] [Indexed: 06/05/2023]
Abstract
The recognition of objects is strongly facilitated when they are presented in the context of other objects (Biederman, 1972). Such contexts facilitate perception and induce expectations of context-congruent objects (Trapp and Bar, 2015). The neural mechanisms underlying these facilitatory effects of context on object processing, however, are not yet fully understood. In the present study, we investigate how context-induced expectations affect subsequent object processing. We used functional magnetic resonance imaging and measured repetition suppression as a proxy for prediction error processing. Participants viewed pairs of alternating or repeated object images which were preceded by context-congruent, context-incongruent or neutral cues. We found a stronger repetition suppression in congruent as compared to incongruent or neutral cues in the object sensitive lateral occipital cortex. Interestingly, this stronger effect was driven by enhanced responses to alternating stimulus pairs in the congruent contexts, rather than by suppressed responses to repeated stimulus pairs, which emphasizes the contribution of surprise-related response enhancement for the context modulation on RS when expectations are violated. In addition, in the congruent condition, we discovered significant functional connectivity between object-responsive and frontal cortical regions, as well as between object-responsive regions and the fusiform gyrus. Our findings indicate that prediction errors, reflected in enhanced brain responses to violated contextual expectations, underlie the facilitating effect of context during object perception.
Collapse
Affiliation(s)
- Chenglin Li
- School of Psychology, Zhejiang Normal University, China; Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany
| | - Linda Ficco
- Department of General Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany; Department of Linguistics and Cultural Evolution, International Max Planck Research School for the Science of Human History, Jena, Germany
| | - Sabrina Trapp
- Macromedia University of Applied Sciences, Munich, Germany
| | - Sophie-Marie Rostalski
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany
| | - Lukas Korn
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany
| | - Gyula Kovács
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich-Schiller-Universität Jena, Germany.
| |
Collapse
|
4
|
Huang Z, Urale PWB, Morgan CA, Rees G, Schwarzkopf DS. The role of awareness in shaping responses in human visual cortex. ROYAL SOCIETY OPEN SCIENCE 2023; 10:230380. [PMID: 37564060 PMCID: PMC10410229 DOI: 10.1098/rsos.230380] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Accepted: 07/20/2023] [Indexed: 08/12/2023]
Abstract
The visual cortex contains information about stimuli even when they are not consciously perceived. However, it remains unknown whether the visual system integrates local features into global objects without awareness. Here, we tested this by measuring brain activity in human observers viewing fragmented shapes that were either visible or rendered invisible by fast counterphase flicker. We then projected measured neural responses to these stimuli back into visual space. Visible stimuli caused robust responses reflecting the positions of their component fragments. Their neural representations also strongly resembled one another regardless of local features. By contrast, representations of invisible stimuli differed from one another and, crucially, also from visible stimuli. Our results demonstrate that even the early visual cortex encodes unconscious visual information differently from conscious information, presumably by only encoding local features. This could explain previous conflicting behavioural findings on unconscious visual processing.
Collapse
Affiliation(s)
- Zien Huang
- School of Optometry and Vision Science, University of Auckland, Auckland, New Zealand
- School of Psychology and Centre for Brain Research, University of Auckland, Auckland, New Zealand
| | - Poutasi W. B. Urale
- School of Optometry and Vision Science, University of Auckland, Auckland, New Zealand
- School of Psychology and Centre for Brain Research, University of Auckland, Auckland, New Zealand
| | - Catherine A. Morgan
- School of Psychology and Centre for Brain Research, University of Auckland, Auckland, New Zealand
- Centre for Advance Magnetic Resonance Imaging, Auckland UniServices Limited, Auckland, New Zealand
| | - Geraint Rees
- UCL Institute of Cognitive Neuroscience, University College London, London, UK
| | - D. Samuel Schwarzkopf
- School of Optometry and Vision Science, University of Auckland, Auckland, New Zealand
- Experimental Psychology, University College London, London, UK
| |
Collapse
|
5
|
Yu R. Perceptual and semantic same-different processing under subliminal conditions. Conscious Cogn 2023; 111:103523. [PMID: 37100000 DOI: 10.1016/j.concog.2023.103523] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 04/13/2023] [Accepted: 04/16/2023] [Indexed: 04/28/2023]
Abstract
Although other types of subliminal integrative processing are widely refuted by recent studies, subliminal same-different processing (SSDP) remains unchallenged to this day. Using shapes, categorical images, and Chinese characters as stimuli, the current study assessed whether SSDP can occur on a perceptual and semantic basis. Although some significant results were found, the effects are much weaker than previous studies, with Bayes factors suggesting that these effects are not reliable. It is therefore concluded that substantiating claims of SSDP requires more reliable evidence than currently available.
Collapse
Affiliation(s)
- Rongjun Yu
- Department of Management, Marketing, and Information Systems, Hong Kong Baptist University, 999077, Hong Kong, China.
| |
Collapse
|
6
|
Stress disrupts insight-driven mnemonic reconfiguration in the medial temporal lobe. Neuroimage 2023; 265:119804. [PMID: 36503160 PMCID: PMC9878442 DOI: 10.1016/j.neuroimage.2022.119804] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Revised: 12/05/2022] [Accepted: 12/07/2022] [Indexed: 12/13/2022] Open
Abstract
Memories are not stored in isolation. Insight into the relationship of initially unrelated events may trigger a flexible reconfiguration of the mnemonic representation of these events. Such representational changes allow the integration of events into coherent episodes and help to build up-to-date-models of the world around us. This process is, however, frequently impaired in stress-related mental disorders resulting in symptoms such as fragmented memories in PTSD. Here, we combined a real life-like narrative-insight task, in which participants learned how initially separate events are linked, with fMRI-based representational similarity analysis to test if and how acute stress interferes with the insight-driven reconfiguration of memories. Our results showed that stress reduced the activity of medial temporal and prefrontal areas when participants gained insight into the link between events. Moreover, stress abolished the insight-related increase in representational dissimilarity for linked events in the anterior part of the hippocampus as well as its association with measures of subsequent memory that we observed in non-stressed controls. However, memory performance, as assessed in a forced-choice recognition test, was even enhanced in the stress group. Our findings suggest that acute stress impedes the neural integration of events into coherent episodes but promotes long-term memory for these integrated narratives and may thus have implications for understanding memory distortions in stress-related mental disorders.
Collapse
|
7
|
Yang YH, Huang TR, Yeh SL. Role of visual awareness on semantic integration of sequentially presented words: An fMRI study. Brain Cogn 2022; 164:105916. [PMID: 36260953 DOI: 10.1016/j.bandc.2022.105916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Revised: 09/06/2022] [Accepted: 10/04/2022] [Indexed: 11/26/2022]
Abstract
Reading comprehension requires the semantic integration of words across space and time. However, it remains unclear whether comprehension requires visual awareness for such semantic integration. Compared to earlier studies that investigated semantic integration indirectly from its priming effect, we used functional magnetic resonance imaging (fMRI) to directly examine the processes of semantic integration with or without visual awareness. Specifically, we manipulated participants' visual awareness by continuous flash suppression (CFS) while they viewed a meaningful sequence of four Chinese words (i.e., an idiom) or its meaningless counterpart (i.e., a random sequence). Behaviorally, participants had better recognition memory for idioms than random sequences only when their visual awareness was interfered rather than blocked by CFS. Neurally, semantics-processing areas, such as the superior temporal gyrus and inferior frontal gyrus, were significantly activated only when participants were aware of word sequences, be they meaningful or meaningless. By contrast, orthography-processing areas, such as the fusiform gyrus and inferior occipital gyrus, were significantly activated regardless of visual awareness or word sequence. Taken together, these results suggest that visual awareness modules the functioning of the semantic neural network in the brain and facilitates reading comprehension.
Collapse
|
8
|
Altered functional connectivity: A possible reason for reduced performance during visual cognition involving scene incongruence and negative affect. IBRO Neurosci Rep 2022; 13:533-542. [DOI: 10.1016/j.ibneur.2022.11.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2022] [Accepted: 11/19/2022] [Indexed: 11/22/2022] Open
|
9
|
Abstract
The extent to which we are affected by perceptual input of which we are unaware is widely debated. By measuring neural responses to sensory stimulation, neuroscientific data could complement behavioral results with valuable evidence. Here we review neuroscientific findings of processing of high-level information, as well as interactions with attention and memory. Although the results are mixed, we find initial support for processing object categories and words, possibly to the semantic level, as well as emotional expressions. Robust neural evidence for face individuation and integration of sentences or scenes is lacking. Attention affects the processing of stimuli that are not consciously perceived, and such stimuli may exogenously but not endogenously capture attention when relevant, and be maintained in memory over time. Sources of inconsistency in the literature include variability in control for awareness as well as individual differences, calling for future studies that adopt stricter measures of awareness and probe multiple processes within subjects.
Collapse
Affiliation(s)
- Liad Mudrik
- School of Psychological Sciences and Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel;
| | - Leon Y Deouell
- Department of Psychology and The Edmond and Lily Safra Center for Brain Sciences, The Hebrew University of Jerusalem, Jerusalem, Israel;
| |
Collapse
|
10
|
Doradzińska Ł, Furtak M, Bola M. Perception of semantic relations in scenes: A registered report study of attention hold. Conscious Cogn 2022; 100:103315. [PMID: 35339910 DOI: 10.1016/j.concog.2022.103315] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 03/07/2022] [Accepted: 03/12/2022] [Indexed: 11/16/2022]
Abstract
To what extent the semantic relations present in scenes guide spatial attention automatically remains a matter of debate. Considering that spatial attention can be understood as a sequence of shifts, engagements, and disengagements, semantic relations might affect each stage of this process differently. Therefore, we investigated whether objects that violate semantic rules engage attention for longer than objects that are expected in a given context. The experiment involved a central presentation of a distractor scene that contained a semantically congruent or incongruent object, and a peripheral presentation of a small target letter. We found that incongruent scenes did not delay responses to the peripheral target, which indicates that they did not hold attention for longer than congruent scenes. Therefore, by showing that violations of semantic relations do not engage attention automatically, our study contributes to a better understanding of how attention operates in naturalistic settings.
Collapse
Affiliation(s)
- Łucja Doradzińska
- Laboratory of Brain Imaging, Nencki Institute of Experimental Biology of Polish Academy of Sciences, 3 Pasteur Street, 02-093 Warsaw, Poland
| | - Marcin Furtak
- Laboratory of Brain Imaging, Nencki Institute of Experimental Biology of Polish Academy of Sciences, 3 Pasteur Street, 02-093 Warsaw, Poland
| | - Michał Bola
- Laboratory of Brain Imaging, Nencki Institute of Experimental Biology of Polish Academy of Sciences, 3 Pasteur Street, 02-093 Warsaw, Poland.
| |
Collapse
|
11
|
Abstract
During natural vision, our brains are constantly exposed to complex, but regularly structured environments. Real-world scenes are defined by typical part-whole relationships, where the meaning of the whole scene emerges from configurations of localized information present in individual parts of the scene. Such typical part-whole relationships suggest that information from individual scene parts is not processed independently, but that there are mutual influences between the parts and the whole during scene analysis. Here, we review recent research that used a straightforward, but effective approach to study such mutual influences: By dissecting scenes into multiple arbitrary pieces, these studies provide new insights into how the processing of whole scenes is shaped by their constituent parts and, conversely, how the processing of individual parts is determined by their role within the whole scene. We highlight three facets of this research: First, we discuss studies demonstrating that the spatial configuration of multiple scene parts has a profound impact on the neural processing of the whole scene. Second, we review work showing that cortical responses to individual scene parts are shaped by the context in which these parts typically appear within the environment. Third, we discuss studies demonstrating that missing scene parts are interpolated from the surrounding scene context. Bridging these findings, we argue that efficient scene processing relies on an active use of the scene's part-whole structure, where the visual brain matches scene inputs with internal models of what the world should look like.
Collapse
Affiliation(s)
- Daniel Kaiser
- Justus-Liebig-Universität Gießen, Germany.,Philipps-Universität Marburg, Germany.,University of York, United Kingdom
| | - Radoslaw M Cichy
- Freie Universität Berlin, Germany.,Humboldt-Universität zu Berlin, Germany.,Bernstein Centre for Computational Neuroscience Berlin, Germany
| |
Collapse
|
12
|
Wischnewski M, Peelen MV. Causal neural mechanisms of context-based object recognition. eLife 2021; 10:69736. [PMID: 34374647 PMCID: PMC8354632 DOI: 10.7554/elife.69736] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2021] [Accepted: 07/26/2021] [Indexed: 12/05/2022] Open
Abstract
Objects can be recognized based on their intrinsic features, including shape, color, and texture. In daily life, however, such features are often not clearly visible, for example when objects appear in the periphery, in clutter, or at a distance. Interestingly, object recognition can still be highly accurate under these conditions when objects are seen within their typical scene context. What are the neural mechanisms of context-based object recognition? According to parallel processing accounts, context-based object recognition is supported by the parallel processing of object and scene information in separate pathways. Output of these pathways is then combined in downstream regions, leading to contextual benefits in object recognition. Alternatively, according to feedback accounts, context-based object recognition is supported by (direct or indirect) feedback from scene-selective to object-selective regions. Here, in three pre-registered transcranial magnetic stimulation (TMS) experiments, we tested a key prediction of the feedback hypothesis: that scene-selective cortex causally and selectively supports context-based object recognition before object-selective cortex does. Early visual cortex (EVC), object-selective lateral occipital cortex (LOC), and scene-selective occipital place area (OPA) were stimulated at three time points relative to stimulus onset while participants categorized degraded objects in scenes and intact objects in isolation, in different trials. Results confirmed our predictions: relative to isolated object recognition, context-based object recognition was selectively and causally supported by OPA at 160–200 ms after onset, followed by LOC at 260–300 ms after onset. These results indicate that context-based expectations facilitate object recognition by disambiguating object representations in the visual cortex.
Collapse
Affiliation(s)
- Miles Wischnewski
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands.,Department of Biomedical Engineering, University of Minnesota, Minneapolis, United States
| | - Marius V Peelen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
| |
Collapse
|
13
|
Zher-Wen, Yu R. Unconscious preparation: Effects of prime visibility on semantic generalization of task priming. Br J Psychol 2021; 112:835-865. [PMID: 33780564 DOI: 10.1111/bjop.12503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2019] [Revised: 03/02/2021] [Indexed: 11/30/2022]
Abstract
Studies found that subliminal primes can be associated with specific tasks to facilitate task performance, and such learning is highly adaptive and generalizable. Meanwhile, conditioning studies suggest that aversive/reward learning and generalization actually occur at the semantic level. The current study shows that prime-task associations can also be generalized to novel word/neighbour primes from the same semantic category, and this occurs without contingency awareness. Previous studies have counterintuitively suggested that both the learning of task priming and the semantic priming of word neighbours depend on the lack of visibility. Here, we show that semantic generalization indeed depends on reduced visibility, but cannot occur subliminally. The current study shows for the first time that semantic learning and generalization can occur without any emotional or motivational factors, and that semantic priming can occur for arbitrary-linked stimuli in a context completely devoid of semantics.
Collapse
Affiliation(s)
- Zher-Wen
- Department of Psychology, National University of Singapore, Singapore
| | - Rongjun Yu
- Department of Psychology, National University of Singapore, Singapore.,Department of Management, Hong Kong Baptist University, Hong Kong, China.,Department of Sport, Physical Education and Health, Hong Kong Baptist University, Hong Kong, China.,Department of Physics, Hong Kong Baptist University, Hong Kong, China
| |
Collapse
|
14
|
Zacharia AA, Ahuja N, Kaur S, Sharma R. Frontal activation as a key for deciphering context congruity and valence during visual perception: An electrical neuroimaging study. Brain Cogn 2021; 150:105711. [PMID: 33774336 DOI: 10.1016/j.bandc.2021.105711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2020] [Revised: 01/12/2021] [Accepted: 02/24/2021] [Indexed: 11/20/2022]
Abstract
The object-context associations and the valence are two important stimulus attributes that influence visual perception. The current study investigates the neural sources associated with schema congruent and incongruent object-context associations within positive, negative, and neutral valence during an intermittent binocular rivalry task with simultaneous high-density EEG recording. Cortical sourceswere calculated using the sLORETA algorithm in 150 ms after stimulus onset (Stim + 150) and 400 ms before response (Resp-400) time windows. No significant difference in source activity was found between congruent and incongruent associations in any of the valence categories in the Stim + 150 ms window indicating that immediately after stimulus presentation the basic visual processing remains the same for both. In the Resp-400 ms window, different frontal regions showed higher activity for incongruent associations with different valence such as the superior frontal gyrus showed significantly higher activations for negative while the middle and medial frontal gyrus showed higher activations for neutral and finally, the inferior frontal gyrus showed higher activations for positive valence. Besides replicating the previous knowledge of frontal activations in response to context congruity, the current study provides further evidence for the sensitivity of the frontal lobe to the valence associated with the incongruent stimuli.
Collapse
Affiliation(s)
- Angel Anna Zacharia
- Stress and Cognitive Electroimaging Lab, Department of Physiology, All India Institute of Medical Sciences, New Delhi 110029, India
| | - Navdeep Ahuja
- Stress and Cognitive Electroimaging Lab, Department of Physiology, All India Institute of Medical Sciences, New Delhi 110029, India
| | - Simran Kaur
- Stress and Cognitive Electroimaging Lab, Department of Physiology, All India Institute of Medical Sciences, New Delhi 110029, India
| | - Ratna Sharma
- Stress and Cognitive Electroimaging Lab, Department of Physiology, All India Institute of Medical Sciences, New Delhi 110029, India.
| |
Collapse
|
15
|
Hirschhorn R, Kahane O, Gur-Arie I, Faivre N, Mudrik L. Windows of Integration Hypothesis Revisited. Front Hum Neurosci 2021; 14:617187. [PMID: 33519404 PMCID: PMC7840615 DOI: 10.3389/fnhum.2020.617187] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Accepted: 12/18/2020] [Indexed: 11/13/2022] Open
Abstract
In the ongoing research of the functions of consciousness, special emphasis has been put on integration of information: the ability to combine different signals into a coherent, unified one. Several theories of consciousness hold that this ability depends on - or at least goes hand in hand with - conscious processing. Yet some empirical findings have suggested otherwise, claiming that integration of information could take place even without awareness. Trying to reconcile this apparent contradiction, the "windows of integration" (WOI) hypothesis claims that conscious access enables signal processing over large integration windows. The hypothesis applies to integration windows defined either temporally, spatially, or semantically. In this review, we explain the hypothesis and re-examine it in light of new studies published since it was suggested. In line with the hypothesis, these studies provide compelling evidence for unconscious integration, but also demonstrate its limits with respect to time, space, and semantic distance. The review further highlights open questions that still need to be pursued to demonstrate the applicability of the WOI hypothesis as a guiding principle for understanding the depth and scope of unconscious processes.
Collapse
Affiliation(s)
- Rony Hirschhorn
- Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel
| | - Ofer Kahane
- School of Psychological Sciences, Tel-Aviv University, Tel-Aviv, Israel
| | - Inbal Gur-Arie
- School of Psychological Sciences, Tel-Aviv University, Tel-Aviv, Israel
| | - Nathan Faivre
- Laboratoire de Psychologie et Neurocognition (LPNC), CNRS UMR 5105, Université Grenoble Alpes, Grenoble, France
| | - Liad Mudrik
- Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel
- School of Psychological Sciences, Tel-Aviv University, Tel-Aviv, Israel
| |
Collapse
|
16
|
Kaiser D, Häberle G, Cichy RM. Real-world structure facilitates the rapid emergence of scene category information in visual brain signals. J Neurophysiol 2020; 124:145-151. [PMID: 32519577 DOI: 10.1152/jn.00164.2020] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
In everyday life, our visual surroundings are not arranged randomly but structured in predictable ways. Although previous studies have shown that the visual system is sensitive to such structural regularities, it remains unclear whether the presence of an intact structure in a scene also facilitates the cortical analysis of the scene's categorical content. To address this question, we conducted an EEG experiment during which participants viewed natural scene images that were either "intact" (with their quadrants arranged in typical positions) or "jumbled" (with their quadrants arranged into atypical positions). We then used multivariate pattern analysis to decode the scenes' category from the EEG signals (e.g., whether the participant had seen a church or a supermarket). The category of intact scenes could be decoded rapidly within the first 100 ms of visual processing. Critically, within 200 ms of processing, category decoding was more pronounced for the intact scenes compared with the jumbled scenes, suggesting that the presence of real-world structure facilitates the extraction of scene category information. No such effect was found when the scenes were presented upside down, indicating that the facilitation of neural category information is indeed linked to a scene's adherence to typical real-world structure rather than to differences in visual features between intact and jumbled scenes. Our results demonstrate that early stages of categorical analysis in the visual system exhibit tuning to the structure of the world that may facilitate the rapid extraction of behaviorally relevant information from rich natural environments.NEW & NOTEWORTHY Natural scenes are structured, with different types of information appearing in predictable locations. Here, we use EEG decoding to show that the visual brain uses this structure to efficiently analyze scene content. During early visual processing, the category of a scene (e.g., a church vs. a supermarket) could be more accurately decoded from EEG signals when the scene adhered to its typical spatial structure compared with when it did not.
Collapse
Affiliation(s)
- Daniel Kaiser
- Department of Psychology, University of York, York, United Kingdom
| | - Greta Häberle
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany.,Charité - Universitätsmedizin Berlin, Einstein Center for Neurosciences Berlin, Berlin, Germany.,Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Radoslaw M Cichy
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany.,Charité - Universitätsmedizin Berlin, Einstein Center for Neurosciences Berlin, Berlin, Germany.,Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany.,Bernstein Center for Computational Neuroscience Berlin, Berlin, Germany
| |
Collapse
|
17
|
Furtak M, Doradzińska Ł, Ptashynska A, Mudrik L, Nowicka A, Bola M. Automatic Attention Capture by Threatening, But Not by Semantically Incongruent Natural Scene Images. Cereb Cortex 2020; 30:4158-4168. [DOI: 10.1093/cercor/bhaa040] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2019] [Revised: 01/22/2020] [Accepted: 02/03/2020] [Indexed: 12/15/2022] Open
Abstract
Abstract
Visual objects are typically perceived as parts of an entire visual scene, and the scene’s context provides information crucial in the object recognition process. Fundamental insights into the mechanisms of context-object integration have come from research on semantically incongruent objects, which are defined as objects with a very low probability of occurring in a given context. However, the role of attention in processing of the context-object mismatch remains unclear, with some studies providing evidence in favor, but other against an automatic capture of attention by incongruent objects. Therefore, in the present study, 25 subjects completed a dot-probe task, in which pairs of scenes—congruent and incongruent or neutral and threatening—were presented as task-irrelevant distractors. Importantly, threatening scenes are known to robustly capture attention and thus were included in the present study to provide a context for interpretation of results regarding incongruent scenes. Using N2 posterior-contralateral ERP component as a primary measure, we revealed that threatening images indeed capture attention automatically and rapidly, but semantically incongruent scenes do not benefit from an automatic attentional selection. Thus, our results suggest that identification of the context-object mismatch is not preattentive.
Collapse
Affiliation(s)
- Marcin Furtak
- Laboratory of Brain Imaging, Nencki Institute of Experimental Biology, 02-093 Warsaw, Poland
| | - Łucja Doradzińska
- Laboratory of Brain Imaging, Nencki Institute of Experimental Biology, 02-093 Warsaw, Poland
| | - Alina Ptashynska
- Laboratory of Brain Imaging, Nencki Institute of Experimental Biology, 02-093 Warsaw, Poland
| | - Liad Mudrik
- School of Psychological Science, Tel Aviv University, 69978 Tel Aviv, Israel
- Sagol School of Neuroscience, Tel Aviv University, 69978 Tel Aviv, Israel
| | - Anna Nowicka
- Laboratory of Language Neurobiology, Nencki Institute of Experimental Biology, 02-093 Warsaw, Poland
| | - Michał Bola
- Laboratory of Brain Imaging, Nencki Institute of Experimental Biology, 02-093 Warsaw, Poland
| |
Collapse
|
18
|
Caplette L, Gosselin F, Mermillod M, Wicker B. Real-world expectations and their affective value modulate object processing. Neuroimage 2020; 213:116736. [PMID: 32171924 DOI: 10.1016/j.neuroimage.2020.116736] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2019] [Revised: 03/09/2020] [Accepted: 03/10/2020] [Indexed: 10/24/2022] Open
Abstract
It is well known that expectations influence how we perceive the world. Yet the neural mechanisms underlying this process remain unclear. Studies about the effects of prior expectations have focused so far on artificial contingencies between simple neutral cues and events. Real-world expectations are however often generated from complex associations between contexts and objects learned over a lifetime. Additionally, these expectations may contain some affective value and recent proposals present conflicting hypotheses about the mechanisms underlying affect in predictions. In this study, we used fMRI to investigate how object processing is influenced by realistic context-based expectations, and how affect impacts these expectations. First, we show that the precuneus, the inferotemporal cortex and the frontal cortex are more active during object recognition when expectations have been elicited a priori, irrespectively of their validity or their affective intensity. This result supports previous hypotheses according to which these brain areas integrate contextual expectations with object sensory information. Notably, these brain areas are different from those responsible for simultaneous context-object interactions, dissociating the two processes. Then, we show that early visual areas, on the contrary, are more active during object recognition when no prior expectation has been elicited by a context. Lastly, BOLD activity was shown to be enhanced in early visual areas when objects are less expected, but only when contexts are neutral; the reverse effect is observed when contexts are affective. This result supports the proposal that affect modulates the weighting of sensory information during predictions. Together, our results help elucidate the neural mechanisms of real-world expectations.
Collapse
Affiliation(s)
- Laurent Caplette
- Département de Psychologie, Université de Montréal, Montréal, Québec, Canada.
| | - Frédéric Gosselin
- Département de Psychologie, Université de Montréal, Montréal, Québec, Canada
| | | | - Bruno Wicker
- Département de Psychologie, Université de Montréal, Montréal, Québec, Canada; LNC, CNRS & Aix-Marseille Université, 13331, Marseille, France
| |
Collapse
|
19
|
Age effects on the neural processing of object-context associations in briefly flashed natural scenes. Neuropsychologia 2020; 136:107264. [DOI: 10.1016/j.neuropsychologia.2019.107264] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2019] [Revised: 09/30/2019] [Accepted: 11/11/2019] [Indexed: 01/31/2023]
|
20
|
Kaiser D, Häberle G, Cichy RM. Cortical sensitivity to natural scene structure. Hum Brain Mapp 2019; 41:1286-1295. [PMID: 31758632 PMCID: PMC7267931 DOI: 10.1002/hbm.24875] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2019] [Revised: 11/07/2019] [Accepted: 11/07/2019] [Indexed: 11/23/2022] Open
Abstract
Natural scenes are inherently structured, with meaningful objects appearing in predictable locations. Human vision is tuned to this structure: When scene structure is purposefully jumbled, perception is strongly impaired. Here, we tested how such perceptual effects are reflected in neural sensitivity to scene structure. During separate fMRI and EEG experiments, participants passively viewed scenes whose spatial structure (i.e., the position of scene parts) and categorical structure (i.e., the content of scene parts) could be intact or jumbled. Using multivariate decoding, we show that spatial (but not categorical) scene structure profoundly impacts on cortical processing: Scene‐selective responses in occipital and parahippocampal cortices (fMRI) and after 255 ms (EEG) accurately differentiated between spatially intact and jumbled scenes. Importantly, this differentiation was more pronounced for upright than for inverted scenes, indicating genuine sensitivity to spatial structure rather than sensitivity to low‐level attributes. Our findings suggest that visual scene analysis is tightly linked to the spatial structure of our natural environments. This link between cortical processing and scene structure may be crucial for rapidly parsing naturalistic visual inputs.
Collapse
Affiliation(s)
- Daniel Kaiser
- Department of Psychology, University of York, York, UK.,Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
| | - Greta Häberle
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany.,Einstein Center for Neurosciences Berlin, Humboldt-Universität Berlin, Berlin, Germany.,Berlin School of Mind and Brain, Humboldt-Universität Berlin, Berlin, Germany
| | - Radoslaw M Cichy
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany.,Einstein Center for Neurosciences Berlin, Humboldt-Universität Berlin, Berlin, Germany.,Berlin School of Mind and Brain, Humboldt-Universität Berlin, Berlin, Germany.,Bernstein Center for Computational Neuroscience Berlin, Humboldt-Universität Berlin, Berlin, Germany
| |
Collapse
|