Failure to detect meaning in RSVP at 27 ms per picture

What does decoding from the PFC reveal about consciousness?

Disputes between rival theories of consciousness have often centered on whether perceptual contents can be decoded from the prefrontal cortex (PFC). Failures to decode from the PFC are taken to challenge 'cognitive' theories of consciousness such as the global workspace theory and higher-order monitoring theories, and decoding successes have been taken to confirm these theories. However, PFC decoding shows both too much and too little. Too much because cognitive theories of consciousness do not need PFC rerepresentation of perceptual contents since pointers to perceptual representations suffice. Too little because there is evidence that PFC decoding of perceptual content reflects postperceptual cognitive representation, such as thoughts that have those perceptual contents rather than conscious percepts.

The Role of Occipitotemporal Network for Speed-Reading: An fMRI Study

The activity of occipitotemporal regions involved in linguistic reading processes, such as the ventral occipitotemporal cortex (vOT), is believed to exhibit strong interactions during higher-order language processing, specifically in the connectivity between the occipital gyrus and the temporal gyrus. In this study, we utilized functional magnetic resonance imaging (fMRI) with psychophysiological interaction (PPI) and dynamic causal modeling (DCM) to investigate the functional and effective connectivity in the occipitotemporal network during speed reading. We conducted the experiment with native Japanese speakers who underwent and without speed-reading training and subsequently performed established reading tasks at different speeds (slow, medium, and fast) while undergoing 3-Tesla Siemens fMRI. Our activation analyses revealed significant changes in occipital and temporal regions as reading speed increased, indicating functional connectivity within the occipitotemporal network. DCM results further demonstrated more intricate effective connections and high involvement within the occipitotemporal pathway: (1) reading signals originated from the inferior occipital gyrus (iO), distributed to the vOT and the posterior superior temporal sulcus (pSTS), and then gathered in the anterior superior temporal sulcus (aSTS); (2) reading speed loads had modulation effects on the pathways from the aSTS to vOT and from the iO to vOT. These findings highlight the complex connectivity and dynamic interactions within the occipitotemporal network during speed-reading processes.

Metacontrast masking is ineffective in the first 6 months of life

Metacontrast masking is one of the most widely studied types of visual masking, in which a visual stimulus is rendered invisible by a subsequent mask that does not spatially overlap with the target. Metacontrast has been used for many decades as a tool to study visual processing and conscious perception in adults. However, there are so far no infant studies on metacontrast and it remains unknown even whether it occurs in infants. The present study examined metacontrast masking in 3- to 8-month-old infants (N = 168) using a habituation paradigm. We found that metacontrast is ineffective for infants under 7 months and that younger infants can perceive a masked stimulus that older infants cannot. Our results suggest that metacontrast is distinct from other simple types of masking that occur in early infancy, and would be consistent with the idea that metacontrast results from the disruption of recurrent processing.

Mechanisms of human dynamic object recognition revealed by sequential deep neural networks

Humans can quickly recognize objects in a dynamically changing world. This ability is showcased by the fact that observers succeed at recognizing objects in rapidly changing image sequences, at up to 13 ms/image. To date, the mechanisms that govern dynamic object recognition remain poorly understood. Here, we developed deep learning models for dynamic recognition and compared different computational mechanisms, contrasting feedforward and recurrent, single-image and sequential processing as well as different forms of adaptation. We found that only models that integrate images sequentially via lateral recurrence mirrored human performance (N = 36) and were predictive of trial-by-trial responses across image durations (13-80 ms/image). Importantly, models with sequential lateral-recurrent integration also captured how human performance changes as a function of image presentation durations, with models processing images for a few time steps capturing human object recognition at shorter presentation durations and models processing images for more time steps capturing human object recognition at longer presentation durations. Furthermore, augmenting such a recurrent model with adaptation markedly improved dynamic recognition performance and accelerated its representational dynamics, thereby predicting human trial-by-trial responses using fewer processing resources. Together, these findings provide new insights into the mechanisms rendering object recognition so fast and effective in a dynamic visual world.

All-or-none face categorization in the human brain

Visual categorization is integral for our interaction with the natural environment. In this process, similar selective responses are produced to a class of variable visual inputs. Whether categorization is supported by partial (graded) or absolute (all-or-none) neural responses in high-level human brain regions is largely unknown. We address this issue with a novel frequency-sweep paradigm probing the evolution of face categorization responses between the minimal and optimal stimulus presentation times. In a first experiment, natural images of variable non-face objects were progressively swept from 120 to 3 ​Hz (8.33-333 ​ms duration) in rapid serial visual presentation sequences. Widely variable face exemplars appeared every 1 ​s, enabling an implicit frequency-tagged face-categorization electroencephalographic (EEG) response at 1 ​Hz. Face-categorization activity emerged with stimulus durations as brief as 17 ​ms (17-83 ​ms across individual participants) but was significant with 33 ​ms durations at the group level. The face categorization response amplitude increased until 83 ​ms stimulus duration (12 ​Hz), implying graded categorization responses. In a second EEG experiment, faces appeared non-periodically throughout such sequences at fixed presentation rates, while participants explicitly categorized faces. A strong correlation between response amplitude and behavioral accuracy across frequency rates suggested that dilution from missed categorizations, rather than a decreased response to each face stimulus, accounted for the graded categorization responses as found in Experiment 1. This was supported by (1) the absence of neural responses to faces that participants failed to categorize explicitly in Experiment 2 and (2) equivalent amplitudes and spatio-temporal signatures of neural responses to behaviorally categorized faces across presentation rates. Overall, these observations provide original evidence that high-level visual categorization of faces, starting at about 100 ​ms following stimulus onset in the human brain, is variable across observers tested under tight temporal constraints, but occurs in an all-or-none fashion.

Downgraded phenomenology: how conscious overflow lost its richness

Our in-the-moment experience of the world can feel vivid and rich, even when we cannot describe our experience due to limitations of attention, memory or other cognitive processes. But the nature of visual awareness is quite sparse, as suggested by the phenomena of failures of awareness, such as change blindness and inattentional blindness. I will argue that once failures of memory or failures of comparison are ruled out as explanations for these phenomena, they present strong evidence against rich awareness. To accommodate and explain these massive failures of awareness, any theory of phenomenal consciousness must downgrade phenomenology to a degree where it is functionless or, ironically, does not reflect what we experience.This article is part of the theme issue 'Perceptual consciousness and cognitive access'.

Rapid identification of the face in infants

Our visual system can rapidly process stimuli relevant to our current behavioral goal within various irrelevant stimuli in natural scenes. This ability to detect and identify target stimuli during nontarget stimuli has been mainly studied in adults, so that the development of this high-level visual function has been unknown among infants, although it has been shown that 15-month-olds' temporal thresholds of face visibility are close to those of adults. However, we demonstrate here that infants younger than 15 months can identify a target face among nontarget but meaningful scene images. In the current study, we investigated infants' ability to detect and identify a face in a rapid serial visual presentation. Experiment 1 examined whether 5- to 8-month-olds could discriminate the difference in the presentation duration of visual streams (100 vs. 11 ms). Results showed that 7- and 8-month-olds successfully discriminated between the presentation durations. In Experiment 2, we examined whether 5- to 8-month-olds could detect the face presented for 100 ms and found that 7- and 8-month-olds could detect the face embedded in rapid serial visual streams. To further clarify the face processing at this age of infants, we tested whether infants could identify upright and inverted faces in rapid visual streams in Experiments 3a and 3b. The results showed that 7- and 8-month-olds identified upright faces, but not inverted faces, during the visual stream, which reflected face inversion effects. Overall, we suggest that the temporal speed of face processing at 7 and 8 months of age would be comparable to that of adults.

Imaging object-scene relations processing in visible and invisible natural scenes

Integrating objects with their context is a key step in interpreting complex visual scenes. Here, we used functional Magnetic Resonance Imaging (fMRI) while participants viewed visual scenes depicting a person performing an action with an object that was either congruent or incongruent with the scene. Univariate and multivariate analyses revealed different activity for congruent vs. incongruent scenes in the lateral occipital complex, inferior temporal cortex, parahippocampal cortex, and prefrontal cortex. Importantly, and in contrast to previous studies, these activations could not be explained by task-induced conflict. A secondary goal of this study was to examine whether processing of object-context relations could occur in the absence of awareness. We found no evidence for brain activity differentiating between congruent and incongruent invisible masked scenes, which might reflect a genuine lack of activation, or stem from the limitations of our study. Overall, our results provide novel support for the roles of parahippocampal cortex and frontal areas in conscious processing of object-context relations, which cannot be explained by either low-level differences or task demands. Yet they further suggest that brain activity is decreased by visual masking to the point of becoming undetectable with our fMRI protocol.

Ultra-Rapid serial visual presentation reveals dynamics of feedforward and feedback processes in the ventral visual pathway

Human visual recognition activates a dense network of overlapping feedforward and recurrent neuronal processes, making it hard to disentangle processing in the feedforward from the feedback direction. Here, we used ultra-rapid serial visual presentation to suppress sustained activity that blurs the boundaries of processing steps, enabling us to resolve two distinct stages of processing with MEG multivariate pattern classification. The first processing stage was the rapid activation cascade of the bottom-up sweep, which terminated early as visual stimuli were presented at progressively faster rates. The second stage was the emergence of categorical information with peak latency that shifted later in time with progressively faster stimulus presentations, indexing time-consuming recurrent processing. Using MEG-fMRI fusion with representational similarity, we localized recurrent signals in early visual cortex. Together, our findings segregated an initial bottom-up sweep from subsequent feedback processing, and revealed the neural signature of increased recurrent processing demands for challenging viewing conditions.

Natural scenes can be identified as rapidly as individual features

Can observers determine the gist of a natural scene in a purely feedforward manner, or does this process require deliberation and feedback? Observers can recognise images that are presented for very brief periods of time before being masked. It is unclear whether this recognition process occurs in a purely feedforward manner or whether feedback from higher cortical areas to lower cortical areas is necessary. The current study revealed that the minimum presentation time required to identify or to determine the gist of a natural scene was no different from that required to determine the orientation or colour of an isolated line. Conversely, a visual task that would be expected to necessitate feedback (determining whether an image contained exactly six lines) required a significantly greater minimum presentation time. Assuming that the orientation or colour of an isolated line can be determined in a purely feedforward manner, these results indicate that the identification and the determination of the gist of a natural scene can also be performed in a purely feedforward manner. These results challenge a number of theories of visual recognition that require feedback.

High-Fidelity Visual Long-Term Memory within an Unattended Blink of an Eye

What is stored in long-term memory from current sensations is a question that has attracted considerable interest. Over time, several prominent theories have consistently proposed that only attended sensory information leaves a durable memory trace whereas unattended information is not stored beyond the current moment, an assumption that seems to be supported by abundant empirical evidence. Here we show, by using a more sensitive memory test than in previous studies, that this is actually not true. Observers viewed a rapid stream of real-world object pictures overlapped by words (presentation duration per stimulus: 500 ms, interstimulus interval: 200 ms), with the instruction to attend to the words and detect word repetitions, without knowing that their memory would be tested later. In a surprise two-alternative forced-choice recognition test, memory for the unattended object pictures was tested. Memory performance was substantially above chance, even when detailed feature knowledge was necessary for correct recognition, even when tested 24 h later, and even although participants reported that they do not have any memories. These findings suggests that humans have the ability to store at high speed detailed copies of current visual stimulations in long-term memory independently of current intentions and the current attentional focus.

Contrasting gist-based and template-based guidance during real-world visual search

Visual search through real-world scenes is guided both by a representation of target features and by knowledge of the sematic properties of the scene (derived from scene gist recognition). In 3 experiments, we compared the relative roles of these 2 sources of guidance. Participants searched for a target object in the presence of a critical distractor object. The color of the critical distractor either matched or mismatched (a) the color of an item maintained in visual working memory for a secondary task (Experiment 1), or (b) the color of the target, cued by a picture before search commenced (Experiments 2 and 3). Capture of gaze by a matching distractor served as an index of template guidance. There were 4 main findings: (a) The distractor match effect was observed from the first saccade on the scene, (b) it was independent of the availability of scene-level gist-based guidance, (c) it was independent of whether the distractor appeared in a plausible location for the target, and (d) it was preserved even when gist-based guidance was available before scene onset. Moreover, gist-based, semantic guidance of gaze to target-plausible regions of the scene was delayed relative to template-based guidance. These results suggest that feature-based template guidance is not limited to plausible scene regions after an initial, scene-level analysis. (PsycINFO Database Record

Making Sense of Real-World Scenes

To interact with the world, we have to make sense of the continuous sensory input conveying information about our environment. A recent surge of studies has investigated the processes enabling scene understanding, using increasingly complex stimuli and sophisticated analyses to highlight the visual features and brain regions involved. However, there are two major challenges to producing a comprehensive framework for scene understanding. First, scene perception is highly dynamic, subserving multiple behavioral goals. Second, a multitude of different visual properties co-occur across scenes and may be correlated or independent. We synthesize the recent literature and argue that for a complete view of scene understanding, it is necessary to account for both differing observer goals and the contribution of diverse scene properties.