Investigating category- and shape-selective neural processing in ventral and dorsal visual stream under interocular suppression

Perceptual and semantic same-different processing under subliminal conditions

Although other types of subliminal integrative processing are widely refuted by recent studies, subliminal same-different processing (SSDP) remains unchallenged to this day. Using shapes, categorical images, and Chinese characters as stimuli, the current study assessed whether SSDP can occur on a perceptual and semantic basis. Although some significant results were found, the effects are much weaker than previous studies, with Bayes factors suggesting that these effects are not reliable. It is therefore concluded that substantiating claims of SSDP requires more reliable evidence than currently available.

Probing the attentional modulation of unconscious processing under interocular suppression in a spatial cueing paradigm

The debate about the scope and limits of unconscious visual processing under continuous flash suppression (CFS) has created a heterogeneous set of divergent findings that are yet to be reconciled. Attention has been suggested as an important factor in modulating the processing of suppressed visual information under CFS. Specifically, Eo et al. (2016) reported that semantic processing under CFS can be significantly facilitated when spatial attention is diverted away from the suppressed stimulus. Based on event-related potential (ERP) findings involving the N400, they proposed that inattention attenuates interocular suppression and thereby makes semantic processing available unconsciously, potentially reconciling conflicting evidence in the literature. In this study, we aimed to further investigate the "CFS-attenuation-by-inattention" hypothesis using functional magnetic resonance imaging (fMRI) and multivariate pattern analysis (MVPA). We tested whether the decodability of object category increases under CFS when attention is diverted away from the suppressed stimulus in a spatial cueing task. Our results provide no evidence for the "CFS-attenuation-by-inattention" hypothesis, but show higher decoding accuracies for visible stimuli than for invisible stimuli. We discuss the implications of our findings for the important endeavor of trying to reconcile the divergent reports of unconscious processing under CFS.

Informative neural representations of unseen contents during higher-order processing in human brains and deep artificial networks

A framework to pinpoint the scope of unconscious processing is critical to improve models of visual consciousness. Previous research observed brain signatures of unconscious processing in visual cortex, but these were not reliably identified. Further, whether unconscious contents are represented in high-level stages of the ventral visual stream and linked parieto-frontal areas remains unknown. Using a within-subject, high-precision functional magnetic resonance imaging approach, we show that unconscious contents can be decoded from multi-voxel patterns that are highly distributed alongside the ventral visual pathway and also involving parieto-frontal substrates. Classifiers trained with multi-voxel patterns of conscious items generalized to predict the unconscious counterparts, indicating that their neural representations overlap. These findings suggest revisions to models of consciousness such as the neuronal global workspace. We then provide a computational simulation of visual processing/representation without perceptual sensitivity by using deep neural networks performing a similar visual task. The work provides a framework for pinpointing the representation of unconscious knowledge across different task domains.

Visual adaptation and 7T fMRI reveal facial identity processing in the human brain under shallow interocular suppression

Face identity is represented at a high level of the visual hierarchy. Whether the human brain can process facial identity information in the absence of visual awareness remains unclear. In this study, we investigated potential face identity representation through face-identity adaptation with the adapting faces interocularly suppressed by Continuous Flash Suppression (CFS) noise, a modified binocular rivalry paradigm. The strength of interocular suppression was manipulated by varying the contrast of CFS noise. While obeservers reported the face images subjectively unperceived and the face identity objectively unrecognizable, a significant face identity aftereffect was observed under low but not high contrast CFS noise. In addition, the identity of face images under shallow interocular suppression can be decoded from multi-voxel patterns in the right fusiform face area (FFA) obtained with high-resolution 7T fMRI. Thus the comined evidence from visual adaptation and 7T fMRI suggest that face identity can be represented in the human brain without explicit perceptual recognition. The processing of interocularly suppressed faces could occur at different levels depending on how "deep" the information is suppressed.

The human visual system differentially represents subjectively and objectively invisible stimuli

The study of unconscious processing requires a measure of conscious awareness. Awareness measures can be either subjective (based on participant's report) or objective (based on perceptual performance). The preferred awareness measure depends on the theoretical position about consciousness and may influence conclusions about the extent of unconscious processing and about the neural correlates of consciousness. We obtained functional magnetic resonance imaging (fMRI) measurements from 43 subjects while they viewed masked faces and houses that were either subjectively or objectively invisible. Even for objectively invisible (perceptually indiscriminable) stimuli, we found significant category information in both early, lower-level visual areas and in higher-level visual cortex, although representations in anterior, category-selective ventrotemporal areas were less robust. For subjectively invisible stimuli, similar to visible stimuli, there was a clear posterior-to-anterior gradient in visual cortex, with stronger category information in ventrotemporal cortex than in early visual cortex. For objectively invisible stimuli, however, category information remained virtually unchanged from early visual cortex to object- and category-selective visual areas. These results demonstrate that although both objectively and subjectively invisible stimuli are represented in visual cortex, the extent of unconscious information processing is influenced by the measurement approach. Furthermore, our data show that subjective and objective approaches are associated with different neural correlates of consciousness and thus have implications for neural theories of consciousness.

Continuous flash suppression: Known and unknowns

Studies utilizing continuous flash suppression (CFS) provide valuable information regarding conscious and nonconscious perception. There are, however, crucial unanswered questions regarding the mechanisms of suppression and the level of visual processing in the absence of consciousness with CFS. Research suggests that the answers to these questions depend on the experimental configuration and how we assess consciousness in these studies. The aim of this review is to evaluate the impact of different experimental configurations and the assessment of consciousness on the results of the previous CFS studies. We review studies that evaluated the influence of different experimental configuration on the depth of suppression with CFS and discuss how different assessments of consciousness may impact the results of CFS studies. Finally, we review behavioral and brain recording studies of CFS. In conclusion, previous studies provide evidence for survival of low-level visual information and complete impairment of high-level visual information under the influence of CFS. That is, studies suggest that nonconscious perception of lower-level visual information happens with CFS, but there is no evidence for nonconscious high-level recognition with CFS.

Reflections on Eriksen's seminal essay on discrimination, performance and learning without awareness

Early in his career C.W. Eriksen published in Psychological Review what turned out to be a highly impactful critique on methods and findings on the topic of unconscious influences on discrimination and awareness. His incisive commentary on extant methodology employed at that time - especially the heavy dependence on subjective reports - clearly was heard by others moving forward, as evidenced by the subsequent, lively discussions within the literature concerning the very definition of the notion of unconscious processing. Of equal importance, Eriksen's paper provided an impetus for the development of more refined techniques for manipulating perceptual awareness and for measuring the consequences of those manipulations. My purpose in this essay is to ensure that Eriksen's seminal contributions concerning unconscious phenomena remain within the awareness of the many current investigators working on this popular topic.

Limits on visual awareness of object targets in the context of other object category masks: Investigating bottlenecks in the continuous flash suppression paradigm with hand and tool stimuli

The continuous flash suppression (CFS) task can be used to investigate what limits our capacity to become aware of visual stimuli. In this task, a stream of rapidly changing mask images to one eye initially suppresses awareness for a static target image presented to the other eye. Several factors may determine the breakthrough time from mask suppression, one of which is the overlap in representation of the target/mask categories in higher visual cortex. This hypothesis is based on certain object categories (e.g., faces) being more effective in blocking awareness of other categories (e.g., buildings) than other combinations (e.g., cars/chairs). Previous work found mask effectiveness to be correlated with category-pair high-level representational similarity. As the cortical representations of hands and tools overlap, these categories are ideal to test this further as well as to examine alternative explanations. For our CFS experiments, we predicted longer breakthrough times for hands/tools compared to other pairs due to the reported cortical overlap. In contrast, across three experiments, participants were generally faster at detecting targets masked by hands or tools compared to other mask categories. Exploring low-level explanations, we found that the category average for edges (e.g., hands have less detail compared to cars) was the best predictor for the data. This low-level bottleneck could not completely account for the specific category patterns and the hand/tool effects, suggesting there are several levels at which object category-specific limits occur. Given these findings, it is important that low-level bottlenecks for visual awareness are considered when testing higher-level hypotheses.

Category-selective processing in the two visual pathways as a function of stimulus degradation by noise

Understanding the organising principles and functional properties of the primate brain's numerous visually responsive cortical regions is one of the major goals in cognitive neuroscience. Functional magnetic resonance imaging (fMRI) studies have revealed that neural responses in higher-order visual cortex are shaped by object categories, task context, and spatiotemporal regularities. Beyond these properties, visual processing in the ventral pathway has been shown to be tightly linked to perceptual awareness, while the evidence regarding dorsal visual processing and awareness is mixed. Most previous studies targeting the dorsal pathway have used dichotomous "visible versus invisible" experimental designs and interocular suppression paradigms to modulate stimulus visibility. In this fMRI study, we sought to investigate category-selective processing of faces and tools in the ventral and dorsal visual streams as a function of parametric stimulus degradation by noise. Both frequentist and Bayesian statistics provide strong evidence for a linear relationship between category-selective processing and stimulus information in both visual pathways. Overall, multivariate category decoding accuracies turned out to be lower in the dorsal pathway. We discuss our results within the context of the emerging notion of highly interconnected visual streams, and provide an outlook on how future studies may help to further refine our understanding of the functional role of the dorsal pathway in visual object processing.

Invisible Flashes Alter Perceived Sound Location

Information integration across the senses is fundamental for effective interactions with our environment. The extent to which signals from different senses can interact in the absence of awareness is controversial. Combining the spatial ventriloquist illusion and dynamic continuous flash suppression (dCFS), we investigated in a series of two experiments whether visual signals that observers do not consciously perceive can influence spatial perception of sounds. Importantly, dCFS obliterated visual awareness only on a fraction of trials allowing us to compare spatial ventriloquism for physically identical flashes that were judged as visible or invisible. Our results show a stronger ventriloquist effect for visible than invisible flashes. Critically, a robust ventriloquist effect emerged also for invisible flashes even when participants were at chance when locating the flash. Collectively, our findings demonstrate that signals that we are not aware of in one sensory modality can alter spatial perception of signals in another sensory modality.

Towards a unified perspective of object shape and motion processing in human dorsal cortex

Although object-related areas were discovered in human parietal cortex a decade ago, surprisingly little is known about the nature and purpose of these representations, and how they differ from those in the ventral processing stream. In this article, we review evidence for the unique contribution of object areas of dorsal cortex to three-dimensional (3-D) shape representation, the localization of objects in space, and in guiding reaching and grasping actions. We also highlight the role of dorsal cortex in form-motion interaction and spatiotemporal integration, possible functional relationships between 3-D shape and motion processing, and how these processes operate together in the service of supporting goal-directed actions with objects. Fundamental differences between the nature of object representations in the dorsal versus ventral processing streams are considered, with an emphasis on how and why dorsal cortex supports veridical (rather than invariant) representations of objects to guide goal-directed hand actions in dynamic visual environments.

More than Action: The Dorsal Pathway Contributes to the Perception of 3-D Structure

An evolving view in cognitive neuroscience is that the dorsal visual pathway not only plays a key role in visuomotor behavior but that it also contributes functionally to the recognition of objects. To characterize the nature of the object representations derived by the dorsal pathway, we assessed perceptual performance in the context of the continuous flash suppression paradigm, which suppresses object processing in the ventral pathway while sparing computation in the dorsal pathway. In a series of experiments, prime stimuli, which were rendered imperceptible by the continuous flash suppression, still contributed to perceptual decisions related to the subsequent perceptible target stimuli. However, the contribution of the prime to perception was contingent on the prime's structural coherence, in that a perceptual advantage was observed only for targets primed by objects with legitimate 3-D structure. Finally, we obtained additional evidence to demonstrate that the processing of the suppressed objects was contingent on the magnocellular, rather than the parvocellular, system, further linking the processing of the suppressed stimuli to the dorsal pathway. Together, these results provide novel evidence that the dorsal pathway does not only support visuomotor control but, rather, that it also derives the structural description of 3-D objects and contributes to shape perception.

Ventral and Dorsal Pathways Relate Differently to Visual Awareness of Body Postures under Continuous Flash Suppression

Visual perception includes ventral and dorsal stream processes. However, it is still unclear whether the former is predominantly related to conscious and the latter to nonconscious visual perception as argued in the literature. In this study upright and inverted body postures were rendered either visible or invisible under continuous flash suppression (CFS), while brain activity of human participants was measured with functional MRI (fMRI). Activity in the ventral body-sensitive areas was higher during visible conditions. In comparison, activity in the posterior part of the bilateral intraparietal sulcus (IPS) showed a significant interaction of stimulus orientation and visibility. Our results provide evidence that dorsal stream areas are less associated with visual awareness.

Unconscious response priming during continuous flash suppression

Continuous flash suppression (CFS) has become a popular tool for studying unconscious processing, but the level at which unconscious processing of visual stimuli occurs under CFS is not clear. Response priming is a robust and well-understood phenomenon, in which the prime stimulus facilitates overt responses to targets if the prime and target are associated with the same response. We used CFS to study unconscious response priming of shape: arrows with left or right orientation served as primes and targets. The prime was presented near the limen of consciousness and each trial was followed by subjective rating of visibility and a forced-choice response concerning the orientation of the prime in counterbalanced order. In trials without any reported awareness of the presence of the prime, discrimination of the prime's orientation was at chance level. However, priming was elicited in such unconscious trials. Unconscious priming was not influenced by the prime-target onset-asynchrony (SOA)/prime duration, whereas conscious processing, as indicated by the enhanced discriminability of the prime's orientation and conscious priming, increased at the longest SOAs/prime durations. These results show that conscious and unconscious processes can be dissociated with CFS and that CFS-masking does not completely suppress unconscious visual processing of shape.

Unaware Processing of Tools in the Neural System for Object-Directed Action Representation

The hypothesis that the brain constitutively encodes observed manipulable objects for the actions they afford is still debated. Yet, crucial evidence demonstrating that, even in the absence of perceptual awareness, the mere visual appearance of a manipulable object triggers a visuomotor coding in the action representation system including the premotor cortex, has hitherto not been provided. In this fMRI study, we instantiated reliable unaware visual perception conditions by means of continuous flash suppression, and we tested in 24 healthy human participants (13 females) whether the visuomotor object-directed action representation system that includes left-hemispheric premotor, parietal, and posterior temporal cortices is activated even under subliminal perceptual conditions. We found consistent activation in the target visuomotor cortices, both with and without perceptual awareness, specifically for pictures of manipulable versus non-manipulable objects. By means of a multivariate searchlight analysis, we also found that the brain activation patterns in this visuomotor network enabled the decoding of manipulable versus non-manipulable object picture processing, both with and without awareness. These findings demonstrate the intimate neural coupling between visual perception and motor representation that underlies manipulable object processing: manipulable object stimuli specifically engage the visuomotor object-directed action representation system, in a constitutive manner that is independent from perceptual awareness. This perceptuo-motor coupling endows the brain with an efficient mechanism for monitoring and planning reactions to external stimuli in the absence of awareness.SIGNIFICANCE STATEMENT Our brain constantly encodes the visual information that hits the retina, leading to a stimulus-specific activation of sensory and semantic representations, even for objects that we do not consciously perceive. Do these unconscious representations encompass the motor programming of actions that could be accomplished congruently with the objects' functions? In this fMRI study, we instantiated unaware visual perception conditions, by dynamically suppressing the visibility of manipulable object pictures with mondrian masks. Despite escaping conscious perception, manipulable objects activated an object-directed action representation system that includes left-hemispheric premotor, parietal, and posterior temporal cortices. This demonstrates that visuomotor encoding occurs independently of conscious object perception.

Automatic Recruitment of the Motor System by Undetected Graspable Objects: A Motor-evoked Potential Study

Previous behavioral and neuroimaging studies have suggested that the motor properties associated with graspable objects may be automatically accessed when people passively view these objects. We directly tested this by measuring the excitability of the motor pathway when participants viewed pictures of graspable objects that were presented during the attentional blink (AB), when items frequently go undetected. Participants had to identify two briefly presented objects separated by either a short or long SOA. Motor-evoked potentials were measured from the right hand in response to a single TMS pulse delivered over the left primary motor cortex 250 msec after the onset of the second target. Behavioral results showed poorer identification of objects at short SOA compared with long SOA, consistent with an AB, which did not differ between graspable and nongraspable objects. However, motor-evoked potentials measured during the AB were significantly higher for graspable objects than for nongraspable objects, irrespective of whether the object was successfully identified or undetected. This provides direct evidence that the motor system is automatically activated during visual processing of objects that afford a motor action.

White matter connections of the inferior parietal lobule: A study of surgical anatomy

INTRODUCTION

Interest in the function of the inferior parietal lobule (IPL) has resulted in increased understanding of its involvement in visuospatial and cognitive functioning, and its role in semantic networks. A basic understanding of the nuanced white-matter anatomy in this region may be useful in improving outcomes when operating in this region of the brain. We sought to derive the surgical relationship between the IPL and underlying major white-matter bundles by characterizing macroscopic connectivity.

METHODS

Data of 10 healthy adult controls from the Human Connectome Project were used for tractography analysis. All IPL connections were mapped in both hemispheres, and distances were recorded between cortical landmarks and major tracts. Ten postmortem dissections were then performed using a modified Klingler technique to serve as ground truth.

RESULTS

We identified three major types of connections of the IPL. (1) Short association fibers connect the supramarginal and angular gyri, and connect both of these gyri to the superior parietal lobule. (2) Fiber bundles from the IPL connect to the frontal lobe by joining the superior longitudinal fasciculus near the termination of the Sylvian fissure. (3) Fiber bundles from the IPL connect to the temporal lobe by joining the middle longitudinal fasciculus just inferior to the margin of the superior temporal sulcus.

CONCLUSIONS

We present a summary of the relevant anatomy of the IPL as part of a larger effort to understand the anatomic connections of related networks. This study highlights the principle white-matter pathways and highlights key underlying connections.

Differential modulation of visual object processing in dorsal and ventral stream by stimulus visibility

As a functional organization principle in cortical visual information processing, the influential 'two visual systems' hypothesis proposes a division of labor between a dorsal "vision-for-action" and a ventral "vision-for-perception" stream. A core assumption of this model is that the two visual streams are differentially involved in visual awareness: ventral stream processing is closely linked to awareness while dorsal stream processing is not. In this functional magnetic resonance imaging (fMRI) study with human observers, we directly probed the stimulus-related information encoded in fMRI response patterns in both visual streams as a function of stimulus visibility. We parametrically modulated the visibility of face and tool stimuli by varying the contrasts of the masks in a continuous flash suppression (CFS) paradigm. We found that visibility - operationalized by objective and subjective measures - decreased proportionally with increasing log CFS mask contrast. Neuronally, this relationship was closely matched by ventral visual areas, showing a linear decrease of stimulus-related information with increasing mask contrast. Stimulus-related information in dorsal areas also showed a dependency on mask contrast, but the decrease rather followed a step function instead of a linear function. Together, our results suggest that both the ventral and the dorsal visual stream are linked to visual awareness, but neural activity in ventral areas more closely reflects graded differences in awareness compared to dorsal areas.

Weighing the evidence for a dorsal processing bias under continuous flash suppression

With the introduction of continuous flash suppression (CFS) as a method to render stimuli invisible and study unconscious visual processing, a novel hypothesis has gained popularity. It states that processes typically ascribed to the dorsal visual stream can escape CFS and remain functional, while ventral stream processes are suppressed when stimuli are invisible under CFS. This notion of a CFS-specific "dorsal processing bias" has been argued to be in line with core characteristics of the influential dual-stream hypothesis of visual processing which proposes a dissociation between dorsally mediated vision-for-action and ventrally mediated vision-for-perception. Here, we provide an overview of neuroimaging and behavioral studies that either examine this dorsal processing bias or base their conclusions on it. We show that both evidence for preserved ventral processing as well as lack of dorsal processing can be found in studies using CFS. To reconcile the diverging results, differences in the paradigms and their effects are worthy of future research. We conclude that given the current level of information a dorsal processing bias under CFS cannot be universally assumed.

The Decoding Toolbox (TDT): a versatile software package for multivariate analyses of functional imaging data

The multivariate analysis of brain signals has recently sparked a great amount of interest, yet accessible and versatile tools to carry out decoding analyses are scarce. Here we introduce The Decoding Toolbox (TDT) which represents a user-friendly, powerful and flexible package for multivariate analysis of functional brain imaging data. TDT is written in Matlab and equipped with an interface to the widely used brain data analysis package SPM. The toolbox allows running fast whole-brain analyses, region-of-interest analyses and searchlight analyses, using machine learning classifiers, pattern correlation analysis, or representational similarity analysis. It offers automatic creation and visualization of diverse cross-validation schemes, feature scaling, nested parameter selection, a variety of feature selection methods, multiclass capabilities, and pattern reconstruction from classifier weights. While basic users can implement a generic analysis in one line of code, advanced users can extend the toolbox to their needs or exploit the structure to combine it with external high-performance classification toolboxes. The toolbox comes with an example data set which can be used to try out the various analysis methods. Taken together, TDT offers a promising option for researchers who want to employ multivariate analyses of brain activity patterns.