fMRI reveals that non-local processing in ventral retinotopic cortex underlies perceptual grouping by temporal synchrony

Neural Representations of Observed Interpersonal Synchrony/Asynchrony in the Social Perception Network

The visual perception of individuals is thought to be mediated by a network of regions in the occipitotemporal cortex that supports specialized processing of faces, bodies, and actions. In comparison, we know relatively little about the neural mechanisms that support the perception of multiple individuals and the interactions between them. The present study sought to elucidate the visual processing of social interactions by identifying which regions of the social perception network represent interpersonal synchrony. In an fMRI study with 32 human participants (26 female, 6 male), we used multivoxel pattern analysis to investigate whether activity in face-selective, body-selective, and interaction-sensitive regions across the social perception network supports the decoding of synchronous versus asynchronous head-nodding and head-shaking. Several regions were found to support significant decoding of synchrony/asynchrony, including extrastriate body area (EBA), face-selective and interaction-sensitive mid/posterior right superior temporal sulcus, and occipital face area. We also saw robust cross-classification across actions in the EBA, suggestive of movement-invariant representations of synchrony/asynchrony. Exploratory whole-brain analyses also identified a region of the right fusiform cortex that responded more strongly to synchronous than to asynchronous motion. Critically, perceiving interpersonal synchrony/asynchrony requires the simultaneous extraction and integration of dynamic information from more than one person. Hence, the representation of synchrony/asynchrony cannot be attributed to augmented or additive processing of individual actors. Our findings therefore provide important new evidence that social interactions recruit dedicated visual processing within the social perception network that extends beyond that engaged by the faces and bodies of the constituent individuals.

An fMRI study of visual geometric shapes processing

Cross-modal correspondence has been consistently evidenced between shapes and other sensory attributes. Especially, the curvature of shapes may arouse the affective account, which may contribute to understanding the mechanism of cross-modal integration. Hence, the current study used the functional magnetic resonance imaging (fMRI) technique to examine brain activity’s specificity when people view circular and angular shapes. The circular shapes consisted of a circle and an ellipse, while the angular shapes consisted of a triangle and a star. Results show that the brain areas activated by circular shapes mainly involved the sub-occipital lobe, fusiform gyrus, sub and middle occipital gyrus, and cerebellar VI. The brain areas activated by angular shapes mainly involve the cuneus, middle occipital gyrus, lingual gyrus, and calcarine gyrus. The brain activation patterns of circular shapes did not differ significantly from those of angular shapes. Such a null finding was unexpected when previous cross-modal correspondence of shape curvature was considered. The different brain regions detected by circular and angular shapes and the potential explanations were discussed in the paper.

Skeletal representations of shape in the human visual cortex

Shape perception is crucial for object recognition. However, it remains unknown exactly how shape information is represented and used by the visual system. Here, we tested the hypothesis that the visual system represents object shape via a skeletal structure. Using functional magnetic resonance imaging (fMRI) and representational similarity analysis (RSA), we found that a model of skeletal similarity explained significant unique variance in the response profiles of V3 and LO. Moreover, the skeletal model remained predictive in these regions even when controlling for other models of visual similarity that approximate low-to high-level visual features (i.e., Gabor-jet, GIST, HMAX, and AlexNet), and across different surface forms, a manipulation that altered object contours while preserving the underlying skeleton. Together, these findings shed light on shape processing in human vision, as well as the computational properties of V3 and LO. We discuss how these regions may support two putative roles of shape skeletons: namely, perceptual organization and object recognition.

Neural responses to apparent motion can be predicted by responses to non-moving stimuli

When two objects are presented in alternation at two locations, they are seen as a single object moving from one location to the other. This apparent motion (AM) percept is experienced for objects located at short and also at long distances. However, current models cannot explain how the brain integrates information over large distances to create such long-range AM. This study investigates the neural markers of AM by parcelling out the contribution of spatial and temporal interactions not specific to motion. In two experiments, participants’ EEG was recorded while they viewed two stimuli inducing AM. Different combinations of these stimuli were also shown in a static context to predict an AM neural response where no motion is perceived. We compared the goodness of fit between these different predictions and found consistent results in both experiments. At short-range, the addition of the inhibitory spatial and temporal interactions not specific to motion improved the AM prediction. However, there was no indication that spatial or temporal non-linear interactions were present at long-range. This suggests that short- and long-range AM rely on different neural mechanisms. Importantly, our results also show that at both short- and long-range, responses generated by a moving stimulus could be well predicted from conditions in which no motion is perceived. That is, the EEG response to a moving stimulus is simply a combination of individual responses to non-moving stimuli. This demonstrates a dissociation between the brain response and the subjective percept of motion.

•

EEG responses are inhibited by spatial and temporal stimulus interactions.

•

These interactions are important for motion at short but not at long distances.

•

We find no trace of a specific neural signature of motion perception.

•

Neural responses to motion are well predicted by responses to non-moving stimuli.

Perceptual inference employs intrinsic alpha frequency to resolve perceptual ambiguity

The brain uses its intrinsic dynamics to actively predict observed sensory inputs, especially under perceptual ambiguity. However, it remains unclear how this inference process is neurally implemented in biasing perception of ambiguous inputs towards the predicted percepts. The process of perceptual inference can be well illustrated by the phenomenon of bistable apparent motion in the Ternus display, in which subjective perception spontaneously alternates between element motion (EM) and group motion (GM) percepts depending on whether two consecutively presented frames are grouped over time or not. The frequency of alpha-band oscillations has long been hypothesized to gate the temporal window of perceptual grouping over time. Under this hypothesis, variation in the intrinsic alpha frequency should predict perceptual outcome of the bistable Ternus display. Moreover, we hypothesize that the perception system employs this prior knowledge on intrinsic alpha frequency to resolve perceptual ambiguity, by shifting perceptual inference towards the predicted percepts. Using electroencephalography and intracranial recordings, we showed that both between and within subjects, lower prestimulus alpha frequencies (PAFs) predicted the EM percepts since the two frames fell in the same alpha cycle and got temporally integrated, while higher PAFs predicted the GM percepts since the two frames fell in different alpha cycles. Multivariate decoding analysis between the EM percepts with lower PAFs and the GM percepts with higher PAFs further revealed a representation of the subsequently reported bistable percept in the neural signals shortly before the actual appearance of the second frame. Therefore, perceptual inference, based on variation in intrinsic PAFs, biases poststimulus neural representations by inducing preactivation of the predicted percepts. In addition, enhanced prestimulus blood-oxygen-level-dependent (BOLD) signals and network dynamics in the frontoparietal network, together with reduced prestimulus alpha power, upon perceiving the EM percepts suggest that temporal grouping is an attention-demanding process.

Linking brain to behavior for the visual perception of figures and objects

The dissociation of a figure from its background is an essential feat of visual perception, as it allows us to detect, recognize, and interact with shapes and objects in our environment. In order to understand how the human brain gives rise to the perception of figures, we here review experiments that explore the links between activity in visual cortex and performance of perceptual tasks related to figure perception. We organize our review according to a proposed model that attempts to contextualize figure processing within the more general framework of object processing in the brain. Overall, the current literature provides us with individual linking hypotheses as to cortical regions that are necessary for particular tasks related to figure perception. Attempts to reach a more complete understanding of how the brain instantiates figure and object perception, however, will have to consider the temporal interaction between the many regions involved, the details of which may vary widely across different tasks.

Perceptual organization impairment in schizophrenia and associated brain mechanisms: review of research from 2005 to 2010

Perceptual organization (PO) refers to the processes by which visual information is structured into coherent patterns such as groups, contours, perceptual wholes, and object representations. Impairments in PO have been demonstrated in schizophrenia since the 1960s and have been linked to several illness-related factors including poor premorbid functioning, poor prognosis, and disorganized symptoms. This literature was last reviewed in 2005. Since then, electrophysiological (electroencephalographic, event-related potential, and magnetoencephalographic) and fMRI studies in both patient and nonpatient samples have clarified brain mechanisms involved in the impairment, and additional behavioral studies in patients and nonpatients have clarified the computational mechanisms. In addition, data now exist on the functional consequences of PO impairments, in terms of secondary difficulties in face processing, selective attention, working memory, and social cognition. Preliminary data on drug effects on PO and on changes in response to treatment suggest that anomalies in PO may furnish a biomarker for the integrity of its associated biological mechanisms. All of this recent evidence allows for a clearer picture of the nature of the impairment and how it relates to broader aspects of brain and behavioral functioning in schizophrenia.

Extrastriate cortical activity reflects segmentation of motion into independent sources

Identical local image motion signals can arise from countless object motions in the world. In order to resolve this ambiguity, the visual system must somehow integrate motion signals arising from different locations along an object's contour. Difficulties arise, however, because image contours can derive from multiple objects and from occlusion. Thus, correctly integrating respective objects' motion signals presupposes the specification of what counts as an object. Depending on how this form analysis problem is solved, dramatically different object motion percepts can be constructed from the same set of local image motions. Here we apply fMRI to investigate the mechanisms underlying the segmentation and integration of motion signals that are critical to motion perception in general. We hold the number of image objects constant, but vary whether these objects are perceived to move independently or not. We find that BOLD signal in V3v, V4v, V3A, V3B and MT varies with the number of distinct sources of motion information in the visual scene. These data support the hypothesis that these areas integrate form and motion information in order to segment motion into independent sources (i.e. objects) thereby overcoming ambiguities that arise at the earliest stages of motion processing.

BOLD signal in both ipsilateral and contralateral retinotopic cortex modulates with perceptual fading

Under conditions of visual fixation, perceptual fading occurs when a stationary object, though present in the world and continually casting light upon the retina, vanishes from visual consciousness. The neural correlates of the consciousness of such an object will presumably modulate in activity with the onset and cessation of perceptual fading.

METHOD

In order to localize the neural correlates of perceptual fading, a green disk that had been individually set to be equiluminant with the orange background, was presented in one of the four visual quadrants; Subjects indicated with a button press whether or not the disk was subjectively visible as it perceptually faded in and out.

RESULTS

Blood oxygen-level dependent (BOLD) signal in V1 and ventral retinotopic areas V2v and V3v decreases when the disk subjectively disappears, and increases when it subjectively reappears. This effect occurs in early visual areas both ipsilaterally and contralaterally to the fading figure. That is, it occurs regardless of whether the fading stimulus is presented inside or outside of the corresponding portion of visual field. In addition, we find that the microsaccade rate rises before and after perceptual transitions from not seeing to seeing the disk, and decreases before perceptual transitions from seeing to not seeing the disk. These BOLD signal changes could be driven by a global process that operates across contralateral and ipsilateral visual cortex or by a confounding factor, such as microsaccade rate.

The Role of Temporal Synchrony as a Binding Cue for Visual Persistence in Early Visual Areas: An fMRI Study

We examined the role of temporal synchrony—the simultaneous appearance of visual features—in the perceptual and neural processes underlying object persistence. When a binding cue (such as color or motion) momentarily exposes an object from a background of similar elements, viewers remain aware of the object for several seconds before it perceptually fades into the background, a phenomenon known as object persistence. We showed that persistence from temporal stimulus synchrony, like that arising from motion and color, is associated with activation in the lateral occipital (LO) area, as measured by functional magnetic resonance imaging. We also compared the distribution of occipital cortex activity related to persistence to that of iconic visual memory. Although activation related to iconic memory was largely confined to LO, activation related to object persistence was present across V1 to LO, peaking in V3 and V4, regardless of the binding cue (temporal synchrony, motion, or color). Although persistence from motion cues was not associated with higher activation in the MT+ motion complex, persistence from color cues was associated with increased activation in V4. Taken together, these results demonstrate that although persistence is a form of visual memory, it relies on neural mechanisms different from those of iconic memory. That is, persistence not only activates LO in a cue-independent manner, it also recruits visual areas that may be necessary to maintain binding between object elements.