The causal role of the lateral occipital complex in visual mirror symmetry detection and grouping: an fMRI-guided TMS study

Electrophysiological responses to symmetry presented in the left or in the right visual hemifield

Symmetry is a highly salient feature in the visual world, abundant in both man-made and natural objects. In particular, humans find reflectional symmetry most salient. Electrophysiological work on symmetry perception has identified a difference wave known as the Sustained Posterior Negativity (SPN) originating from extrastriate areas. Amplitude is more negative for symmetrical than random patterns, from around 200 msec after stimulus onset. For the first time, we report responses to patterns presented exclusively in one hemifield. Participants were presented with reflection or random dot patterns to the left and right of fixation (3.2°). They judged whether the patterns were light red or dark red in colour. In Experiment 1, the pair always included one symmetrical and one random pattern. In Experiments 2 and 3 we varied the information presented contralaterally. The SPN was generated separately in each hemisphere in response to what was presented in the contralateral visual hemifield (a lateralised SPN). We conclude that a symmetry-sensitive network of extrastriate areas can be activated independently in each cerebral hemisphere.

An Electrophysiological Index of Perceptual Goodness

A traditional line of work starting with the Gestalt school has shown that patterns vary in strength and salience; a difference in “Perceptual goodness.” The Holographic weight of evidence model quantifies goodness of visual regularities. The key formula states that W = E/N, where E is number of holographic identities in a pattern and N is number of elements. We tested whether W predicts the amplitude of the neural response to regularity in an extrastriate symmetry-sensitive network. We recorded an Event Related Potential (ERP) generated by symmetry called the Sustained Posterior Negativity (SPN). First, we reanalyzed the published work and found that W explained most variance in SPN amplitude. Then in four new studies, we confirmed specific predictions of the holographic model regarding 1) the differential effects of numerosity on reflection and repetition, 2) the similarity between reflection and Glass patterns, 3) multiple symmetries, and 4) symmetry and anti-symmetry. In all cases, the holographic approach predicted SPN amplitude remarkably well; particularly in an early window around 300–400 ms post stimulus onset. Although the holographic model was not conceived as a model of neural processing, it captures many details of the brain response to symmetry.

Different Cortical Mechanisms for Spatial vs. Feature-Based Attentional Selection in Visual Working Memory

The limited capacity of visual working memory (VWM) necessitates attentional mechanisms that selectively update and maintain only the most task-relevant content. Psychophysical experiments have shown that the retroactive selection of memory content can be based on visual properties such as location or shape, but the neural basis for such differential selection is unknown. For example, it is not known if there are different cortical modules specialized for spatial vs. feature-based mnemonic attention, in the same way that has been demonstrated for attention to perceptual input. Here, we used transcranial magnetic stimulation (TMS) to identify areas in human parietal and occipital cortex involved in the selection of objects from memory based on cues to their location (spatial information) or their shape (featural information). We found that TMS over the supramarginal gyrus (SMG) selectively facilitated spatial selection, whereas TMS over the lateral occipital cortex (LO) selectively enhanced feature-based selection for remembered objects in the contralateral visual field. Thus, different cortical regions are responsible for spatial vs. feature-based selection of working memory representations. Since the same regions are involved in terms of attention to external events, these new findings indicate overlapping mechanisms for attentional control over perceptual input and mnemonic representations.

Object attributes combine additively in visual search

We perceive objects as containing a variety of attributes: local features, relations between features, internal details, and global properties. But we know little about how they combine. Here, we report a remarkably simple additive rule that governs how these diverse object attributes combine in vision. The perceived dissimilarity between two objects was accurately explained as a sum of (a) spatially tuned local contour-matching processes modulated by part decomposition; (b) differences in internal details, such as texture; (c) differences in emergent attributes, such as symmetry; and (d) differences in global properties, such as orientation or overall configuration of parts. Our results elucidate an enduring question in object vision by showing that the whole object is not a sum of its parts but a sum of its many attributes.

Perceptual Learning at a Conceptual Level

Humans can learn to abstract and conceptualize the shared visual features defining an object category in object learning. Therefore, learning is generalizable to transformations of familiar objects and even to new objects that differ in other physical properties. In contrast, visual perceptual learning (VPL), improvement in discriminating fine differences of a basic visual feature through training, is commonly regarded as specific and low-level learning because the improvement often disappears when the trained stimulus is simply relocated or rotated in the visual field. Such location and orientation specificity is taken as evidence for neural plasticity in primary visual cortex (V1) or improved readout of V1 signals. However, new training methods have shown complete VPL transfer across stimulus locations and orientations, suggesting the involvement of high-level cognitive processes. Here we report that VPL bears similar properties of object learning. Specifically, we found that orientation discrimination learning is completely transferrable between luminance gratings initially encoded in V1 and bilaterally symmetric dot patterns encoded in higher visual cortex. Similarly, motion direction discrimination learning is transferable between first- and second-order motion signals. These results suggest that VPL can take place at a conceptual level and generalize to stimuli with different physical properties. Our findings thus reconcile perceptual and object learning into a unified framework.

SIGNIFICANCE STATEMENT

Training in object recognition can produce a learning effect that is applicable to new viewing conditions or even to new objects with different physical properties. However, perceptual learning has long been regarded as a low-level form of learning because of its specificity to the trained stimulus conditions. Here we demonstrate with new training tactics that visual perceptual learning is completely transferrable between distinct physical stimuli. This finding indicates that perceptual learning also operates at a conceptual level in a stimulus-invariant manner.

Representation of Maximally Regular Textures in Human Visual Cortex

Naturalistic textures with an intermediate degree of statistical regularity can capture key structural features of natural images (Freeman and Simoncelli, 2011). V2 and later visual areas are sensitive to these features, while primary visual cortex is not (Freeman et al., 2013). Here we expand on this work by investigating a class of textures that have maximal formal regularity, the 17 crystallographic wallpaper groups (Fedorov, 1891). We used texture stimuli from four of the groups that differ in the maximum order of rotation symmetry they contain, and measured neural responses in human participants using functional MRI and high-density EEG. We found that cortical area V3 has a parametric representation of the rotation symmetries in the textures that is not present in either V1 or V2, the first discovery of a stimulus property that differentiates processing in V3 from that of lower-level areas. Parametric responses were also seen in higher-order ventral stream areas V4, VO1, and lateral occipital complex (LOC), but not in dorsal stream areas. The parametric response pattern was replicated in the EEG data, and source localization indicated that responses in V3 and V4 lead responses in LOC, which is consistent with a feedforward mechanism. Finally, we presented our stimuli to four well developed feedforward models and found that none of them were able to account for our results. Our results highlight structural regularity as an important stimulus dimension for distinguishing the early stages of visual processing, and suggest a previously unrecognized role for V3 in the visual form-processing hierarchy. Significance statement: Hierarchical processing is a fundamental organizing principle in visual neuroscience, with each successive processing stage being sensitive to increasingly complex stimulus properties. Here, we probe the encoding hierarchy in human visual cortex using a class of visual textures--wallpaper patterns--that are maximally regular. Through a combination of fMRI and EEG source imaging, we find specific responses to texture regularity that depend parametrically on the maximum order of rotation symmetry in the textures. These parametric responses are seen in several areas of the ventral visual processing stream, as well as in area V3, but not in V1 or V2. This is the first demonstration of a stimulus property that differentiates processing in V3 from that of lower-level visual areas.

Investigating the Causal Role of rOFA in Holistic Detection of Mooney Faces and Objects: An fMRI-guided TMS Study

BACKGROUND

The right occipital face area (rOFA) is known to be involved in face discrimination based on local featural information. Whether this region is also involved in global, holistic stimulus processing is not known.

OBJECTIVE

We used fMRI-guided transcranial magnetic stimulation (TMS) to investigate whether rOFA is causally implicated in stimulus detection based on holistic processing, by the use of Mooney stimuli.

METHODS

Two studies were carried out: In Experiment 1, participants performed a detection task involving Mooney faces and Mooney objects; Mooney stimuli lack distinguishable local features and can be detected solely via holistic processing (i.e. at a global level) with top-down guidance from previously stored representations. Experiment 2 required participants to detect shapes which are recognized via bottom-up integration of local (collinear) Gabor elements and was performed to control for specificity of rOFA's implication in holistic detection.

RESULTS

In Experiment 1, TMS over rOFA and rLO impaired detection of all stimulus categories, with no category-specific effect. In Experiment 2, shape detection was impaired when TMS was applied over rLO but not over rOFA.

CONCLUSIONS

Our results demonstrate that rOFA is causally implicated in the type of top-down holistic detection required by Mooney stimuli and that such role is not face-selective. In contrast, rOFA does not appear to play a causal role in detection of shapes based on bottom-up integration of local components, demonstrating that its involvement in processing non-face stimuli is specific for holistic processing.

Lateral occipitotemporal cortex (LOTC) activity is greatest while viewing dance compared to visualization and movement: learning and expertise effects

The lateral occipitotemporal cortex (LOTC) is comprised of subregions selectively activated by images of human bodies (extrastriate body area, EBA), objects (lateral occipital complex, LO), and motion (MT+). However, their role in motor imagery and movement processing is unclear, as are the influences of learning and expertise on its recruitment. The purpose of our study was to examine putative changes in LOTC activation during action processing following motor learning of novel choreography in professional ballet dancers. Subjects were scanned with functional magnetic resonance imaging up to four times over 34 weeks and performed four tasks: viewing and visualizing a newly learned ballet dance, visualizing a dance that was not being learned, and movement of the foot. EBA, LO, and MT+ were activated most while viewing dance compared to visualization and movement. Significant increases in activation were observed over time in left LO only during visualization of the unlearned dance, and all subregions were activated bilaterally during the viewing task after 34 weeks of performance, suggesting learning-induced plasticity. Finally, we provide novel evidence for modulation of EBA with dance experience during the motor task, with significant activation elicited in a comparison group of novice dancers only. These results provide a composite of LOTC activation during action processing of newly learned ballet choreography and movement of the foot. The role of these areas is confirmed as primarily subserving observation of complex sequences of whole-body movement, with new evidence for modification by experience and over the course of real world ballet learning.

Scaling of the extrastriate neural response to symmetry

Neuroimaging work has shown that visual symmetry activates extrastriate brain areas, most consistently the lateral occipital complex (LOC). LOC activation increases with proportion of symmetrical dots (pSymm) in a degraded display. In the current work, we recorded a posterior ERP called the sustained posterior negativity (SPN), which is relatively negative for symmetrical compared to random patterns. We predicted that SPN would also scale with pSymm, because it is probably generated by the LOC. Twenty-four participants viewed dot patterns with different levels of regularity: 0% regularity (full random configuration) 20%, 40%, 60%, 80%, and 100% (full reflection symmetry). Participants judged if the pattern contained "some regularity" or "no regularity". As expected, the SPN amplitude increased with pSymm, while the latency and duration was the same in all conditions. The SPN was independent of the participant's decision, and it was present on some trials where people reported 'no-regularity'. We conclude that the SPN is generated at an intermediate stage of visual processing, probably in the LOC, where perceptual goodness is represented. This comes after initial visual analysis, but before subsequent decision stages, which apply a threshold to the analog LOC response.

The causal role of the occipital face area (OFA) and lateral occipital (LO) cortex in symmetry perception

Symmetry is an important cue in face and object perception. Here we used fMRI-guided transcranial magnetic stimulation (TMS) to shed light on the role of the occipital face area (OFA), a key region in face processing, and the lateral occipital (LO) cortex, a key area in object processing, in symmetry detection. In the first experiment, we applied TMS over the rightOFA, its left homolog (leftOFA), rightLO, and vertex (baseline) while participants were discriminating between symmetric and asymmetric dot patterns. Stimulation of rightOFA and rightLO impaired performance, causally implicating these two regions in detection of symmetry in low-level dot configurations. TMS over rightLO but not rightOFA also significantly impaired detection of nonsymmetric shapes defined by collinear Gabor patches, demonstrating that rightOFA responds to symmetry but not to all cues mediating figure-ground segregation. The second experiment showed a causal role for rightOFA but not rightLO in facial symmetry detection. Overall, our results demonstrate that both the rightOFA and rightLO are sensitive to symmetry in dot patterns, whereas only rightOFA is causally involved in facial symmetry detection.

The role of the lateral occipital cortex in aesthetic appreciation of representational and abstract paintings: a TMS study

Neuroimaging studies of aesthetic appreciation have shown that activity in the lateral occipital area (LO)-a key node in the object recognition pathway-is modulated by the extent to which visual artworks are liked or found beautiful. However, the available evidence is only correlational. Here we used transcranial magnetic stimulation (TMS) to investigate the putative causal role of LO in the aesthetic appreciation of paintings. In our first experiment, we found that interfering with LO activity during aesthetic appreciation selectively reduced evaluation of representational paintings, leaving appreciation of abstract paintings unaffected. A second experiment demonstrated that, although the perceived clearness of the images overall positively correlated with liking, the detrimental effect of LO TMS on aesthetic appreciation does not owe to TMS reducing perceived clearness. Taken together, our findings suggest that object-recognition mechanisms mediated by LO play a causal role in aesthetic appreciation of representational art.

Right-lateralized alpha desynchronization during regularity discrimination: hemispheric specialization or directed spatial attention?

When actively classifying abstract patterns according to their regularity, alpha desynchronization (ERD) becomes right lateralized over posterior brain areas. This could reflect temporary enhancement of contralateral visual inputs and specifically a shift of attention to the left, or right hemisphere specialization for regularity discrimination. This study tested these competing hypotheses. Twenty-four participants discriminated between dot patterns containing a reflection or a translation. The direction of the transformation, which matched one half onto the other half, was either vertical or horizontal. The strategy of shifting attention to one side of the patterns would not produce lateralized ERD in the horizontal condition. However, right-lateralized ERD was found in all conditions, regardless of orientation. We conclude that right hemisphere networks that incorporate the early posterior regions are specialized for regularity discrimination.

Neural correlates associated with superior tactile symmetry perception in the early blind

Symmetry is an organizational principle that is ubiquitous throughout the visual world. However, this property can also be detected through non-visual modalities such as touch. The role of prior visual experience on detecting tactile patterns containing symmetry remains unclear. We compared the behavioral performance of early blind and sighted (blindfolded) controls on a tactile symmetry detection task. The tactile patterns used were similar in design and complexity as in previous visual perceptual studies. The neural correlates associated with this behavioral task were identified with functional magnetic resonance imaging (fMRI). In line with growing evidence demonstrating enhanced tactile processing abilities in the blind, we found that early blind individuals showed significantly superior performance in detecting tactile symmetric patterns compared to sighted controls. Furthermore, comparing patterns of activation between these two groups identified common areas of activation (e.g. superior parietal cortex) but key differences also emerged. In particular, tactile symmetry detection in the early blind was also associated with activation that included peri-calcarine cortex, lateral occipital (LO), and middle temporal (MT) cortex, as well as inferior temporal and fusiform cortex. These results contribute to the growing evidence supporting superior behavioral abilities in the blind, and the neural correlates associated with crossmodal neuroplasticity following visual deprivation.