The neural basis of mirror symmetry detection: a review

Event related potentials (ERP) reveal a robust response to visual symmetry in unattended visual regions

Visual symmetry at fixation generates a bilateral Event Related Potential (ERP) called the Sustained Posterior Negativity (SPN). Symmetry presented in the left visual hemifield generates a contralateral SPN over the right hemisphere and vice versa. The current study examined whether the contralateral SPN is modulated by the focus of spatial attention. On each trial there were two dot patterns, one to the left of fixation, and one to the right of fixation. A central arrow cue pointed to one of the patterns and participants discriminated its regularity (symmetry or random). We compared contralateral SPN amplitude generated by symmetry at attended and unattended spatial locations. While the response to attended symmetry was slightly enhanced, the response to unattended symmetry was still substantial. Although visual symmetry detection is a computational challenge, we conclude that the brain processes visual symmetry in unattended parts of the visual field.

The quest for psychological symmetry through figural goodness, randomness, and complexity: A selective review

Of the four interrelated concepts in the title, only symmetry has an exact mathematical definition. In mathematical development, symmetry is a graded variable-in marked contrast with the popular binary conception of symmetry in and out of the laboratory (i.e. an object is either symmetrical or nonsymmetrical). Because the notion does not have a direct graded perceptual counterpart (experimental participants are not asked about the amount of symmetry of an object), students of symmetry have taken various detours to characterize the perceptual effects of symmetry. Current approaches have been informed by information theory, mathematical group theory, randomness research, and complexity. Apart from reviewing the development of the main approaches, for the first time we calculated associations between figural goodness as measured in the Garner tradition and measures of algorithmic complexity and randomness developed in recent research. We offer novel ideas and analyses by way of integrating the various approaches.

Lessons from a catalogue of 6674 brain recordings

It is now possible for scientists to publicly catalogue all the data they have ever collected on one phenomenon. For a decade, we have been measuring a brain response to visual symmetry called the sustained posterior negativity (SPN). Here we report how we have made a total of 6674 individual SPNs from 2215 participants publicly available, along with data extraction and visualization tools (https://osf.io/2sncj/). We also report how re-analysis of the SPN catalogue has shed light on aspects of the scientific process, such as statistical power and publication bias, and revealed new scientific insights.

Electrophysiological evidence of the amodal representation of symmetry in extrastriate areas

Extrastriate visual areas are strongly activated by image symmetry. Less is known about symmetry representation at object-level rather than image-level. Here we investigated electrophysiological responses to symmetry, generated by amodal completion of partially-occluded polygon shapes. We used a similar paradigm in four experiments (N = 112). A fully-visible abstract shape (either symmetric or asymmetric) was presented for 250 ms (t0). A large rectangle covered it entirely for 250 ms (t1) and then moved to one side to reveal one half of the shape hidden behind (t2, 1000 ms). Note that at t2 no symmetry could be extracted from retinal image information. In half of the trials the shape was the same as previously presented, in the other trials it was replaced by a novel shape. Participants matched shapes similarity (Exp. 1 and Exp. 2), or their colour (Exp. 3) or the orientation of a triangle superimposed to the shapes (Exp. 4). The fully-visible shapes (t0-t1) elicited automatic symmetry-specific ERP responses in all experiments. Importantly, there was an exposure-dependent symmetry-response to the occluded shapes that were recognised as previously seen (t2). Exp. 2 and Exp.4 confirmed this second ERP (t2) did not reflect a reinforcement of a residual carry-over response from t0. We conclude that the extrastriate symmetry-network can achieve amodal representation of symmetry from occluded objects that have been previously experienced as wholes.

The chronometry of symmetry detection in the lateral occipital (LO) cortex

The lateral occipital cortex (LO) has been shown to code the presence of both vertical and horizontal visual symmetry in dot patterns. However, the specific time window at which LO is causally involved in symmetry encoding has not been investigated. This was assessed using a chronometric transcranial magnetic stimulation (TMS) approach. Participants were presented with a series of dot configurations and instructed to judge whether they were symmetric along the vertical axis or not while receiving a double pulse of TMS over either the right LO (rLO) or the vertex (baseline) at different time windows (ranging from 50 ms to 290 ms from stimulus onset). We found that TMS delivered over the rLO significantly decreased participants' accuracy in discriminating symmetric from non-symmetric patterns when TMS was applied between 130 ms and 250 ms from stimulus onset, suggesting that LO is causally involved in symmetry perception within this time window. These findings confirm and extend prior neuroimaging and ERP evidence by demonstrating not only that LO is causally involved in symmetry encoding but also that its contribution occurs in a relatively large temporal window, at least in tasks requiring fast discrimination of mirror symmetry in briefly (75 ms) presented patterns as in our study.

Neural responses to reflection symmetry for shapes defined by binocular disparity, and for shapes perceived as regions of background

Human perception of symmetry is associated with activation in an extended network of extrastriate visual areas. This activation generates an ERP called the Sustained Posterior Negativity (SPN). In most studies so far, the stimuli have been defined by luminance. We tested whether the SPN is present when stimuli are defined by stereoscopic disparity using random dot stereograms (RDS). In Experiment 1, we compared the SPN signal for contours specified by binocular disparity and contours specified by monocular cues. The SPN was equivalent, suggesting that the type of contour does not alter the SPN signal. In Experiment 2 we exploited the unique property of RDS to provide unambiguous figure-ground arrangements. Psychophysical work has shown that symmetry is more easily detected when it is a property of a single object (i.e., within a figure), compared to a property of a gap between two objects (i.e., the ground). Therefore, the target regions in this experiment could either be foreground or background. The SPN onset was delayed when the symmetry was in a ground region. This may be because object formation interferes with the processing of shape information in the ground region.

The extrastriate symmetry response is robust to variation in visual memory load

An Event Related Potential response to visual symmetry, known as the Sustained Posterior Negativity (SPN), is generated whether symmetry is task relevant or not, and whether symmetry is attended or not. However, no study has yet examined interference from concurrent memory tasks. To answer this fundamental question, we investigated whether the SPN is robust to variation in Visual Working Memory (VWM) load. In Experiment 1 (N = 24), each trial involved a sample display, a probe and a test display. Sample and test displays contained either four colors or four black shapes, and the probe was either a symmetrical or random pattern. We compared a memory task and a passive viewing task. In the memory task, participants held color or shape information in VWM when the probe was presented. In the passive viewing task, there were no memory demands. Contrary to our predictions, there was no evidence that VWM interfered with the symmetry response. Instead, there was a general SPN enhancement during both color and shape memory tasks compared to passive viewing. In Experiment 2 (N = 24), we used symmetrical patterns themselves as sample and test to maximize interference. Again, the SPN was enhanced in the memory task compared to passive viewing. We conclude that the visual symmetry response is not impaired by concurrent VWM tasks, even when these tasks involve remembering symmetry itself. It seems that the SPN is not only attention-proof, but also memory-proof. This adds to evidence that symmetry perception is robust and automatic.

Spinning objects and partial occlusion: Smart neural responses to symmetry

In humans, extrastriate visual areas are strongly activated by symmetry. However, perfect symmetry is rare in natural visual images. Recent findings showed that when parts of a symmetric shape are presented at different points in time the process relies on a perceptual memory buffer. Does this temporal integration need a retinotopic reference frame? For the first time we tested integration of parts both in the temporal and spatial domain, using a non-retinotopic frame of reference. In Experiment 1, an irregular polygonal shape (either symmetric or asymmetric) was partly occluded by a rectangle for 500 ms (T1). The rectangle moved to the opposite side to reveal the other half of the shape, whilst occluding the previously visible half (T2). The reference frame for the object was static: the two parts stimulated retinotopically corresponding receptive fields (revealed over time). A symmetry-specific ERP response from ~300 ms after T2 was observed. In Experiment 2 dynamic occlusion was combined with an additional step at T2: the new half-shape and occluder were rotated by 90°. Therefore, there was a moving frame of reference and the retinal correspondence between the two parts was disrupted. A weaker but significant symmetry-specific response was recorded. This result extends previous findings: global symmetry representation can be achieved in extrastriate areas non-retinotopically, through integration in both temporal and spatial domain.

The response to symmetry in extrastriate areas and its time course are modulated by selective attention

Neurophysiological studies have shown a strong activation in visual areas in response to symmetry. Electrophysiological (EEG) studies, in particular, have confirmed that amplitude at posterior electrodes is more negative for symmetrical compared to asymmetrical patterns. This response is present even when observers perform tasks that do not require processing of symmetry. In this sense the activation is automatic. In this study we test this automaticity more directly by presenting stimuli that contain both symmetry and asymmetry, as overlapping patterns of dots of different colour (black and white). Observers were asked to respond to symmetry in only one of the two colours. If feature-based attention has no role the response should depend on properties of the image. If attention fully filters only the relevant colour the response should depend on properties of the relevant colour only. Neither of these models fully explained the data. We conclude that selective attention does modulate the neural response to symmetry, however we also found a significant contribution from the irrelevant pattern.

The Effect of Blindness on Spatial Asymmetries

The human cerebral cortex is asymmetrically organized with hemispheric lateralization pervading nearly all neural systems of the brain. Whether the lack of normal visual development affects hemispheric specialization subserving the deployment of visuospatial attention asymmetries is controversial. In principle, indeed, the lack of early visual experience may affect the lateralization of spatial functions, and the blind may rely on a different sensory input compared to the sighted. In this review article, we thus present a current state-of-the-art synthesis of empirical evidence concerning the effects of visual deprivation on the lateralization of various spatial processes (i.e., including line bisection, mirror symmetry, and localization tasks). Overall, the evidence reviewed indicates that spatial processes are supported by a right hemispheric network in the blind, hence, analogously to the sighted. Such a right-hemisphere dominance, however, seems more accentuated in the blind as compared to the sighted as indexed by the greater leftward bias shown in different spatial tasks. This is possibly the result of the more pronounced involvement of the right parietal cortex during spatial tasks in blind individuals compared to the sighted, as well as of the additional recruitment of the right occipital cortex, which would reflect the cross-modal plastic phenomena that largely characterize the blind brain.

Electrophysiological priming effects confirm that the extrastriate symmetry network is not gated by luminance polarity

It is known that the extrastriate cortex is activated by visual symmetry. This activation generates an ERP component called the Sustained Posterior Negativity (SPN). SPN amplitude increases (i.e., becomes more negative) with repeated presentations. We exploited this SPN priming effect to test whether the extrastriate symmetry response is gated by element luminance polarity. On each trial, participants observed three stimuli (patterns of dots) in rapid succession (500 ms. with 200 ms. gaps). The patterns were either symmetrical or random. The dot elements were either black or white on a grey background. The triplet sequences either showed repeated luminance (black > black > black, or white > white > white) or changing luminance (black > white > black, or white > black > white). As predicted, SPN priming was comparable in repeated and changing luminance conditions. Therefore, symmetry with black elements is not processed independently from symmetry with white elements. Source waveform analysis confirmed that this priming happened within the extrastriate symmetry network. We conclude that the network pools information across luminance polarity channels.

The extrastriate symmetry response can be elicited by flowers and landscapes as well as abstract shapes

Previous research has investigated the neural response to visual symmetry. It is well established that symmetry activates a network of extrastriate visual regions, including V4 and the Lateral Occipital Complex. This symmetry response generates an event-related potential called the sustained posterior negativity (SPN). However, previous work has used abstract stimuli, typically dot patterns or shapes. We tested the generality of the SPN. We confirmed that the SPN wave was present and of similar amplitude for symmetrical shapes, flowers and landscapes, whether participants were responding either to image symmetry or to image color. We conclude that the extrastriate symmetry response can be generated by any two-dimensional image and is similar in different stimulus domains.

Symmetric patterns with different luminance polarity (anti-symmetry) generate an automatic response in extrastriate cortex

People can quickly detect bilateral reflection in an image. This is true when elements of the same luminance are matched on either side of the axis (symmetry) and when they have opposite luminance polarity (anti-symmetry). Using electroencephalography, we measured the well-established sustained posterior negativity (SPN) response to symmetry and anti-symmetry. In one task, participants judged the presence or absence of regularity (Regularity Discrimination Task). In another, they judged the presence or absence of rare colored oddball trials (Colored Oddball Task). Previous work has concluded that anti-symmetry is only detected indirectly, through serial visual search of element locations. This selective attention account predicts that the anti-symmetry SPN should be abolished in the Colored Oddball Task because there is no need to search for anti-symmetry. However, this prediction was not confirmed: The symmetry and anti-symmetry SPN waves were not modulated by task. We conclude that at least some forms of anti-symmetry can be extracted from the image automatically, in much the same way as symmetry. This is an important consideration for models of symmetry perception, which must be flexible enough to accommodate opposite luminance polarity, while also accounting for the fact anti-symmetry is often perceptually weaker than symmetry.

Sustained response to symmetry in extrastriate areas after stimulus offset: An EEG study

Electrophysiological (EEG) studies of human perception have found that amplitude at posterior electrodes is more negative for symmetrical patterns compared to asymmetrical patterns. This negativity lasts for hundreds of milliseconds and it has been called sustained posterior negativity (SPN). Symmetry activates a network of visual areas, including the lateral occipital complex (LOC). The SPN is a response to presence of symmetry in the image. Given the sustained nature of this activation, in this study we tested the persistence of the SPN after stimulus offset. Two shapes were presented (for 0.5 s each) with a 1 s blank interval in between. We observed a sustained response after stimulus offset, irrespective of whether the task required processing of shape information. This supports the idea that the response to symmetry is generated by information in the image, independently of task, and that it is sustained over approximately one second post stimulus onset.

Measuring Integration Processes in Visual Symmetry with Frequency-Tagged EEG

Symmetry is a highly salient feature of the natural world which requires integration of visual features over space. The aim of the current work is to isolate dynamic neural correlates of symmetry-specific integration processes. We measured steady-state visual evoked potentials (SSVEP) as participants viewed symmetric patterns comprised of distinct spatial regions presented at two different frequencies (f₁ and f₂). We measured intermodulation components, shown to reflect non-linear processing at the neural level, indicating integration of spatially separated parts of the pattern. We generated a wallpaper pattern containing two reflection symmetry axes by tiling the plane with a two-fold reflection symmetric unit-pattern and split each unit-pattern diagonally into separate parts which could be presented at different frequencies. We compared SSVEPs measured for wallpapers and control patterns for which both images were equal in terms of translation and rotation symmetry but reflection symmetry could only emerge for the wallpaper pattern through integration of the image-pairs. We found that low-frequency intermodulation components differed between the wallpaper and control stimuli, indicating the presence of integration mechanisms specific to reflection symmetry. These results showed that spatial integration specific to symmetry perception can be isolated through a combination of stimulus design and the frequency tagging approach.

The neural basis of visual symmetry and its role in mid- and high-level visual processing

Symmetry is an important and prominent feature of the visual world. It has been studied as a basis for image segmentation and perceptual organization, but it also plays a role in higher level processes, such as face and object perception. Over the past decade, there has been progress in the study of the neural mechanisms of symmetry perception in humans and other animals. There is extended activity in the ventral stream, including the lateral occipital complex (LOC) and VO1; this activity starts in V3 and it occurs independently of the task (automatic response). Additionally, when the task requires processing of symmetry, the activation may emerge for objects that are symmetrical, even though they do not project a symmetrical image. There is also some evidence of hemispheric lateralization, especially for the LOC. We review the studies on the cortical basis of visual symmetry processing and its links to encoding of other aspects of the visual world, such as faces and objects.

Blind readers break mirror invariance as sighted do

Mirror invariance refers to a predisposition of humans, including infants and animals, which urge them to consider mirrored images as corresponding to the same object. Yet in order to learn to read a written system that incorporates mirrored letters (e.g., <b> vs. <d> in the Latin alphabet), humans learn to break this perceptual bias. Here we examined the role visual experience and input modality play in the emergence of this bias. To this end, we tested congenital blind (CB) participants in two same-different tactile comparison tasks including pairs of mirrored and non-mirrored Braille letters as well as embossed unfamiliar geometric shapes and Latin letters, and compared their results to those of age-matched sighted participants involved in similar but visually-presented tasks. Sighted participants showed a classical pattern of results for their material of expertise, Latin letters. CB's results signed for their expertise with the Braille script compared to the other two materials that they processed according to an internal frame of reference. They also evidenced that they automatically break mirror invariance for different materials explored through the tactile modality, including Braille letters. Altogether, these results demonstrate that learning to read Braille through the tactile modality allows breaking mirror invariance in a comparable way to what is observed in sighted individuals for the mirrored letters of the Latin alphabet.