Luminance-polarity distribution across the symmetry axis affects the electrophysiological response to symmetry

Mirror symmetry and aging: The role of stimulus figurality and attention to colour

Symmetry perception studies have generally used two stimulus types: figural and dot patterns. Here, we designed a novel figural stimulus-a wedge pattern-made of centrally aligned pseudorandomly positioned wedges. To study the effect of pattern figurality and colour on symmetry perception, we compared symmetry detection in multicoloured wedge patterns with nonfigural dot patterns in younger and older adults. Symmetry signal was either segregated or nonsegregated by colour, and the symmetry detection task was performed under two conditions: with or without colour-based attention. In the first experiment, we compared performance for colour-symmetric patterns that varied in the number of wedges (24 vs. 36) and number of colours (2 vs. 3) and found that symmetry detection was facilitated by attention to colour when symmetry and noise signals were segregated by colour. In the second experiment, we compared performance for wedge and dot patterns on a sample of younger and older participants. Effects of attention to colour in segregated stimuli were magnified for wedge compared with dot patterns, with older and younger adults showing different effects of attention to colour on performance. Older adults significantly underperformed on uncued wedge patterns compared with dot patterns, but their performance improved greatly through colour cueing, reaching performance levels similar to young participants. Thus, while confirming the age-related decline in symmetry detection, we found that this deficit could be alleviated in figural multicoloured patterns by attending to the colour that carries the symmetry signal.

Lessons from a catalogue of 6674 brain recordings

It is now possible for scientists to publicly catalogue all the data they have ever collected on one phenomenon. For a decade, we have been measuring a brain response to visual symmetry called the sustained posterior negativity (SPN). Here we report how we have made a total of 6674 individual SPNs from 2215 participants publicly available, along with data extraction and visualization tools (https://osf.io/2sncj/). We also report how re-analysis of the SPN catalogue has shed light on aspects of the scientific process, such as statistical power and publication bias, and revealed new scientific insights.

Haemodynamic Signatures of Temporal Integration of Visual Mirror Symmetry

EEG, fMRI and TMS studies have implicated the extra-striate cortex, including the Lateral Occipital Cortex (LOC), in the processing of visual mirror symmetries. Recent research has found that the sustained posterior negativity (SPN), a symmetry specific electrophysiological response identified in the region of the LOC, is generated when temporally displaced asymmetric components are integrated into a symmetric whole. We aim to expand on this finding using dynamic dot-patterns with systematically increased intra-pair temporal delay to map the limits of temporal integration of visual mirror symmetry. To achieve this, we used functional near-infrared spectroscopy (fNIRS) which measures the changes in the haemodynamic response to stimulation using near infrared light. We show that a symmetry specific haemodynamic response can be identified following temporal integration of otherwise meaningless dot-patterns, and the magnitude of this response scales with the duration of temporal delay. These results contribute to our understanding of when and where mirror symmetry is processed in the visual system. Furthermore, we highlight fNIRS as a promising but so far underutilised method of studying the haemodynamics of mid-level visual processes in the brain.

Electrophysiological evidence of the amodal representation of symmetry in extrastriate areas

Extrastriate visual areas are strongly activated by image symmetry. Less is known about symmetry representation at object-level rather than image-level. Here we investigated electrophysiological responses to symmetry, generated by amodal completion of partially-occluded polygon shapes. We used a similar paradigm in four experiments (N = 112). A fully-visible abstract shape (either symmetric or asymmetric) was presented for 250 ms (t0). A large rectangle covered it entirely for 250 ms (t1) and then moved to one side to reveal one half of the shape hidden behind (t2, 1000 ms). Note that at t2 no symmetry could be extracted from retinal image information. In half of the trials the shape was the same as previously presented, in the other trials it was replaced by a novel shape. Participants matched shapes similarity (Exp. 1 and Exp. 2), or their colour (Exp. 3) or the orientation of a triangle superimposed to the shapes (Exp. 4). The fully-visible shapes (t0-t1) elicited automatic symmetry-specific ERP responses in all experiments. Importantly, there was an exposure-dependent symmetry-response to the occluded shapes that were recognised as previously seen (t2). Exp. 2 and Exp.4 confirmed this second ERP (t2) did not reflect a reinforcement of a residual carry-over response from t0. We conclude that the extrastriate symmetry-network can achieve amodal representation of symmetry from occluded objects that have been previously experienced as wholes.

The chronometry of symmetry detection in the lateral occipital (LO) cortex

The lateral occipital cortex (LO) has been shown to code the presence of both vertical and horizontal visual symmetry in dot patterns. However, the specific time window at which LO is causally involved in symmetry encoding has not been investigated. This was assessed using a chronometric transcranial magnetic stimulation (TMS) approach. Participants were presented with a series of dot configurations and instructed to judge whether they were symmetric along the vertical axis or not while receiving a double pulse of TMS over either the right LO (rLO) or the vertex (baseline) at different time windows (ranging from 50 ms to 290 ms from stimulus onset). We found that TMS delivered over the rLO significantly decreased participants' accuracy in discriminating symmetric from non-symmetric patterns when TMS was applied between 130 ms and 250 ms from stimulus onset, suggesting that LO is causally involved in symmetry perception within this time window. These findings confirm and extend prior neuroimaging and ERP evidence by demonstrating not only that LO is causally involved in symmetry encoding but also that its contribution occurs in a relatively large temporal window, at least in tasks requiring fast discrimination of mirror symmetry in briefly (75 ms) presented patterns as in our study.

The temporal integration windows for visual mirror symmetry

Symmetry perception in dot patterns is tolerant to temporal delays of up to 60 ms within and between element pairs. However, it is not known how factors effecting symmetry discrimination in static patterns might affect temporal integration in dynamic patterns. One such feature is luminance polarity. Using dynamic stimuli with increasing temporal delay (SOA) between the onset of the first and second element in a symmetric pair, we investigated how four different luminance-polarity conditions affected the temporal integration of symmetric patterns. All four luminance polarity conditions showed similar upper temporal limits of approximately 60 ms. However psychophysical performance over all delay durations showed significantly higher symmetry thresholds for unmatched-polarity patterns at short delays, but also significantly less sensitivity to increasing temporal delay relative to matched-polarity patterns. These varying temporal windows are consistent with the involvement of a fast, sensitive first-order mechanism for matched-polarity patterns, and a slower, more robust second-order mechanism for unmatched-polarity patterns. Temporal integration windows for unmatched-polarity patterns were not consistent with performance expected from attentional mechanisms alone, and instead supports the involvement of second-order mechanisms that combines information from ON and OFF channels.

Spinning objects and partial occlusion: Smart neural responses to symmetry

In humans, extrastriate visual areas are strongly activated by symmetry. However, perfect symmetry is rare in natural visual images. Recent findings showed that when parts of a symmetric shape are presented at different points in time the process relies on a perceptual memory buffer. Does this temporal integration need a retinotopic reference frame? For the first time we tested integration of parts both in the temporal and spatial domain, using a non-retinotopic frame of reference. In Experiment 1, an irregular polygonal shape (either symmetric or asymmetric) was partly occluded by a rectangle for 500 ms (T1). The rectangle moved to the opposite side to reveal the other half of the shape, whilst occluding the previously visible half (T2). The reference frame for the object was static: the two parts stimulated retinotopically corresponding receptive fields (revealed over time). A symmetry-specific ERP response from ~300 ms after T2 was observed. In Experiment 2 dynamic occlusion was combined with an additional step at T2: the new half-shape and occluder were rotated by 90°. Therefore, there was a moving frame of reference and the retinal correspondence between the two parts was disrupted. A weaker but significant symmetry-specific response was recorded. This result extends previous findings: global symmetry representation can be achieved in extrastriate areas non-retinotopically, through integration in both temporal and spatial domain.

Electrophysiological priming effects demonstrate independence and overlap of visual regularity representations in the extrastriate cortex

An Event Related Potential (ERP) component called the Sustained Posterior Negativity (SPN) is generated by regular visual patterns (e.g. vertical reflectional symmetry, horizontal reflectional symmetry or rotational symmetry). Behavioural studies suggest symmetry becomes increasingly salient when the exemplars update rapidly. In line with this, Experiment 1 (N = 48) found that SPN amplitude increased when three different reflectional symmetry patterns were presented sequentially. We call this effect ‘SPN priming’. We then exploited SPN priming to investigate independence of different symmetry representations. SPN priming did not survive changes in retinal location (Experiment 2, N = 48) or non-orthogonal changes in axis orientation (Experiment 3, N = 48). However, SPN priming transferred between vertical and horizontal axis orientations (Experiment 4, N = 48) and between reflectional and rotational symmetry (Experiment 5, N = 48). SPN priming is interesting in itself, and a useful new method for identifying functional boundaries of the symmetry response. We conclude that visual regularities at different retinal locations are coded independently. However, there is some overlap between different regularities presented at the same retinal location.

The response to symmetry in extrastriate areas and its time course are modulated by selective attention

Neurophysiological studies have shown a strong activation in visual areas in response to symmetry. Electrophysiological (EEG) studies, in particular, have confirmed that amplitude at posterior electrodes is more negative for symmetrical compared to asymmetrical patterns. This response is present even when observers perform tasks that do not require processing of symmetry. In this sense the activation is automatic. In this study we test this automaticity more directly by presenting stimuli that contain both symmetry and asymmetry, as overlapping patterns of dots of different colour (black and white). Observers were asked to respond to symmetry in only one of the two colours. If feature-based attention has no role the response should depend on properties of the image. If attention fully filters only the relevant colour the response should depend on properties of the relevant colour only. Neither of these models fully explained the data. We conclude that selective attention does modulate the neural response to symmetry, however we also found a significant contribution from the irrelevant pattern.

Electrophysiological priming effects confirm that the extrastriate symmetry network is not gated by luminance polarity

It is known that the extrastriate cortex is activated by visual symmetry. This activation generates an ERP component called the Sustained Posterior Negativity (SPN). SPN amplitude increases (i.e., becomes more negative) with repeated presentations. We exploited this SPN priming effect to test whether the extrastriate symmetry response is gated by element luminance polarity. On each trial, participants observed three stimuli (patterns of dots) in rapid succession (500 ms. with 200 ms. gaps). The patterns were either symmetrical or random. The dot elements were either black or white on a grey background. The triplet sequences either showed repeated luminance (black > black > black, or white > white > white) or changing luminance (black > white > black, or white > black > white). As predicted, SPN priming was comparable in repeated and changing luminance conditions. Therefore, symmetry with black elements is not processed independently from symmetry with white elements. Source waveform analysis confirmed that this priming happened within the extrastriate symmetry network. We conclude that the network pools information across luminance polarity channels.

Shape facilitates number: brain potentials and microstates reveal the interplay between shape and numerosity in human vision

Recognition of simple shapes and numerosity estimation for small quantities are often studied independently of each other, but we know that these processes are both rapid and accurate, suggesting that they may be mediated by common neural mechanisms. Here we address this issue by examining how spatial configuration, shape complexity, and luminance polarity of elements affect numerosity estimation. We directly compared the Event Related Potential (ERP) time-course for numerosity estimation under shape and random configurations and found a larger N2 component for shape over lateral-occipital electrodes (250–400 ms), which also increased with higher numbers. We identified a Left Mid Frontal (LMF; 400–650 ms) component over left-lateralised medial frontal sites that specifically separated low and high numbers of elements, irrespective of their spatial configuration. Different luminance-polarities increased N2 amplitude only, suggesting that shape but not numerosity is selective to polarity. Functional microstates confined numerosity to a strict topographic distribution occurring within the LMF time-window, while a microstate responding only to shape-configuration was evidenced earlier, in the N2 time-window. We conclude that shape-coding precedes numerosity estimation, which can be improved when the number of elements and shape vertices are matched. Thus, numerosity estimation around the subitizing range is facilitated by a shape-template matching process.

The extrastriate symmetry response can be elicited by flowers and landscapes as well as abstract shapes

Previous research has investigated the neural response to visual symmetry. It is well established that symmetry activates a network of extrastriate visual regions, including V4 and the Lateral Occipital Complex. This symmetry response generates an event-related potential called the sustained posterior negativity (SPN). However, previous work has used abstract stimuli, typically dot patterns or shapes. We tested the generality of the SPN. We confirmed that the SPN wave was present and of similar amplitude for symmetrical shapes, flowers and landscapes, whether participants were responding either to image symmetry or to image color. We conclude that the extrastriate symmetry response can be generated by any two-dimensional image and is similar in different stimulus domains.

Electrophysiological responses to regularity show specificity to global form: The case of Glass patterns

The holographic weight of evidence model (van der Helm & Leeuwenberg, J Math Psychol, 35, 1991, 151; van der Helm & Leeuwenberg, Psychol Rev, 103, 1996, 429) estimates that the perceptual goodness of moiré structures (Glass patterns), irrespective of their global form, is comparable to that of reflection symmetry. However, both behavioural and neuroscience evidences suggest that certain Glass forms (i.e. circular and radial structures) are perceptually more salient than others (i.e. translation structures) and may recruit different perceptual mechanisms. In this study, we tested whether brain responses for circular, radial and translation Glass patterns are comparable to the response for onefold bilateral reflection symmetry. We recorded an event‐related potential (ERP), called the sustained posterior negativity (SPN), which has been shown to index perceptual goodness of a range of regularities. We found that circular and radial Glass patterns generated a comparable SPN amplitude to onefold reflection symmetry (in line with the prediction of the holographic model), starting approx. 180 ms after stimulus onset. Conversely, the SPN response to translation Glass patterns had a longer latency (approx. 400 ms). These results show that Glass patterns are a special case of visual regularity, and perceptual goodness may not be fully explained by the holographic identities that constitute it. Specialised processing mechanisms might exist in the regularity‐sensitive extrastriate areas, which are tuned to global form configurations.

Symmetric patterns with different luminance polarity (anti-symmetry) generate an automatic response in extrastriate cortex

People can quickly detect bilateral reflection in an image. This is true when elements of the same luminance are matched on either side of the axis (symmetry) and when they have opposite luminance polarity (anti-symmetry). Using electroencephalography, we measured the well-established sustained posterior negativity (SPN) response to symmetry and anti-symmetry. In one task, participants judged the presence or absence of regularity (Regularity Discrimination Task). In another, they judged the presence or absence of rare colored oddball trials (Colored Oddball Task). Previous work has concluded that anti-symmetry is only detected indirectly, through serial visual search of element locations. This selective attention account predicts that the anti-symmetry SPN should be abolished in the Colored Oddball Task because there is no need to search for anti-symmetry. However, this prediction was not confirmed: The symmetry and anti-symmetry SPN waves were not modulated by task. We conclude that at least some forms of anti-symmetry can be extracted from the image automatically, in much the same way as symmetry. This is an important consideration for models of symmetry perception, which must be flexible enough to accommodate opposite luminance polarity, while also accounting for the fact anti-symmetry is often perceptually weaker than symmetry.

Speed tuning properties of mirror symmetry detection mechanisms

The human visual system is often tasked with extracting image properties such as symmetry from rapidly moving objects and scenes. The extent to which motion speed and symmetry processing mechanisms interact is not known. Here we examine speed-tuning properties of symmetry detection mechanisms using dynamic dot-patterns containing varying amounts of position and local motion-direction symmetry. We measured symmetry detection thresholds for stimuli in which symmetric and noise elements either drifted with different relative speeds, were relocated at different relative temporal frequencies or were static. We also measured percentage correct responses under two stimulus conditions: a segregated condition in which symmetric and noise elements drifted at different speeds, and a non-segregated condition in which the symmetric elements drifted at two different speeds in equal proportions, as did the noise elements. We found that performance (i) improved gradually with increasing the difference in relative speed between symmetric and noise elements, but was invariant across relative temporal frequencies/lifetime duration differences between symmetric and noise elements, (ii) was higher in the segregated compared to non-segregated conditions, and in the moving compared to the static conditions. We conclude that symmetry detection mechanisms are broadly tuned to speed, with speed-selective symmetry channels combining their outputs by probability summation.

Temporal dynamics of mirror-symmetry perception

Recent studies have suggested that temporal dynamics rather than symmetrical motion-direction contribute to mirror-symmetry perception. Here we investigate temporal aspects of symmetry perception and implicitly, its temporal flexibility and limitations, by examining how symmetrical pattern elements are combined over time. Stimuli were dynamic dot-patterns consisting of either an on-going alternation of two images (sustained stimulus presentation) or just two images each presented once (transient stimulus presentation) containing different amounts of symmetry about the vertical axis. We varied the duration of the two images under five temporal-arrangement conditions: (a) whole patterns in which a symmetric pattern alternated with a noise pattern; (b) delayed halves—the halves of the symmetric and noise patterns were presented with temporal delay; (c) matched-pairs—two alternating images each containing equal amounts of symmetrical matched-pairs; (d) delayed matched-pairs—the same as arrangement (c), but with matched-pairs presented with delay; and (e) static—both images presented simultaneously as one. We found increased sensitivity in sustained compared to transient stimulus presentations and with synchronous compared to delayed matched-pairs stimuli. For the delayed conditions, sensitivity decreased gradually with longer image durations (>60 ms), prominently for the transient stimulus presentations. We conclude that spatial correlations across-the-symmetry-midline can be integrated over time (∼120 ms), and symmetry mechanisms can tolerate temporal delays between symmetric dot-pairs of up to ∼60 ms.