1
|
Aizenman AM, Ehinger KA, Wick FA, Micheletto R, Park J, Jurgensen L, Wolfe JM. Hiding the Rabbit: Using a genetic algorithm to investigate shape guidance in visual search. J Vis 2022; 22:7. [PMID: 35024760 PMCID: PMC8762685 DOI: 10.1167/jov.22.1.7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
During visual search, attention is guided by specific features, including shape. Our understanding of shape guidance is limited to specific attributes (closures and line terminations) that do not fully explain the richness of preattentive shape processing. We used a novel genetic algorithm method to explore shape space and to stimulate hypotheses about shape guidance. Initially, observers searched for targets among 12 random distractors defined, in radial frequency space, by the amplitude and phase of 10 radial frequencies. Reaction time (RT) was the measure of “fitness.” To evolve toward an easier search task, distractors with faster RTs survived to the next generation, “mated,” and produced offspring (new distractors for the next generation of search). To evolve a harder search, surviving distractors were those yielding longer RTs. Within eight generations of evolution, the method succeeds in producing visual searches either harder or easier than the starting search. In radial frequency space, easy distractors evolve amplitude × frequency spectra that are dissimilar to the target, whereas hard distractors evolve spectra that are more similar to the target. This method also works with naturally shaped targets (e.g., rabbit silhouettes). Interestingly, the most inefficient distractors featured a combination of a body and ear distractors that did not resemble the rabbit (visually or in spectrum). Adding extra ears to these distractors did not impact the search spectrally and instead made it easier to confirm a rabbit, once it was found. In general, these experiments show that shapes that are clearly distinct when attended are similar to each other preattentively.
Collapse
Affiliation(s)
| | | | - Farahnaz A Wick
- Harvard Medical School, Cambridge, MA, USA.,Brigham and Women's Hospital, Cambridge, MA, USA.,
| | | | | | | | - Jeremy M Wolfe
- Harvard Medical School, Cambridge, MA, USA.,Brigham and Women's Hospital, Cambridge, MA, USA.,
| |
Collapse
|
2
|
Żołubak A, Garcia-Suarez L. Shape discrimination in peripheral vision: Addressing pragmatic limitations of M-scaling radial frequency patterns. Vision Res 2021; 188:115-125. [PMID: 34315091 DOI: 10.1016/j.visres.2021.06.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2020] [Revised: 06/24/2021] [Accepted: 06/27/2021] [Indexed: 10/20/2022]
Abstract
Peripheral worsening in shape discrimination (SD) can be compensated by size-scaling of peripheral stimuli. However, such scaling results in production of large stimuli that occupy a vast range of eccentricities. We used six proportionally decreasing spatial scales to address this pragmatic limitation and to explore how shape discrimination varies with radius in the nasal visual field. Five participants with normal vision discriminated circles and radial frequency (RF) patterns presented nasally to the fixation point at 5°, 10°, 15° and 20°. Stimuli were scaled with the nasal cortical magnification factor (nCMF) from a central stimulus in six spatial scales, which varied from 0.125 to 1, where 1 corresponded to 1.2° radius. Thresholds expressed in Weber fractions remained constant at eccentricities up to 20° regardless of the spatial scale. Weber fractions for the smaller spatial scales (0.125-0.5) were higher and more variable than for the larger spatial scales (0.75-1), yet still constant across periphery. The results provide evidence that peripheral shape discrimination is constrained by low-level properties, such as eccentricity, and can be predicted by the cortical magnification theory. However, above the peripheral modulation resolution limits, RF shape discrimination is based on the proportion between the modulation amplitude and the radius for larger scales (0.75-1), and demonstrates peripheral scale invariance for these stimuli. For eccentric shape discrimination tests, stimuli with low spatial frequency, high contrast, and radii corresponding to SS 0.75-0.875 should be used to ensure constant Weber fractions, small variability, and peripheral stimuli that are not excessively magnified.
Collapse
Affiliation(s)
- Anna Żołubak
- School of Health Professions, University of Plymouth, Derriford Road, Plymouth PL6 8BH, United Kingdom.
| | - Luis Garcia-Suarez
- School of Health Professions, University of Plymouth, Derriford Road, Plymouth PL6 8BH, United Kingdom
| |
Collapse
|
3
|
Tan KWS, Scholes C, Roach NW, Haris EM, McGraw PV. Impact of microsaccades on visual shape processing. J Neurophysiol 2020; 125:609-619. [PMID: 33378248 DOI: 10.1152/jn.00454.2020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Sensitivity to subtle changes in the shape of visual objects has been attributed to the existence of global pooling mechanisms that integrate local form information across space. Although global pooling is typically demonstrated under steady fixation, other work suggests prolonged fixation can lead to a collapse of global structure. Here, we ask whether small ballistic eye movements that naturally occur during periods of fixation affect the global processing of radial frequency (RF) patterns-closed contours created by sinusoidally modulating the radius of a circle. Observers were asked to discriminate the shapes of circular patterns and RF-modulated patterns while fixational eye movements were recorded binocularly at 500 Hz. Microsaccades were detected using a velocity-based algorithm, allowing trials to be sorted according to the relative timing of stimulus and microsaccade onset. Results revealed clear perisaccadic changes in shape discrimination thresholds. Performance was impaired when microsaccades occurred close to stimulus onset, but facilitated when they occurred shortly afterward. In contrast, global integration of shape was unaffected by the timing of microsaccades. These findings suggest that microsaccades alter the discrimination sensitivity to briefly presented shapes but do not disrupt the spatial pooling of local form signals.NEW & NOTEWORTHY Microsaccades cause rapid displacement of visual images during fixation and dramatically alter the perception of basic image features. However, their effect on more complex aspects of visual processing is not well understood. Here, we demonstrate a dissociation in the impact of microsaccades on shape perception. Although overall shape discrimination performance is modulated around the time of microsaccades, the pooling efficiency of global mechanisms that combine local form information across space remains unaffected.
Collapse
Affiliation(s)
- Ken W S Tan
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Chris Scholes
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Neil W Roach
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Elizabeth M Haris
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Paul V McGraw
- Nottingham Visual Neuroscience Group, School of Psychology, University of Nottingham, Nottingham, United Kingdom
| |
Collapse
|
4
|
Frequency ratio determines discrimination of concentric radial frequency patterns in the peripheral visual field. Atten Percept Psychophys 2020; 82:3993-4006. [PMID: 32888172 DOI: 10.3758/s13414-020-02001-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Using a radial frequency discrimination task that has not been tested in many previous studies, we examined the dependence of the pattern radius (4 to 16 deg) on the radial frequency thresholds of two different types of concentric radial frequency (RF) patterns: constant circular contour frequency (CCF) RF patterns with different radii, which have the constant physical length of modulation cycle in external real-world space, and constant radial frequency magnified RF patterns with different radii, which have the constant cortical length of modulation cycles. These two types RF patterns used as the reference stimuli had an equal maximum orientation difference from circularity regardless of change in radius. The discrimination threshold expressed by the frequency ratio between RF patterns of different frequencies vs. radius functions for the constant CCF RF patterns indicated different functional forms dependent on the modulation amplitude of the RF patterns. The thresholds increased with increasing pattern radius for small modulation amplitude RF patterns but were relatively flattened for large-amplitude RF patterns. This dependence was ascribed to the eccentricity effect wherein the deformation thresholds for discriminating the RF pattern from a circle increase with increasing stimulus eccentricity (Feng et al. 2020). The discrimination thresholds vs. radius functions for the magnified RF patterns were also flattened for different modulation amplitudes and frequencies. The thresholds (frequency ratio) were similar at all eccentricities. Cortical magnification neutralized the eccentricity effect observed for the constant CCF patterns.
Collapse
|
5
|
Feng Y, Wu Q, Yang J, Takahashi S, Ejima Y, Wu J, Zhang M. Eccentricity Effect of Deformation Detection for Radial Frequency Patterns With Their Centers at Fixation Point. Perception 2020; 49:858-881. [DOI: 10.1177/0301006620936473] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
We measured the eccentricity effect of deformation thresholds of circular contours for two types of the radial frequency (RF) patterns with their centers at the fixation point: constant circular contour frequency (CCF) RF patterns and constant RF magnified (retino-cortical scaling) RF patterns. We varied the eccentricity by changing the mean radius of the RF patterns while keeping the centers of the RF patterns at the fixation point. Our peripheral stimulus presentation was distinguished from previous studies which have simply translated RF patterns at different locations in the visual field. Sensitivity for such shape discrimination fell off as the moderate and high CCF patterns were presented on more eccentric sites but did not as the low CCF patterns. However, sensitivity held constant as the magnified RF patterns were presented on more eccentric sites, indicating that the eccentricity effects observed for the high and moderate CCF patterns were neutralized by retinocortical mapping. Notably, sensitivity for the magnified RF patterns with large radii (4°–16°) presented in the peripheral field revealed a similar RF dependence observed for RF patterns with small radii (0.25°–1.0°) presented at the fovea in previous studies.
Collapse
Affiliation(s)
- Yang Feng
- Biomedical Engineering Laboratory, Graduate School of Natural Science and Technology, Okayama University, Japan
| | - Qiong Wu
- Department of Psychology, Suzhou University of Science and Technology, China; Cognitive Neuroscience Laboratory, Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Japan
| | | | | | - Yoshimichi Ejima
- Cognitive Neuroscience Laboratory, Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Japan
| | - Jinglong Wu
- Key Laboratory of Biomimetic Robots and System, Ministry of Education, State Key Laboratory of Intelligent Control and Decision of Complex Systems, Beijing Institute of Technology, China; Cognitive Neuroscience Laboratory, Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Japan
| | - Ming Zhang
- Department of Psychology, Suzhou University of Science and Technology, China; Cognitive Neuroscience Laboratory, Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Japan; Department of Psychology, Soochow University, China
| |
Collapse
|
6
|
Gheorghiu E, Dering BR. Shape facilitates number: brain potentials and microstates reveal the interplay between shape and numerosity in human vision. Sci Rep 2020; 10:12413. [PMID: 32709892 PMCID: PMC7381628 DOI: 10.1038/s41598-020-68788-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Accepted: 06/19/2020] [Indexed: 12/04/2022] Open
Abstract
Recognition of simple shapes and numerosity estimation for small quantities are often studied independently of each other, but we know that these processes are both rapid and accurate, suggesting that they may be mediated by common neural mechanisms. Here we address this issue by examining how spatial configuration, shape complexity, and luminance polarity of elements affect numerosity estimation. We directly compared the Event Related Potential (ERP) time-course for numerosity estimation under shape and random configurations and found a larger N2 component for shape over lateral-occipital electrodes (250–400 ms), which also increased with higher numbers. We identified a Left Mid Frontal (LMF; 400–650 ms) component over left-lateralised medial frontal sites that specifically separated low and high numbers of elements, irrespective of their spatial configuration. Different luminance-polarities increased N2 amplitude only, suggesting that shape but not numerosity is selective to polarity. Functional microstates confined numerosity to a strict topographic distribution occurring within the LMF time-window, while a microstate responding only to shape-configuration was evidenced earlier, in the N2 time-window. We conclude that shape-coding precedes numerosity estimation, which can be improved when the number of elements and shape vertices are matched. Thus, numerosity estimation around the subitizing range is facilitated by a shape-template matching process.
Collapse
Affiliation(s)
- Elena Gheorghiu
- Department of Psychology, University of Stirling, Stirling, FK9 4LA, Scotland, UK.
| | - Benjamin R Dering
- Department of Psychology, University of Stirling, Stirling, FK9 4LA, Scotland, UK
| |
Collapse
|
7
|
Slugocki M, Sekuler AB, Bennett PJ. Sensitivity to curvature deformations along closed contours. J Vis 2019; 19:7. [PMID: 31715630 DOI: 10.1167/19.13.7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Human observers are exquisitely sensitive to curvature deformations along a circular closed contour (Wilkinson, Wilson, & Habak, 1998; Hess, Wang, & Dakin, 1999; Loffler, Wilson, & Wilkinson, 2003). Such remarkable sensitivity has been attributed to the curvature encoding scheme used by V4 neurons, which typically are assumed to be equally sensitive to curvature at all polar angles (Pasupathy & Connor, 2001, 2002; Carlson, Rasquinha, Zhang, & Connor, 2011). To test the assumption that detection thresholds for curvature deformations are invariant across polar angles, we used a novel stimulus class we call Difference of Gaussian (DoG) contours that allowed us to independently manipulate the amplitude, angular frequency, and polar angle of curvature of a closed-contour shape while measuring contour-curvature thresholds. Our results demonstrate that (a) detection thresholds were higher when observers were uncertain about the location of the curvature deformation, but on average, thresholds did not vary significantly across 24 polar angles; (b) the direction and magnitude of the oblique effect varies across individuals; (c) there is a strong association between detecting a contour deformation and identifying its location; (d) curvature detectors may serve as labeled lines.
Collapse
Affiliation(s)
- Michael Slugocki
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada
| | - Allison B Sekuler
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada.,Rotman Research Institute, Baycrest Health Sciences, Toronto, Ontario, Canada.,Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| | - Patrick J Bennett
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
8
|
The processing of compound radial frequency patterns. Vision Res 2019; 161:63-74. [PMID: 31082405 DOI: 10.1016/j.visres.2019.05.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2018] [Revised: 05/03/2019] [Accepted: 05/07/2019] [Indexed: 11/20/2022]
Abstract
Radial frequency (RF) patterns can be combined to construct complex shapes. Previous studies have suggested that such complex shapes may be encoded by multiple, narrowly-tuned RF shape channels. To test this hypothesis, thresholds were measured for detection and discrimination of various combinations of two RF components. Results show evidence of summation: sensitivity for the compounds was better than that for the components, with little effect of the components' relative phase. If both RF components are processed separately at the point of detection, they would combine by probability summation (PS), resulting in only a small increase in sensitivity for the compound compared to the components. Summation exceeding the prediction of PS suggests a form of additive summation (AS) by a common mechanism. Data were compared to predictions of winner-take-all, where only the strongest component contributes to detection, a single channel AS model, and multi-channel PS and AS models. The multi-channel PS and AS models were modelled under both Fixed and Matched Attention Window scenarios, the former assuming a single internal noise source for both components and compounds or different internal noise sources for components and compounds respectively. The winner-take-all and single channel models could be rejected. Of the remaining models, the best performing one was an AS model with a Fixed Attention Window, consistent with detection being mediated by channels that are efficiently combined and limited by a single source of noise for both components and compounds.
Collapse
|
9
|
Slugocki M, Duong CQ, Sekuler AB, Bennett PJ. Evaluating spatiotemporal interactions between shapes. J Vis 2019; 19:30. [PMID: 31026017 DOI: 10.1167/19.4.30] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Spatiotemporal interactions between stimuli can alter the perceived curvature along the outline of a shape (Habak, Wilkinson, Zakher, & Wilson, 2004; Habak, Wilkinson, & Wilson, 2006). To better understand these interactions, we used a forward and backward masking paradigm with radial frequency (RF) contours while measuring RF detection thresholds. In Experiment 1, we presented a mask alongside a target contour and altered the stimulus onset asynchrony between this target-mask pair and a temporal mask. We found that a temporal mask increased thresholds when it preceded the target-mask stimulus by 130-180 ms but decreased thresholds when it followed the target-stimulus mask by 180 ms. Furthermore, Experiment 2 demonstrated that the effects of temporal and spatial masks are approximately additive. We discuss these findings in relation to theories of transient and sustained channels in vision.
Collapse
Affiliation(s)
- Michael Slugocki
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada
| | - Catherine Q Duong
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada
| | - Allison B Sekuler
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada.,Rotman Research Institute, Baycrest Health Sciences, Toronto, Ontario, Canada.,Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| | - Patrick J Bennett
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
10
|
Schmidtmann G, Fruend I. Radial frequency patterns describe a small and perceptually distinct subset of all possible planar shapes. Vision Res 2018; 154:122-130. [PMID: 30496727 DOI: 10.1016/j.visres.2018.10.007] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2018] [Revised: 10/04/2018] [Accepted: 10/25/2018] [Indexed: 11/18/2022]
Abstract
The visual system is exposed to a vast number of shapes and objects. Yet, human object recognition is effortless, fast and largely independent of naturally occurring transformations such as position and scale. The precise mechanisms of shape encoding are still largely unknown. Radial frequency (RF) patterns are a special class of closed contours defined by modulation of a circle's radius. These patterns have been frequently and successfully used as stimuli in vision science to investigate aspects of shape processing. Given their mathematical properties, RF patterns can not represent any arbitrary shape, but the ability to generate more complex, biologically relevant, shapes depicting the outlines of objects such as fruits or human heads raises the possibility that RF patterns span a representative subset of possible shapes. However, this assumption has not been tested before. Here we show that only a small fraction of all possible shapes can be represented by RF patterns and that this small fraction is perceptually distinct from the general class of all possible shapes. Specifically, we derive a general measure for the distance of a given shape's outline from the set of RF patterns, allowing us to scan large numbers of object outlines automatically. We find that only between 1% and 6% of naturally smooth outlines can be exactly represented by RF patterns. We present results from a visual search experiment, which revealed that searching an RF pattern among non-radial frequency patterns is efficient, whereas searching an RF pattern among other RF patterns is inefficient (and vice versa). These results suggest that RF patterns represent only a restricted subset of possible planar shapes and that results obtained with this special class of stimuli can not simply be expected to generalise to any arbitrary planar shape.
Collapse
Affiliation(s)
- Gunnar Schmidtmann
- Eye & Vision Research Group, School of Health Professions, University of Plymouth, Plymouth, Devon, UK
| | - Ingo Fruend
- Centre for Vision Research, and Department of Psychology, York University, Toronto, ON, Canada.
| |
Collapse
|
11
|
Slugocki M, Sekuler AB, Bennett PJ. Phase-selective masking with radial frequency contours. Vision Res 2018; 154:1-13. [PMID: 30391293 DOI: 10.1016/j.visres.2018.10.013] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2018] [Revised: 10/18/2018] [Accepted: 10/18/2018] [Indexed: 11/26/2022]
Abstract
Sensitivity to changes in the shape of a closed-contour figure is affected by surrounding figures (Vision Research 44 (2004) 2815-2823). We examined how between-contour masking depends on radial frequency. Experiment 1 replicated previous studies that found that masking between adjacent radial frequency (RF) patterns was greatest when the two shapes were phase aligned, and that the magnitude of masking declined approximately linearly with increasing phase offsets. In addition, we found that the effect of phase offset on masking was very similar for RFs ranging from 3 to 8, a result that suggests that sensitivity to phase decreases with increasing radial frequency. Experiment 2 tested this idea and found that phase discrimination threshold for single cycles of curvature was approximately proportional to radial frequency. Experiment 3 showed that both curvature maxima and minima contribute to phase dependent masking between RF contours. Together, Experiments 1-3 demonstrate that the strength of phase-dependent masking does not depend on RF, but is related to sensitivity for phase shifts in isolated contours, and is affected by both positive and negative curvature extrema. We discuss these results in relation to properties of curvature sensitive neurons.
Collapse
Affiliation(s)
- Michael Slugocki
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada.
| | - Allison B Sekuler
- Rotman Research Institute, Baycrest Health Sciences, Toronto, Ontario, Canada; Department of Psychology, University of Toronto, Toronto, Ontario, Canada; Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada.
| | - Patrick J Bennett
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, Ontario, Canada.
| |
Collapse
|
12
|
Green RJ, Dickinson JE, Badcock DR. The effect of spatiotemporal displacement on the integration of shape information. J Vis 2018; 18:4. [DOI: 10.1167/18.5.4] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Robert J. Green
- School of Psychological Science, The University of Western Australia, Perth, Australia
| | - J. Edwin Dickinson
- School of Psychological Science, The University of Western Australia, Perth, Australia
| | - David R. Badcock
- School of Psychological Science, The University of Western Australia, Perth, Australia
| |
Collapse
|
13
|
Vergeer M, Kogo N, Nikolaev AR, Alp N, Loozen V, Schraepen B, Wagemans J. EEG frequency tagging reveals higher order intermodulation components as neural markers of learned holistic shape representations. Vision Res 2018; 152:91-100. [PMID: 29474892 DOI: 10.1016/j.visres.2018.01.007] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2017] [Revised: 01/18/2018] [Accepted: 01/20/2018] [Indexed: 01/23/2023]
Abstract
Shape perception is intrinsically holistic: combinations of features give rise to configurations with emergent properties that are different from the sum of the parts. The current study investigated neural markers of holistic shape representations learned by means of categorization training. We used the EEG frequency tagging technique, where two parts of a shape stimulus were 'tagged' by modifying their contrast at different temporal frequencies. Signals from both parts are integrated and, as a result, emergent frequency components (so-called, intermodulation responses, IMs), caused by nonlinear interaction of two frequency signals, are observed in the EEG spectrum. First, participants were trained in 4 sessions to discriminate highly similar, unfamiliar shapes into two categories, defined based on the combination of features. After training, EEG was recorded while frequency-tagged shapes from either the trained or the untrained shape family were presented. For all IMs combined, no learning effects were detected, but post hoc analyses of higher-order IMs revealed stronger occipital and occipito-temporal IMs for both trained and untrained exemplars of the trained shape family as compared to the untrained shape family. In line with recent findings, we suggest that the higher-order IMs may reflect high-level visual computations, like holistic shape categorization, resulting from a cascade of non-linear operations. Higher order frequency responses are relatively low in power, hence results should be interpreted cautiously and future research is needed to confirm these effects. In general, these findings are, to our knowledge, the first to show IMs as a neural correlate of perceptual learning.
Collapse
Affiliation(s)
- Mark Vergeer
- Laboratory of Experimental Psychology, Department of Brain & Cognition, KU Leuven, Belgium; Department of Psychology, University of Minnesota Twin Cities, USA.
| | - Naoki Kogo
- Laboratory of Experimental Psychology, Department of Brain & Cognition, KU Leuven, Belgium
| | - Andrey R Nikolaev
- Laboratory of Experimental Psychology, Department of Brain & Cognition, KU Leuven, Belgium
| | - Nihan Alp
- Laboratory of Experimental Psychology, Department of Brain & Cognition, KU Leuven, Belgium
| | - Veerle Loozen
- Laboratory of Experimental Psychology, Department of Brain & Cognition, KU Leuven, Belgium
| | - Brenda Schraepen
- Laboratory of Experimental Psychology, Department of Brain & Cognition, KU Leuven, Belgium
| | - Johan Wagemans
- Laboratory of Experimental Psychology, Department of Brain & Cognition, KU Leuven, Belgium
| |
Collapse
|
14
|
Nothing more than a pair of curvatures: A common mechanism for the detection of both radial and non-radial frequency patterns. Vision Res 2017; 134:18-25. [DOI: 10.1016/j.visres.2017.03.005] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2016] [Revised: 03/19/2017] [Accepted: 03/20/2017] [Indexed: 11/20/2022]
|
15
|
Chen YC, Huang PC, Woods A, Spence C. When "Bouba" equals "Kiki": Cultural commonalities and cultural differences in sound-shape correspondences. Sci Rep 2016; 6:26681. [PMID: 27230754 PMCID: PMC4882484 DOI: 10.1038/srep26681] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2015] [Accepted: 05/04/2016] [Indexed: 11/21/2022] Open
Abstract
It has been suggested that the Bouba/Kiki effect, in which meaningless speech sounds are systematically mapped onto rounded or angular shapes, reflects a universal crossmodal correspondence between audition and vision. Here, radial frequency (RF) patterns were adapted in order to compare the Bouba/Kiki effect in Eastern and Western participants demonstrating different perceptual styles. Three attributes of the RF patterns were manipulated: The frequency, amplitude, and spikiness of the sinusoidal modulations along the circumference of a circle. By testing participants in the US and Taiwan, both cultural commonalities and differences in sound-shape correspondence were revealed. RF patterns were more likely to be matched with “Kiki” than with “Bouba” when the frequency, amplitude, and spikiness increased. The responses from both groups of participants had a similar weighting on frequency; nevertheless, the North Americans had a higher weighting on amplitude, but a lower weighting on spikiness, than their Taiwanese counterparts. These novel results regarding cultural differences suggest that the Bouba/Kiki effect is partly tuned by differing perceptual experience. In addition, using the RF patterns in the Bouba/Kiki effect provides a “mid-level” linkage between visual and auditory processing, and a future understanding of sound-shape correspondences based on the mechanism of visual pattern processing.
Collapse
Affiliation(s)
- Yi-Chuan Chen
- Department of Experimental Psychology, Oxford University, Oxford, UK
| | - Pi-Chun Huang
- Department of Psychology, National Cheng Kung University, Tainan, Taiwan
| | - Andy Woods
- Department of Experimental Psychology, Oxford University, Oxford, UK.,Xperiment, Surrey, UK
| | - Charles Spence
- Department of Experimental Psychology, Oxford University, Oxford, UK
| |
Collapse
|
16
|
Salmela VR, Henriksson L, Vanni S. Radial Frequency Analysis of Contour Shapes in the Visual Cortex. PLoS Comput Biol 2016; 12:e1004719. [PMID: 26866917 PMCID: PMC4750910 DOI: 10.1371/journal.pcbi.1004719] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2015] [Accepted: 12/17/2015] [Indexed: 12/18/2022] Open
Abstract
Cumulative psychophysical evidence suggests that the shape of closed contours is analysed by means of their radial frequency components (RFC). However, neurophysiological evidence for RFC-based representations is still missing. We investigated the representation of radial frequency in the human visual cortex with functional magnetic resonance imaging. We parametrically varied the radial frequency, amplitude and local curvature of contour shapes. The stimuli evoked clear responses across visual areas in the univariate analysis, but the response magnitude did not depend on radial frequency or local curvature. Searchlight-based, multivariate representational similarity analysis revealed RFC specific response patterns in areas V2d, V3d, V3AB, and IPS0. Interestingly, RFC-specific representations were not found in hV4 or LO, traditionally associated with visual shape analysis. The modulation amplitude of the shapes did not affect the responses in any visual area. Local curvature, SF-spectrum and contrast energy related representations were found across visual areas but without similar specificity for visual area that was found for RFC. The results suggest that the radial frequency of a closed contour is one of the cortical shape analysis dimensions, represented in the early and mid-level visual areas.
Collapse
Affiliation(s)
- Viljami R. Salmela
- Institute of Behavioural Sciences, Division of Cognitive and Neuropsychology, University of Helsinki, Helsinki, Finland
- Advanced Magnetic Imaging Centre, Aalto NeuroImaging, Aalto University School of Science, Espoo, Finland
- * E-mail:
| | - Linda Henriksson
- Advanced Magnetic Imaging Centre, Aalto NeuroImaging, Aalto University School of Science, Espoo, Finland
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Simo Vanni
- Advanced Magnetic Imaging Centre, Aalto NeuroImaging, Aalto University School of Science, Espoo, Finland
- Clinical Neurosciences, Neurology, University of Helsinki and Helsinki University Hospital, Helsinki, Finland
| |
Collapse
|
17
|
Kempgens C, Loffler G, Orbach HS. Set-size effects for sampled shapes: experiments and model. Front Comput Neurosci 2013; 7:67. [PMID: 23755007 PMCID: PMC3664879 DOI: 10.3389/fncom.2013.00067] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2013] [Accepted: 05/07/2013] [Indexed: 11/13/2022] Open
Abstract
The location of imperfections or heterogeneities in shapes and contours often correlates with points of interest in a visual scene. Investigating the detection of such heterogeneities provides clues as to the mechanisms processing simple shapes and contours. We determined set-size effects (e.g., sensitivity to single target detection as distractor number increases) for sampled contours to investigate how the visual system combines information across space. Stimuli were shapes sampled by oriented Gabor patches: circles and high-amplitude RF4 and RF8 radial frequency patterns with Gabor orientations tangential to the shape. Subjects had to detect a deviation in orientation of one element ("heterogeneity"). Heterogeneity detection sensitivity was measured for a range (7-40) of equally spaced (2.3-0.4°) elements. In a second condition, performance was measured when elements sampled a part of the shapes. We either varied partial contour length for a fixed (7) set-size, co-varying inter-element spacing, or set-size for a fixed spacing (0.7°), co-varying partial contour length. Surprisingly, set-size effects (poorer performance with more elements) are rarely seen. Set-size effects only occur for shapes containing concavities (RF4 and RF8) and when spacing is fixed. When elements are regularly spaced, detection performance improves with set-size for all shapes. When set-size is fixed and spacing varied, performance improves with decreasing spacing. Thus, when an increase in set-size and a decrease in spacing co-occur, the effect of spacing dominates, suggesting that inter-element spacing, not set-size, is the critical parameter for sampled shapes. We propose a model for the processing of simple shapes based on V4 curvature units with late noise, incorporating spacing, average shape curvature, and the number of segments with constant sign of curvature contained in the shape, which accurately accounts for our experimental results, making testable predictions for a variety of simple shapes.
Collapse
|
18
|
Schmidtmann G, Gordon GE, Bennett DM, Loffler G. Detecting shapes in noise: tuning characteristics of global shape mechanisms. Front Comput Neurosci 2013; 7:37. [PMID: 23720625 PMCID: PMC3655279 DOI: 10.3389/fncom.2013.00037] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2012] [Accepted: 04/02/2013] [Indexed: 11/13/2022] Open
Abstract
The proportion of signal elements embedded in noise needed to detect a signal is a standard tool for investigating motion perception. This paradigm was applied to the shape domain to determine how local information is pooled into a global percept. Stimulus arrays consisted of oriented Gabor elements that sampled the circumference of concentric radial frequency (RF) patterns. Individual Gabors were oriented tangentially to the shape (signal) or randomly (noise). In different conditions, signal elements were located randomly within the entire array or constrained to fall along one of the concentric contours. Coherence thresholds were measured for RF patterns with various frequencies (number of corners) and amplitudes (“sharpness” of corners). Coherence thresholds (about 10% = 15 elements) were lowest for circular shapes. Manipulating shape frequency or amplitude showed a range where thresholds remain unaffected (frequency ≤ RF4; amplitude ≤ 0.05). Increasing either parameter caused thresholds to rise. Compared to circles, thresholds increased by approximately four times for RF13 and five times for amplitudes of 0.3. Confining the signals to individual contours significantly reduced the number of elements needed to reach threshold (between 4 and 6), independent of the total number of elements on the contour or contour shape. Finally, adding external noise to the orientation of the elements had a greater effect on detection thresholds than adding noise to their position. These results provide evidence for a series of highly sensitive, shape-specific analysers which sum information globally but only from within specific annuli. These global mechanisms are tuned to position and orientation of local elements from which they pool information. The overall performance for arrays of elements can be explained by the sensitivity of multiple, independent concentric shape detectors rather than a single detector integrating information widely across space (e.g. Glass pattern detector).
Collapse
|
19
|
Daar M, Or CCF, Wilson HR. Increment thresholds for radial frequency trajectories produce a dipper function. Vision Res 2012; 73:46-52. [PMID: 23041505 DOI: 10.1016/j.visres.2012.09.010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2012] [Revised: 08/21/2012] [Accepted: 09/17/2012] [Indexed: 12/01/2022]
Abstract
Radial frequency (RF) trajectories are a new class of stimuli that have been developed to study the visual perception of periodic motion (Or et al., 2011). These stimuli are described by a moving dot that traces a distorted path through space with periodic radial deformations whose frequency, amplitude, and phase can be independently specified. Here, we extend Or et al.'s findings by investigating how the discrimination of RF amplitude changes as a function of different reference amplitudes in a two-interval forced choice task. Using an RF3 trajectory (a pattern with three cycles of deformation along its trajectory), increment thresholds were measured at six different reference amplitudes: Detection (discriminating a circle from RF3), 1X (discriminating a pair of RF3 patterns, with the amplitude of one member of this pair set to (1X) threshold obtained from the detection condition), 2.5X, 5X, 10X, and 15X. Data show that sensitivity to changes in amplitude improves at 2.5X by a factor of about 2, recovers to detection threshold levels at 5X, and continues to rise at 10X and 15X. These results generalize across both radial frequency and the angular speed of the trajectory, and persist with low contrast trajectories. Our findings point to the existence of a neural mechanism that is sensitive to deviations from circular motion trajectories.
Collapse
Affiliation(s)
- Marwan Daar
- Centre for Vision Research, York University, 4700 Keele Street, Room 0009 CSEB, Toronto, Ontario, Canada M3J 1P3.
| | | | | |
Collapse
|
20
|
Schmidtmann G, Kennedy GJ, Orbach HS, Loffler G. Non-linear global pooling in the discrimination of circular and non-circular shapes. Vision Res 2012; 62:44-56. [DOI: 10.1016/j.visres.2012.03.001] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2011] [Revised: 03/02/2012] [Accepted: 03/03/2012] [Indexed: 11/29/2022]
|
21
|
Bell J, Gheorghiu E, Hess RF, Kingdom FAA. Global shape processing involves a hierarchy of integration stages. Vision Res 2011; 51:1760-6. [PMID: 21704056 DOI: 10.1016/j.visres.2011.06.003] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2011] [Revised: 04/20/2011] [Accepted: 06/02/2011] [Indexed: 10/18/2022]
Abstract
Radial Frequency (RF) patterns can be used to study the processing of familiar shapes, e.g. triangles and squares. Opinion is divided over whether the mechanisms that detect these shapes integrate local orientation and position information directly, or whether local orientations and positions are first combined to represent extended features, such as curves, and that it is local curvatures that the shape mechanism integrates. The latter view incorporates an intermediate processing stage, the former does not. To differentiate between these hypotheses we studied the processing of micro-patch sampled RF patterns as a function of the luminance polarity of successive elements on the contour path. Our first study measures shape after effects involving suprathreshold amplitude RF shapes and shows that alternating the luminance polarity of successive micro-patch elements disrupts adaptation of the global shape. Our second study shows that polarity alternations also disrupt sensitivity to threshold-amplitude RF patterns. These results suggest that neighbouring points of the contour shape are integrated into extended features by a polarity selective mechanism, prior to global shape processing, consistent with the view that for both threshold amplitude and suprathreshold amplitude patterns, global processing of RF shapes involves an intermediate stage of processing.
Collapse
Affiliation(s)
- Jason Bell
- McGill Vision Research, Dept. of Ophthalmology, McGill University, 687 Pine Av. West, H4-14, Montreal, Quebec, Canada H3A 1A1.
| | | | | | | |
Collapse
|
22
|
Grinter EJ, Maybery MT, Pellicano E, Badcock JC, Badcock DR. Perception of shapes targeting local and global processes in autism spectrum disorders. J Child Psychol Psychiatry 2010; 51:717-24. [PMID: 20070450 DOI: 10.1111/j.1469-7610.2009.02203.x] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
BACKGROUND Several researchers have found evidence for impaired global processing in the dorsal visual stream in individuals with autism spectrum disorders (ASDs). However, support for a similar pattern of visual processing in the ventral visual stream is less consistent. Critical to resolving the inconsistency is the assessment of local and global form processing ability. METHODS Within the visual domain, radial frequency (RF) patterns - shapes formed by sinusoidally varying the radius of a circle to add 'bumps' of a certain number to a circle - can be used to examine local and global form perception. Typically developing children and children with an ASD discriminated between circles and RF patterns that are processed either locally (RF24) or globally (RF3). RESULTS Children with an ASD required greater shape deformation to identify RF3 shapes compared to typically developing children, consistent with difficulty in global processing in the ventral stream. No group difference was observed for RF24 shapes, suggesting intact local ventral-stream processing. CONCLUSIONS These outcomes support the position that a deficit in global visual processing is present in ASDs, consistent with the notion of Weak Central Coherence.
Collapse
|
23
|
Bell J, Hancock S, Kingdom FAA, Peirce JW. Global shape processing: which parts form the whole? J Vis 2010; 10:16. [PMID: 20884565 DOI: 10.1167/10.6.16] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Research suggests that detection of low-frequency radial frequency (RF) patterns involves global shape processing and that points of maximum curvature (corners) contribute more than points of minimum curvature (sides). However, this has only been tested with stimuli presented at the threshold of discriminability from a circle. We used RF pattern adaptation to (a) examine whether a supra-threshold RF pattern is processed as a global shape and (b) determine what the critical features are for representing its shape. We measured the perceived amplitude shift of an RF test pattern after prolonged exposure either to a higher amplitude pattern or to various combinations of its parts (concave maxima, convex maxima, inflections). We found greater shifts in perceived amplitude after adaptation to a "whole" pattern than after adaptation to its component parts, which alternated to produce equal net contrast. Furthermore, when adapting to specific parts of the shape in isolation, we found that each part generated a similar magnitude aftereffect. Although the whole is clearly greater than the sum of the parts, we find that concave maxima, convex maxima, and inflections contribute equally to global shape processing, a fact that is only apparent when using a supra-threshold appearance-based task.
Collapse
Affiliation(s)
- Jason Bell
- McGill Vision Research, Department of Ophthalmology, McGill University, Montreal, Quebec, Canada
| | | | | | | |
Collapse
|
24
|
Bex PJ. (In) sensitivity to spatial distortion in natural scenes. J Vis 2010; 10:23.1-15. [PMID: 20462324 DOI: 10.1167/10.2.23] [Citation(s) in RCA: 40] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2009] [Accepted: 12/19/2009] [Indexed: 11/24/2022] Open
Abstract
The perception of object structure in the natural environment is remarkably stable under large variation in image size and projection, especially given our insensitivity to spatial position outside the fovea. Sensitivity to periodic spatial distortions that were introduced into one quadrant of gray-scale natural images was measured in a 4AFC task. Observers were able to detect the presence of distortions in unfamiliar images even though they did not significantly affect the amplitude spectrum. Sensitivity depended on the spatial period of the distortion and on the image structure at the location of the distortion. The results suggest that the detection of distortion involves decisions made in the late stages of image perception and is based on an expectation of the typical structure of natural scenes.
Collapse
Affiliation(s)
- Peter J Bex
- Schepens Eye Research Institute, Harvard Medical School, Boston, MA, USA.
| |
Collapse
|