Spatial and temporal frequency in figure-ground organization

Temporal correspondence in perceptual organization: Reciprocal interactions between temporal sensitivity and figure-ground segregation

How do visual representations account for time? Is it the case that they represent time by themselves possessing temporal properties (temporal mirroring) or by atemporal markers/tags (temporal tagging)? This question has been asked for the past 5 decades and more, in neuroscience, philosophy, and psychology. To address this debate, we designed a study to test temporal correspondence. We tested whether a temporal property (flicker frequency) could influence figure-ground segregation, and in turn, reciprocally, whether a figure-ground segregation would alter a temporal property (here, temporal resolution). We manipulated flicker frequency of dots on either side of an ambiguous edge in Experiment 1 and asked participants to indicate the figural region. In Experiment 2, we measured temporal sensitivity using a temporal order judgment (TOJ) task in both figural and ground regions. We showed temporal correspondence by showing specifically that figure-ground segregation depends on flicker frequency differences between two regions in ambiguous displays, where slow-flickering regions are seen as figural (Experiment 1). Reciprocally, in Experiment 2, we showed that participants performed a temporal-order judgment task better when the task had to be performed on a region seen as background compared with the same region seen as a figure. We show how relatively slower flickering regions are seen as figural, and correspondingly, seeing a region as figural is associated with a poorer temporal resolution. Our results collectively allow us to demonstrate a tight temporal correspondence in figure-ground perception, which could be explained using the parvocellular and magnocellular pathways, the two major retino-geniculo-cortical pathways.

When figure-ground segregation fails: Exploring antagonistic interactions in figure-ground perception

Perceptual fading of an artificial scotoma can be viewed as a failure of figure-ground segregation, providing a useful tool for investigating possible mechanisms and processes involved in figure-ground perception. Weisstein's antagonistic magnocellular/parvocellular stream figure-ground model proposes P stream activity encodes figure, and M stream activity encodes background. Where a boundary separates two regions, the region that is perceived as figure or ground is determined by the outcome of antagonism between M and P activity within each region and across the boundary between them. The region with the relatively stronger P "figure signal" is perceived as figure, and the region with the relatively stronger M "ground signal" is perceived as ground. From this perspective, fading occurs when the figure signal is overwhelmed by the ground signal. Strengthening the figure signal or weakening the ground signal should make the figure more resistant to fading. Based on research showing that red light suppresses M activity and short wavelength sensitive S-cones provide minimal input to M cells, we used red and blue light to reduce M activity in both figure and ground. The time to fade from stimulus onset until the figure completely disappeared was measured. Every combination of gray, green, red, and blue as figure and/or ground was tested. Compared with gray and green light, fade times were greatest when red or blue light either strengthened the figure signal by reducing M activity in the figure, or weakened the ground signal by reducing M activity in ground. The results support a dynamic antagonistic relationship between M and P activity contributing to figure-ground perception as envisioned in Weisstein's model.

Temporal resolution of figures and grounds

Recent studies have demonstrated that establishing figure-ground organization influences other perceptual processes. Specifically, figures undergo perceptual processing earlier than ground regions (Lester, Hecht, & Vecera, 2009), and they are processed for longer durations relative to ground regions (Hecht & Vecera, 2011). One potential consequence of figures' extended processing is degraded temporal resolution compared to ground regions. To test this hypothesis, observers completed a modified flicker-fusion task while viewing either displays that contained well-defined figures and grounds or displays that were ambiguous. As evidenced by increased sensitivity for flickering targets on the ground regions, the current results support the claim that figures have poorer temporal resolution than ground regions.

Figure-ground discrimination in the avian brain: the nucleus rotundus and its inhibitory complex

In primates, neurons sensitive to figure-ground status are located in striate cortex (area V1) and extrastriate cortex (area V2). Although much is known about the anatomical structure and connectivity of the avian visual pathway, the functional organization of the avian brain remains largely unexplored. To pinpoint the areas associated with figure-ground segregation in the avian brain, we used a radioactively labeled glucose analog to compare differences in glucose uptake after figure-ground, color, and shape discriminations. We also included a control group that received food on a variable-interval schedule, but was not required to learn a visual discrimination. Although the discrimination task depended on group assignment, the stimulus displays were identical for all three experimental groups, ensuring that all animals were exposed to the same visual input. Our analysis concentrated on the primary thalamic nucleus associated with visual processing, the nucleus rotundus (Rt), and two nuclei providing regulatory feedback, the pretectum (PT) and the nucleus subpretectalis/interstitio-pretecto-subpretectalis complex (SP/IPS). We found that figure-ground discrimination was associated with strong and nonlateralized activity of Rt and SP/IPS, whereas color discrimination produced strong and lateralized activation in Rt alone. Shape discrimination was associated with lower activity of Rt than in the control group. Taken together, our results suggest that figure-ground discrimination is associated with Rt and that SP/IPS may be a main source of inhibitory control. Thus, figure-ground segregation in the avian brain may occur earlier than in the primate brain.

Visual shape representation with geometrically characterized contour partitions

This paper proposes a biologically plausible matching method to recognize general shapes based on contour curvature information. The human visual system recognizes general shapes flexibly in real-world scenes through the ventral pathway. The pathway is typically modeled using artificial neural networks. These network models, however, do not construct a shape representation that satisfies the following required constraints: (1) The original shape should be represented by a group of partitioned contours in order to retrieve the whole shape (global information) from the partial contours (local information). (2) Coarse and fine structures of the original shapes should be individually represented in order for the visual system to respond to shapes as quickly as possible based on the least number of their features, and to discriminate between shapes based on detailed information. (3) The shape recognition realized with an artificial visual system should be invariant to geometric transformation such as expansion, rotation, or shear. In this paper, we propose a visual shape representation with geometrically characterized contour partitions described on multiple spatial scales.

Visual streams and shifting attention

Understanding the relationship between bottom-up and top-down processing in visual perception and attention is challenging. An important part of that challenge is studying the roles the parvocellular (P) and magnocellular (M) retino-geniculo-cortical pathways play in visual processing and attention. The P pathway provides the dominant initial input to the ventral stream which plays an important role in object processing and is assumed to be relatively more involved in object-based attention. The faster responding M pathway provides the dominant initial input to the dorsal stream which plays an important role in processing movement and spatial location information and is assumed to be relatively more involved in space-based attention. To gain insight into the relationship between M/dorsal and P/ventral activity and deploying visual attention, we used a covert cuing paradigm to manipulate attention while bottom-up and top-down perceptual stimulus variables created M/dorsal and P/ventral-biased conditions. One study examined the object advantage, where responses are faster for within-relative to equidistant between-object shifts of attention. Visual stream contributions to object- and spaced-based attention were revealed using psychophysically equiluminant conditions expected to reduce M/dorsal activity. Other studies investigating visual stream contributions to location-based inhibition of return (IOR) used IOR magnitude as an indicator of the ease or difficulty of deploying spatial attention. Greater IOR was found under P/ventral-biased conditions. Less IOR was found under M/dorsal-biased conditions. The results support the use of M/dorsal and P/ventral-biased conditions as a valuable strategy for studying the relationship between visual stream activity and shifting attention.

Effects of image background on spatial-frequency thresholds for face recognition

A great deal of work has been devoted to the question of which spatial frequencies, if any, are optimal for various visual tasks, such as face and object recognition. However, to date these studies have all been carried out with stimuli set against a uniform background. It is possible that this type of stimulus does not produce ecologically valid results. The natural world in which visual tasks normally take place involves a great deal of luminance variation and distracting visual structure, which may alter the spatial frequencies necessary for a task. We conducted two experiments that examined the effects of image background on the spatial-frequency thresholds (50% maximum of a low-pass or high-pass Butterworth filter) for face recognition by the psychophysical methods of adjustment and constant stimuli. In both experiments we found no significant difference in spatial-frequency thresholds between uniform-grey backgrounds and natural-scene backgrounds, and only minor differences between uniform-grey backgrounds and fractal noise backgrounds. This suggests that results obtained with uniform backgrounds are ecologically valid and that background effects, if they exist, are small.

Figure-ground assignment in pigeons: evidence for a figural benefit

Four pigeons discriminated whether a target spot appeared on a colored figural shape or on a differently colored background by first pecking the target and then reporting its location: on the figure or the background. We recorded three dependent variables: target detection time, choice response time, and choice accuracy. The birds were faster to detect the target, to report its location, and to learn the correct response on figure trials than on background trials. Later tests suggested that the pigeons might have attended to the figural region as a whole rather than using local properties in performing the figure-background discrimination. The location of the figural region did not affect figure-ground assignment. Finally, when 4 other pigeons had to detect and peck the target without making a choice report, no figural advantage emerged in target detection time, suggesting that the birds' attention may not have been automatically summoned to the figural region.

Illusory three-dimensional rotation of horizontal lines: a new motion-depth illusion

A new motion--depth illusion is reported. When a curved aperture translates vertically and stationary horizontal lines can be seen through it, the line lengths on the retina change continuously because of the occlusion. Instead of seeing the aperture translate, subjects sometimes see the lines rotate in depth around a vertical axis. This is a rare kind of illusion: an ambiguous motion which can be seen as either stationary in two dimensions or rotating in three dimensions. Three-dimensional rotation was more often observed when the luminance difference between the horizontal lines and the background was larger than that between the aperture and the background. This illusion demonstrates that motion detection and the structure-from-motion process correlate with figure--ground segregation, depth stratification, and figural-completion processes based on luminance contrast.

Blur and contrast as pictorial depth cues

Studies have shown that blur can act as a pictorial cue to depth perception. But blurring a stimulus reduces its contrast, and studies have also shown that contrast can act as a pictorial cue to depth perception. To determine whether blur and contrast have separate influences on depth perception, each variable was independently manipulated in two experiments. Observers reported depth alternations in a simple reversible figure. Both contrast and blur were found to influence depth perception, but blur had its greatest effect at moderate contrasts. When blurred and sharp stimuli were equated on either Michelson or RMS contrast, blur continued to affect depth perception. Hence blur can act as a depth cue independently of contrast. It is speculated that blur is effective as a pictorial cue because of its usual association with other depth cues, particularly in pictures and photographs.

Antiphase flicker induces depth segregation

We examined the influence of the temporal phase of flickering stimuli on perceptual organization. When two regions of a uniform random-dot field are flickered in temporal alternation with the same flicker rate, one of the regions appears to lie in front of the other. Within the range of temporal frequencies used in the present experiments, depth perception was maximal between 5 and 31.3 Hz. Which region of the two is perceived as lying in front is different from person to person and sometimes fluctuates within the same subject, but when two regions are of different sizes, the smaller region tends to be perceived in front for longer than the larger region. The depth segregation was not due to a luminance difference, because the average temporal luminance of the regions was kept equal. Strikingly, the illusory depth segregation is perceived even between two adjacent regions whose densities of dots, sizes, shapes, and flicker rates are identical. This result suggests that a difference of temporal phase between two flickering regions is crucial for this new depth perception.

Influence of flicker on perceived size and depth

Previous research (e.g., Wong & Weisstein, 1984a, 1985) has shown that flickering stimuli appear to be more distant than nonflickering stimuli at the same physical distance. Given this relation between flicker and perceived depth, inappropriate constancy scaling theories predict that flickering stimuli should be perceived as larger than nonflickering ones. In contrast, links between flicker and motion perception suggest that flickering stimuli should be perceived as smaller than nonflickering ones. Two experiments tested these contrasting predictions. In Experiment 1, 22 subjects compared flickering and nonflickering vertical lines and reported that the flickering stimulus appeared significantly smaller than the nonflickering one. In Experiment 2, 21 subjects reported that the stimuli used in Experiment 1 produced depth effects similar to those reported in previous experiments: flickering stimuli were perceived as more distant than nonflickering ones. The observed effect of flicker on perceived size was contrary to predictions from inappropriate constancy scaling theory, but consistent with views that motion and flicker are processed by the same pathway.

Conflicting figure--ground and depth information reduces moving phantom visibility

Moving phantom visibility was measured in two experiments where the global figure-ground and depth relations within phantom-inducing patterns were manipulated. The local inducing environment where the illusion occurred was identical for all patterns. Phantom visibility was significantly reduced when occlusion cues specified the phantom-inducing parts of a pattern as ground. These results suggest conflicting figure-ground and depth information interferes with the representation and perception of phantoms as figure regions.

Semantic context and figure-ground organization

The semantic-priming paradigm was used to investigate the effect of semantic context on the latency to identify visually ambiguous and unambiguous targets. Ambiguous targets had reversible figure-ground organizations analogous to Rubin's vase-profiles picture in which the figural vase is shaped by the same contour that, if reassigned, shapes two figural profiles. The two organizations of the ambiguous targets were either a series of black irregular shapes or a familiar word in white letters; subjects were required to achieve the latter organization. Unambiguous target words were not reversible. Related primes, unlike unrelated primes, facilitated the identification of both types of target; but the magnitude of facilitation was greater for ambiguous targets. The results demonstrate that semantic context influences the speed of figure-ground organization and add perceptual ambiguity to the target manipulations that interact with context to affect encoding.

Figure and ground in space and time: 1. Temporal response surfaces of perceptual organization

The figure-ground organization of an ambiguous bipartite pattern can be manipulated by altering the temporal-frequency content of the two regions of the pattern. Ambiguous patterns in which the two regions of each pattern contained sine-wave gratings of either 8, 4, 1, or 0.5 cycles deg-1 undergoing contrast reversal at rates of 0, 3.75, 7.5, or 15 Hz were tested for figure-ground organization under conditions of equated space-averaged and time-averaged luminance and perceived contrast. All combinations of temporal-frequency differences between the two regions were tested at each spatial frequency. The data are reported for two levels of temporal resolution (15 and 30 s). The pattern region with the relatively higher temporal frequency tended to be seen as the background a higher percentage of the viewing time. There were significant linear trends for the appearance as background of the region of higher temporal frequency with respect to the magnitude of the temporal-frequency difference between the two regions of each pattern for all spatial frequencies and data intervals except the final 15 s interval of the lowest (0.5 cycle deg-1) spatial-frequency condition.

Figure and ground in space and time: 2. Frequency, velocity, and perceptual organization

The figure-ground organization of an ambiguous bipartite pattern in which the two regions of the pattern contained sine-wave gratings which differed in spatial frequency was examined for two pairs of spatial frequencies: 1 and 4 cycles deg-1, and 1 and 8 cycles deg-1. The region of higher spatial frequency underwent contrast reversal at one of four rates: 0, 3.75, 7.5, or 15 Hz. The region of lower spatial frequency was equated with either the temporal frequency or the velocity of the grating of higher spatial frequency in three sets of conditions: one stationary condition, three in which temporal frequency was equated, and three in which velocity was equated. For the 1 and 4 cycles deg-1 pair, the region of lower spatial frequency tended to be seen as the background a higher percentage of the time. There were significant linear trends for the appearance as background of the region of lower spatial frequency with respect to the magnitude of the velocity difference between the two regions of the pattern. The faster the 1 cycle deg-1 grating moved with respect to the 4 cycles deg-1 grating, the higher the percentage of the time it was seen as the ground. The results for the 1 and 8 cycles deg-1 pair were in some cases unexpected in that the 8 cycles deg-1 grating was seen as the ground behind the 1 cycle deg-1 grating even though it was of a higher spatial frequency and moved at a slower velocity. The spatiotemporal tuning of the visual system is discussed.