Identification of everyday objects on the basis of Gaborized outline versions

Seeing our 3D world while only viewing contour-drawings

Artists can represent a 3D object by using only contours in a 2D drawing. Prior studies have shown that people can use such drawings to perceive 3D shapes reliably, but it is not clear how useful this kind of contour information actually is in a real dynamical scene in which people interact with objects. To address this issue, we developed an Augmented Reality (AR) device that can show a participant a contour-drawing or a grayscale-image of a real dynamical scene in an immersive manner. We compared the performance of people in a variety of run-of-the-mill tasks with both contour-drawings and grayscale-images under natural viewing conditions in three behavioral experiments. The results of these experiments showed that the people could perform almost equally well with both types of images. This contour information may be sufficient to provide the basis for our visual system to obtain much of the 3D information needed for successful visuomotor interactions in our everyday life.

Fragmented ambiguous objects: Stimuli with stable low-level features for object recognition tasks

Visual object recognition is a complex skill that relies on the interaction of many spatially distinct and specialized visual areas in the human brain. One tool that can help us better understand these specializations and interactions is a set of visual stimuli that do not differ along low-level dimensions (e.g., orientation, contrast) but do differ along high-level dimensions, such as whether a real-world object can be detected. The present work creates a set of line segment-based images that are matched for luminance, contrast, and orientation distribution (both for single elements and for pair-wise combinations) but result in a range of object and non-object percepts. Image generation started with images of isolated objects taken from publicly available databases and then progressed through 3-stages: a computer algorithm generating 718 candidate images, expert observers selecting 217 for further consideration, and naïve observers performing final ratings. This process identified a set of 100 images that all have the same low-level properties but cover a range of recognizability (proportion of naïve observers (N = 120) who indicated that the stimulus "contained a known object") and semantic stability (consistency across the categories of living, non-living/manipulable, and non-living/non-manipulable when the same observers named "known" objects). Stimuli are available at https://github.com/caolman/FAOT.git.

A shape-level flanker facilitation effect in contour integration and the role of shape complexity

The detection of an object in the visual field requires the visual system to integrate a variety of local features into a single object. How these local processes and their global integration is influenced by the presence of other shapes in the visual field is poorly understood. The detectability (contour integration) of a central target object in the form of a two dimensional Gaborized contour was compared in the presence or absence of nearby surrounding objects. A 2-AFC staircase procedure added orientation jitter to the constituent Gabor patches to determine the detectability of the target contour. The set of contours was generated using shape profiles of everyday objects and geometric forms. Experiment 1 examined the effect of three types of congruencies between the target and two flanking contours (contour shape, symmetry and familiarity). Experiment 2 investigated the effect of varying the number and spatial positions of the flankers. In addition, a measure of shape complexity (reciprocal of shape compactness) was used to assess the effects of contour complexity on detection. Across both experiments the detectability of the target contour increased when the target and flanker had the same shape and this was related to both the number of flankers and the complexity of the target shapes. Another factor that modulated this shape-level flanker facilitation effect was the presence of symmetry. The overall results are consistent with a contour integration process in which the visual system incorporates contextual information to extract the most likely smooth contour within a noise field.

Combining S-cone and luminance signals adversely affects discrimination of objects within backgrounds

The visual system processes objects embedded in complex scenes that vary in both luminance and colour. In such scenes, colour contributes to the segmentation of objects from backgrounds, but does it also affect perceptual organisation of object contours which are already defined by luminance signals, or are these processes unaffected by colour's presence? We investigated if luminance and chromatic signals comparably sustain processing of objects embedded in backgrounds, by varying contrast along the luminance dimension and along the two cone-opponent colour directions. In the first experiment thresholds for object/non-object discrimination of Gaborised shapes were obtained in the presence and absence of background clutter. Contrast of the component Gabors was modulated along single colour/luminance dimensions or co-modulated along multiple dimensions simultaneously. Background clutter elevated discrimination thresholds only for combined S-(L + M) and L + M signals. The second experiment replicated and extended this finding by demonstrating that the effect was dependent on the presence of relatively high S-(L + M) contrast. These results indicate that S-(L + M) signals impair spatial vision when combined with luminance. Since S-(L + M) signals are characterised by relatively large receptive fields, this is likely to be due to an increase in the size of the integration field over which contour-defining information is summed.

Contour complexity and contour detection

Itis well-known that "smooth" chains of oriented elements-contours-are more easily detected amid background noise than more undulating (i.e., "less smooth") chains. Here, we develop a Bayesian framework for contour detection and show that it predicts that contour detection performance should decrease with the contour's complexity, quantified as the description length (DL; i.e., the negative logarithm of probability integrated along the contour). We tested this prediction in two experiments in which subjects were asked to detect simple open contours amid pixel noise. In Experiment 1, we demonstrate a consistent decline in performance with increasingly complex contours, as predicted by the Bayesian model. In Experiment 2, we confirmed that this effect is due to integrated complexity along the contour, and does not seem to depend on local stretches of linear structure. The results corroborate the probabilistic model of contours, and show how contour detection can be understood as a special case of a more general process-the identification of organized patterns in the environment.

Impaired identification of impoverished animate but not inanimate objects in adults with high-functioning autism spectrum disorder

The ability to identify animate and inanimate objects from impoverished images was investigated in adults with high-functioning autism spectrum disorder (HFA) and in matched typically developed (TD) adults, using a newly developed task. Consecutive frames were presented containing Gabor elements that slightly changed orientation from one frame to the next. For a subset of elements, the changes were such that these elements gradually formed the outline of an object. Elements enclosed within the object's outline gradually adopted one and the same orientation, outside elements adopted random orientations. The subjective experience was that of an object appearing out of a fog. The HFA group required significantly more frames to identify the impoverished objects than the TD group. Crucially, this difference depended on the nature of the objects: the HFA group required significantly more frames to identify animate objects, but with respect to the identification of inanimate objects the groups did not differ. The groups also did not differ with respect to the number and type of incorrect guesses they made. The results suggest a specific impairment in individuals with HFA in identifying animate objects. A number of possible explanations are discussed.

Component processes in contour integration: a direct comparison between snakes and ladders in a detection and a shape discrimination task

In contour integration, a relevant question is whether snakes and ladders are processed similarly. Higher presentation time thresholds for ladders in detection tasks indicate this is not the case. However, in a detection task only processing differences at the level of element linking and possibly contour localization might be picked up, while differences at the shape encoding level cannot be noticed. In this study, we make a direct comparison of detection and shape discrimination tasks to investigate if processing differences in the visual system between snakes and ladders are limited to contour detection or extend to higher level contour processing, like shape encoding. Stimuli consisted of elements that were oriented collinearly (snakes) or orthogonally (ladders) to the contour path and were surrounded by randomly oriented background elements. In two tasks, six experienced subjects either detected the contour when presented with a contour and a completely random stimulus or performed a shape discrimination task when presented with two contours with different curvature. Presentation time was varied in 9 steps between 8 and 492 ms. By applying a generalized linear mixed model we found that differences in snake and ladder processing are not limited to a detection stage but are also apparent at a shape encoding stage.

Contour integration and aging: the effects of element spacing, orientation alignment and stimulus duration

The ability to extract contours in cluttered visual scenes, which is a crucial step in visual processing, declines with healthy aging, but the reasons for this decline are not well understood. In three experiments, we examined how the effect of aging on contour discrimination varies as a function of contour and distracter inter-element spacing, collinearity, and stimulus duration. Spiral-shaped contours composed of Gabors were embedded within a field of distracter Gabors of uniform density. In a four alternative forced-choice task, younger and older subjects were required to report the global orientation of the contour. In Experiment 1, the absolute contour element spacing varied from two to eight times the Gabor wavelength and contour element collinearity was disrupted with five levels of orientation jitter. Contour discrimination accuracy was lower in older subjects, but the effect of aging did not vary with contour spacing or orientation jitter. Experiment 2 found that decreasing stimulus durations from 0.8 to 0.04 s had a greater effect on older subjects' performance, but only for less salient contours. Experiment 3 examined the effect of the background on contour discrimination by varying the spacing and orientation of the distracter elements for contours with small and large absolute spacing. As in Experiment, the effect of aging did not vary with absolute contour spacing. Decreasing the distracter spacing, however, had a greater detrimental effect on accuracy in older subjects compared to younger subjects. Finally, both groups showed equally high accuracy when all distracters were iso-oriented. In sum, these findings suggest that aging does not affect the sensitivity of contour integration to proximity or collinearity. However, contour integration in older adults is slower and is especially vulnerable when distracters are denser than contour elements.

Paradoxical psychometric functions ("swan functions") are explained by dilution masking in four stimulus dimensions

The visual system dissects the retinal image into millions of local analyses along numerous visual dimensions. However, our perceptions of the world are not fragmentary, so further processes must be involved in stitching it all back together. Simply summing up the responses would not work because this would convey an increase in image contrast with an increase in the number of mechanisms stimulated. Here, we consider a generic model of signal combination and counter-suppression designed to address this problem. The model is derived and tested for simple stimulus pairings (e.g. A + B), but is readily extended over multiple analysers. The model can account for nonlinear contrast transduction, dilution masking, and signal combination at threshold and above. It also predicts nonmonotonic psychometric functions where sensitivity to signal A in the presence of pedestal B first declines with increasing signal strength (paradoxically dropping below 50% correct in two-interval forced choice), but then rises back up again, producing a contour that follows the wings and neck of a swan. We looked for and found these "swan" functions in four different stimulus dimensions (ocularity, space, orientation, and time), providing some support for our proposal.

A common rule for integration and suppression of luminance contrast across eyes, space, time, and pattern

Visual perception begins by dissecting the retinal image into millions of small patches for local analyses by local receptive fields. However, image structures extend well beyond these receptive fields and so further processes must be involved in sewing the image fragments back together to derive representations of higher order (more global) structures. To investigate the integration process, we also need to understand the opposite process of suppression. To investigate both processes together, we measured triplets of dipper functions for targets and pedestals involving interdigitated stimulus pairs (A, B). Previous work has shown that summation and suppression operate over the full contrast range for the domains of ocularity and space. Here, we extend that work to include orientation and time domains. Temporal stimuli were 15-Hz counter-phase sine-wave gratings, where A and B were the positive and negative phases of the oscillation, respectively. For orientation, we used orthogonally oriented contrast patches (A, B) whose sum was an isotropic difference of Gaussians. Results from all four domains could be understood within a common framework in which summation operates separately within the numerator and denominator of a contrast gain control equation. This simple arrangement of summation and counter-suppression achieves integration of various stimulus attributes without distorting the underlying contrast code.

Spatial arrangement in texture discrimination and texture segregation

We investigated the role of spatial arrangement of texture elements in three psychophysical experiments on texture discrimination and texture segregation. In our stimuli, oriented Gabor elements formed an iso-oriented and a randomly oriented texture region. We manipulated (1) the orientation similarity in the iso-oriented region by adding orientation jitter to the orientation of each Gabor; (2) the spatial arrangement of the Gabors: quasi-random or regular; and (3) the shape of the edge between the two texture regions: straight or curved. In Experiment 1, participants discriminated an iso-oriented stimulus from a stimulus with only randomly oriented elements. Experiment 2 required texture segregation to judge the shape of the texture edge. Experiment 3 replicated Experiment 2 with Gabors of a smaller spatial extent in a denser arrangement. We found comparable performance levels with regular and quasi-random Gabor positions in the discrimination task but not in the segregation tasks. We conclude that spatial arrangement plays a role in a texture segregation task requiring shape discrimination of the texture edge but not in a texture discrimination task in which it is sufficient to discriminate an iso-oriented region from a completely random region.

Shape detection of Gaborized outline versions of everyday objects

We previously tested the identifiability of six versions of Gaborized outlines of everyday objects, differing in the orientations assigned to elements inside and outside the outline. We found significant differences in identifiability between the versions, and related a number of stimulus metrics to identifiability [Sassi, M., Vancleef, K., Machilsen, B., Panis, S., & Wagemans, J. (2010). Identification of everyday objects on the basis of Gaborized outline versions. i-Perception, 1(3), 121–142]. In this study, after retesting the identifiability of new variants of three of the stimulus versions, we tested their robustness to local orientation jitter in a detection experiment. In general, our results replicated the key findings from the previous study, and allowed us to substantiate our earlier interpretations of the effects of our stimulus metrics and of the performance differences between the different stimulus versions. The results of the detection task revealed a different ranking order of stimulus versions than the identification task. By examining the parallels and differences between the effects of our stimulus metrics in the two tasks, we found evidence for a trade-off between shape detectability and identifiability. The generally simple and smooth shapes that yield the strongest contour integration and most robust detectability tend to lack the distinguishing features necessary for clear-cut identification. Conversely, contours that do contain such identifying features tend to be inherently more complex and, therefore, yield weaker integration and less robust detectability.

A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization

In 1912, Max Wertheimer published his paper on phi motion, widely recognized as the start of Gestalt psychology. Because of its continued relevance in modern psychology, this centennial anniversary is an excellent opportunity to take stock of what Gestalt psychology has offered and how it has changed since its inception. We first introduce the key findings and ideas in the Berlin school of Gestalt psychology, and then briefly sketch its development, rise, and fall. Next, we discuss its empirical and conceptual problems, and indicate how they are addressed in contemporary research on perceptual grouping and figure-ground organization. In particular, we review the principles of grouping, both classical (e.g., proximity, similarity, common fate, good continuation, closure, symmetry, parallelism) and new (e.g., synchrony, common region, element and uniform connectedness), and their role in contour integration and completion. We then review classic and new image-based principles of figure-ground organization, how it is influenced by past experience and attention, and how it relates to shape and depth perception. After an integrated review of the neural mechanisms involved in contour grouping, border ownership, and figure-ground perception, we conclude by evaluating what modern vision science has offered compared to traditional Gestalt psychology, whether we can speak of a Gestalt revival, and where the remaining limitations and challenges lie. A better integration of this research tradition with the rest of vision science requires further progress regarding the conceptual and theoretical foundations of the Gestalt approach, which is the focus of a second review article.

Towards a new kind of experimental psycho-aesthetics? Reflections on the Parallellepipeda project

Experimental psycho-aesthetics-the science aimed at understanding the factors that determine aesthetic experience-is reviewed briefly as background to describe the Parallellepipeda project, a cross-over project between artists and scientists in Leuven. In particular, I sketch how it started and developed further, with close interactions between the participating artists and scientists. A few examples of specific research projects are mentioned to illustrate the kind of research questions we address and the methodological approach we have taken. We often found an effect of providing participants with additional information, a difference between novice and expert participants, and a shift with increasing experience with an artwork, in the direction of tolerating more complexity and acquiring more order from it. By establishing more connections between parts of an artwork and more associations to the artwork, it becomes a stronger Gestalt, which is more easily mastered by the viewer and leads to increased appreciation. In the final part of the paper, I extract some general lessons from the project regarding a possible new way of doing psycho-aesthetics research, which is able to solve some of the problems of traditional experimental psycho-aesthetics (eg, trade-off between experimental control and ecological validity).

Integrating biological motion: the role of grouping in the perception of point-light actions

The human visual system is highly sensitive to biological motion and manages to organize even a highly reduced point-light stimulus into a vivid percept of human action. The current study investigated to what extent the origin of this saliency of point-light displays is related to its intrinsic Gestalt qualities. In particular, we studied whether biological motion perception is facilitated when the elements can be grouped according to good continuation and similarity as Gestalt principles of perceptual organization. We found that both grouping principles enhanced biological motion perception but their effects differed when stimuli were inverted. These results provide evidence that Gestalt principles of good continuity and similarity also apply to more complex and dynamic meaningful stimuli.

Context modulates the ERP signature of contour integration

We investigated how the electrophysiological signature of contour integration is changed by the context in which a contour is embedded. Specifically, we manipulated the orientations of Gabor elements surrounding an embedded shape outline. The amplitudes of early visual components over posterior scalp regions were changed by the presence of a contour, and by the orientation of elements surrounding the contour. Differences in context type had an effect on the early P1 and N1 components, but not on the later P2 component. The presence of a contour had an effect on the N1 and P2 components, but not on the earlier P1 component. A modulatory effect of context on contour integration was observed on the N1 component. These results highlight the importance of the context in which contour integration takes place.

Encoding of complexity, shape, and curvature by macaque infero-temporal neurons

We recorded responses of macaque infero-temporal (IT) neurons to a stimulus set of Fourier boundary descriptor shapes wherein complexity, general shape, and curvature were systematically varied. We analyzed the response patterns of the neurons to the different stimuli using multidimensional scaling. The resulting neural shape space differed in important ways from the physical, image-based shape space. We found a particular sensitivity for the presence of curved versus straight contours that existed only for the simple but not for the medium and highly complex shapes. Also, IT neurons could linearly separate the simple and the complex shapes within a low-dimensional neural shape space, but no distinction was found between the medium and high levels of complexity. None of these effects could be derived from physical image metrics, either directly or by comparing the neural data with similarities yielded by two models of low-level visual processing (one using wavelet-based filters and one that models position and size invariant object selectivity through four hierarchically organized neural layers). This study highlights the relevance of complexity to IT neural encoding, both as a neurally independently represented shape property and through its influence on curvature detection.