Perception of contours and shapes: Low and intermediate stage mechanisms

2D Geometry Predicts Perceived Visual Curvature in Context-Free Viewing

Planar geometry was exploited for the computation of symmetric visual curves in the image plane, with consistent variations in local parameters such as sagitta, chordlength, and the curves' height-to-width ratio, an indicator of the visual area covered by the curve, also called aspect ratio. Image representations of single curves (no local image context) were presented to human observers to measure their visual sensation of curvature magnitude elicited by a given curve. Nonlinear regression analysis was performed on both the individual and the average data using two types of model: (1) a power function where y (sensation) tends towards infinity as a function of x (stimulus input), most frequently used to model sensory scaling data for sensory continua, and (2) an “exponential rise to maximum” function, which converges towards an asymptotically stable level of y as a function of x. Both models provide satisfactory fits to subjective curvature magnitude as a function of the height-to-width ratio of single curves. The findings are consistent with an in-built sensitivity of the human visual system to local curve geometry, a potentially essential ground condition for the perception of concave and convex objects in the real world.

The neural bases of different levels of action understanding

Many have recently questioned whether all levels of actions understanding, from lower kinematic levels to the higher goal or intention levels of action understanding, are processed in the action observation network (a network of neurons that are active during action execution and observation). A recent study by Wurm and Lingnau (J Neurosci 35: 7727-7735, 2015) gave evidence to the contrary, by showing that higher levels of action understanding are processed in the lateral occipitotemporal cortex. An important next step is to differentiate between the role of the lateral occipitotemporal cortex in processing the visual form of an observed action and the goal of an observed action.

Boundary detection using double-opponency and spatial sparseness constraint

Brightness and color are two basic visual features integrated by the human visual system (HVS) to gain a better understanding of color natural scenes. Aiming to combine these two cues to maximize the reliability of boundary detection in natural scenes, we propose a new framework based on the color-opponent mechanisms of a certain type of color-sensitive double-opponent (DO) cells in the primary visual cortex (V1) of HVS. This type of DO cells has oriented receptive field with both chromatically and spatially opponent structure. The proposed framework is a feedforward hierarchical model, which has direct counterpart to the color-opponent mechanisms involved in from the retina to V1. In addition, we employ the spatial sparseness constraint (SSC) of neural responses to further suppress the unwanted edges of texture elements. Experimental results show that the DO cells we modeled can flexibly capture both the structured chromatic and achromatic boundaries of salient objects in complex scenes when the cone inputs to DO cells are unbalanced. Meanwhile, the SSC operator further improves the performance by suppressing redundant texture edges. With competitive contour detection accuracy, the proposed model has the additional advantage of quite simple implementation with low computational cost.

Effect of the small-world structure on encoding performance in the primary visual cortex: an electrophysiological and modeling analysis

The biological networks have been widely reported to present small-world properties. However, the effects of small-world network structure on population's encoding performance remain poorly understood. To address this issue, we applied a small world-based framework to quantify and analyze the response dynamics of cell assemblies recorded from rat primary visual cortex, and further established a population encoding model based on small world-based generalized linear model (SW-GLM). The electrophysiological experimental results show that the small world-based population responses to different topological shapes present significant variation (t test, p < 0.01; effect size: Hedge's g > 0.8), while no significant variation was found for control networks without considering their spatial connectivity (t test, p > 0.05; effect size: Hedge's g < 0.5). Furthermore, the numerical experimental results show that the predicted response under SW-GLM is more accurate and reliable compared to the control model without small-world structure, and the decoding performance is also improved about 10 % by taking the small-world structure into account. The above results suggest the important role of the small-world neural structure in encoding visual information for the neural population by providing electrophysiological and theoretical evidence, respectively. The study helps greatly to well understand the population encoding mechanisms of visual cortex.

Collinear facilitation and contour integration in autism: evidence for atypical visual integration

Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by impaired social interaction, atypical communication and a restricted repertoire of interests and activities. Altered sensory and perceptual experiences are also common, and a notable perceptual difference between individuals with ASD and controls is their superior performance in visual tasks where it may be beneficial to ignore global context. This superiority may be the result of atypical integrative processing. To explore this claim we investigated visual integration in adults with ASD (diagnosed with Asperger's Syndrome) using two psychophysical tasks thought to rely on integrative processing-collinear facilitation and contour integration. We measured collinear facilitation at different flanker orientation offsets and contour integration for both open and closed contours. Our results indicate that compared to matched controls, ASD participants show (i) reduced collinear facilitation, despite equivalent performance without flankers; and (ii) less benefit from closed contours in contour integration. These results indicate weaker visuospatial integration in adults with ASD and suggest that further studies using these types of paradigms would provide knowledge on how contextual processing is altered in ASD.

Multifeature-based surround inhibition improves contour detection in natural images

To effectively perform visual tasks like detecting contours, the visual system normally needs to integrate multiple visual features. Sufficient physiological studies have revealed that for a large number of neurons in the primary visual cortex (V1) of monkeys and cats, neuronal responses elicited by the stimuli placed within the classical receptive field (CRF) are substantially modulated, normally inhibited, when difference exists between the CRF and its surround, namely, non-CRF, for various local features. The exquisite sensitivity of V1 neurons to the center-surround stimulus configuration is thought to serve important perceptual functions, including contour detection. In this paper, we propose a biologically motivated model to improve the performance of perceptually salient contour detection. The main contribution is the multifeature-based center-surround framework, in which the surround inhibition weights of individual features, including orientation, luminance, and luminance contrast, are combined according to a scale-guided strategy, and the combined weights are then used to modulate the final surround inhibition of the neurons. The performance was compared with that of single-cue-based models and other existing methods (especially other biologically motivated ones). The results show that combining multiple cues can substantially improve the performance of contour detection compared with the models using single cue. In general, luminance and luminance contrast contribute much more than orientation to the specific task of contour extraction, at least in gray-scale natural images.

Discriminating facial expressions of emotion and its link with perceiving visual form in Parkinson's disease

We investigated the link between the ability to perceive facial expressions of emotion and the ability to perceive visual form in Parkinson's disease (PD). We assessed in individuals with PD and healthy controls the ability to discriminate graded intensities of facial expressions of anger from neutral expressions and the ability to discriminate radial frequency (RF) patterns with modulations in amplitude from a perfect circle. Those with PD were, as a group, impaired relative to controls in discriminating graded intensities of angry from neutral expressions and discriminating modulated amplitudes of RF patterns from perfect circles; these two abilities correlated positively and moderately to highly, even after removing the variance that was shared with disease progression and general cognitive functioning. The results indicate that the impaired ability to perceive visual form is likely to contribute to the impaired ability to perceive facial expressions of emotion in PD, and that both are related to the progression of the disease.

Parallel processing in the brain's visual form system: an fMRI study

We here extend and complement our earlier time-based, magneto-encephalographic (MEG), study of the processing of forms by the visual brain (Shigihara and Zeki, 2013) with a functional magnetic resonance imaging (fMRI) study, in order to better localize the activity produced in early visual areas when subjects view simple geometric stimuli of increasing perceptual complexity (lines, angles, rhombuses) constituted from the same elements (lines). Our results show that all three categories of form activate all three visual areas with which we were principally concerned (V1–V3), with angles producing the strongest and rhombuses the weakest activity in all three. The difference between the activity produced by angles and rhombuses was significant, that between lines and rhombuses was trend significant while that between lines and angles was not. Taken together with our earlier MEG results, the present ones suggest that a parallel strategy is used in processing forms, in addition to the well-documented hierarchical strategy.

The development of contour processing: evidence from physiology and psychophysics

Object perception and pattern vision depend fundamentally upon the extraction of contours from the visual environment. In adulthood, contour or edge-level processing is supported by the Gestalt heuristics of proximity, collinearity, and closure. Less is known, however, about the developmental trajectory of contour detection and contour integration. Within the physiology of the visual system, long-range horizontal connections in V1 and V2 are the likely candidates for implementing these heuristics. While post-mortem anatomical studies of human infants suggest that horizontal interconnections reach maturity by the second year of life, psychophysical research with infants and children suggests a considerably more protracted development. In the present review, data from infancy to adulthood will be discussed in order to track the development of contour detection and integration. The goal of this review is thus to integrate the development of contour detection and integration with research regarding the development of underlying neural circuitry. We conclude that the ontogeny of this system is best characterized as a developmentally extended period of associative acquisition whereby horizontal connectivity becomes functional over longer and longer distances, thus becoming able to effectively integrate over greater spans of visual space.

Bayesian integration of position and orientation cues in perception of biological and non-biological forms

Visual form analysis is fundamental to shape perception and likely plays a central role in perception of more complex dynamic shapes, such as moving objects or biological motion. Two primary form-based cues serve to represent the overall shape of an object: the spatial position and the orientation of locations along the boundary of the object. However, it is unclear how the visual system integrates these two sources of information in dynamic form analysis, and in particular how the brain resolves ambiguities due to sensory uncertainty and/or cue conflict. In the current study, we created animations of sparsely-sampled dynamic objects (human walkers or rotating squares) comprised of oriented Gabor patches in which orientation could either coincide or conflict with information provided by position cues. When the cues were incongruent, we found a characteristic trade-off between position and orientation information whereby position cues increasingly dominated perception as the relative uncertainty of orientation increased and vice versa. Furthermore, we found no evidence for differences in the visual processing of biological and non-biological objects, casting doubt on the claim that biological motion may be specialized in the human brain, at least in specific terms of form analysis. To explain these behavioral results quantitatively, we adopt a probabilistic template-matching model that uses Bayesian inference within local modules to estimate object shape separately from either spatial position or orientation signals. The outputs of the two modules are integrated with weights that reflect individual estimates of subjective cue reliability, and integrated over time to produce a decision about the perceived dynamics of the input data. Results of this model provided a close fit to the behavioral data, suggesting a mechanism in the human visual system that approximates rational Bayesian inference to integrate position and orientation signals in dynamic form analysis.

Shape beyond recognition: form-derived directionality and its effects on visual attention and motion perception

The shape of an object restricts its movements and therefore its future location. The rules governing selective sampling of the environment likely incorporate any available data, including shape, that provide information about where important things are going to be in the near future so that the object can be located, tracked, and sampled for information. We asked people to assess in which direction several novel objects pointed or directed them. With independent groups of people, we investigated whether their attention and sense of motion were systematically biased in this direction. Our work shows that nearly any novel object has intrinsic directionality derived from its shape. This shape information is swiftly and automatically incorporated into the allocation of overt and covert visual orienting and the detection of motion, processes that themselves are inherently directional. The observed connection between form and space suggests that shape processing goes beyond recognition alone and may help explain why shape is a relevant dimension throughout the visual brain.

Visual search targeting either local or global perceptual processes differs as a function of autistic-like traits in the typically developing population

Relative to low scorers, high scorers on the autism-spectrum quotient (AQ) show enhanced performance on the embedded figures test and the radial frequency search task (RFST), which has been attributed to both enhanced local processing and differences in combining global percepts. We investigate the role of local and global processing further using the RFST in four experiments. High AQ adults maintained a consistent advantage in search speed across diverse target-distracter stimulus conditions. This advantage may reflect enhanced local processing of curvature in early stages of the form vision pathway and superior global detection of shape primitives. However, more probable is the presence of a superior search process that enables a consistent search advantage at both levels of processing.

Component processes in contour integration: a direct comparison between snakes and ladders in a detection and a shape discrimination task

In contour integration, a relevant question is whether snakes and ladders are processed similarly. Higher presentation time thresholds for ladders in detection tasks indicate this is not the case. However, in a detection task only processing differences at the level of element linking and possibly contour localization might be picked up, while differences at the shape encoding level cannot be noticed. In this study, we make a direct comparison of detection and shape discrimination tasks to investigate if processing differences in the visual system between snakes and ladders are limited to contour detection or extend to higher level contour processing, like shape encoding. Stimuli consisted of elements that were oriented collinearly (snakes) or orthogonally (ladders) to the contour path and were surrounded by randomly oriented background elements. In two tasks, six experienced subjects either detected the contour when presented with a contour and a completely random stimulus or performed a shape discrimination task when presented with two contours with different curvature. Presentation time was varied in 9 steps between 8 and 492 ms. By applying a generalized linear mixed model we found that differences in snake and ladder processing are not limited to a detection stage but are also apparent at a shape encoding stage.

Adaptation to implied tilt: extensive spatial extrapolation of orientation gradients

To extract the global structure of an image, the visual system must integrate local orientation estimates across space. Progress is being made toward understanding this integration process, but very little is known about whether the presence of structure exerts a reciprocal influence on local orientation coding. We have previously shown that adaptation to patterns containing circular or radial structure induces tilt-aftereffects (TAEs), even in locations where the adapting pattern was occluded. These spatially “remote” TAEs have novel tuning properties and behave in a manner consistent with adaptation to the local orientation implied by the circular structure (but not physically present) at a given test location. Here, by manipulating the spatial distribution of local elements in noisy circular textures, we demonstrate that remote TAEs are driven by the extrapolation of orientation structure over remarkably large regions of visual space (more than 20°). We further show that these effects are not specific to adapting stimuli with polar orientation structure, but require a gradient of orientation change across space. Our results suggest that mechanisms of visual adaptation exploit orientation gradients to predict the local pattern content of unfilled regions of space.

Impaired texture segregation but spared contour integration following damage to right posterior parietal cortex

We examined the relations between texture segregation and contour integration in patients with deficits in spatial attention leading to left or right hemisphere extinction. Patients and control participants were presented with texture and contour stimuli consisting of oriented elements. We induced regularity in the stimuli by manipulating the element orientations resulting in an implicit texture border or explicit contour. Participants had to discriminate curved from straight shapes without making eye movements, while the stimulus presentation time was varied using a QUEST procedure. The results showed that only patients with right hemisphere extinction had a spatial bias, needing a longer presentation time to determine the shape of the border or contour on the contralesional side, especially for borders defined by texture. These results indicate that texture segregation is modulated by attention-related brain areas in the right posterior parietal cortex.

Abnormal contextual modulation of visual contour detection in patients with schizophrenia

Schizophrenia patients demonstrate perceptual deficits consistent with broad dysfunction in visual context processing. These include poor integration of segments forming visual contours, and reduced visual contrast effects (e.g. weaker orientation-dependent surround suppression, ODSS). Background image context can influence contour perception, as stimuli near the contour affect detection accuracy. Because of ODSS, this contextual modulation depends on the relative orientation between the contour and flanking elements, with parallel flankers impairing contour perception. However in schizophrenia, the impact of abnormal ODSS during contour perception is not clear. It is also unknown whether deficient contour perception marks genetic liability for schizophrenia, or is strictly associated with clinical expression of this disorder. We examined contour detection in 25 adults with schizophrenia, 13 unaffected first-degree biological relatives of schizophrenia patients, and 28 healthy controls. Subjects performed a psychophysics experiment designed to quantify the effect of flanker orientation during contour detection. Overall, patients with schizophrenia showed poorer contour detection performance than relatives or controls. Parallel flankers suppressed and orthogonal flankers enhanced contour detection performance for all groups, but parallel suppression was relatively weaker for schizophrenia patients than healthy controls. Relatives of patients showed equivalent performance with controls. Computational modeling suggested that abnormal contextual modulation in schizophrenia may be explained by suppression that is more broadly tuned for orientation. Abnormal flanker suppression in schizophrenia is consistent with weaker ODSS and/or broader orientation tuning. This work provides the first evidence that such perceptual abnormalities may not be associated with a genetic liability for schizophrenia.

Set-size effects for sampled shapes: experiments and model

The location of imperfections or heterogeneities in shapes and contours often correlates with points of interest in a visual scene. Investigating the detection of such heterogeneities provides clues as to the mechanisms processing simple shapes and contours. We determined set-size effects (e.g., sensitivity to single target detection as distractor number increases) for sampled contours to investigate how the visual system combines information across space. Stimuli were shapes sampled by oriented Gabor patches: circles and high-amplitude RF4 and RF8 radial frequency patterns with Gabor orientations tangential to the shape. Subjects had to detect a deviation in orientation of one element ("heterogeneity"). Heterogeneity detection sensitivity was measured for a range (7-40) of equally spaced (2.3-0.4°) elements. In a second condition, performance was measured when elements sampled a part of the shapes. We either varied partial contour length for a fixed (7) set-size, co-varying inter-element spacing, or set-size for a fixed spacing (0.7°), co-varying partial contour length. Surprisingly, set-size effects (poorer performance with more elements) are rarely seen. Set-size effects only occur for shapes containing concavities (RF4 and RF8) and when spacing is fixed. When elements are regularly spaced, detection performance improves with set-size for all shapes. When set-size is fixed and spacing varied, performance improves with decreasing spacing. Thus, when an increase in set-size and a decrease in spacing co-occur, the effect of spacing dominates, suggesting that inter-element spacing, not set-size, is the critical parameter for sampled shapes. We propose a model for the processing of simple shapes based on V4 curvature units with late noise, incorporating spacing, average shape curvature, and the number of segments with constant sign of curvature contained in the shape, which accurately accounts for our experimental results, making testable predictions for a variety of simple shapes.

Detecting shapes in noise: tuning characteristics of global shape mechanisms

The proportion of signal elements embedded in noise needed to detect a signal is a standard tool for investigating motion perception. This paradigm was applied to the shape domain to determine how local information is pooled into a global percept. Stimulus arrays consisted of oriented Gabor elements that sampled the circumference of concentric radial frequency (RF) patterns. Individual Gabors were oriented tangentially to the shape (signal) or randomly (noise). In different conditions, signal elements were located randomly within the entire array or constrained to fall along one of the concentric contours. Coherence thresholds were measured for RF patterns with various frequencies (number of corners) and amplitudes (“sharpness” of corners). Coherence thresholds (about 10% = 15 elements) were lowest for circular shapes. Manipulating shape frequency or amplitude showed a range where thresholds remain unaffected (frequency ≤ RF4; amplitude ≤ 0.05). Increasing either parameter caused thresholds to rise. Compared to circles, thresholds increased by approximately four times for RF13 and five times for amplitudes of 0.3. Confining the signals to individual contours significantly reduced the number of elements needed to reach threshold (between 4 and 6), independent of the total number of elements on the contour or contour shape. Finally, adding external noise to the orientation of the elements had a greater effect on detection thresholds than adding noise to their position. These results provide evidence for a series of highly sensitive, shape-specific analysers which sum information globally but only from within specific annuli. These global mechanisms are tuned to position and orientation of local elements from which they pool information. The overall performance for arrays of elements can be explained by the sensitivity of multiple, independent concentric shape detectors rather than a single detector integrating information widely across space (e.g. Glass pattern detector).

Detecting global form: separate processes required for Glass and radial frequency patterns

Global processing of form information has been studied extensively using both Glass and radial frequency (RF) patterns. Models, with common early stages, have been proposed for the detection of properties of both pattern types but human performance has not been examined to determine whether the two pattern types interact in the manner this would suggest. The experiments here investigated whether low RF patterns and concentric Glass patterns, which are thought to tap the same level of processing in form-vision, are detected by a common mechanism. Six observers participated in two series of masking experiments. First: sensitivity to the presence of either coherent structure, or contour deformation, was assessed. The computational model predicted that detection of one pattern would be masked by the other. Second: a further experiment examined position coding. The model predicted that localizing the center of form in a Glass pattern would be affected by the presence of an RF pattern: sensitivity to a change of location should be reduced and the apparent location should be drawn toward the center of the masking pattern. However, the results observed in all experiments were inconsistent with the interaction predicted by the models, suggesting that separate neural mechanisms for global processing of signal are required to process these two patterns, and also indicating that the models need to be altered to preclude the interactions that were predicted but not obtained.

Shape detection of Gaborized outline versions of everyday objects

We previously tested the identifiability of six versions of Gaborized outlines of everyday objects, differing in the orientations assigned to elements inside and outside the outline. We found significant differences in identifiability between the versions, and related a number of stimulus metrics to identifiability [Sassi, M., Vancleef, K., Machilsen, B., Panis, S., & Wagemans, J. (2010). Identification of everyday objects on the basis of Gaborized outline versions. i-Perception, 1(3), 121–142]. In this study, after retesting the identifiability of new variants of three of the stimulus versions, we tested their robustness to local orientation jitter in a detection experiment. In general, our results replicated the key findings from the previous study, and allowed us to substantiate our earlier interpretations of the effects of our stimulus metrics and of the performance differences between the different stimulus versions. The results of the detection task revealed a different ranking order of stimulus versions than the identification task. By examining the parallels and differences between the effects of our stimulus metrics in the two tasks, we found evidence for a trade-off between shape detectability and identifiability. The generally simple and smooth shapes that yield the strongest contour integration and most robust detectability tend to lack the distinguishing features necessary for clear-cut identification. Conversely, contours that do contain such identifying features tend to be inherently more complex and, therefore, yield weaker integration and less robust detectability.

The human visual system uses a global closure mechanism

Research asserting that the visual system instantiates a global closure heuristic in contour integration has been challenged by an argument that behaviorally-detected closure enhancement could be accounted for by low-level local mechanisms driven by collinearity or "good continuation" interacting with proximity. The present study investigated this issue in three experiments. Exp. 1 compared the visibility of closed and open contours using circles and S-contours from low to moderately high angles of path curvature in a temporal alternative-forced choice task. Circles were more detectable than S-contours, an effect that increased with curvature. The closure enhancement observed can, however, be explained by the fact that circles contain more 'contiguity' than S-contours. Additional tests added discontinuities to otherwise closed paths to control for the effects of good continuation and closure independently. Exp. 2 compared the visibility of incomplete circles (C-contours) and S-contours derived from the full circles and S-contours in Exp. 1. Exp. 3a compared the visibility of arc pairs arranged in an enclosed position similar to "()" and a non-enclosed position similar to ")(". Results consistently showed enhanced visibility of contour configurations enclosing a region even after controlling for differences in contiguity and changes of curvature direction. A control test (Exp. 3b) demonstrated that the gap in the contours of Exp. 3a was too large to be bridged by local-level collinearity/proximity alone. The combination of good continuation and proximity alone does not explain the closure effects observed across these tests, as demonstrated through the application of a Bayesian model of collinearity and proximity (Geisler et al., 2001) to the stimuli in Exps. 3a and 3b. These results argue for the presence of a global closure-driven contour enhancing mechanism in human vision.

The spatial range of contour integration deficits in schizophrenia

Contour integration (CI) refers to the process that represents spatially separated elements as a unified edge or closed shape. Schizophrenia is a psychiatric disorder characterized by symptoms such as hallucinations, delusions, disorganized thinking, inappropriate affect, and social withdrawal. Persons with schizophrenia are impaired at CI, but the specific mechanisms underlying the deficit are still not clear. Here, we explored the hypothesis that poor patient performance owes to reduced feedback or impaired longer-range lateral connectivity within early visual cortex--functionally similar to that found in 5- to 6-year old children. This hypothesis predicts that as target element spacing increases from .7 to 1.4° of visual angle, patient impairments will become more pronounced. As a test of the prediction, 25 healthy controls and 36 clinically stable, asymptomatic persons with schizophrenia completed a CI task that involved determining whether a subset of Gabor elements formed a leftward or rightward pointing shape. Adjacent shape elements were spaced at either .7 or 1.4° of visual angle. Difficulty in each spacing condition depended on the number of noise elements present. Patients performed worse than controls overall, both groups performed worse with the larger spacing, and the magnitude of the between-group difference was not amplified at the larger spacing. These results show that CI deficits in schizophrenia cannot be explained in terms of a reduced spatial range of integration, at least not when the shape elements are spaced within 1.5°. Later-developing, low-level integrative mechanisms of lateral connectivity and feedback appear not to be differentially impaired in the illness.

Influence of background on precision of 3D depth judgment tasks in a real environment

Presently, little is known about the effect of curved backgrounds against which the target stimulus is presented on precision in stereoacuity. The experiment analyzed the influence of stimulus orientation and 3D background configuration on stereoscopic vision. Participants were instructed to perform 3D visual alignment tasks on a modified version of the Howard-Dolman apparatus, whereupon precision in depth perception for different curved backgrounds (flat, black, concave, and convex) was evaluated. In addition, the influence of stimulus orientation (0 degrees, 45 degrees, and 90 degrees) on precision was examined. The findings revealed an underestimation in the perceived depth in all background configurations, indicating highest and lowest precision outcomes for convex and concave backgrounds, respectively. In addition, a significant interaction of background and orientation was found. It was concluded that, in a real environment, background local depth cues are integrated with target stimuli to contribute to depth perception.

Increased surround modulation of perceived contrast in the elderly

PURPOSE

The appearance of a stimulus depends on its background, with high-contrast backgrounds resulting in lower perceived contrast. Increased perceptual surround suppression effects have been reported in the elderly. Our experiments tested whether enhanced surround suppression in the elderly arises because of age-dependent differences in brightness induction mechanisms that are sensitive to phase information at the border of the central stimulus.

METHODS

Fifteen younger (18 to 33 years) and 18 older (61 to 84 years) adults participated. Using a method of constant stimuli, perceived contrast was measured for a sine wave grating with and without an annular surround. Annuli were either in-phase with the central grating (suppresses the perceived central contrast) or out-of-phase (typically enhances perceived central contrast). The experiment was repeated using stimuli where the contrast was reduced for younger observers to approximately match the effective contrast available to older adults.

RESULTS

With the surround present, the older group matched the contrast of the central target to an average lower contrast than younger adults [F(1,31) = 17.4, p < 0.001]. The magnitude of contrast suppression differences between older and younger observers was invariant of annulus grating phase [F(1,31) = 0.036, p = 0.85] and was of similar magnitude when the stimuli were approximately matched between groups for differences in contrast detection [F(1,31) = 0.06, p = 0.81].

CONCLUSIONS

Normal ageing increases perceived contrast surround suppression, irrespective of information at the stimulus border between center and surround. Conditions that result in perceived contrast enhancement on average in younger adults result in contrast suppression in the elderly. Our findings suggest that age-related differences are likely in the appearance of objects in natural environments where background contrast varies.

Arc length-based aspect ratio selection

The aspect ratio of a plot has a dramatic impact on our ability to perceive trends and patterns in the data. Previous approaches for automatically selecting the aspect ratio have been based on adjusting the orientations or angles of the line segments in the plot. In contrast, we recommend a simple, effective method for selecting the aspect ratio: minimize the arc length of the data curve while keeping the area of the plot constant. The approach is parameterization invariant, robust to a wide range of inputs, preserves visual symmetries in the data, and is a compromise between previously proposed techniques. Further, we demonstrate that it can be effectively used to select the aspect ratio of contour plots. We believe arc length should become the default aspect ratio selection method.

Atypical lateral connectivity: a neural basis for altered visuospatial processing in autism

BACKGROUND

Autistic perception encompasses both inferior and superior performance on different types of visuospatial tasks. Influential neurocognitive models relevant to atypical perception (i.e., weak central coherence, enhanced perceptual functioning) can, to differing degrees, account for these findings. However, the neural underpinnings mediating atypical visuospatial autistic perception have yet to be elucidated.

METHODS

In the present study, we used a lateral masking paradigm to assess the functional integrity of lateral interactions mediating visuospatial information processing within early visual areas of autistic (n = 18) and nonautistic (n = 15) observers. Detection thresholds were measured for centrally presented Gabor targets flanked collinearly at different distances (experiment 1) and flanked orthogonally at different contrasts (experiment 2).

RESULTS

Autistic and nonautistic groups showed increased target sensitivity when the distance between collinear targets and flankers was small (3 lambda) but not large (6 lambda). However, the effect of small-distance facilitation was significantly greater for the autistic group. In addition, we observed a group-specific effect of contrast: in the autistic group, target sensitivity was enhanced by low flanker contrasts of both 5% and 10% luminance difference, whereas for the nonautistic group, this effect occurred at 10% contrast only.

CONCLUSIONS

These findings support the idea that atypical visuospatial perception in autism may originate from altered lateral connectivity within primary visual areas, differentially affecting perception at the earliest levels of feature extraction.

Model cortical association fields account for the time course and dependence on target complexity of human contour perception

Can lateral connectivity in the primary visual cortex account for the time dependence and intrinsic task difficulty of human contour detection? To answer this question, we created a synthetic image set that prevents sole reliance on either low-level visual features or high-level context for the detection of target objects. Rendered images consist of smoothly varying, globally aligned contour fragments (amoebas) distributed among groups of randomly rotated fragments (clutter). The time course and accuracy of amoeba detection by humans was measured using a two-alternative forced choice protocol with self-reported confidence and variable image presentation time (20-200 ms), followed by an image mask optimized so as to interrupt visual processing. Measured psychometric functions were well fit by sigmoidal functions with exponential time constants of 30-91 ms, depending on amoeba complexity. Key aspects of the psychophysical experiments were accounted for by a computational network model, in which simulated responses across retinotopic arrays of orientation-selective elements were modulated by cortical association fields, represented as multiplicative kernels computed from the differences in pairwise edge statistics between target and distractor images. Comparing the experimental and the computational results suggests that each iteration of the lateral interactions takes at least ms of cortical processing time. Our results provide evidence that cortical association fields between orientation selective elements in early visual areas can account for important temporal and task-dependent aspects of the psychometric curves characterizing human contour perception, with the remaining discrepancies postulated to arise from the influence of higher cortical areas.

Current computer vision algorithms reproducing the feed-forward features of the primate visual pathway still fall far behind the capabilities of human subjects in detecting objects in cluttered backgrounds. Here we investigate the possibility that recurrent lateral interactions, long hypothesized to form cortical association fields, can account for the dependence of object detection accuracy on shape complexity and image exposure time. Cortical association fields are thought to aid object detection by reinforcing global image features that cannot easily be detected by single neurons in feed-forward models. Our implementation uses the spatial arrangement, relative orientation, and continuity of putative contour elements to compute the lateral contextual support. We designed synthetic images that allowed us to control object shape and background clutter while eliminating unintentional cues to the presence of an otherwise hidden target. In contrast, real objects can vary uncontrollably in shape, are camouflaged to different degrees by background clutter, and are often associated with non-shape cues, making results using natural image sets difficult to interpret. Our computational model of cortical association fields matches many aspects of the time course and object detection accuracy of human subjects on statistically identical synthetic image sets. This implies that lateral interactions may selectively reinforce smooth object global boundaries.

The same binding in contour integration and crowding

Binding of features helps object recognition in contour integration but hinders it in crowding. In contour integration, aligned adjacent objects group together to form a path. In crowding, flanking objects make the target unidentifiable. However, to date, the two tasks have only been studied separately. K. A. May and R. F. Hess (2007) suggested that the same binding mediates both tasks. To test this idea, we ask observers to perform two different tasks with the same stimulus. We present oriented grating patches that form a "snake letter" in the periphery. Observers report either the identity of the whole letter (contour integration task) or the phase of one of the grating patches (crowding task). We manipulate the strength of binding between gratings by varying the alignment between them, i.e., the Gestalt goodness of continuation, measured as "wiggle." We find that better alignment strengthens binding, which improves contour integration and worsens crowding. Observers show equal sensitivity to alignment in these two very different tasks, suggesting that the same binding mechanism underlies both phenomena. It has been claimed that grouping among flankers reduces their crowding of the target. Instead, we find that these published cases of weak crowding are due to weak binding resulting from target-flanker misalignment. We conclude that crowding is mediated solely by the grouping of flankers with the target and is independent of grouping among flankers.

Encoding of complexity, shape, and curvature by macaque infero-temporal neurons

We recorded responses of macaque infero-temporal (IT) neurons to a stimulus set of Fourier boundary descriptor shapes wherein complexity, general shape, and curvature were systematically varied. We analyzed the response patterns of the neurons to the different stimuli using multidimensional scaling. The resulting neural shape space differed in important ways from the physical, image-based shape space. We found a particular sensitivity for the presence of curved versus straight contours that existed only for the simple but not for the medium and highly complex shapes. Also, IT neurons could linearly separate the simple and the complex shapes within a low-dimensional neural shape space, but no distinction was found between the medium and high levels of complexity. None of these effects could be derived from physical image metrics, either directly or by comparing the neural data with similarities yielded by two models of low-level visual processing (one using wavelet-based filters and one that models position and size invariant object selectivity through four hierarchically organized neural layers). This study highlights the relevance of complexity to IT neural encoding, both as a neurally independently represented shape property and through its influence on curvature detection.

Awareness becomes necessary between adaptive pattern coding of open and closed curvatures

Visual pattern processing becomes increasingly complex along the ventral pathway, from the low-level coding of local orientation in the primary visual cortex to the high-level coding of face identity in temporal visual areas. Previous research using pattern aftereffects as a psychophysical tool to measure activation of adaptive feature coding has suggested that awareness is relatively unimportant for the coding of orientation, but awareness is crucial for the coding of face identity. We investigated where along the ventral visual pathway awareness becomes crucial for pattern coding. Monoptic masking, which interferes with neural spiking activity in low-level processing while preserving awareness of the adaptor, eliminated open-curvature aftereffects but preserved closed-curvature aftereffects. In contrast, dichoptic masking, which spares spiking activity in low-level processing while wiping out awareness, preserved open-curvature aftereffects but eliminated closed-curvature aftereffects. This double dissociation suggests that adaptive coding of open and closed curvatures straddles the divide between weakly and strongly awareness-dependent pattern coding.

Global shape processing involves a hierarchy of integration stages

Radial Frequency (RF) patterns can be used to study the processing of familiar shapes, e.g. triangles and squares. Opinion is divided over whether the mechanisms that detect these shapes integrate local orientation and position information directly, or whether local orientations and positions are first combined to represent extended features, such as curves, and that it is local curvatures that the shape mechanism integrates. The latter view incorporates an intermediate processing stage, the former does not. To differentiate between these hypotheses we studied the processing of micro-patch sampled RF patterns as a function of the luminance polarity of successive elements on the contour path. Our first study measures shape after effects involving suprathreshold amplitude RF shapes and shows that alternating the luminance polarity of successive micro-patch elements disrupts adaptation of the global shape. Our second study shows that polarity alternations also disrupt sensitivity to threshold-amplitude RF patterns. These results suggest that neighbouring points of the contour shape are integrated into extended features by a polarity selective mechanism, prior to global shape processing, consistent with the view that for both threshold amplitude and suprathreshold amplitude patterns, global processing of RF shapes involves an intermediate stage of processing.

Differential effect of contrast polarity reversals in closed squares and open L-junctions

Scene segmentation depends on interaction between geometrical and photometric factors. It has been shown that reversals in contrast polarity at points of highest orientation discontinuity along closed contours significantly impair shape discrimination performance, while changes in contrast polarity at straight(er) contour segments do not have such deleterious effects (Spehar, 2002). Here we employ (semi) high resolution fMRI (1.5 mm × 1.5 mm × 1.5 mm) to investigate the neuronal substrate underlying these perception effects. Stimuli consisted of simple elements (a) squares with contrast reversals along straight segments; (b) squares with contrast reversals in the corner (highest orientation discontinuity); (c) L-Junctions with contrast reversals along the straight ends; (d) L-Junctions with contrast reversals in the corner. Element with contrast polarity reversals are easy to distinguish though appear geometrically equivalent. For squares with contrast polarity reversals only along straight lines we find significantly lower BOLD modulation compared to any of the control conditions, which show similar responses to each other. In the light of previous psychophysical work (Elder and Zucker, 1993; Spehar, 2002) we speculate that this effect is due to closure perception. We observe this across a wide range of areas on occipital cortex.

High-frequency oscillatory response to illusory contour in typically developing boys and boys with autism spectrum disorders

Illusory contour (IC) perception, a fruitful model for studying the automatic contextual integration of local image features, can be used to investigate the putative impairment of such integration in children with autism spectrum disorders (ASD). We used the illusory Kanizsa square to test how the phase-locked (PL) gamma and beta electroencephalogram (EEG) responses of typically developing (TD) children aged 3-7 years and those with ASD were modulated by the presence of IC in the image. The PL beta and gamma activity strongly differentiated between IC and control figures in both groups of children (IC effect). However, the timing, topography, and direction of the IC effect differed in TD and ASD children. Between 40 msec and 120 msec after stimulus onset, both groups demonstrated lower power of gamma oscillations at occipital areas in response to IC than in response to the control figure. In TD children, this relative gamma suppression was followed by relatively higher parieto-occipital gamma and beta responses to IC within 120-270 msec after stimulus onset. This second stage of IC processing was absent in children with ASD. Instead, their response to IC was characterized by protracted (40-270 msec) relative reduction of gamma and beta oscillations at occipital areas. We hypothesize that children with ASD rely more heavily on lower-order processing in the primary visual areas and have atypical later stage related to higher-order processes of contour integration.

Estimating the usefulness of distorted natural images using an image contour degradation measure

Quality estimators aspire to quantify the perceptual resemblance, but not the usefulness, of a distorted image when compared to a reference natural image. However, humans can successfully accomplish tasks (e.g., object identification) using visibly distorted images that are not necessarily of high quality. A suite of novel subjective experiments reveals that quality does not accurately predict utility (i.e., usefulness). Thus, even accurate quality estimators cannot accurately estimate utility. In the absence of utility estimators, leading quality estimators are assessed as both quality and utility estimators and dismantled to understand those image characteristics that distinguish utility from quality. A newly proposed utility estimator demonstrates that a measure of contour degradation is sufficient to accurately estimate utility and is argued to be compatible with shape-based theories of object perception.

Mechanisms underlying the representation of angles embedded within contour stimuli in area V2 of macaque monkeys

We previously found that surprisingly many V2 neurons showed selective responses to particular angles embedded within continuous contours [M. Ito & H. Komatsu (2004)Journal of Neuroscience, 24, 3313-3324]. Here, we addressed whether the selectivity is dependent on the presence of individual constituent components or on the unique combination of these components. To reveal roles of constituent half-lines in response to whole angles, we conducted a quantitative model study after the framework of cascade models. Our linear-non-linear summation model implemented a few subunits selective to particular half-lines and was fitted to neuronal responses for each neuron. The study indicates that the best-fitting models well replicate the selectivity in the majority of V2 neurons and that the angle selectivity is dependent on a linear combination of responses to individual half-line components of the angles. The implication is that optimal angles are given by a combination of two preferred half-line components and the selectivity is sharpened by introducing suppression to non-preferred half-line components, rather than a specific facilitatory interaction between two preferred half-line components. The study indicates the participation of the gain control of responsiveness according to the number of half-line components. We also showed that the selectivity to acute angles depends on a combination of responses to one preferred component and weak responses to another component. Therefore, we concluded that the angle selectivity is dependent on selective responses to individual half-line components of the angles rather than a unique combination between them, whereas neurons could be selective to various angle widths at area V2.

Visual detection and identification are not the same: evidence from psychophysics and fMRI

Sometimes object detection as opposed to identification is sufficient to initiate the appropriate action. To explore the neural origin of behavioural differences between the two tasks, we combine psychophysical measurements and fMRI, specifically contrasting shape detection versus identification of a figure. This figure consisted of Gabor elements being oriented differently from those in the background. We equalized performance levels for detection and identification by adjusting orientation differences accordingly for each observer. Hence, stimulus saliency was constant for both tasks allowing a differentiation between the activations specific for detection versus identification processes. Identification yielded higher psychophysical thresholds, slower reaction times and increased hemodynamic activations in the lateral-occipital complex (LOC) and an adjacent area in the collateral sulcus (CoS). Additional analysis using cortex-based alignment revealed four voxel-clusters differentially activated by the tasks, situated in the inferior parietal lobe, the precuneus, the anterior cingulum and the medial frontal gyrus. Our results indicate partly separated cortical mechanisms for object detection and identification.

Visual search performance in the autism spectrum II: the radial frequency search task with additional segmentation cues

The Embedded Figures Test (EFT) requires detecting a shape within a complex background and individuals with autism or high Autism-spectrum Quotient (AQ) scores are faster and more accurate on this task than controls. This research aimed to uncover the visual processes producing this difference. Previously we developed a search task using radial frequency (RF) patterns with controllable amounts of target/distracter overlap on which high AQ participants showed more efficient search than low AQ observers. The current study extended the design of this search task by adding two lines which traverse the display on random paths sometimes intersecting target/distracters, other times passing between them. As with the EFT, these lines segment and group the display in ways that are task irrelevant. We tested two new groups of observers and found that while RF search was slowed by the addition of segmenting lines for both groups, the high AQ group retained a consistent search advantage (reflected in a shallower gradient for reaction time as a function of set size) over the low AQ group. Further, the high AQ group were significantly faster and more accurate on the EFT compared to the low AQ group. That is, the results from the present RF search task demonstrate that segmentation and grouping created by intersecting lines does not further differentiate the groups and is therefore unlikely to be a critical factor underlying the EFT performance difference. However, once again, we found that superior EFT performance was associated with shallower gradients on the RF search task.

Perception of shapes targeting local and global processes in autism spectrum disorders

BACKGROUND

Several researchers have found evidence for impaired global processing in the dorsal visual stream in individuals with autism spectrum disorders (ASDs). However, support for a similar pattern of visual processing in the ventral visual stream is less consistent. Critical to resolving the inconsistency is the assessment of local and global form processing ability.

METHODS

Within the visual domain, radial frequency (RF) patterns - shapes formed by sinusoidally varying the radius of a circle to add 'bumps' of a certain number to a circle - can be used to examine local and global form perception. Typically developing children and children with an ASD discriminated between circles and RF patterns that are processed either locally (RF24) or globally (RF3).

RESULTS

Children with an ASD required greater shape deformation to identify RF3 shapes compared to typically developing children, consistent with difficulty in global processing in the ventral stream. No group difference was observed for RF24 shapes, suggesting intact local ventral-stream processing.

CONCLUSIONS

These outcomes support the position that a deficit in global visual processing is present in ASDs, consistent with the notion of Weak Central Coherence.

Global shape processing: which parts form the whole?

Research suggests that detection of low-frequency radial frequency (RF) patterns involves global shape processing and that points of maximum curvature (corners) contribute more than points of minimum curvature (sides). However, this has only been tested with stimuli presented at the threshold of discriminability from a circle. We used RF pattern adaptation to (a) examine whether a supra-threshold RF pattern is processed as a global shape and (b) determine what the critical features are for representing its shape. We measured the perceived amplitude shift of an RF test pattern after prolonged exposure either to a higher amplitude pattern or to various combinations of its parts (concave maxima, convex maxima, inflections). We found greater shifts in perceived amplitude after adaptation to a "whole" pattern than after adaptation to its component parts, which alternated to produce equal net contrast. Furthermore, when adapting to specific parts of the shape in isolation, we found that each part generated a similar magnitude aftereffect. Although the whole is clearly greater than the sum of the parts, we find that concave maxima, convex maxima, and inflections contribute equally to global shape processing, a fact that is only apparent when using a supra-threshold appearance-based task.

Vision in developmental disorders: is there a dorsal stream deficit?

The main aim of this review is to evaluate the proposal that several developmental disorders affecting vision share an impairment of the dorsal visual stream. First, the current definitions and common measurement approaches used to assess differences in both local and global functioning within the visual system are considered. Next, studies assessing local and global processing in the dorsal and ventral visual pathways are reviewed for five developmental conditions for which early to mid level visual abilities have been assessed: developmental dyslexia, autism spectrum disorders, developmental dyspraxia, Williams syndrome and Fragile X syndrome. The reviewed evidence is broadly consistent with the idea that the dorsal visual stream is affected in developmental disorders. However, the potential for a unique profile of visual abilities that distinguish some of the conditions is posited, given that for some of these disorders ventral stream deficits have also been found. We conclude with ideas regarding future directions for the study of visual perception in children with developmental disorders using psychophysical measures.