Effects of spatial configuration on contrast detection

Space, time, and dynamics of binocular interactions

Binocular summation (BS), defined as the superiority of binocular over monocular visual performance, shows that thresholds are about 40% (a factor of 1.4) better in binocular than in monocular viewing. However, it was reported that different amounts of BS exist in a range from 1.4 to 2 values because BS is affected by the spatiotemporal parameters of the stimulus. Lateral interactions can be defined as the neuron's ability to affect the neighboring neurons by either inhibiting or exciting their activity. We investigated the effect of the spatial and temporal domains on binocular interactions and BS under the lateral masking paradigm and how BS would be affected by lateral interactions via a lateral masking experiment. The two temporal alternative forced-choice (2TAFC) method was used. The stimuli consisted of a central vertically oriented Gabor target and high-contrast Gabor flankers positioned in two configurations (orthogonal or collinear) with target-flanker separations of either 2 or 3 wavelengths (λ), presented at 4 different presentation times (40, 80, 120, and 200 ms) using a different order of measurements across the different experiments. Opaque lenses were used to control the monocular and binocular vision. BS is absent at close distances (2λ), depending on the presentation time's order, for the collinear but not for the orthogonal configuration. However, BS exists at more distant flankers (collinear and orthogonal, 3λ). BS is not uniform (1.4); it depends on the stimulus condition, the presentation times, the order, and the method that was used to control the monocular and binocular vision.

Binocular fusion disorders impair basic visual processing

In an era of increasing screen consumption, the requirement for binocular vision is demanding, leading to the emergence of syndromes such as the computer vision syndrome (CVS) or visual discomfort reported by virtual reality (VR) users. Heterophoria (phoria) is a latent eye misalignment (with a prevalence up to 35%) that appears in conditions that disrupt binocular vision and may affect the quality of binocular fusion. Collinear facilitation (CF), the mechanism for grouping contour elements, is a process that reveals lateral interactions by improving the visibility of a target by flankers placed collinearly. An abnormal pattern of CF has been observed in strabismic amblyopia. We hypothesize that phoria may affect CF in the horizontal meridian (HM) due to latent eye misalignment and its impact on binocular fusion. Fully corrected participants (phoria group and controls) completed a standard CF experiment for horizontal and vertical meridians during binocular and monocular viewing. Phoric observers exhibited (1) an asymmetry and an abnormal pattern of CF only for the HM, during both monocular and binocular viewing, (2) poor binocular summation between the monocular inputs, and (3) no binocular advantage of the CF. Phoria affects the CF in a way that is reminiscent of meridional amblyopia without being attributed to abnormal refraction. The abnormal pattern of CF in monocular viewing suggests that phoria could be a binocular developmental disorder that affects monocular spatial interactions. We suggest that the results could contribute to explain the visual discomfort experienced with VR users or symptoms when presenting CVS.

Contrast adaptation improves spatial integration

The effects of contrast adaptation and contrast area summation (spatial integration) were investigated using a contrast discrimination task. The task consisted of a target of variable size, and a pedestal with a fixed base contrast. Discrimination performance was examined for a condition in which the pedestal size was fixed, equal to the largest target size, and for a condition in which the pedestal size matched the target size and thus varied with it. Repeated performance of the task produced rapid within-session improvements for both conditions. For stimuli with a matching size of target and pedestal, the performance improved only for the larger targets, indicating the development of spatial integration, which was initially absent for these stimuli. However, the improvements were mostly temporary, and were not fully retained between subsequent daily sessions. The temporary nature of the sensitivity gains implies that they resulted, at least in part, from rapid adaptation to the stimulus contrast. We suggest that adaptation decorrelates and thus reduces the spatial noise generated by a high-contrast pedestal, leading to improved spatial integration (area summation) and better contrast sensitivity. A decorrelation model successfully predicted our experimental results.

Development of global visual processing: From the retina to the perceptive field

Young children exhibit poorer visual performance than adults due to immaturity of the fovea and of the fundamental processing of visual functions such as masking and crowding. Recent studies suggest that masking and crowding are closely related to the size of the fundamental processing unit-the perceptive field (PF). However, while it is known that the retina and basic visual functions develop throughout childhood, it is not clear whether and how changes in the size of the PF affect masking and crowding. Furthermore, no retinal and perceptual development data have been collected from the same cohort and time. Here we explored the developmental process of the PF and the basic visual functions. Psychophysical and imaging methods were used to test visual functions and foveal changes in participants ranging from 3-17 years old. Lateral masking, crowding and contrast sensitivity were tested using computerized tasks. Foveal measurements were obtained from spectral-domain optical coherence tomography (OCT). The children patterns below 6 years exhibited high crowding, while the expected facilitation was found only at a larger target-flanker distance than required for children above 6 years, who exhibited the typical adult. Foveal thickness and macular volume for the children below 6 years were significantly lower than for the older group. Significant correlation was found for contrast sensitivity, foveal thickness and macular volume with age and between contrast sensitivity and foveal thickness. Our data suggest that the developmental processes at the retina and visual cortex occur in the same age range. Thus, in parallel to maturation of the PF, which enables reduction in crowding, foveal development contributes to increasing contrast sensitivity.

Integration of cortical population signals for visual perception

Visual stimuli evoke heterogeneous responses across nearby neural populations. These signals must be locally integrated to contribute to perception, but the principles underlying this process are unknown. Here, we exploit the systematic organization of orientation preference in macaque primary visual cortex (V1) and perform causal manipulations to examine the limits of signal integration. Optogenetic stimulation and visual stimuli are used to simultaneously drive two neural populations with overlapping receptive fields. We report that optogenetic stimulation raises firing rates uniformly across conditions, but improves the detection of visual stimuli only when activating cells that are preferentially-tuned to the visual stimulus. Further, we show that changes in correlated variability are exclusively present when the optogenetically and visually-activated populations are functionally-proximal, suggesting that correlation changes represent a hallmark of signal integration. Our results demonstrate that information from functionally-proximal neurons is pooled for perception, but functionally-distal signals remain independent.

The equivalent internal orientation and position noise for contour integration

Contour integration is the joining-up of local responses to parts of a contour into a continuous percept. In typical studies observers detect contours formed of discrete wavelets, presented against a background of random wavelets. This measures performance for detecting contours in the limiting external noise that background provides. Our novel task measures contour integration without requiring any background noise. This allowed us to perform noise-masking experiments using orientation and position noise. From these we measure the equivalent internal noise for contour integration. We found an orientation noise of 6° and position noise of 3 arcmin. Orientation noise was 2.6x higher in contour integration compared to an orientation discrimination control task. Comparing against a position discrimination task found position noise in contours to be 2.4x lower. This suggests contour integration involves intermediate processing that enhances the quality of element position representation at the expense of element orientation. Efficiency relative to the ideal observer was lower for the contour tasks (36% in orientation noise, 21% in position noise) compared to the controls (54% and 57%).

Contour detection improved by context-adaptive surround suppression

Recently, many image processing applications have taken advantage of a psychophysical and neurophysiological mechanism, called “surround suppression” to extract object contour from a natural scene. However, these traditional methods often adopt a single suppression model and a fixed input parameter called “inhibition level”, which needs to be manually specified. To overcome these drawbacks, we propose a novel model, called “context-adaptive surround suppression”, which can automatically control the effect of surround suppression according to image local contextual features measured by a surface estimator based on a local linear kernel. Moreover, a dynamic suppression method and its stopping mechanism are introduced to avoid manual intervention. The proposed algorithm is demonstrated and validated by a broad range of experimental results.

Temporal asynchrony and spatial perception

Collinear facilitation is an enhancement in the visibility of a target by laterally placed iso-oriented flankers in a collinear (COL) configuration. Iso-oriented flankers placed in a non-collinear configuration (side-by-side, SBS) produce less facilitation. Surprisingly, presentation of both configurations simultaneously (ISO-CROSS) abolishes the facilitation rather than increases it - a phenomenon that can’t be fully explained by the spatial properties of the target and flankers. Based on our preliminary data and recent studies, we hypothesized that there might be a novel explanation based on the temporal properties of the excitation and inhibition, resulting in asynchrony between the lateral inputs received from COL and SBS, leading to cancelation of the facilitatory component in ISO-CROSS. We explored this effect using a detection task in humans. The results replicated the previous results showing that the preferred facilitation for COL and SBS was abolished for the ISO-CROSS configuration. However, presenting the SBS flankers, but not the COL flankers 20 msec before ISO-CROSS restored the facilitatory effect. We propose a novel explanation that the perceptual advantage of collinear facilitation may be cancelled by the delayed input from the sides; thus, the final perception is determined by the overall spatial-temporal integration of the lateral interactions.

Configuration-Specific Attentional Modulation of Flanker – Target Lateral Interactions

Elements of a contour are often easier to detect when they possess collinearity, with their local orientations matching the global orientation of the contour. We recently reported attentional modulation of such lateral interactions between a central near-threshold target Gabor patch and flanking high-contrast patches (Freeman et al, 2001 Nature Neuroscience4 1032–1036). Here, we examined whether such attentional effects reflect specific modulation of mechanisms sensitive to collinear configurations, or instead more general modulation of sensitivity to either the global or local orientation-components of the stimulus. Thresholds for detecting a central Gabor target were measured, while observers also judged the Vernier alignment between one pair of flankers and ignored a second flanker pair (when present). Target contrast-thresholds were facilitated only when attending collinear flankers. There was no facilitation when attending flankers that shared only local orientation with the target, or flankers that fell on a global axis aligned with target orientation but having orthogonal local orientation. Ignored collinear flankers had no effect on target thresholds. These results demonstrate strong and specific attentional modulation of contour-integration mechanisms in early vision sensitive to collinear configurations.

The spatial range of peripheral collinear facilitation

Contrast detection thresholds for a central Gabor patch (target) can be modulated by the presence of co-oriented and collinear high contrast Gabors flankers. In foveal vision collinear facilitation can be observed for target-to-flankers relative distances beyond two times the wavelength (λ) of the Gabor’s carrier, while for shorter relative distances (<2λ) there is suppression. These modulatory influences seem to disappear after 12λ. In this study, we measured contrast detection thresholds for different spatial frequencies (1, 4 and 6 cpd) and target-to-flankers relative distances ranging from 6 to 16λ, but with collinear configurations presented in near periphery at 4° of eccentricity. Results showed that in near periphery collinear facilitation extends beyond 12λ for the higher spatial frequencies tested (4 and 6 cpd), while it decays already at 10λ for the lowest spatial frequency used (i.e., 1 cpd). In addition, we found that increasing the spatial frequency the peak of collinear facilitation shifts towards larger target-to-flankers relative distances (expressed as multiples of the stimulus wavelength), an effect never reported neither for near peripheral nor for central vision. The results suggest that the peak and the spatial extent of collinear facilitation in near periphery depend on the spatial frequency of the stimuli used.

Low level constraints on dynamic contour path integration

Contour integration is a fundamental visual process. The constraints on integrating discrete contour elements and the associated neural mechanisms have typically been investigated using static contour paths. However, in our dynamic natural environment objects and scenes vary over space and time. With the aim of investigating the parameters affecting spatiotemporal contour path integration, we measured human contrast detection performance of a briefly presented foveal target embedded in dynamic collinear stimulus sequences (comprising five short ‘predictor’ bars appearing consecutively towards the fovea, followed by the ‘target’ bar) in four experiments. The data showed that participants' target detection performance was relatively unchanged when individual contour elements were separated by up to 2° spatial gap or 200 ms temporal gap. Randomising the luminance contrast or colour of the predictors, on the other hand, had similar detrimental effect on grouping dynamic contour path and subsequent target detection performance. Randomising the orientation of the predictors reduced target detection performance greater than introducing misalignment relative to the contour path. The results suggest that the visual system integrates dynamic path elements to bias target detection even when the continuity of path is disrupted in terms of spatial (2°), temporal (200 ms), colour (over 10 colours) and luminance (−25% to 25%) information. We discuss how the findings can be largely reconciled within the functioning of V1 horizontal connections.

Abnormal contextual modulation of visual contour detection in patients with schizophrenia

Schizophrenia patients demonstrate perceptual deficits consistent with broad dysfunction in visual context processing. These include poor integration of segments forming visual contours, and reduced visual contrast effects (e.g. weaker orientation-dependent surround suppression, ODSS). Background image context can influence contour perception, as stimuli near the contour affect detection accuracy. Because of ODSS, this contextual modulation depends on the relative orientation between the contour and flanking elements, with parallel flankers impairing contour perception. However in schizophrenia, the impact of abnormal ODSS during contour perception is not clear. It is also unknown whether deficient contour perception marks genetic liability for schizophrenia, or is strictly associated with clinical expression of this disorder. We examined contour detection in 25 adults with schizophrenia, 13 unaffected first-degree biological relatives of schizophrenia patients, and 28 healthy controls. Subjects performed a psychophysics experiment designed to quantify the effect of flanker orientation during contour detection. Overall, patients with schizophrenia showed poorer contour detection performance than relatives or controls. Parallel flankers suppressed and orthogonal flankers enhanced contour detection performance for all groups, but parallel suppression was relatively weaker for schizophrenia patients than healthy controls. Relatives of patients showed equivalent performance with controls. Computational modeling suggested that abnormal contextual modulation in schizophrenia may be explained by suppression that is more broadly tuned for orientation. Abnormal flanker suppression in schizophrenia is consistent with weaker ODSS and/or broader orientation tuning. This work provides the first evidence that such perceptual abnormalities may not be associated with a genetic liability for schizophrenia.

Collinear stimuli induce local and cross-areal coherence in the visual cortex of behaving monkeys

Background

Collinear patterns of local visual stimuli are used to study contextual effects in the visual system. Previous studies have shown that proximal collinear flankers, unlike orthogonal, can enhance the detection of a low contrast central element. However, the direct neural interactions between cortical populations processing the individual flanker elements and the central element are largely unknown.

Methodology/Principal Findings

Using voltage-sensitive dye imaging (VSDI) we imaged neural population responses in V1 and V2 areas in fixating monkeys while they were presented with collinear or orthogonal arrays of Gabor patches. We then studied the spatio-temporal interactions between neuronal populations processing individual Gabor patches in the two conditions. Time-frequency analysis of the stimulus-evoked VSDI signal showed power increase mainly in low frequencies, i.e., the alpha band (α; 7–14 Hz). Power in the α-band was more discriminative at a single trial level than other neuronal population measures. Importantly, the collinear condition showed an increased intra-areal (V1-V1 and V2-V2) and inter-areal (V1-V2) α-coherence with shorter latencies than the orthogonal condition, both before and after the removal of the stimulus contribution. α-coherence appeared between discrete neural populations processing the individual Gabor patches: the central element and the flankers.

Conclusions/Significance

Our findings suggest that collinear effects are mediated by synchronization in a distributed network of proximal and distant neuronal populations within and across V1 and V2.

The human visual system uses a global closure mechanism

Research asserting that the visual system instantiates a global closure heuristic in contour integration has been challenged by an argument that behaviorally-detected closure enhancement could be accounted for by low-level local mechanisms driven by collinearity or "good continuation" interacting with proximity. The present study investigated this issue in three experiments. Exp. 1 compared the visibility of closed and open contours using circles and S-contours from low to moderately high angles of path curvature in a temporal alternative-forced choice task. Circles were more detectable than S-contours, an effect that increased with curvature. The closure enhancement observed can, however, be explained by the fact that circles contain more 'contiguity' than S-contours. Additional tests added discontinuities to otherwise closed paths to control for the effects of good continuation and closure independently. Exp. 2 compared the visibility of incomplete circles (C-contours) and S-contours derived from the full circles and S-contours in Exp. 1. Exp. 3a compared the visibility of arc pairs arranged in an enclosed position similar to "()" and a non-enclosed position similar to ")(". Results consistently showed enhanced visibility of contour configurations enclosing a region even after controlling for differences in contiguity and changes of curvature direction. A control test (Exp. 3b) demonstrated that the gap in the contours of Exp. 3a was too large to be bridged by local-level collinearity/proximity alone. The combination of good continuation and proximity alone does not explain the closure effects observed across these tests, as demonstrated through the application of a Bayesian model of collinearity and proximity (Geisler et al., 2001) to the stimuli in Exps. 3a and 3b. These results argue for the presence of a global closure-driven contour enhancing mechanism in human vision.

The integration of straight contours (snakes and ladders): The role of spatial arrangement, spatial frequency and spatial phase

In the present study we addressed the issue of whether the Gestalt principle of grouping by similarity (iso-orientation) subtends extraction of straight contours made up of disconnected, iso-oriented Gabor elements, whether collinear (snakes) or parallel (ladders). To prevent the use of the most obvious grouping principle of good continuation, which allows us to perceive the relation between local and global orientation along the contour, we manipulated the spatial arrangement of randomly oriented Gabors in the background: they were positioned on an ordered grid, and grouped on the basis of good continuation, or randomly positioned and not grouped. Grid-positioned backgrounds exert a suppressive contextual influence on detection of good continuation along the contour path. Results obtained in a two-interval forced choice task showed that the orderly-positioned background did not completely prevent detection of snakes and ladders. Detection of snakes was hampered at low spatial frequency whereas detection of ladders was improved by the randomly-positioned background at high spatial frequency. These contextual influences support the suggestion that both iso-orientation and good continuation rules are employed by the association field underlying the binding of straight contours. In addition, they are not compatible with integration of snakes and ladders elements within a single receptive field. In support of this suggestion we found that phase constancy within contour elements (as opposed to phase randomization) improved snake detectability at low spatial frequency, and, unexpectedly, impaired ladder detectability at high spatial frequency. This suggests that a low-level mechanism based on the balance between excitatory and inhibitory lateral interactions at a first stage may account for the detection of both straight contours.

Reducing crowding by weakening inhibitory lateral interactions in the periphery with perceptual learning

We investigated whether lateral masking in the near-periphery, due to inhibitory lateral interactions at an early level of central visual processing, could be weakened by perceptual learning and whether learning transferred to an untrained, higher-level lateral masking known as crowding. The trained task was contrast detection of a Gabor target presented in the near periphery (4°) in the presence of co-oriented and co-aligned high contrast Gabor flankers, which featured different target-to-flankers separations along the vertical axis that varied from 2λ to 8λ. We found both suppressive and facilitatory lateral interactions at target-to-flankers distances (2λ - 4λ and 8λ, respectively) that were larger than those found in the fovea. Training reduces suppression but does not increase facilitation. Most importantly, we found that learning reduces crowding and improves contrast sensitivity, but has no effect on visual acuity (VA). These results suggest a different pattern of connectivity in the periphery with respect to the fovea as well as a different modulation of this connectivity via perceptual learning that not only reduces low-level lateral masking but also reduces crowding. These results have important implications for the rehabilitation of low-vision patients who must use peripheral vision to perform tasks, such as reading and refined figure-ground segmentation, which normal sighted subjects perform in the fovea.

An exploration of the spatial scale over which orientation-dependent surround effects affect contour detection

Contour detection is a crucial component of visual processing; however, performance on contour detection tasks can vary depending on the context of the visual scene. S. C. Dakin and N. J. Baruch (2009) showed that detection of a contour in an array of distracting elements depends on the orientation of flanking elements. Here, using a line of five collinear Gabor elements ("target contour") in a field of distractor Gabor elements, we systematically measured the effects of eccentricity, spacing, and spatial frequency on contour detection performance in three different contexts: randomly oriented distractors (control condition), flanking distractors (on either side of the collinear Gabors) aligned approximately parallel to the target contour, and flanking distractors aligned approximately orthogonal to the target contour. In the control condition, contour detection performance was best for larger Gabors (2 cpd) spaced farther apart (1.2°). Parallel flankers reduced performance for intermediate and large spacings and sizes compared to the control condition, while orthogonal flankers increased performance for the smallest spacing and size compared to the control condition. The results are fit by a model in which collinear facilitation, which is size-dependent but can persist for several degrees of visual angle, competes with orientation-dependent suppression from the flanking context when elements are separated by less than a degree of visual angle.

Peeling plaids apart: context counteracts cross-orientation contrast masking

Background

Contrast discrimination for an image is usually harder if another image is superimposed on top. We asked whether such contrast masking may be enhanced or relieved depending on cues promoting integration of both images as a single pattern, versus segmentation into two independent components.

Methodology & Principal Findings

Contrast discrimination thresholds for a foveal test grating were sharply elevated in the presence of a perfectly overlapping orthogonally-oriented mask grating. However thresholds returned to the unmasked baseline when a surround grating was added, having the same orientation and phase of either the test or mask grating. Both such masking and ‘unmasking’ effects were much stronger for moving than static stimuli.

Conclusions & Significance

Our results suggest that common-fate motion reinforces the perception of a single coherent plaid pattern, while the surround helps to identify each component independently, thus peeling the plaid apart again. These results challenge current models of early vision, suggesting that higher-level surface organization influences contrast encoding, determining whether the contrast of a grating may be recovered independently from that of its mask.

Population response to contextual influences in the primary visual cortex

Collinear proximal flankers can facilitate the detection of a low-contrast target or generate false-alarm target detection in the absence of a target. Although these effects are known to involve subthreshold neuronal interactions beyond the classical receptive field, the underlying neuronal mechanisms are not fully understood. Here, we used voltage-sensitive dye imaging that emphasizes subthreshold population activity, at high spatial and temporal resolution and imaged the visual cortex of fixating monkeys while they were presented with a low-contrast Gabor target, embedded within collinear or orthogonal flankers. We found that neuronal activity at the target site in area primary visual cortex increased and response latency decreased due to spatial spread of activation from the flankers' site. This increased activity was smaller than expected by a linear summation. The presentation of flankers alone induced strong spatial filling-in at the target site. Importantly, the increased neuronal activity at the target site was synchronized over time, both locally and with neuronal population at the flanker's site. This onset synchronization was higher for collinear than for orthogonal flankers. We further show that synchrony is a superior code over amplitude, for discriminating collinear from orthogonal pattern. These results suggest that population synchrony can serve as a code to discriminate contextual effects.

Neural correlates of texture and contour integration in children with autism spectrum disorders

In this study, we have used an electrophysiological paradigm to investigate the neural correlates of the visual integration of local signals across space to generate global percepts in a group of low functioning autistic kids. We have analyzed the amplitude of key harmonics of the Visual Evoked Potentials (VEPs) recorded while participants observed orientation-based texture and contour stimuli, forming coherent global patterns, alternating with visual patterns in which the same number of local elements were randomly oriented in order to loose any globally organized feature. Comparing the results of the clinical sample with those obtained in an age-matched control group, we have observed that in the texture conditions the 1st and 3rd harmonics, containing signature of global form processing (Norcia, Pei, Bonneh, Hou, Sampath, & Pettet, 2005), were present in the control group, while in the experimental group only the 1st harmonic was present. In the Contour condition the 1st harmonic was not present for both groups while the 3rd harmonic was significantly present in the control group but absent in the group with autism. Moreover, the amount of organization required to elicit significant 1st harmonic response in the texture condition was higher in the clinical group. The present results bring additional support to the idea that texture and contour processing are supported by independent mechanisms in normal vision. Autistic vision would thus be characterized by a preserved, perhaps weaker texture mechanism, possibly mediated by feedback interactions between visual areas, and by a disfunction of the mechanism supporting contour processing, possibly mediated by long-range intra-cortical connections. Within this framework, the residual ability to detect contours shown in psychophysical studies could be due to the contribution of the texture mechanism to contour processing.

The effect of aging on contour integration

Perception of global patterns requires the integration of local orientation information across space. The present study examined whether this integration ability declines in older age. We measured contrast thresholds for discriminating the global orientation of a "C" shaped contour against a blank background in younger and older subjects. Performance of younger subjects improved when the elements composing the "C" were aligned along the contour path, as opposed to being orthogonal to it or of mixed orientations. However, older subjects' performance was not affected by the orientation of the local elements. This indicates an age-related decline in contour integration.

Summation of perceptual cues in natural visual scenes

Natural visual scenes are rich in information, and any neural system analysing them must piece together the many messages from large arrays of diverse feature detectors. It is known how threshold detection of compound visual stimuli (sinusoidal gratings) is determined by their components' thresholds. We investigate whether similar combination rules apply to the perception of the complex and suprathreshold visual elements in naturalistic visual images. Observers gave magnitude estimations (ratings) of the perceived differences between pairs of images made from photographs of natural scenes. Images in some pairs differed along one stimulus dimension such as object colour, location, size or blur. But, for other image pairs, there were composite differences along two dimensions (e.g. both colour and object-location might change). We examined whether the ratings for such composite pairs could be predicted from the two ratings for the respective pairs in which only one stimulus dimension had changed. We found a pooling relationship similar to that proposed for simple stimuli: Minkowski summation with exponent 2.84 yielded the best predictive power (r=0.96), an exponent similar to that generally reported for compound grating detection. This suggests that theories based on detecting simple stimuli can encompass visual processing of complex, suprathreshold stimuli.

Semantic processing of crowded stimuli?

Effects of semantic processing of crowded characters were investigated using numbers as stimuli. In an identification task, typical spacing effects in crowding were replicated. Using the same stimuli in a magnitude comparison task, a smaller effect of spacing was observed as well as an effect of response congruency. These effects were replicated in a second experiment with varying stimulus-onset asynchronies. In addition, decreasing performance with increasing onset-asynchrony (so-called type-B masking) for incongruent flankers indicates semantic processing of target and flankers. The data show that semantic processing takes place even in crowded stimuli. This argues strongly against common accounts of crowding in terms of early stimulus-driven impairments of processing.

Spatio-temporal low-level neural networks account for visual masking

T emporal masking is a paradigm that is widely used to study visual information processing. When a mask is presented, typically within less than 100 msec before or after the target, the response to the target is reduced. The results of our psychophysical and visual evoked potential (VEP) experiments show that the masking effect critically depends on a combination of several factors: (1) the processing time of the target, (2) the order of presentation of the target and the mask, and (3) the spatial arrangement of the target and the mask. Thus, the masking effect depends on the spatial-temporal combination of these factors. Suppression was observed when the mask was positioned within a spatial range that was found to evoke inhibition, and when the temporal separation between the target and the mask was short. In contrast, lateral facilitation was observed when the mask was presented at a spatial separation that did not evoke inhibition from the target’s vicinity and with a temporal sequence that preceded the target, or when it was presented simultaneously with it, but not when the target preceded the mask. We propose that masking effects, either suppression or facilitation, reflect integration into the spatial and the temporal domains of the feedforward response to the target and the lateral inputs evoked by the mask (excitatory and/or inhibitory). Because the excitation evoked by the mask develops and propagates slowly from the mask’s location to the target’s location, it lags behind the response to the target. On the other hand, inhibition that is produced in the vicinity of the target evolves more rapidly and follows the onset and offset of the stimulus more closely. Thus, lateral excitation that overcomes the inhibition may facilitate the grouping of local elements into a global percept by increasing the survivability of the object and its accessibility for perceptual awareness.

The relationship between the subjective and objective aspects of visual filling-in

We explored the relationship between filling-in processes and the known increase in detection sensitivity observed for targets presented between collinear flankers. Filling-in was probed using a Yes/No detection task by measuring the false-positive reports (false-alarm, FA) and hit rate (Hit) for a low-contrast Gabor target with different target-flankers distances. Observers increased the number of reports on the presence of a target (FA and Hit) when the flankers' distance was within the known range of facilitatory lateral interactions. This bias in reporting was reduced with blocked stimulation, when the target-flanker distance was kept fixed across trials. When different distances were mixed by trials the bias followed the pattern of lateral interactions across distance. The effect was maximal when flankers and targets were aligned. These false perceptions are most likely the result of a filling-in process by lateral excitation that produces illusory contours.

Spatial and temporal crowding in amblyopia

Spatial crowding is a well-known deficit in amblyopia. We have previously reported evidence suggesting that the inability to isolate stimuli in space in crowded displays (spatial crowding) is a largely independent component of the amblyopic deficit in visual acuity, which is typically found in strabismic amblyopia [Bonneh, Y., Sagi, D., & Polat, U. (2004a). Local and non-local deficits in amblyopia: Acuity and spatial interactions. Vision Research, 44, 3009-3110]. Here, we extend this result to the temporal domain by measuring visual acuity (VA) for a single pattern in a rapid serial visual presentation (RSVP-VA, N=15) for fast ("crowded") and slow ("uncrowded") presentations. We found that strabismic amblyopes but not anisometropic amblyopes or normal controls exhibited a significant difference between VA under the fast and slow conditions. We further compared the "temporal crowding" measure to two measures of spatial crowding: (1) static Tumbling-E acuity in multi-pattern crowded displays (N=26) and (2) Gabor alignment with lateral flankers (N=20). We found that all three measures of crowding (one temporal and two spatial) were highly correlated across subjects while being largely independent of the visual acuity for a single isolated pattern, with both spatial and temporal crowding being high and correlated in strabismus and low in anisometropia. This suggests that time and space are related in crowding, at least in amblyopia.

Bilateral long-range interaction between right and left visual hemifield

Long-range interaction has been reported to be limited in space within a few degrees. Here, we present a new type of interaction by means of a bilateral configuration using two Gabor signals (GSs). Two horizontally oriented GSs, the first defined as a cue and the second as a probe, appeared in the right and left peripheral visual fields in mirror symmetrical regions. The detection threshold of the GS probe was found to decrease significantly up to cue-probe separations of 10 degrees tested. Since the interaction was sensitive to symmetrical locus, as well as specific to the direction of the horizontal axis, the results suggest novel long-range interaction extending toward the periphery with a mirror-symmetrical configuration. This may be acquired by neuronal communication, which directly connects bilateral receptive fields in the right and left visual cortices.

Separate first- and second-order processing is supported by spatial summation estimates at the fovea and eccentrically

We estimated spatial summation areas for the detection of luminance-modulated (LM) and contrast-modulated (CM) blobs at the fovea, 2.5, 5 and 10 deg eccentrically. Gaussian profiles were added or multiplied to binary white noise to create LM and CM blob stimuli and these were used to psychophysically estimate detection thresholds and spatial summation areas. The results reveal significantly larger summation areas for detecting CM than LM blobs across eccentricity. These differences are comparable to receptive field size estimates made in V1 and V2. They support the notion that separate spatial processing occurs for the detection of LM and CM stimuli.

Global contour processing in amblyopia

The purpose of the experiments described here was to investigate global image processing using methods that require global processing while eliminating or compensating for low level abnormalities: visibility, shape perception and positional uncertainty. In order to accomplish this we used a closed figure made up of Gabor patches either in noise or on a blank field. The stimuli were circular or elliptical contours, formed by N equally spaced Gabor patches. We performed two separate experiments: In one experiment we fixed N and varied the aspect ratio using a staircase to determine the threshold aspect ratio; in the second experiment we held the aspect ratio constant (at twice the threshold aspect ratio) and varied N in order to measure the threshold number of elements required to judge the shape. Our results confirm and extend previous studies showing that humans with naturally occurring amblyopia show deficits in contour processing. Our results show that the deficits depend strongly on spatial scale (target size and spatial frequency). The deficit in global contour processing is substantially greater in noise (where contour-linking is required) than on a blank field. The magnitude of the deficits is modest when low-level deficits (reduced visibility, increased positional uncertainty, and abnormal shape perception) are minimized, and does not seem to depend much on acuity, crowding or stereoacuity. The residual deficits reported here cannot be simply ascribed to reduced visibility or increased positional uncertainty, and we therefore conclude that these are genuine deficits in global contour segregation and integration.

Sensitivity and configuration-specificity of orientation-defined texture processing in infants and adults

Here we use textures made up of widely spaced Gabor patches to compare infant and adult sensitivity to the global organization of the elements comprising the textures. Visual Evoked Potentials (VEPs) were recorded to alterations between random images and images containing varying proportions of patches that were of the same orientation. The patches were placed on rectangular, hexagonal or random lattices. Texture-specific responses were robust in adults and their VEP threshold was reached when 1-17% of the patches had the same orientation in the structured image. Infant thresholds were approximately 20-60%. While infants are capable of detecting the global structure of our textures, their sensitivity is low. In adults we found, unexpectedly, that sensitivity and response gain were higher for horizontal compared to vertical global orientations. Infant sensitivity was the same for the two orientations. Comparable orientation anisotropies have not been previously reported for gratings, suggesting that the Gabor-defined textures are tapping different mechanisms. There were small, but measurable effects of the lattice type in adults, with the rectangular lattice producing the largest responses.

Contour saliency in primary visual cortex

Contour integration is an important intermediate stage of object recognition, in which line segments belonging to an object boundary are perceptually linked and segmented from complex backgrounds. Contextual influences observed in primary visual cortex (V1) suggest the involvement of V1 in contour integration. Here, we provide direct evidence that, in monkeys performing a contour detection task, there was a close correlation between the responses of V1 neurons and the perceptual saliency of contours. Receiver operating characteristic analysis showed that single neuronal responses encode the presence or absence of a contour as reliably as the animal's behavioral responses. We also show that the same visual contours elicited significantly weaker neuronal responses when they were not detected in the detection task, or when they were unattended. Our results demonstrate that contextual interactions in V1 play a pivotal role in contour integration and saliency.

Temporal asymmetry of collinear lateral interactions

The visibility of a target improves when the target is presented simultaneously or with a delay between two collinear flankers. Here we tested the temporal properties of lateral facilitation by manipulating the timing of both onsets and offsets of the target and flankers. The results show that lateral facilitation critically depends on the order of presentation of the target and flankers. A typical pattern of lateral interactions was observed when the flankers preceded the target, or were presented simultaneously with it, but not when the target preceded the flankers. This result is incompatible with a feedforward account of lateral interactions, according to which the two temporal effects are linearly summed within a higher level receptive field. We propose that both facilitation and masking are the result of excitatory and inhibitory interactions within neuronal networks. The temporal asymmetry can be accounted for by assuming different time courses for the excitatory and the inhibitory interactions. Although the excitation is slow to develop, lagging behind the stimulus both in onset and offset, inhibition is rapid and follows the onset and offset of the stimulus more closely. Such a network exhibits fast transitions between slow processes.

Collinearity, curvature interpolation, and the power of perceptual integration

In three experiments, participants determined the orientation of a global triangle formed by three Gabor patches of a target spatial frequency in a field of distracters. The orientation of the target patches and their proximity were varied between conditions. When all the target patches had the same orientation this facilitated the response compared to random orientations. This effect occurred only when the patches were in close proximity. When the orientations of the target patches were different but aligned to the global triangle, facilitation occurred regardless of proximity. These contrasting types of facilitation were attributed to different early perceptual integration mechanisms that enable the perception of holistic structure.

Contextual effects in fine spatial discriminations

The context in which a pattern is viewed can greatly affect its apparent contrast, a phenomenon commonly attributed to pooled contrast gain control processes. A low-contrast surround may slightly enhance apparent contrast, whereas increasing the contrast of the surround leads to a monotonic decline in contrast appearance. We ask here how the presence of a patterned surround affects the ability to perform fine, suprathreshold orientation, contrast, and spatial frequency discriminations as a function of surround contrast and phase. Our results revealed an unexpected dip in performance when center and surround were in phase and similar in contrast. These results suggest that additional processes, perhaps those involved in scene segregation, play a role in contextual effects on discrimination.

Eccentricity effects on lateral interactions

We attempted to resolve an apparent conflict between the lack of psychophysical evidence of collinear facilitation at the near-periphery and physiological evidence from the monkey showing collinear effects extra-fovealy. We compared collinear and orthogonal configurations to discount facilitation due to reduced positional uncertainty. Detection thresholds were measured for Gabor targets at eccentricities of 0 degrees - 4 degrees, flanked by collinear or orthogonal flankers. Like in previous reports in the literature, results varied among subjects when the stimulus position was off-fixation. We found reduced facilitation at eccentricities as small as 1 degrees - 2 degrees. Moreover, facilitation did not increase when the stimuli were M-scaled or when observers received more practice. However, a larger proportion of subjects showed collinear facilitation when attention was directed to the tested configurations. The results suggest that differences in allocation of attention along the visual field may affect the underlying lateral interactions, consequently resulting in eccentricity effects as well as inter-observer variability.

Spatial interactions in amblyopia: Effects of stimulus parameters and amblyopia type

Adults with amblyopia were recently shown to perform abnormally in tasks requiring integration of local features into global percepts. Moreover, spatial interactions in amblyopic patients, though often found to be abnormal, showed marked variability. Here we measured collinear lateral interactions using Gabor patches in a large number of amblyopic (N=75) and normal subjects (N=25), testing four spatial frequencies (1.5, 3, 6, 9 cpd). We used the lateral masking paradigm, in which the contrast-detection threshold is measured in the presence of high-contrast flankers at different distances from a central target. Whereas in normal subjects spatial interaction patterns were evident across all spatial frequencies, amblyopic subjects showed abnormal spatial interactions and increasing deficiencies with increasing spatial frequencies. These abnormalities depended on the axis of astigmatism (in meridional amblyopia) and were more pronounced in strabismic than in anisometropic amblyopia. Spatial interactions were independent on the contrast-detection thresholds. Thus, adults with amblyopia might perform as well as normal observers for some stimulus parameters and abnormally for others. Our results indicate a close relationship between abnormal visual input to the visual cortex during development and abnormal functionality of the collinear spatial interactions in adults with amblyopia.

Local and non-local deficits in amblyopia: acuity and spatial interactions

Amblyopic vision is thought to be limited by abnormal long-range spatial interactions, but their exact mode of action and relationship to the main amblyopic deficit in visual acuity is largely unknown. We studied this relationship in a group (N=59) of anisometropic (N=21) and strabismic (or combined, N=38) subjects, using (1) a single and multi-pattern (crowded) computerized static Tumbling-E test with scaled spacing of two pattern widths (TeVA), in addition to an optotype (ETDRS chart) acuity test (VA) and (2) contrast detection of Gabor patches with lateral flankers (lateral masking) along the horizontal and vertical axes as well as in collinear and parallel configurations. By correlating the different measures of visual acuity and contrast suppression, we found that (1) the VA of the strabismic subjects could be decomposed into two uncorrelated components measured in TeVA: acuity for isolated patterns and acuity reduction due to flanking patterns. The latter comprised over 60% of the VA magnitude, on the average and accounted for over 50% of its variance. In contrast, a slight reduction in acuity was found in the anisometropic subjects, and the acuity for a single pattern could account for 70% of the VA variance. (2) The lateral suppression (contrast threshold elevation) in a parallel configuration along the horizontal axis was correlated with the VA (R2=0.7), as well as with the crowding effect (TeVA elevation, R2=0.5) for the strabismic group. Some correlation with the VA was also found for the collinear configuration in the anisometropic group, but less suppression and no correlation were found for all the vertical configurations in all the groups. The results indicate the existence of a specific non-local component of the strabismic deficit, in addition to the local acuity deficit in all amblyopia types. This deficit might reflect long-range lateral inhibition, or alternatively, an inaccurate and scattered top-down attentional selection mechanism.

Electrophysiological correlates of lateral interactions in human visual cortex

Detection thresholds for visually presented targets can be influenced by the nature of information in adjacent regions of the visual field. For example, detection thresholds for low-contrast Gabor patches decrease when flanked by patches that are oriented collinearly rather than orthogonally with the target. Such results are consistent with the known microanatomy of primary visual cortex, where long-range horizontal connections link cortical columns with common orientation preferences. To investigate the neural bases of collinearity effects, we recorded event-related brain potentials (ERPs) together with psychophysical measures for targets flanked by collinear vs. orthogonal gratings. Human volunteers performed a contrast discrimination task on a target grating presented at a perifoveal location. For targets flanked by collinear stimuli, we observed an increased positive polarity voltage deflection in the occipital scalp-recorded ERPs between 80 to 140 ms after stimulus onset. Such a midline occipital scalp voltage distribution of this ERP collinearity effect is consistent with a generator in primary visual cortex. Two later negative voltage ERP deflections (latencies of 245-295 and 300-350 ms) were focused at lateral occipital scalp sites, a pattern consistent with activity in extrastriate visual cortex. These ERP effects were correlated with improved contrast discrimination for central targets presented with collinear flanks. These results demonstrate that the integration of local flanking elements with a central stimulus can occur as early as 80 ms in human visual cortex, but this includes processes occurring at longer latencies and appears to involve both striate and extrastriate visual areas.

Grouping and segmentation in binocular rivalry

Dichoptic presentation of dot arrays produces binocular rivalry if the arrays are of opposite contrast relative to background. Rivalry can occur even if individual dots in one eye's array do not overlap with the dots in the contralateral eye's array. The amount of unitary perception of only one array is a measure of the probability that the stimuli rival as textured surfaces rather than as portions of arrays or as individual dot elements. In accordance with Gestalt grouping principles, arrays of uniform brightness or color produced more unitary perception than mixed arrays. However, experiments with parametric variation of dot motion coherence suggested that segmentation mechanisms based on detection of collinearity can also influence perceptual selection and suppression in binocular rivalry.

Improving vision in adult amblyopia by perceptual learning

Practicing certain visual tasks leads, as a result of a process termed "perceptual learning," to a significant improvement in performance. Learning is specific for basic stimulus features such as local orientation, retinal location, and eye of presentation, suggesting modification of neuronal processes at the primary visual cortex in adults. It is not known, however, whether such low-level learning affects higher-level visual tasks such as recognition. By systematic low-level training of an adult visual system malfunctioning as a result of abnormal development (leading to amblyopia) of the primary visual cortex during the "critical period," we show here that induction of low-level changes might yield significant perceptual benefits that transfer to higher visual tasks. The training procedure resulted in a 2-fold improvement in contrast sensitivity and in letter-recognition tasks. These findings demonstrate that perceptual learning can improve basic representations within an adult visual system that did not develop during the critical period.

Timing of contextual modulation in the shine-through effect

Contextual elements can fundamentally change the perception of an embedded target. A recently discovered masking effect, shine-through, allows one to investigate the precise dynamics of contextual modulation of the human visual system. In this shine-through effect, a vernier precedes a grating comprising more than seven elements for display times as short as 10 ms. The vernier appears as a "shine-through" element superimposed on the grating. However, if additional single lines are presented above and below the grating, visibility of the shine-through element dramatically diminishes. Recent publications focused mainly on the spatial aspects of this contextual modulation. Here, we investigate its temporal characteristics. We show that contextual suppression can occur for context durations of 5-10 ms, even if contextual elements appear 100 ms before target onset. This contextual suppression is not due to the presentation of the contextual elements themselves since without the grating contextual elements exert only weak masking power. Only the combination of contextual elements and grating causes the contextual suppression.

"Phase capture" in the perception of interpolated shape: cue combination and the influence function

This study was concerned with what stimulus information observers use to judge the shape of simple objects. We used a string of four Gabor patches to define a contour. A fifth, center patch served as a test pattern. The observers' task was to judge the location of the test pattern relative to the contour. The contour was either a straight line, or an arc with positive or negative curvature (the radius of curvature was either 2 or 6 deg). We asked whether phase shifts in the inner or outer pairs of patches distributed along the contour influence the perceived shape. That is, we measured the phase shift influence function. We found that shifting the inner patches of the string by 0.25 cycle results in almost complete phase capture (attraction) at the smallest separation (2 lambda), and the capture effect falls off rapidly with separation. A 0.25 cycle shift of the outer pair of patches has a much smaller effect, in the opposite direction (repulsion). In our experiments, the contour is defined by two cues--the cue provided by the Gabor carrier (the 'feature' cue) and that defined by the Gaussian envelope (the 'envelope' cue). Our phase shift influence function can be thought of as a cue combination task. An ideal observer would weight the cues by the inverse variance of the two cues. The variance in each of these cues predicts the main features of our results quite accurately.

Effects of natural images on the detectability of simple and compound wavelet subband quantization distortions

Quantization of the coefficients within a discrete wavelet transform subband gives rise to distortions in the reconstructed image that are localized in spatial frequency and orientation and are spatially correlated with the image. We investigated the detectability of these distortions: Contrast thresholds were measured for both simple and compound distortions presented in the unmasked paradigm and against two natural-image maskers. Simple and compound distortions were generated through uniform scalar quantization of one or two subbands. Unmasked detection thresholds for simple distortions yielded contrast sensitivity functions similar to those reported for 1-octave Gabor patches. Detection thresholds for simple distortions presented against two natural-image backgrounds revealed that thresholds were elevated across the frequency range of 1.15-18.4 cycles per degree with the greatest elevation for low-frequency distortions. Unmasked thresholds for compound distortions revealed relative sensitivities of 1.1-1.2, suggesting that summation of responses to wavelet distortions is similar to summation of responses to gratings. Masked thresholds for compound distortions revealed relative sensitivities of 1.5-1.7, suggesting greater summation when distortions are masked by natural images.