Orientation illusions and after-effects: inhibition between channels

Stronger tilt aftereffects in individuals diagnosed with schizophrenia spectrum disorders but not bipolar disorder

An altered use of context and experience to interpret incoming information has been posited to explain schizophrenia symptoms. The visual system can serve as a model system for examining how context and experience guide perception and the neural mechanisms underlying putative alterations. The influence of prior experience on current perception is evident in visual aftereffects, the perception of the "opposite" of a previously viewed stimulus. Aftereffects are associated with neural adaptation and concomitant change in strength of lateral inhibitory connections in visually responsive neurons. In a previous study, we observed stronger aftereffects related to orientation (tilt aftereffects) but not luminance (negative afterimages) in individuals diagnosed with schizophrenia, which we interpreted as potentially suggesting altered cortical (but not subcortical) adaptability and local changes in excitatory-inhibitory interactions. Here, we tested whether stronger tilt aftereffects were specific to individuals with schizophrenia or extended to individuals with bipolar disorder. We measured tilt aftereffects and negative afterimages in 32 individuals with bipolar disorder, and compared aftereffect strength to a previously reported group of 36 individuals with schizophrenia and 22 healthy controls. We observed stronger tilt aftereffects, but not negative afterimages, in individuals with schizophrenia as compared to both controls and individuals with bipolar disorder, who did not differ from each other. These results mitigate concerns that stronger tilt aftereffects in schizophrenia are a consequence of medication or of the psychosocial consequences of a severe mental illness.

Temporal resolution and temporal extent of orientation repulsion

A vertical target is perceived as tilted against a slightly tilted inducer surrounding it. To identify the temporal resolution and temporal extent of this phenomenon of orientation repulsion in the same paradigm, we used an alternating pair of inducer stimuli having complementary orientation distributions and quantified repulsion at various alternation frequencies. The duration of each inducer stimulus was inversely proportional to the frequency. When an orthogonal pair of D2 patterns, a type of grating whose luminance modulation in a particular orientation was the second-order partial derivative of an isotropic 2D-Gaussian, was used as the inducer, repulsion occurred when the duration exceeded 20 ms and leveled off at 30 ms and beyond. When a custom-made texture with a narrowband orientation distribution and another texture with a complementary orientation distribution were alternated as the inducer, repulsion gradually increased until the inducer duration reached 200 ms. The gradual increase in repulsion was observed regardless of whether the orientation of the inducer that appeared simultaneously with the target was discernible. These findings reveal that contextual modulation in orientation occurs at a high temporal resolution and continues to a long temporal extent under optimal conditions.

On the synthesis of visual illusions using deep generative models

Visual illusions expand our understanding of the visual system by imposing constraints in the models in two different ways: i) visual illusions for humans should induce equivalent illusions in the model, and ii) illusions synthesized from the model should be compelling for human viewers too. These constraints are alternative strategies to find good vision models. Following the first research strategy, recent studies have shown that artificial neural network architectures also have human-like illusory percepts when stimulated with classical hand-crafted stimuli designed to fool humans. In this work we focus on the second (less explored) strategy: we propose a framework to synthesize new visual illusions using the optimization abilities of current automatic differentiation techniques. The proposed framework can be used with classical vision models as well as with more recent artificial neural network architectures. This framework, validated by psychophysical experiments, can be used to study the difference between a vision model and the actual human perception and to optimize the vision model to decrease this difference.

Small-angle attraction in the tilt illusion

The tilt illusion (TI) describes the phenomenon in which a surround inducer grating of a particular orientation influences the perceived orientation of a central test grating. Typically, inducer-test orientation differences of 5 to 40 degrees cause the test orientation to appear shifted away from the inducer orientation (i.e. repulsion). For orientation differences of 60 to 90 degrees, the inducer typically causes the test grating orientation to appear shifted toward the inducer orientation, termed here “large-angle” attraction. Both repulsion and large-angle attraction effects have been observed in contrast-modulated as well as luminance-modulated grating patterns. Here, we show that a secondary, “small-angle” 0 to 10 degrees attraction effect is observed in contrast-modulated and orientation-modulated gratings, as well as in luminance-modulated gratings that are relatively low in spatial frequency, low in contrast, or contain added texture. The observed small-angle attraction, which can exceed in magnitude that of the repulsion and large-angle attraction effects, is dependent on the spatial phase relationship between the inducer and test, being maximal when in-phase. Both small-angle attraction and repulsion effects are reduced when a gap is introduced between the test and inducer. Our findings suggest that small-angle attraction in the TI is a result of assimilation of the inducer pattern into the receptive fields of neurons sensitive to the test.

Stronger tilt aftereffects in persons with schizophrenia

Individuals with schizophrenia may fail to appropriately use temporal context and apply past environmental regularities to the interpretation of incoming sensory information. Here we use the visual system as a test bed for investigating how prior experience shapes perception in individuals with schizophrenia. Specifically, we use visual aftereffects, illusory percepts resulting from prior exposure to visual input, to measure the influence of prior events on current processing. At a neural level, visual aftereffects arise due to attenuation in the responses of neurons that code the features of the prior stimulus (neuronal adaptation) and subsequent disinhibition of neurons signaling activity at the opposite end of the feature dimension. In the current study, we measured tilt aftereffects and negative afterimages, 2 types of aftereffects that reflect, respectively, adaptation of cortical orientation-coding neurons and adaptation of subcortical and retinal luminance-coding cells in persons with schizophrenia (PSZ; n = 36) and demographically matched healthy controls (HC; n = 22). We observed stronger tilt aftereffects in PSZ compared to HC, but no difference in negative afterimages. Stronger tilt aftereffects were related to more severe negative symptoms. These data suggest oversensitivity to recent regularities, in the form of stronger visual adaptation, at cortical, but not subcortical, levels in schizophrenia. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Luminance-contrast properties of texture-shape and texture-surround suppression of contour shape

Studies have revealed that textures suppress the processing of the shapes of contours they surround. One manifestation of texture-surround suppression is the reduction in the magnitude of adaptation-induced contour-shape aftereffects when the adaptor contour is surrounded by a texture. Here we utilize this phenomenon to investigate the nature of the first-order inputs to texture-surround suppression of contour shape by examining its selectivity to luminance polarity and the magnitude of luminance contrast. Stimuli were constructed from sinusoidal-shaped strings of either "bright" or "dark" elongated Gaussians. Observers adapted to pairs of contours, and the aftereffect was measured as the shift in the apparent shape frequency of subsequently presented test contours. We found that the suppression of the contour-shape aftereffect by a surround texture made of similar contours was maximal when the adaptor's center and surround contours were of the same polarity, revealing polarity specificity of the surround-suppression effect. We also measured the effect of varying the relative contrasts of the adaptor's center and surround and found that the reduction in the contour-shape aftereffect was determined by the surround-to-center contrast ratio. Finally, we measured the selectivity to luminance polarity of the texture-shape aftereffect itself and found that it was reduced when the adaptors and tests were of opposite luminance polarity. We conclude that texture-surround suppression of contour-shape as well as texture-shape processing itself depend on "on-off" luminance-polarity channel interactions. These selectivities may constitute an important neural substrate underlying efficient figure-ground segregation and image segmentation.

A review of visual aftereffects in schizophrenia

Psychosis-a cardinal symptom of schizophrenia-has been associated with a failure to appropriately create or use stored regularities about past states of the world to guide the interpretation of incoming information, which leads to abnormal perceptions and beliefs. The visual system provides a test bed for investigating the role of prior experience and prediction, as accumulated knowledge of the world informs our current perception. More specifically, the strength of visual aftereffects, illusory percepts that arise after prolonged viewing of a visual stimulus, can serve as a valuable measure of the influence of prior experience on current visual processing. In this paper, we review findings from a largely older body of work on visual aftereffects in schizophrenia, attempt to reconcile discrepant findings, highlight the role of antipsychotic medication, consider mechanistic interpretations for behavioral effects, and propose directions for future research.

Intact perceptual bias in autism contradicts the decreased normalization model

One recent, promising account of Autism Spectrum Disorders (ASD) situates the cause of the disorder in an atypicality in basic neural information processing, more specifically in how activity of one neuron is modulated by neighboring neurons. The canonical neural computation that implements such contextual influence is called divisive (or suppressive) normalization. The account proposes that this normalization is reduced in ASD. We tested one fundamental prediction of this model for low-level perception, namely that individuals with ASD would show reduced cross-orientation suppression (leading to an illusory tilt perception). 11 young adults with an ASD diagnosis and 12 age-, gender-, and IQ-matched control participants performed a psychophysical orientation perception task with compound grating stimuli. Illusory tilt perception did not differ significantly between groups, indicating typical divisive normalization in individuals with ASD. In fact, all individuals with ASD showed a considerable orientation bias. There was also no correlation between illusory tilt perception and autistic traits as measured by the Social Responsiveness Scale. These results provide clear evidence against the decreased divisive normalization model of ASD in low-level perception, where divisive normalization is best characterized. We evaluate the broader existing evidence for this model and propose ways to salvage and refine the model.

An Adaptation-Induced Repulsion Illusion in Tactile Spatial Perception

Following focal sensory adaptation, the perceived separation between visual stimuli that straddle the adapted region is often exaggerated. For instance, in the tilt aftereffect illusion, adaptation to tilted lines causes subsequently viewed lines with nearby orientations to be perceptually repelled from the adapted orientation. Repulsion illusions in the nonvisual senses have been less studied. Here, we investigated whether adaptation induces a repulsion illusion in tactile spatial perception. In a two-interval forced-choice task, participants compared the perceived separation between two point-stimuli applied on the forearms successively. Separation distance was constant on one arm (the reference) and varied on the other arm (the comparison). In Experiment 1, we took three consecutive baseline measurements, verifying that in the absence of manipulation, participants’ distance perception was unbiased across arms and stable across experimental blocks. In Experiment 2, we vibrated a region of skin on the reference arm, verifying that this focally reduced tactile sensitivity, as indicated by elevated monofilament detection thresholds. In Experiment 3, we applied vibration between the two reference points in our distance perception protocol and discovered that this caused an illusory increase in the separation between the points. We conclude that focal adaptation induces a repulsion aftereffect illusion in tactile spatial perception. The illusion provides clues as to how the tactile system represents spatial information. The analogous repulsion aftereffects caused by adaptation in different stimulus domains and sensory systems may point to fundamentally similar strategies for dynamic sensory coding.

Cross-Modal Transfer of the Tilt Aftereffect From Vision to Touch

Visual input powerfully modulates the dynamics of tactile orientation perception. This study investigated the transfer of the tilt aftereffect (TAE) from vision to somatosensation. In a visual tilt adaptation paradigm, participants were exposed to clockwise or anticlockwise visual tilt, followed by three brief tactile two-point stimuli delivered on their forehead. In a two-alternative forced choice task, participants had to indicate whether the haptic stimulus was tilted to the right or left. Repeated exposure to oriented visual gratings produced a tactile TAE, such that the subsequent tactile stimuli appeared tilted toward the opposite direction. To assess the origin of this effect, the experiment was repeated with the head tilted. Adaptation to a gravitationally tilted grating but with the head tilted so that the grating was retinally vertical induced a robust tactile aftereffect suggesting that the visuotactile TAE is due to spatiotopic rather than retinotopic adaptation.

Insights into Seeing and Grasping: Distinguishing the Neural Correlates of Perception and Action

Vision contributes to both perception and visuomotor control, and it has been suggested that many higher brain structures specialize in one or the other function. An alternative view, presented here, is that most higher brain areas participate in both visuomotor and perceptual functions. In the anterior frontal cortex, for example, the activity of one population of neurons reflects perceptual reports about a visual stimulus, whereas the activity of an intermingled population reflects movements aimed at the same stimulus. Similarly, posterior parietal and inferior temporal areas appear to function in both visual perception and visuomotor control. Visuomotor signals in higher order cortical areas could contribute to the perception of one’s own action. They also might reflect the existence of two systems for visual information processing: one stressing accuracy for the control of movement and the other generating hypotheses about the world.

Effective connectivity within human primary visual cortex predicts interindividual diversity in illusory perception

Visual perception depends strongly on spatial context. A classic example is the tilt illusion where the perceived orientation of a central stimulus differs from its physical orientation when surrounded by tilted spatial contexts. Here we show that such contextual modulation of orientation perception exhibits trait-like interindividual diversity that correlates with interindividual differences in effective connectivity within human primary visual cortex. We found that the degree to which spatial contexts induced illusory orientation perception, namely, the magnitude of the tilt illusion, varied across healthy human adults in a trait-like fashion independent of stimulus size or contrast. Parallel to contextual modulation of orientation perception, the presence of spatial contexts affected effective connectivity within human primary visual cortex between peripheral and foveal representations that responded to spatial context and central stimulus, respectively. Importantly, this effective connectivity from peripheral to foveal primary visual cortex correlated with interindividual differences in the magnitude of the tilt illusion. Moreover, this correlation with illusion perception was observed for effective connectivity under tilted contextual stimulation but not for that under iso-oriented contextual stimulation, suggesting that it reflected the impact of orientation-dependent intra-areal connections. Our findings revealed an interindividual correlation between intra-areal connectivity within primary visual cortex and contextual influence on orientation perception. This neurophysiological-perceptual link provides empirical evidence for theoretical proposals that intra-areal connections in early visual cortices are involved in contextual modulation of visual perception.

Segmentation decreases the magnitude of the tilt illusion

In the tilt illusion, the perceived orientation of a target grating depends strongly on the orientation of a surround. When the orientations of the center and surround gratings differ by a small angle, the center grating appears to tilt away from the surround orientation (repulsion), whereas for a large difference in angle, the center appears to tilt toward the surround orientation (attraction). In order to understand how segmentation/perceptual grouping of the center and surround affect the magnitude of the tilt illusion, we conducted three psychophysical experiments in which we measured observers' perception of center orientation as a function of center-surround relative contrast, relative disparity depth, and geometric features such as occlusion and collinearity. All of these manipulations affected the strength of perceived orientation bias in the center. Our results suggest that if stronger segmentation/perceptual grouping is induced between the center and surround, the tilt repulsion bias decreases/increases. A grouping-dependent tilt illusion plays an important role in visual search and detection by enhancing the sensitivity of our visual system to feature discrepancies, especially in relatively homogenous environments.

How visual short-term memory maintenance modulates subsequent visual aftereffects

Prolonged viewing of a visual stimulus can result in sensory adaptation, giving rise to perceptual phenomena such as the tilt aftereffect (TAE). However, it is not known if short-term memory maintenance induces such effects. We examined how visual short-term memory (VSTM) maintenance modulates the strength of the TAE induced by subsequent visual adaptation. We reasoned that if VSTM maintenance induces aftereffects on subsequent encoding of visual information, then it should either enhance or reduce the TAE induced by a subsequent visual adapter, depending on the congruency of the memory cue and the adapter. Our results were consistent with this hypothesis and thus indicate that the effects of VSTM maintenance can outlast the maintenance period.

How visual short-term memory maintenance modulates the encoding of external input: evidence from concurrent visual adaptation and TMS

The impact of memory representations on the encoding of visual input has been the subject of much debate. Here we investigated this issue by examining how visual short-term memory (VSTM) maintenance of orientation information modulates the strength of the tilt aftereffect (TAE) induced by a concurrent visual adapter. We reasoned that if VSTM maintenance facilitates visual processing of stimuli that match the VSTM content, then the magnitude of the TAE should be enhanced when the orientations of the memory item and the adapter are identical. In contrast, if VSTM content inhibits visual processing, then the TAE induced by the adapter should be reduced. Our results are consistent with the latter hypothesis, and a TMS study demonstrated that the reduction of the TAE by VSTM maintenance of orientation information occurs in the early visual cortex. VSTM maintenance of shape information also reduced the TAE magnitude, but to a smaller extent than maintenance of orientation information. A TMS experiment did not implicate the early visual cortex in this phenomenon. In summary, our results indicate that VSTM maintenance under these circumstances inhibits the encoding of concurrent visual input, and that this inhibition occurs at various levels of the visual cortex.

Dynamics of unconscious contextual effects in orientation processing

Contextual effects abound in the real world; how we perceive an object depends on what surrounds it. A classic example of this is the tilt illusion (TI) whereby the presence of a surround shifts the perceived orientation of a target. Surprisingly, the magnitude and direction of this shift depend on the orientation difference between the target and surround: when their orientations are similar, the perceived difference is amplified and the target appears repelled in orientation from the surround (i.e., the TI). However, when their orientations are close to perpendicular, the difference is decreased and the target appears attracted in orientation toward the surround (i.e., the indirect TI). These misperceptions of orientation have revealed much about the underlying detectors involved in visual processing and how they interact with each other. What remains at stake are the levels of processing involved. To examine this, we designed a reverse-correlation technique whereby observers are blind to the orientation of the surround. We find that the TI and indirect TI occur reliably and over a similar time course, supporting the role of a single mechanism underlying orientation biases that operates in the early stages of visual processing before the conscious extraction of the surround orientation.

Asymmetry of visual function in migraine with aura: Correlation with lateralisation of headache and aura

Background: Asymmetry of visual phenomena and headache is an important feature of migraine with aura.

Methods: This asymmetry was explored by assessment of visual illusions, hemifield spatial contrast detection (HCD) and hemifield pattern reversal visual evoked potentials (HVEPs) in 47 migraineurs with aura (MA), who were not taking prophylactic medications, and 62 controls with the same age range (16–59).

Results: Illusions were greater and HCD was poorer in MA than in controls. There were no group differences with respect to P100 amplitude. The longer the duration of migraine the poorer the HCD. When the aura was consistently unilateral it was associated with greater illusions, reduced HCD and reduced hemifield P100 amplitude. These findings were not related to the side of headache.

Conclusion: The lateralised changes suggest that the visual dysfunction occurs at a cortical level, and the correlation with the side of the aura suggests that dysfunction is most likely to occur in an area of preexisting anomaly of neural function.

When do we know which way is up? The time course of orientation perception

There is evidence that global visual context affects orientation perception in later stages of processing than local context. We measured the relative time courses of two orientation illusions: The Tilt Illusion (TI) involves dense gratings in close proximity; the Rod and Frame Illusion (RFI) involves a solitary bar surrounded by a distant frame. We also varied whether the context was flashed briefly (Experiment 1) or remained visible (Experiment 2). Results showed that the TI (but not the RFI) occurs when the context is briefly flashed in advance of the test, that both illusions are strongest when the context and inducer appear simultaneously, and that the RFI frame must be visible for at least 800 ms to induce an illusion with asynchronous displays. Experiment 3 confirmed these patterns held for measures of illusion magnitude and discriminability. Results are consistent with an earlier effect of local spatial context and a later effect of global spatial context on orientation perception.

The dynamics of perceptual learning: an incremental reweighting model

The mechanisms of perceptual learning are analyzed theoretically, probed in an orientation-discrimination experiment involving a novel nonstationary context manipulation, and instantiated in a detailed computational model. Two hypotheses are examined: modification of early cortical representations versus task-specific selective reweighting. Representation modification seems neither functionally necessary nor implied by the available psychophysical and physiological evidence. Computer simulations and mathematical analyses demonstrate the functional and empirical adequacy of selective reweighting as a perceptual learning mechanism. The stimulus images are processed by standard orientation- and frequency-tuned representational units, divisively normalized. Learning occurs only in the "read-out" connections to a decision unit; the stimulus representations never change. An incremental Hebbian rule tracks the task-dependent predictive value of each unit, thereby improving the signal-to-noise ratio of their weighted combination. Each abrupt change in the environmental statistics induces a switch cost in the learning curves as the system temporarily works with suboptimal weights.

The dynamics of visual adaptation to faces

Several recent demonstrations using visual adaptation have revealed high-level aftereffects for complex patterns including faces. While traditional aftereffects involve perceptual distortion of simple attributes such as orientation or colour that are processed early in the visual cortical hierarchy, face adaptation affects perceived identity and expression, which are thought to be products of higher-order processing. And, unlike most simple aftereffects, those involving faces are robust to changes in scale, position and orientation between the adapting and test stimuli. These differences raise the question of how closely related face aftereffects are to traditional ones. Little is known about the build-up and decay of the face aftereffect, and the similarity of these dynamic processes to traditional aftereffects might provide insight into this relationship. We examined the effect of varying the duration of both the adapting and test stimuli on the magnitude of perceived distortions in face identity. We found that, just as with traditional aftereffects, the identity aftereffect grew logarithmically stronger as a function of adaptation time and exponentially weaker as a function of test duration. Even the subtle aspects of these dynamics, such as the power-law relationship between the adapting and test durations, closely resembled that of other aftereffects. These results were obtained with two different sets of face stimuli that differed greatly in their low-level properties. We postulate that the mechanisms governing these shared dynamics may be dissociable from the responses of feature-selective neurons in the early visual cortex.

Colour and luminance selectivity of spatial and temporal interactions in orientation perception

Previous studies have commented upon the similar phenomenology of simultaneous and successive interactions in the perception of orientation. These similarities have been taken as evidence of common mechanisms underlying the simultaneous tilt illusion (TI) and the successive tilt aftereffect (TAE). We measured the TI and TAE for four subjects for combinations of test and inducing stimuli modulated along either the same or orthogonal axes of colour space within the L+M+S, L-M colour-luminance plane. The largest TI and TAE were found when test and inducer were modulated along the same axis of colour space. The TI consistently showed greater selectivity for colour/luminance than the TAE. The results are discussed in relation to the known chromatic properties of the primate visual pathways. Specifically, we suggest that both the TI and TAE involve colour- and luminance-specific neurons in primary visual cortex as well as cue-invariant mechanisms in extrastriate cortex.

Visual orientation illusions: global mechanisms involved in hierarchical effects and frames of reference

Five experiments were conducted in order to determine which of two hypotheses, initially proposed by Rock (1990), accounts for interactions between oriented elements in a visual scene. We also explored the suggestion that two hypothetical processes--namely, frame of reference and hierarchical organization--describe phenomena arising from distinct mechanisms (Spinelli, Antonucci, Daini, Martelli, & Zoccolotti, 1999). Double inducing stimulus versions of one-dimensional and two-dimensional tilt illusions, the rod-and-frame illusion, and combinations of these were used. Our data suggest that both hypotheses can predict orientation interactions in conditions in which only one mechanism--namely, the global visual mechanism of symmetry axes extraction (Wenderoth & Beh, 1977)--is activated. Which hypothesis is appropriate to predict the perceived orientation depends on some physical features of the objects.

Signals in macaque striate cortical neurons that support the perception of glass patterns

Glass patterns are texture stimuli made by pairing randomly placed dots with partners at specific offsets. The strong percept of global form that arises from the sparse local orientation cues has made these patterns the subject of psychophysical investigations, yet neuronal responses to Glass patterns have not been studied. We measured the responses of neurons in macaque striate cortex (V1) to dynamic, translational Glass patterns as a function of dot separation and dot-pair orientation. Responses were selective, but were on average more than an order of magnitude weaker than responses to sinusoidal gratings. Response and selectivity were greatest when the dot-pair orientation matched that of the preferred grating and when dot separation was between one-quarter and one-half of the spatial period of the optimal grating; changing the dot-pair separation or inverting the contrast of one of the dots radically changed the orientation selectivity. We computed the expected responses for a receptive field model to translational Glass patterns and found that the complexity of our V1 tuning curves could be understood in terms of the responses of linear filters to pairs of dots. This modeling connects our understanding of V1 receptive fields as rectified, quasi-linear filters with results from psychophysical studies of Glass patterns. Our results provide a basis for studying how subsequent visual areas integrate weak, local signals into global form percepts.

Interaction between first- and second-order orientation channels revealed by the tilt illusion: psychophysics and computational modelling

This paper examines the interaction between first- and second-order contours in the orientation domain. Using the simultaneous tilt illusion (TI), we show that the apparent rotation of a vertical test grating away from that of a surrounding inducing grating (repulsion effect) occurs when both the inducing and test grating are either first- or second-order. Furthermore, a significant repulsion effect is obtained when a first-order inducing grating surrounds a second-order test. If lateral inhibitory interactions between populations of orientation selective neurons provides a plausible explanation for orientation repulsion effects [Blakemore, C. B. Carpenter, R. H. S. & Georgeson, M. A. (1970) Nature, 228, 37-39], it is likely that the cue-invariant mechanisms that encodes the orientation of first- and second-order contours also exhibit inhibitory interactions. A two-channel computational model of orientation encoding is presented where one channel encodes only first-order stimuli while the second channel encodes both first- and second-order contours. In addition to predicting the orientation repulsion effects we observed, the model also provides a functional account of orientation attraction effects in terms of the responses of populations of orientation-tuned neurons.

Orientation processing mechanisms revealed by the plaid tilt illusion

The tilt after-effect (TAE) and tilt illusion (TI) have revealed a great deal about the nature of orientation coding of 1-dimensional (1D) lines and gratings. Comparatively little research however has addressed the mechanisms responsible for encoding the orientation of 2-dimensional (2D) plaid stimuli. A multi-stage model of edge detection has recently been proposed [Georgeson, M. A. (1998) Image & Vision Computing, 16(6-7), 389-405] to account for the perceived structure of a plaid stimulus that incorporates extraction of the zero-crossings (ZCs) of the plaid. Data is presented showing that the ZCs of a plaid inducing stimulus can interact with vertical grating test stimulus to induce a standard tilt illusion. However, by considering the second-order structure of a plaid rather than ZCs, it was shown that the perceived orientation of the vertical test grating results from the combination of orientation illusions due to the first- and second-order components of an inducing plaid. The data suggest that the mechanisms encoding the orientation of second-order contours are similar to, and interact directly with, those that encode first-order contours.

Inter-attribute tilt effects and orientation analysis in the visual brain

A test grating appears to be tilted away from an inducing grating for small angular separations (repulsion), but towards the inducing grating for larger angular separations (attraction). Previous research on luminance gratings suggests that repulsion is caused by local inhibition in cortical areas V1 and/or V2, and that the attraction involves global interactions beyond V1, in extrastriate areas. Experiments reported here demonstrate attribute invariant attraction and repulsion effects for gratings specified by luminance, motion, and disparity contrasts. A frame surrounding the inducing grating abolishes only the attraction effect, but a spatial frequency difference, or a small gap between the inducer and test gratings, abolishes only the repulsion effect, irrespective of the attributes that specify the gratings. It is proposed that detectors selectively sensitive to attribute invariant orientation and size exist in early cortical sites such as V1 and/or V2.

Adaptation-induced plasticity of orientation tuning in adult visual cortex

A key emergent property of the primary visual cortex (V1) is the orientation selectivity of its neurons. The extent to which adult visual cortical neurons can exhibit changes in orientation selectivity is unknown. Here we use single-unit recording and intrinsic signal imaging in V1 of adult cats to demonstrate systematic repulsive shifts in orientation preference following short-term exposure (adaptation) to one stimulus orientation. In contrast to the common view of adaptation as a passive process by which responses around the adapting orientation are reduced, we show that changes in orientation tuning also occur due to response increases at orientations away from the adapting stimulus. Adaptation-induced orientation plasticity is thus an active time-dependent process that involves network interactions and includes both response depression and enhancement.

Tilt aftereffects in a self-organizing model of the primary visual cortex

RF-LISSOM, a self-organizing model of laterally connected orientation maps in the primary visual cortex, was used to study the psychological phenomenon known as the tilt aftereffect. The same self-organizing processes that are responsible for the long-term development of the map are shown to result in tilt aftereffects over short timescales in the adult. The model permits simultaneous observation of large numbers of neurons and connections, making it possible to relate high-level phenomena to low-level events, which is difficult to do experimentally. The results give detailed computational support for the long-standing conjecture that the direct tilt aftereffect arises from adaptive lateral interactions between feature detectors. They also make a new prediction that the indirect effect results from the normalization of synaptic efficacies during this process. The model thus provides a unified computational explanation of self-organization and both the direct and indirect tilt aftereffect in the primary visual cortex.

Large repulsion, but not attraction, tilt illusions occur when stimulus parameters selectively favour either transient (M-like) or sustained (P-like) mechanisms

A vertical test grating appears tilted away from a surrounding inducing grating which is 15 degrees from vertical (repulsion effect) but towards an inducer 75 degrees from vertical (attraction effect). This is the tilt illusion (TI) and similar effects occur when inducing and test stimuli are presented successively (tilt after-effect or TAE). When it was reported [Wolfe, J. (1984). Vision Research, 24, 1959-1964] that large repulsion TAEs occurred with short test flashes, Wolfe postulated that either there are distinct mechanisms which process brief and longer duration stimuli; or that there are distinct mechanisms which are not primarily concerned with duration but are differentially responsive to temporal parameters, amongst several others. Other evidence that TI attraction effects are not modulated by test flash duration resulted in an hypothesis that repulsion and attraction effects are mediated by transient and sustained mechanisms, respectively [Wenderoth, P., van der Zwan, R., & Johnstone, S. (1989). Perception, 18, 715-728]. We demonstrate that large repulsion TIs can be induced when parameters other than duration are manipulated, including contrast and spatial frequency but that these parameters fail to modulate attraction TIs. These results are consistent with some previous hypotheses regarding the origin of repulsion and attraction effects and with Wolfe's latter hypothesis but do not support the view that the two effects are processed, respectively, by transient and sustained mechanisms.

Orientation discrimination and tilt aftereffects with luminance and illusory contours

Orientation discrimination and tilt aftereffects (TAEs) were measured to determine if the orientation of luminance and illusory contours are processed by separate mechanisms. The assumption was made that if a single mechanism supports the perception of both types of contours, then illusory and luminance contours that support the same level of orientation discrimination will be equally effective adapting patterns. Experiment I found that orientation discrimination psychometric functions for illusory and luminance contours are similar, confirming that performance could be matched. Experiment II measured orientation discrimination for a range of intensities for both contours. Experiment III measured TAEs following adaptation to illusory and luminance contours that supported a similar range of orientation discrimination. Similar TAEs were not observed, thus rejecting the single mechanism hypothesis. Experiments IV and V sought to validate the assumption that equivalent orientation discrimination predicts equivalent TAEs by using stimuli that seemed likely to be represented by the same visual mechanism. Luminance contours masked by randomly placed dots and unmasked luminance contours were used with the same procedures as experiments II and III. Equal TAEs were not observed for masked and unmasked contours matched on orientation discrimination, suggesting the assumption relating discriminability to adaptation was incorrect.

The effects of surround contrast on contrast thresholds, perceived contrast and contrast discrimination

Perceived contrast, contrast detection thresholds and contrast discrimination thresholds were measured in the presence and absence of surrounding patterns of a similar spatio-temporal makeup. In the foveal retina we found that the perceived contrast of the central pattern was reduced by the presence of the contrast surrounds with the effect being greatest at low test contrast. Detection thresholds were not affected and contrast discrimination thresholds were only affected over a small range of low test contrasts. However if the test pattern was made smaller, or if its central part was occluded detection thresholds were raised. In the peripheral retina detection thresholds were raised and discrimination thresholds were affected over most of the range of contrasts. We argue that the pattern of results resembles those produced in masking paradigms where the test and mask are coextensive if the spatial range of interactions is taken into account and hence the effects of the contrast surround may be merely a manifestation of normal masking processes.

Tuning of orientation detectors in human vision

A new method to study the tuning of orientation detectors in the human visual system is proposed. The stimulus consists of a sequence of flashed sinusoidal gratings of random orientations and spatial phases shown at a fast presentation rate. The subject's task is to report, as fast as possible, when the presence of a particular orientation (horizontal, vertical, or oblique) is seen in the stimulus sequence by pressing a button. The data are analyzed by calculating the empirical distribution of orientations present in the stimulus sequence within an optimal time-window before the button was pressed. The resulting orientation distributions show a "Mexican hat" shape, which resembles the distributions obtained in some single neurons of monkey primary visual cortex using a similar method (Ringach et al., 1997). The findings are consistent with the idea of "lateral inhibition" between neighboring detectors in the orientation domain.

Glass patterns: some contrast effects re-evaluated

The relative contrast of features is known to be important in determining if they can be grouped. Two manipulations of feature contrast have previously been used to criticise models of visual grouping based on spatial filtering: high-pass filtering and reversal of contrast polarity. The effects of these manipulations are considered in the context of the perception of Glass patterns. It is shown that high-pass filtering elements, whilst destroying structure in the output of low-pass filters, do not significantly disrupt the output of locally band-pass filters. The finding that subjects can perceive structure in Glass patterns composed of high-pass features therefore offers no evidence against such spatial filtering mechanisms. Band-pass filtering models are shown to explain the rotation of perceived structure in Glass patterns composed of opposite contrast features. However, structure is correctly perceived in patterns composed of two 'interleaved' opposite contrast patterns, which is problematic for oriented filtering mechanisms. Two possible explanations are considered: nonlinear contrast transduction prior to filtering, and integration of local orientation estimates from first-order and second-order mechanisms.

Spatial frequency adaptation: threshold elevation and perceived contrast

We have measured the spread of contrast adaptation across the dimension of spatial frequency. Threshold elevation was tightly tuned to the adapting spatial frequency but became much broader as test contrast was increased. This means that, for a given test frequency, there are some frequencies which do not raise threshold but do result in a loss of perceived contrast. The contrast dependence, retinal specificity and interocular transfer of adaptation effects elicited from same-and remote-frequency adaptation were compared. While we were able to show some distinct differences between threshold and suprathreshold tests, we were unable to demonstrate any reliable differences in the retinal specificity and interocular transfer between same- and remote-frequency adaptation.

Patterns of excitation and inhibition evoked by horizontal connections in visual cortex share a common relationship to orientation columns

Combined optical imaging and electrophysiological techniques were used to assess directly the functional nature of long-range excitatory and inhibitory synaptic interactions between orientation columns in area 17 of ferret visual cortex. A significant correlation was found between the layout of iso-orientation columns and the pattern of evoked synaptic inputs between cortical sites: the largest-amplitude inhibitory and excitatory synaptic responses were evoked in single neurons when stimulation and recording electrodes were located in orientation columns sharing the same angle preference. Both excitatory and inhibitory synaptic responses decreased in amplitude when stimulation and recording electrodes were located in orientation columns with orthogonal angle preferences. Changing the stimulus intensity altered the balance of evoked excitation and inhibition without changing the columnar specificity of inputs. These results directly demonstrate that horizontal connections modulate both excitatory and inhibitory synaptic interactions between iso-orientation columns.

Mechanisms of purely subjective contour tilt aftereffects

Neurones tuned for second-order stimuli--those which have edges defined by properties other than luminance and colour--have been frequently observed in prestriate cortex and in area V2 there are neurones which explicitly and unambiguously signal the orientation of purely subjective contours, i.e. contours with no Fourier components at the orientation of the perceived edge [von der Heydt, R. & Peterhans, (1989) Journal of Neuroscience, 9, 1731-1748]. No neurones in area V1 showed similar tuning characteristics. In addition, it has been demonstrated that like real contours, purely subjective test contours are subject to tilt aftereffects following prolonged viewing of an adapting stimulus. whether that stimulus is real or subjective [Paradiso, M. A., Shimojo, S. & Nakayama, K. (1989) Vision Research, 29, 1205-1213]. This result supports the assertion that the cortical processes responsible for real contour perception are also those giving rise to subjective contour perception. The data reported here further examined this hypothesis. Four experiments show that purely subjective contours exhibit both direct and indirect tilt aftereffects and tilt illusions like those observed with real contours. Further, they provide evidence that direct and indirect subjective contour effects, like direct and indirect real contour effects, arise via the operation of two mechanisms: a low level process, possibly lateral inhibition between orientation channels, and a second "higher-order" process. The data suggest that processing of orientation information beyond the striate cortex is similar to that which occurs in area V1 and the data are consistent with models of contour processing which assume that all perceived contours, both real and subjective, arise from a common mechanism.

Direct evidence for competition between local and global mechanisms of two-dimensional orientation illusions

Orientation illusions induced by two-dimensional stimuli, such as square outline frames or plaids, have been more or less adequately accounted for in terms of repulsion of the vertical test stimulus from the axis of symmetry nearest vertical of the inducing stimulus, whether that axis is real or virtual. Recently, data have been obtained which directly suggest a more complex mechanism: one in which the observed illusion is the sum of all effects--complementary and antagonistic--induced by all axes flanking vertical which are sufficiently close to vertical to exert a significant effect. Experiments are reported in which this latter hypothesis was directly tested by using nonorthogonal plaid component gratings and varying the real-axis orientations while a virtual plaid axis remained fixed in orientation at 10 degrees from vertical. The data indicate that the real component gratings modulate the virtual-axis effect.

Local and global mechanisms of one- and two-dimensional orientation illusions

One-dimensional (1-D) orientation illusions induced on a test grating by a tilted and surrounding 1-D inducing grating have a well-known angular function that exhibits both repulsion and attraction effects. Two-dimensional (2-D) orientation illusions are those induced on a test grating by 2-D image modulation, such as a pair of superimposed inducing gratings at different orientations, usually orthogonal (a plaid). Given the known angular functions induced by the plaid component gratings, two hypotheses were developed that predicted different plaid-induced illusion functions. Hypothesis 1 states that the 1-D component-induced effects simply add linearly; Hypothesis 2 states that there is an additional mechanism that responds to the virtual axes of mirror symmetry of the plaid and adds to the effect. The data of two experiments were consistent with the predictions from the second hypothesis but not the first. Possible neural substrates of mechanisms that extract axes of symmetry are discussed; it is suggested that such global symmetry axes may underlie the perceived orientation of complex shapes.

Effects of tryptophan depletion on Poggendorff illusion, corner Poggendorff illusion, and attention

The effects of a tryptophan-free amino acid mixture on Poggendorff illusion, corner Poggendorff illusion, and attention were investigated with 12 male subjects who ingested either a balanced amino acid mixture or a tryptophan-free mixture, the latter known to cause a marked depletion of brain tryptophan and serotonin. No significant difference between the two mixtures on the perceptual illusions was found.

An increase in strength of tilt aftereffect associated with tryptophan depletion

The effects of a tryptophan-free amino acid mixture on tilt aftereffect, movement aftereffect, and the Mueller-Lyer illusion were studied. 12 male subjects ingested either a balanced amino acid mixture or a tryptophan-free mixture which causes a marked depletion of brain tryptophan and serotonin. The tryptophan-free mixture significantly increased the strength of tilt aftereffect but had no effect on movement aftereffect or the Mueller-Lyer illusion. These results were discussed with reference to the pharmacological activity of serotonin and its influence on the strength of lateral inhibition in mammalian brains.

Pattern orientation, not motion, determines the two-dimensional tilt illusion

In the usual tilt illusion (TI) configuration, an inducing stimulus which has a single orientation is used psychophysically to explore orientation analysis in the human visual system. Recently, this approach has been extended to the use of inducing stimuli which have two orientations. Such a two-dimensional (2-D) stimulus permits investigation of the low-level analysis of visual patterns. Prior experimentation has left it unclear whether it is the spatial or the motion properties of a moving crossed-grating plaid which determine two-dimensional tilt illusions (2-D TIs) because these two parameters previously were perfectly correlated. In the present experiments pattern orientation and motion were decoupled. It is shown that 2-D TIs are determined by the spatial properties of an inducing annulus and not by its motion properties. The results also support the existence of a mechanism which extracts axes of symmetry, and which is difficult to account for in terms of local cross-orientation domain inhibition.

The effects of exposure duration and surrounding frames on direct and indirect tilt aftereffects and illusions

Direct and indirect tilt illusions (TIs) have been shown to have different mechanisms, because spatial parameters that affect the one do not affect the other, and vice versa. The indirect TI, for example, is reduced markedly by a surrounding vertical square frame, a manipulandum that has no effect on the direct TI (Wenderoth & Johnstone, 1988a). In six experiments, we show that both direct and indirect TIs are enhanced in magnitude with short (10-60 msec) exposures; that tilt aftereffects (TAEs) induced with short test exposures are entirely comparable in magnitude; that a surrounding square frame reduces indirect TAEs but not direct TAEs, just as occurs with the TI; and that when the surrounding frame is present during adaptation only, test only, and both or neither, the greatest indirect TAE reduction occurs when the frame is present during the test. These results are consistent with the view (Wenderoth & Johnstone, 1987, 1988a, 1988b) that indirect TIs and TAEs may not reflect temporary neural modification based on V1 lateral inhibitory processes but rather the operation of more global, possibly extrastriate, orientation-constancy mechanisms.

Spatial and orientation specific integration in the tilt illusion

Lateral inhibition across a population of cells in visual cortex which are tuned to local orientation has been proposed and widely accepted as a basic process in the analysis of contour in the visual field. The tilt illusion is usually explained in terms of this inhibition. Experiments are reported which cast new light on the analysis of visual orientation. It is shown that tilt illusions may be obtained with very thin inducing annuli which are spatially remote from the test figure. In experiments in which remote crossed-grating plaids were used, an illusion which was pattern (global) rather than component (local) selective was seen. It is difficult to account for these observations in terms of local inhibitory mechanisms. Rather, the results support the existence of a secondary mechanism which is involved in basic orientation analytic processes. The relevance of these observations to models of visual contour analysis is discussed.

Contrast, spatial frequency and test duration effects on the tilt aftereffect: implications for underlying mechanisms

The tilt aftereffect (TAE) was measured with a forced-choice technique for gratings of different spatial frequencies, contrasts and adapting and test durations. At short test durations, a 2 c/deg grating gave a larger TAE than a 10 c/deg, while at long test durations the opposite occurred. Low contrast gratings tended to give smaller TAEs at short test durations, and larger TAEs at long durations, than high contrast. A longer adapting duration tended to produce larger TAEs at low contrast for any test duration, but larger TAEs at high contrast only at long test durations. We suggest that the spatial frequency effect reflects differential excitation by the test stimuli of transient and sustained channels, and that the contrast effects reflect both a non-linearity in the relationship between excitation and inhibition, and the adapting effects of the test grating.

Subjective contours, tilt aftereffects, and visual cortical organization

The tilt aftereffect (TAE) was used to study interactions between real and subjective contours. Subjects adapted to either real or illusory lines and were then shown test stimuli containing real or illusory lines. In our first experiment, we found that there is a marked asymmetry in the interactions between real and subjective stimuli. Adaptation to real lines produces comparable TAEs with real and subjective test lines. With either type of test stimulus the maximum effect occurs with a 10-20 deg difference between the orientations of the adaptation and test stimuli. Also, there is a strong TAE when the adaptation and test stimuli contain only subjective lines. However, there is a significantly weaker TAE when the adaptation stimulus is subjective and the test stimulus is real. In a second experiment we find that interocular transfer of tilt aftereffects is greater when the test stimulus is subjective than when it is real. These results are consistent with physiological reports that a subset of orientation selective cells in visual cortex is responsive to subjective contours and that these cells are more binocular, on average, than those responsive only to real contours. Our findings also suggest that the perception of subjective contours is based on the activation of neurons with properties, such as orientation selectivity, which are characteristic of early visual cortical areas.