How reliable is the pattern adaptation technique? A modeling study

Short-Term Attractive Tilt Aftereffects Predicted by a Recurrent Network Model of Primary Visual Cortex

Adaptation is a multi-faceted phenomenon that is of interest in terms of both its function and its potential to reveal underlying neural processing. Many behavioral studies have shown that after exposure to an oriented adapter the perceived orientation of a subsequent test is repulsed away from the orientation of the adapter. This is the well-known Tilt Aftereffect (TAE). Recently, we showed that the dynamics of recurrently connected networks may contribute substantially to the neural changes induced by adaptation, especially on short time scales. Here we extended the network model and made the novel behavioral prediction that the TAE should be attractive, not repulsive, on a time scale of a few 100 ms. Our experiments, using a novel adaptation protocol that specifically targeted adaptation on a short time scale, confirmed this prediction. These results support our hypothesis that recurrent network dynamics may contribute to short-term adaptation. More broadly, they show that understanding the neural processing of visual inputs that change on the time scale of a typical fixation requires a detailed analysis of not only the intrinsic properties of neurons, but also the slow and complex dynamics that emerge from their recurrent connectivity. We argue that this is but one example of how even simple recurrent networks can underlie surprisingly complex information processing, and are involved in rudimentary forms of memory, spatio-temporal integration, and signal amplification.

Testing the assumptions underlying fMRI adaptation using intracortical recordings in area MT

We investigated how neural activity in the middle temporal area of the macaque monkey changes after 3 sec of exposure to a visual stimulus and used this to gain insight into the assumptions underlying the fMRI adaptation method (fMRIa). We studied both changes in tuning curves following weak and strong motion stimuli (adaptation) and the differences between a first and second exposure to the same stimulus (repetition suppression). Typically, tuning curves had smaller amplitudes and narrower tuning widths after strong adaptation; this was true for single neurons, multi-unit activity (MUA), the evoked local field potential (LFP), as well as gamma band activity. Repetition typically led to reduced responses. This reduction was correlated with direction selectivity and not explained by neural fatigue. Our data, however, warn against a simplistic view of the consequences of adaptation. First, a considerable fraction of neurons and sites showed response enhancements after adaptation, especially when probed with a stimulus that moved opposite to the direction of the adapting stimulus. Second, adaptation was stimulus selective only on a time scale of ∼100 msec. Third, aggregate measures of neural activity (MUA, LFPs) had substantially different adaptation effects. Fourth, there were qualitative differences between our findings in MT and earlier findings in IT cortex. We conclude that selective adaptation effects in fMRIa are relatively easy to miss even when they exist (for instance by presenting stimuli for too long, or because neurons that enhance after adaptation cancel out the effect of neurons that suppress). Moreover, we argue that adaptation should be understood in the context of the computations that a neural circuit perform. Using fMRIa as a tool to uncover neural selectivity requires a better understanding of this circuitry and its consequences for adaptation.

Visual Adaptation

Sensory systems continuously mold themselves to the widely varying contexts in which they must operate. Studies of these adaptations have played a long and central role in vision science. In part this is because the specific adaptations remain a powerful tool for dissecting vision, by exposing the mechanisms that are adapting. That is, "if it adapts, it's there." Many insights about vision have come from using adaptation in this way, as a method. A second important trend has been the realization that the processes of adaptation are themselves essential to how vision works, and thus are likely to operate at all levels. That is, "if it's there, it adapts." This has focused interest on the mechanisms of adaptation as the target rather than the probe. Together both approaches have led to an emerging insight of adaptation as a fundamental and ubiquitous coding strategy impacting all aspects of how we see.

Orientation and Spatial Frequency Selectivity following Adaptation: A Reaction Time Study

The aim of the study was to determine orientation and spatial frequency sensitivity using reaction times (RTs) in an adaptation paradigm. Simple RTs were measured to the onset of a Gabor patch (SD = 1.2 deg, spatial frequency = 4 cycles deg−1). Observers adapted for 10 s to a 4 cycles deg−1 grating presented at a series of orientations (0, 2, 5, 10, 22.5, 45, 90°) or spatial frequencies (±0.5, 1, and 2 octaves). The contrast of the test grating was 4x each participant's unadapted threshold. The effect of adaptation was evaluated by transforming RTs to effective contrast reduction using RT-based contrast response functions. RTs increased by between ∼ 100 ms to 150 ms when the test and adapting gratings were of the same orientation or spatial frequency. The effect became less pronounced as the difference in orientation or spatial frequency increased. The average bandwidths for orientation and spatial frequency were 17.4° and 1.24 octaves, respectively. The method has some advantages over traditional approaches. It reveals a rapid time course of adaptation recovery with a half-life of about 13 s to 23 s. RTs form a rapid and easily implemented technique for assessing the underlying physiological mechanisms that control adaptation at suprathreshold levels of contrast.

A review of the mechanisms by which attentional feedback shapes visual selectivity

The glut of information available for the brain to process at any given moment necessitates an efficient attentional system that can 'pick and choose' what information receives prioritized processing. A growing body of work, spanning numerous methodologies and species, reveals that one powerful way in which attending to an item separates the wheat from the chaff is by altering a basic response property in the brain: neuronal selectivity. Selectivity is a cornerstone response property, largely dictating our ability to represent and interact with the environment. Although it is likely that selectivity is altered throughout many brain areas, here we focus on how directing attention to an item affects selectivity in the visual system, where this response property is generally more well characterized. First, we review the neural architecture supporting selectivity, and then discuss the various changes that could occur in selectivity for an attended item. In a survey of the literature, spanning neurophysiology, neuroimaging and psychophysics, we reveal that there is general convergence regarding the manner with which selectivity is shaped by attentional feedback. In a nutshell, the literature suggests that the type of changes in selectivity that manifest appears to depend on the type of attention being deployed: whereas directing spatial attention towards an item only alters spatial selectivity, directing feature-based attention can alter the selectivity of attended features.

Evolving concepts of sensory adaptation

Sensory systems constantly adapt their responses to match the current environment. These adjustments occur at many levels of the system and increasingly appear to calibrate even for highly abstract perceptual representations of the stimulus. The similar effects of adaptation across very different stimulus domains point to common design principles but also continue to raise questions about the purpose of adaptation.

Adaptation and visual coding

Visual coding is a highly dynamic process and continuously adapting to the current viewing context. The perceptual changes that result from adaptation to recently viewed stimuli remain a powerful and popular tool for analyzing sensory mechanisms and plasticity. Over the last decade, the footprints of this adaptation have been tracked to both higher and lower levels of the visual pathway and over a wider range of timescales, revealing that visual processing is much more adaptable than previously thought. This work has also revealed that the pattern of aftereffects is similar across many stimulus dimensions, pointing to common coding principles in which adaptation plays a central role. However, why visual coding adapts has yet to be fully answered.