A two-stage cascade model of BOLD responses in human visual cortex

Visual neuroscientists have discovered fundamental properties of neural representation through careful analysis of responses to controlled stimuli. Typically, different properties are studied and modeled separately. To integrate our knowledge, it is necessary to build general models that begin with an input image and predict responses to a wide range of stimuli. In this study, we develop a model that accepts an arbitrary band-pass grayscale image as input and predicts blood oxygenation level dependent (BOLD) responses in early visual cortex as output. The model has a cascade architecture, consisting of two stages of linear and nonlinear operations. The first stage involves well-established computations—local oriented filters and divisive normalization—whereas the second stage involves novel computations—compressive spatial summation (a form of normalization) and a variance-like nonlinearity that generates selectivity for second-order contrast. The parameters of the model, which are estimated from BOLD data, vary systematically across visual field maps: compared to primary visual cortex, extrastriate maps generally have larger receptive field size, stronger levels of normalization, and increased selectivity for second-order contrast. Our results provide insight into how stimuli are encoded and transformed in successive stages of visual processing.

Much has been learned about how stimuli are represented in the visual system from measuring responses to carefully designed stimuli. Typically, different studies focus on different types of stimuli. Making sense of the large array of findings requires integrated models that explain responses to a wide range of stimuli. In this study, we measure functional magnetic resonance imaging (fMRI) responses in early visual cortex to a wide range of band-pass filtered images, and construct a computational model that takes the stimuli as input and predicts the fMRI responses as output. The model has a cascade architecture, consisting of two stages of linear and nonlinear operations. A novel component of the model is a nonlinear operation that generates selectivity for second-order contrast, that is, variations in contrast-energy across the visual field. We find that this nonlinearity is stronger in extrastriate areas V2 and V3 than in primary visual cortex V1. Our results provide insight into how stimuli are encoded and transformed in the visual system.

The benefits of cholinergic enhancement during perceptual learning are long-lasting

The neurotransmitter acetylcholine (ACh) regulates many aspects of cognition, including attention and memory. Previous research in animal models has shown that plasticity in sensory systems often depends on the behavioral relevance of a stimulus and/or task. However, experimentally increasing ACh release in the cortex can result in experience-dependent plasticity, even in the absence of behavioral relevance. In humans, the pharmacological enhancement of ACh transmission by administration of the cholinesterase inhibitor donepezil during performance of a perceptual task increases the magnitude of perceptual learning (PL) and its specificity to physical parameters of the stimuli used for training. Behavioral effects of PL have previously been shown to persist for many months. In the present study, we tested whether enhancement of PL by donepezil is also long-lasting. Healthy human subjects were trained on a motion direction discrimination task during cholinergic enhancement, and follow-up testing was performed 5-15 months after the end of training and without additional drug administration. Increases in performance associated with training under donepezil were evident in follow-up retesting, indicating that cholinergic enhancement has beneficial long-term effects on PL. These findings suggest that cholinergic enhancement of training procedures used to treat clinical disorders should improve long-term outcomes of these procedures.

Cholinergic enhancement reduces orientation-specific surround suppression but not visual crowding

Acetylcholine (ACh) reduces the spatial spread of excitatory fMRI responses in early visual cortex and receptive field size of V1 neurons. We investigated the perceptual consequences of these physiological effects of ACh with surround suppression and crowding, two phenomena that involve spatial interactions between visual field locations. Surround suppression refers to the reduction in perceived stimulus contrast by a high-contrast surround stimulus. For grating stimuli, surround suppression is selective for the relative orientations of the center and surround, suggesting that it results from inhibitory interactions in early visual cortex. Crowding refers to impaired identification of a peripheral stimulus in the presence of flankers and is thought to result from excessive integration of visual features. We increased synaptic ACh levels by administering the cholinesterase inhibitor donepezil to healthy human subjects in a placebo-controlled, double-blind design. In Experiment 1, we measured surround suppression of a central grating using a contrast discrimination task with three conditions: (1) surround grating with the same orientation as the center (parallel), (2) surround orthogonal to the center, or (3) no surround. Contrast discrimination thresholds were higher in the parallel than in the orthogonal condition, demonstrating orientation-specific surround suppression (OSSS). Cholinergic enhancement decreased thresholds only in the parallel condition, thereby reducing OSSS. In Experiment 2, subjects performed a crowding task in which they reported the identity of a peripheral letter flanked by letters on either side. We measured the critical spacing between the targets and flanking letters that allowed reliable identification. Cholinergic enhancement with donepezil had no effect on critical spacing. Our findings suggest that ACh reduces spatial interactions in tasks involving segmentation of visual field locations but that these effects may be limited to early visual cortical processing.

Broader visual orientation tuning in patients with schizophrenia

Reduced gamma-aminobutyric acid (GABA) levels in cerebral cortex are thought to contribute to information processing deficits in patients with schizophrenia (SZ), and we have previously reported lower in vivo GABA levels in the visual cortex of patients with SZ. GABA-mediated inhibition plays a role in sharpening orientation tuning of visual cortical neurons. Therefore, we predicted that tuning for visual stimulus orientation would be wider in SZ. We measured orientation tuning with a psychophysical procedure in which subjects performed a target detection task of a low-contrast oriented grating, following adaptation to a high-contrast grating. Contrast detection thresholds were determined for a range of adapter-target orientation offsets. For both SZ and healthy controls, contrast thresholds decreased as orientation offset increased, suggesting that this tuning curve reflects the selectivity of visual cortical neurons for stimulus orientation. After accounting for generalized deficits in task performance in SZ, there was no difference between patients and controls for detection of target stimuli having either the same orientation as the adapter or orientations far from the adapter. However, patients' thresholds were significantly higher for intermediate adapter-target offsets. In addition, the mean width parameter of a Gaussian fit to the psychophysical orientation tuning curves was significantly larger for the patient group. We also present preliminary data relating visual cortical GABA levels, as measured with magnetic resonance spectroscopy, and orientation tuning width. These results suggest that our finding of broader orientation tuning in SZ may be due to diminished visual cortical GABA levels.

Modulation of inhibition of return by the dopamine D2 receptor agonist bromocriptine depends on individual DAT1 genotype

Involuntary visual spatial attention is captured when a salient cue appears in the visual field. If a target appears soon after the cue, response times to targets at the cue location are faster relative to other locations. However, after longer cue-target intervals, responses to targets at the cue location are slower, due to inhibition of return (IOR). IOR depends on striatal dopamine (DA) levels: It varies with different alleles of the DA transporter gene DAT1 and is reduced in patients with Parkinson's disease, a disease characterized by reduced striatal dopaminergic transmission. We examined the role of DA in involuntary attention and IOR by administering the DA D2 receptor-specific agonist bromocriptine to healthy human subjects. There was no effect of either DAT1 genotype or bromocriptine on involuntary attention, but participants with DAT1 alleles predicting higher striatal DA had a larger IOR. Furthermore, bromocriptine increased the magnitude of IOR in participants with low striatal DA but abolished the IOR in subjects with high striatal DA. This inverted U-shaped pattern resembles previously described relationships between DA levels and performance on cognitive tasks and suggests an involvement of striatal DA in IOR that does not include a role in involuntary attention.

Cholinergic enhancement increases the effects of voluntary attention but does not affect involuntary attention

Voluntary visual spatial attention can be allocated in a goal-oriented manner to locations containing behaviorally relevant information. In contrast, involuntary attention is automatically captured by salient events. Allocation of attention is known to be modulated by release of the neurotransmitter acetylcholine (ACh) in cerebral cortex. We used an anti-predictive spatial cueing task to assess the effects of pharmacological enhancement of cholinergic transmission on behavioral measures of voluntary and involuntary attention in healthy human participants. Each trial began with the presentation of a cue in a peripheral location. In 80% of the trials, a target then appeared in a location opposite the cue. In the remaining 20% of trials, the target appeared in the cue location. For trials with short stimulus onset asynchrony (SOA) between cue and target, involuntary capture of attention resulted in shorter reaction times (RTs) to targets presented at the cue location. For long SOA trials, allocation of voluntary attention resulted in the opposite pattern: RTs were shorter when the target appeared in the expected (opposite) location. Each subject participated in two sessions: one in which the cholinesterase inhibitor donepezil was administered to increase synaptic ACh levels and one in which placebo was administered. Donepezil selectively improved performance (reduced RT) for long SOA trials in which targets appeared in the expected location. Thus, cholinergic enhancement augments the benefits of voluntary attention but does not affect involuntary attention, suggesting that they rely on different neurochemical mechanisms.

Cholinergic enhancement augments magnitude and specificity of visual perceptual learning in healthy humans

Learning through experience underlies the ability to adapt to novel tasks and unfamiliar environments. However, learning must be regulated so that relevant aspects of the environment are selectively encoded. Acetylcholine (ACh) has been suggested to regulate learning by enhancing the responses of sensory cortical neurons to behaviorally relevant stimuli. In this study, we increased synaptic levels of ACh in the brains of healthy human subjects with the cholinesterase inhibitor donepezil (trade name: Aricept) and measured the effects of this cholinergic enhancement on visual perceptual learning. Each subject completed two 5 day courses of training on a motion direction discrimination task, once while ingesting 5 mg of donepezil before every training session and once while placebo was administered. We found that cholinergic enhancement augmented perceptual learning for stimuli having the same direction of motion and visual field location used during training. In addition, perceptual learning with donepezil was more selective to the trained direction of motion and visual field location. These results, combined with previous studies demonstrating an increase in neuronal selectivity following cholinergic enhancement, suggest a possible mechanism by which ACh augments neural plasticity by directing activity to populations of neurons that encode behaviorally relevant stimulus features.

Bursts generate a non-reducible spike-pattern code

At the single-neuron level, precisely timed spikes can either constitute firing-rate codes or spike-pattern codes that utilize the relative timing between consecutive spikes. There has been little experimental support for the hypothesis that such temporal patterns contribute substantially to information transmission. By using grasshopper auditory receptors as a model system, we show that correlations between spikes can be used to represent behaviorally relevant stimuli. The correlations reflect the inner structure of the spike train: a succession of burst-like patterns. We demonstrate that bursts with different spike counts encode different stimulus features, such that about 20% of the transmitted information corresponds to discriminating between different features, and the remaining 80% is used to allocate these features in time. In this spike-pattern code, the what and the when of the stimuli are encoded in the duration of each burst and the time of burst onset, respectively. Given the ubiquity of burst firing, we expect similar findings also for other neural systems.

Interactions of cognitive and auditory abilities in congenitally blind individuals

Congenitally blind individuals have been found to show superior performance in perceptual and memory tasks. In the present study, we asked whether superior stimulus encoding could account for performance in memory tasks. We characterized the performance of a group of congenitally blind individuals on a series of auditory, memory and executive cognitive tasks and compared their performance to that of sighted controls matched for age, education and musical training. As expected, we found superior verbal spans among congenitally blind individuals. Moreover, we found superior speech perception, measured by resilience to noise, and superior auditory frequency discrimination. However, when memory span was measured under conditions of equivalent speech perception, by adjusting the signal to noise ratio for each individual to the same level of perceptual difficulty (80% correct), the advantage in memory span was completely eliminated. Moreover, blind individuals did not possess any advantage in cognitive executive functions, such as manipulation of items in memory and math abilities. We propose that the short-term memory advantage of blind individuals results from better stimulus encoding, rather than from superiority at subsequent processing stages.

Burst firing is a neural code in an insect auditory system

Various classes of neurons alternate between high-frequency discharges and silent intervals. This phenomenon is called burst firing. To analyze burst activity in an insect system, grasshopper auditory receptor neurons were recorded in vivo for several distinct stimulus types. The experimental data show that both burst probability and burst characteristics are strongly influenced by temporal modulations of the acoustic stimulus. The tendency to burst, hence, is not only determined by cell-intrinsic processes, but also by their interaction with the stimulus time course. We study this interaction quantitatively and observe that bursts containing a certain number of spikes occur shortly after stimulus deflections of specific intensity and duration. Our findings suggest a sparse neural code where information about the stimulus is represented by the number of spikes per burst, irrespective of the detailed interspike-interval structure within a burst. This compact representation cannot be interpreted as a firing-rate code. An information-theoretical analysis reveals that the number of spikes per burst reliably conveys information about the amplitude and duration of sound transients, whereas their time of occurrence is reflected by the burst onset time. The investigated neurons encode almost half of the total transmitted information in burst activity.

Spike-timing precision underlies the coding efficiency of auditory receptor neurons

Sensory systems must translate incoming signals quickly and reliably so that an animal can act successfully in its environment. Even at the level of receptor neurons, however, functional aspects of the sensory encoding process are not yet fully understood. Specifically, this concerns the question how stimulus features and neural response characteristics lead to an efficient transmission of sensory information. To address this issue, we have recorded and analyzed spike trains from grasshopper auditory receptors, while systematically varying the stimulus statistics. The stimulus variations profoundly influenced the efficiency of neural encoding. This influence was largely attributable to the presence of specific stimulus features that triggered remarkably precise spikes whose trial-to-trial timing variability was as low as 0.15 ms--one order of magnitude shorter than typical stimulus time scales. Precise spikes decreased the noise entropy of the spike trains, thereby increasing the rate of information transmission. In contrast, the total spike train entropy, which quantifies the variety of different spike train patterns, hardly changed when stimulus conditions were altered, as long as the neural firing rate remained the same. This finding shows that stimulus distributions that were transmitted with high information rates did not invoke additional response patterns, but instead displayed exceptional temporal precision in their neural representation. The acoustic stimuli that led to the highest information rates and smallest spike-time jitter feature pronounced sound-pressure deflections lasting for 2-3 ms. These upstrokes are reminiscent of salient structures found in natural grasshopper communication signals, suggesting that precise spikes selectively encode particularly important aspects of the natural stimulus environment.