A Compound Computational Model for Filling-In Processes Triggered by Edges: Watercolor Illusions

The goal of our research was to develop a compound computational model with the ability to predict different variations of the “watercolor effects” and additional filling-in effects that are triggered by edges. The model is based on a filling-in mechanism solved by a Poisson equation, which considers the different gradients as “heat sources” after the gradients modification. The biased (modified) contours (edges) are ranked and determined according to their dominancy across the different chromatic and achromatic channels. The color and intensity of the perceived surface are calculated through a diffusive filling-in process of color triggered by the enhanced and biased edges of stimulus formed as a result of oriented double-opponent receptive fields. The model can successfully predict both the assimilative and non-assimilative watercolor effects, as well as a number of “conflicting” visual effects. Furthermore, the model can also predict the classic Craik–O'Brien–Cornsweet (COC) effect. In summary, our proposed computational model is able to predict most of the “conflicting” filling-in effects that derive from edges that have been recently described in the literature, and thus supports the theory that a shared visual mechanism is responsible for the vast variety of the “conflicting” filling-in effects that derive from edges.

Predicting Illusory Contours Without Extracting Special Image Features

Boundary completion is one of the desired properties of a robust object boundary detection model, since in real-word images the object boundaries are commonly not fully and clearly seen. An extreme example of boundary completion occurs in images with illusory contours, where the visual system completes boundaries in locations without intensity gradient. Most illusory contour models extract special image features, such as L and T junctions, while the task is known to be a difficult issue in real-world images. The proposed model uses a functional optimization approach, in which a cost value is assigned to any boundary arrangement to find the arrangement with minimal cost. The functional accounts for basic object properties, such as alignment with the image, object boundary continuity, and boundary simplicity. The encoding of these properties in the functional does not require special features extraction, since the alignment with the image only requires extraction of the image edges. The boundary arrangement is represented by a border ownership map, holding object boundary segments in discrete locations and directions. The model finds multiple possible image interpretations, which are ranked according to the probability that they are supposed to be perceived. This is achieved by using a novel approach to represent the different image interpretations by multiple functional local minima. The model is successfully applied to objects with real and illusory contours. In the case of Kanizsa illusion the model predicts both illusory and real (pacman) image interpretations. The model is a proof of concept and is currently restricted to synthetic gray-scale images with solid regions.

A Model for a Filling-in Process Triggered by Edges Predicts "Conflicting" Afterimage Effects

The goal of our research was to develop a compound computational model that predicts the "opposite" effects of the alternating aftereffects stimuli, such as the "color dove illusion" (Barkan and Spitzer, 2017), and the "filling in the afterimage after the image" (van Lier et al., 2009). The model is based on a filling-in mechanism, through a diffusion equation where the color and intensity of the perceived surface are obtained through a diffusion process of color from the stimulus edges. The model solves the diffusion equation with boundary conditions that takes the locations of the chromatic edges of the chromatic inducer (chromatic stimulus) and the achromatic remaining contours into account. These contours (edges) trigger the diffusion process. The same calculations are done for both types of afterimage effects, with the only difference related to the location of the remaining contour. While a gradient toward the inducing color produces a perception of the complementary color, an opposite gradient yields the perception of the same color as that of the chromatic inducer. Furthermore, we show that the same computational model can also predict new alternating aftereffects stimuli, such as the spiral stimulus, and the averaging of colors in alternating afterimage stimuli described by Anstis et al. (2012). The suggested model is able to predict most of the additional properties related to the "conflicting" phenomena that have been recently described in the literature, and thus supports the idea that a shared visual mechanism is responsible for both the positive and the negative effects.

The ASACUSA antihydrogen and hydrogen program: results and prospects

The goal of the ASACUSA-CUSP collaboration at the Antiproton Decelerator of CERN is to measure the ground-state hyperfine splitting of antihydrogen using an atomic spectroscopy beamline. A milestone was achieved in 2012 through the detection of 80 antihydrogen atoms 2.7 m away from their production region. This was the first observation of 'cold' antihydrogen in a magnetic field free region. In parallel to the progress on the antihydrogen production, the spectroscopy beamline was tested with a source of hydrogen. This led to a measurement at a relative precision of 2.7×10^-9 which constitutes the most precise measurement of the hydrogen hyperfine splitting in a beam. Further measurements with an upgraded hydrogen apparatus are motivated by CPT and Lorentz violation tests in the framework of the Standard Model Extension. Unlike for hydrogen, the antihydrogen experiment is complicated by the difficulty of synthesizing enough cold antiatoms in the ground state. The first antihydrogen quantum states scan at the entrance of the spectroscopy apparatus was realized in 2016 and is presented here. The prospects for a ppm measurement are also discussed.This article is part of the Theo Murphy meeting issue 'Antiproton physics in the ELENA era'.

Neuronal Mechanism for Compensation of Longitudinal Chromatic Aberration-Derived Algorithm

The human visual system faces many challenges, among them the need to overcome the imperfections of its optics, which degrade the retinal image. One of the most dominant limitations is longitudinal chromatic aberration (LCA), which causes short wavelengths (blue light) to be focused in front of the retina with consequent blurring of the retinal chromatic image. The perceived visual appearance, however, does not display such chromatic distortions. The intriguing question, therefore, is how the perceived visual appearance of a sharp and clear chromatic image is achieved despite the imperfections of the ocular optics. To address this issue, we propose a neural mechanism and computational model, based on the unique properties of the S-cone pathway. The model suggests that the visual system overcomes LCA through two known properties of the S channel: (1) omitting the contribution of the S channel from the high-spatial resolution pathway (utilizing only the L and M channels). (b) Having large and coextensive receptive fields that correspond to the small bistratified cells. Here, we use computational simulations of our model on real images to show how integrating these two basic principles can provide a significant compensation for LCA. Further support for the proposed neuronal mechanism is given by the ability of the model to predict an enigmatic visual phenomenon of large color shifts as part of the assimilation effect.

Multi-scale texture-based level-set segmentation of breast B-mode images

Automatic segmentation of ultrasonographic breast lesions is very challenging, due to the lesions' spiculated nature and the variance in shape and texture of the B-mode ultrasound images. Many studies have tried to answer this challenge by applying a variety of computational methods including: Markov random field, artificial neural networks, and active contours and level-set techniques. These studies focused on creating an automatic contour, with maximal resemblance to a manual contour, delineated by a trained radiologist. In this study, we have developed an algorithm, designed to capture the spiculated boundary of the lesion by using the properties from the corresponding ultrasonic image. This is primarily achieved through a unique multi-scale texture identifier (inspired by visual system models) integrated in a level-set framework. The algorithm׳s performance has been evaluated quantitatively via contour-based and region-based error metrics. We compared the algorithm-generated contour to a manual contour delineated by an expert radiologist. In addition, we suggest here a new method for performance evaluation where corrections made by the radiologist replace the algorithm-generated (original) result in the correction zones. The resulting corrected contour is then compared to the original version. The evaluation showed: (1) Mean absolute error of 0.5 pixels between the original and the corrected contour; (2) Overlapping area of 99.2% between the lesion regions, obtained by the algorithm and the corrected contour. These results are significantly better than those previously reported. In addition, we have examined the potential of our segmentation results to contribute to the discrimination between malignant and benign lesions.

Single additive mechanism predicts lateral interactions effects-computational model

The mechanism underlying the lateral interactions (LI) phenomenon is still an enigma. Over the years, several groups have tried to explain the phenomenon and suggested models to predict its psychophysical results. Most of these models comprise both inhibitory and facilitatory mechanisms for describing the LI phenomenon. Their studies' assumption that a significant inhibition mechanism exists is based on the classical interpretation of the threshold elevation perceived in psychophysical experiments. In this work, we suggest a different interpretation of the threshold elevation obtained experimentally. Our model proposes and demonstrates how a facilitatory additive mechanism can solely predict both the facilitation and "inhibition" aspects of the phenomenon, without the need for an additional inhibitory mechanism, at least for the two flankers' configurations. Though the model is simple it succeeds to predict the LI effect under a large variety of stimuli configurations and parameters. The model is in agreement with both classical and recent psychophysical and neurophysiological results. We suggest that the LI mechanism plays a role in creating an educated guess to form a continuation of gratings and textures based on the surrounding visual stimuli.

Is the Kanizsa illusion triggered by the simultaneous contrast mechanism?

Current illusory contour models do not predict the disappearance of the Kanizsa illusion due to specific spatial luminance distributions within the inducers. We suggest that these stimulus conditions are characterized by an insufficient amount of induced brightness. Our model's core assumption is that contour edge detection of the Kanizsa illusion and the simultaneous contrast (brightness induction) effect are triggered by the same mechanism. The simultaneous contrast can immunize the occlusion detection mechanism against spatial and temporal noise. Our model contains physiologically inspired building blocks that detect the oriented contour edges, complete the illusory contours, and enhance them. The model succeeds in predicting the appearance and the disappearance of many different Kanizsa illusion variants.

Does the chromatic Mach bands effect exist?

The achromatic Mach bands effect is a well-known visual illusion, discovered over a hundred years ago. This effect has been investigated thoroughly, mainly for its brightness aspect. The existence of Chromatic Mach bands, however, has been disputed. In recent years it has been reported that Chromatic Mach bands are not perceived under controlled iso-luminance conditions. However, here we show that a variety of Chromatic Mach bands, consisting of chromatic and achromatic regions, separated by a saturation ramp, can be clearly perceived under iso-luminance and iso-brightness conditions. In this study, observers' eye movements were recorded under iso-brightness conditions. Several observers were tested for their ability to perceive the Chromatic Mach bands effect and its magnitude, across different cardinal and non-cardinal Chromatic Mach bands stimuli. A computational model of color adaptation, which predicted color induction and color constancy, successfully predicts this variation of Chromatic Mach bands. This has been tested by measuring the distance of the data points from the "achromatic point" and by calculating the shift of the data points from predicted complementary lines. The results suggest that the Chromatic Mach bands effect is a specific chromatic induction effect.

Brightness contrast-contrast induction model predicts assimilation and inverted assimilation effects

In classical assimilation effects, intermediate luminance patches appear lighter when their immediate surround is comprised of white patches and appear darker when their immediate surround is comprised of dark patches. With patches either darker or lighter than both inducing patches, the direction of the brightness effect is reversed and termed as "inverted assimilation effect." Several explanations and models have been suggested, some are relevant to specific stimulus geometry, anchoring theory, and models that involve high level cortical processing (such as scission, etc.). None of these studies predicted the various types of assimilation effects and their inverted effects. We suggest here a compound brightness model, which is based on contrast-contrast induction (second-order adaptation mechanism). The suggested model predicts the various types of brightness assimilation effects and their inverted effects. The model is composed of three main stages: (1) composing post-retinal second-order opponent receptive fields, (2) calculations of local and remote contrast, and (3) adaptation of the second-order (contrast-contrast induction). We also utilize a variation of the Jacobi iteration process to enable elegant edge integration in order to evaluate the model is performance.

Insulin glulisine: a faster onset of action compared with insulin lispro

AIM

This randomized, single-centre, double-blind, crossover study compared the pharmacodynamic and pharmacokinetic properties of two different doses of insulin glulisine (glulisine) and insulin lispro (lispro) in lean to obese subjects.

METHODS

Eighty subjects without diabetes, stratified into four body mass index (BMI) classes (<25, >or=25 to <30, >or=30 to <35 and >or=35 kg/m(2)), were randomized to receive single injections of glulisine and lispro (0.2 and 0.4 U/kg) on four study days under glucose clamp conditions. Glucose infusion rates (GIR) and insulin (INS) concentrations were assessed for 10 h postdose.

RESULTS

Glulisine showed a greater early metabolic action than lispro [GIR-area under the curve (GIR-AUC) between 0 and 1 h (0.2 U/kg: 102.3 +/- 75.1 vs. 83.1 +/- 72.8 mg/kg, p < 0.05; 0.4 U/kg: 158.0 +/- 100.0 vs. 112.3 +/- 70.8 mg/kg, p < 0.001)], with an earlier time to 10% of total GIR-AUC (0.2 U/kg: 1.4 +/- 0.4 vs. 1.5 +/- 0.4 h; 0.4 U/kg: 1.4 +/- 0.3 vs. 1.5 +/- 0.3 h, p < 0.05). The total metabolic effect was not different between the two insulins. In accordance with these findings, the time to 10% of total INS-AUC was faster with glulisine compared with lispro at either dose (0.2 U/kg: 0.7 +/- 0.2 vs. 0.8 +/- 0.2 h; 0.4 U/kg: 0.8 +/- 0.2 vs. 0.9 +/- 0.2 h, p < 0.001). The faster rise in insulin concentrations and the earlier onset of activity of glulisine vs. lispro was consistently observed in each individual BMI class.

CONCLUSIONS

Glulisine shows a faster onset of action than lispro, independent of BMI and dose.

Chromatic collinear facilitation, further evidence for chromatic form perception

Collinear facilitation of contrast detection of achromatic stimuli has been studied over the past decade by different groups. We measured collinear facilitation of chromatic contrast detection under equal-luminance (photometric quantity) and under isoluminance (minimum motion technique) conditions, as two different controls. The facilitation was tested for chromatic contrast detection of a foveal Gabor signal flanked by two high chromatic-contrast Gabor signals. The results indicated a significant facilitation in the presence of spatial adjacent collinear chromatic contrast signals, when the flankers were located at a short distance, across all observers for three chromatic channels. The facilitation was compared to a non-collinear flanker configuration. The results indicated no facilitation effect at the opposing phase configuration, at a short flanker distance, whereas a small facilitation was observed with a configuration at a longer flanker distance. The findings suggest that the performance and specificity of chromatic collinear facilitation is not impaired with regard to achromatic mechanisms.

Computational adaptation model and its predictions for color induction of first and second orders

The appearance of a patch of color or its contrast depends not only on the stimulus itself but also on the surrounding stimuli (induction effects-simultaneous contrast). A comprehensive computational physiological model is presented to describe chromatic adaptation of the first (retinal) and second (cortical) orders, and to predict the different chromatic induction effects. We propose that the chromatic induction of the first order that yields perceived complementary colors can be predicted by retinal adaptation mechanisms, contrary to previous suggestions. The second order of the proposed adaptation mechanism succeeds to predict the automatic perceived inhibition or facilitation of the central contrast of a texture stimulus, depending on the surrounding contrast. Furthermore, contrary to other models, this model is able to also predict the effect of variegated surrounding on the central perceived color.

Color constancy: the role of low-level mechanisms

Color constancy (CC) is an important psychophysical phenomenon, which has been studied extensively. However, it is not clearly understood. This study presents a novel biological model for the contribution of low level mechanisms to CC. The model is based on two chromatic adaptation mechanisms in the color-coded retinal ganglion cells, 'local' and 'remote', which cause a 'curve-shifting' effect at each receptive field subregion. Simulations are employed for calculating the perceived image and measuring the degree of CC using both 'human-perception' and 'machine-vision' indices. The results indicate that the contribution of adaptations to CC is significant, robust and in agreement with experimental findings. The model is successful in performing CC under multiple chromatic illumination sources, a condition which mimics common natural environments.

Width of the specular peak perpendicular to the principal plane for rough surfaces

The bidirectional reflectance distribution function (BRDF) model developed by Torrance and Sparrow [J. Opt. Soc. Am. 57, 1105-1114 (1967)] is used to describe the specular reflection of rough surfaces. We compare this model with the BRDF measurements of four manmade surfaces with different roughnesses. The model can be used to describe the basic features of the measured BRDFs. We found that the width of the specular peak perpendicular to the principal plane decreases strongly with an increasing illumination zenith angle in the data as well as in the model. A model analysis shows that the width is approximately proportional to the cosine of the illumination angle theta(i), and the deviations are determined by the roughness of the surface. This relationship is accompanied by an increase in reflectance in the specular direction in the principal plane that is 1/cos theta(i) stronger than the increase for a perfectly smooth surface.

The effects of attentional spread and attentional effort on orientation discrimination

The spatial properties of visual attention and its relation to attentional effort have been investigated, and it has been found that stimulus detectability changes as a function of attentional beam width and degree of task difficulty. Using a matching-to-sample paradigm, two Gabor patches were presented simultaneously both as a sample stimulus and a test stimulus, the stimuli set at three different distances. Task difficulty was gradated by changing the orientation difference of the two Gabor patches on nonmatching trials. 'Difficult' nonmatching probe trials were embedded within an easy block of trials (easy condition), and vice versa for 'easy' probe trials. The detectability, d', differences of probe trials in the two conditions were calculated as a measure of change in attention. Our results show that the detectability of a pair of stimuli decreases with an increase in the distance between stimuli. Furthermore, the results indicate an increase in attentional effort for various attentional beam widths and that r = d'easy/d'difficult of the probe trials is constant throughout the different stimuli separation.

The Effects of Attentional Spread and Attentional Effort on Orientation Discrimination

We investigated the spatial properties of visual attention, and its relation to attentional effort. We show that stimulus detectability changes as a function of attentional beam width and of the degree of task difficulty. We used a matching-to-sample paradigm, presenting two Gabor patches simultaneously as sample stimuli and as test stimulus, the stimuli being at three different distances. Task difficulty was graded by changing the orientation difference of the two Gabor patches on nonmatching trials. ‘Difficult’ nonmatching probe trials were embedded within an easy block of trials (easy condition), and vice versa for ‘easy’ probe trials. Differences in the detectability, d', between probe trials in the two conditions were taken as a measure for the change in attention. Our results show that the detectability of a pair of stimuli decreases with an increase in the distance between stimuli. In addition, the results indicate an increase in attentional effort for different attentional beam widths, and also suggest a decrease in the SD of the internal stimulus representation during the task conditions that require more attention.

Role of remote adaptation in perceived subjective color

Light adaptation to illumination that is presented peripherally changes the subjective color of a central Benham disk stimulus. In our experiments we kept the peripheral illumination achromatic and remote (not even adjacent to the test stimulus). Using a high-frame-rate monitor, we produced the subjective color stimulus, to our knowledge for the first time, on a computer screen in emulation of the Benham disk programs. The resulting changes in the perceived subjective color were as follows: (1) Remote adapting illumination caused a dramatic shift in the perceived subjective color with a span from red to green; (2) there was a trade-off dependence between the area and the intensity of the remote adapting illumination with respect to the perceived color of the test stimulus; (3) the effect of the remote adaptation showed no interocular interaction. This finding suggests that the effect is elicited from a low-level stage in the visual pathway. In addition, we were able to approximate experimentally the spatial profile of the contribution of the remote illumination through the shift in the perceived color. We also found an opposite general trend of color shifts that occurred when either the central stimulus luminance or the remote illumination was increased. A suggested model for the reversed color shifts trend is discussed.

Spatiotemporal adaptation model for retinal ganglion cells

An adaptation model for the level of the ganglion cell in the retina is presented. The model assumes separate adaptation mechanisms for each of the receptive field (RF) regions, i.e., before edge detection. According to the model, the decay in the response time course of each RF region reflects its adaptation process. A mathematical description of adaptation that includes its temporal properties is developed through the change in the semisaturation constant theta in the Naka-Rushton equation. The model and its simulations show a good agreement with a wide variety of physiological studies.

Attentional effort modulated by task difficulty

It has been assumed that stimulus discrimination in a visual task is performed with fixed attentive effort. Here we show that attention to the same pair of stimuli can be modulated by varying the task difficulty when a task requires the discrimination of only a small number of different stimuli. We used a matching-to-sample paradigm, where a test stimulus is presented after a sample stimulus. When both stimuli Gabor gratings have identical orientations ("matching" trial) the required response is different from when they have different orientations ("non-matching" trial). The task difficulty was manipulated by changing the orientation difference between sample and test stimuli for non-matching trials. Difficult non-matching probe trials were embedded within an easy block of trials (easy environment), and vice versa for easy probe trials. Detectability (d') differences for the same pairs of stimuli (probe trials) in the two environments were calculated as a measure for change in attentional effort, regardless of changes in likelihood ratios (beta). Our results show an increase in d' during the difficult task, for both types of probe trials, in paradigms that contained a small number of stimulus combinations. Thus a modulation in attentional effort along a single discrimination dimension is revealed. However it is restricted by the number of stimulus combinations, due to the limited capacity of the attention available for each stimulus combination.

Model of local velocity in the primary visual cortical cells

A motion model for the early stages of motion processing in the visual cortex that focuses on velocity properties is presented. The model presents analytically the correlation between the velocity tuning curve and various cell parameters. The building block for this model is the rebound response, which makes possible the detection of spatial and temporal edges. The model suggests that adjacent subunits in the primary cortical cells display different strengths in their rebound responses, and thus a synergistic response is evoked in the preferred direction. The analysis deals separately with the two cutoff points of the velocity tuning curves. The model predicts a linear relation between the low cutoff point and the receptive-field size and an inverse correlation with the integration time. The high cutoff point is inversely correlated with the cell threshold.

Effect of degree of uniformity on predicted visual cortical response tuning curves

The different cortical visual cells exhibit a large repertoire of responses to sinusoidal gratings, depending on their receptive field structure and the stimulation parameters. It has been shown previously that the tuning curves and histogram shapes of cell responses are affected by subunit distances. One receptive field model (Spitzer and Hochstein 1985b) incorporated subunit distance but assigned it as a constant parameter, for ease of calculation. Here we investigate different tuning curve properties of various primary cortical cell types during testing of 10 deg of nonuniform distances of the receptive fields' subunits. The effect of nonuniformity was compared for average responses, tuning curve shapes, maximum peak responses, and bandwidths across four cell types of different sizes. The shapes and other properties of tuning curves are usually found to be retained also when the degree of uniformity is not very high for most of the cell types. In addition, the effect of uniformity is compared across these different response properties. The maximum peak responses of the tuning curve are found to display a lower coefficient of variation than the bandwidth, for all cell types, for most degrees of uniformity.

Spatio-temporal model for subjective colours based on colour coded ganglion cells

We propose a mathematical model for the generation of the subjective colour phenomenon through Benham's disk stimuli. The model relates to the spatial and temporal properties of three colour coded retinal ganglion cells: L+/M-, M+/L- and S-/(L+M)+ [or (L+M)-/S+]. It is suggested that the phenomenon is based on both the opponent mechanisms in the cells' receptive fields, and the "rebound response"--a common cell response to turning off of an inhibitory stimulus (nonlinear cell dynamics). A physiological mechanism is suggested for this response. The integrated cell responses to Benham disk-stimuli create imbalances between the colour pathways that are interpreted as actual colours. The model also predicts the shift in the perceived colours when the disk rotation rate is varied.

A model for the early stages of motion processing based on spatial and temporal edge detection by X-cells

A model for the early stages of motion processing in the visual cortex is presented. The 'building block' for this model is the 'rebound response', which is the neuronal response evoked when a sufficient inhibitory stimulus is turned off. This response enables detection of temporal changes when the stimulus involves spatial changes. The model suggests that adjacent subunits in primary cortical cells have different weight functions for rebound responses, and thus a synergistic type of response is evoked in the preferred direction, which is predicted for both light and dark stimuli. Predictions of the model for different stimuli and receptive field structures are discussed. It appears to be more economical than previous motion models.

A model for detection of spatial and temporal edges by a single X cell

When an inhibitory visual stimulus is turned off, an increased rate of spike discharge is evoked which we term the "rebound response". This response exists as a part of different cell responses from the retina to the cortex. The rebound response, with its temporal dependence on stimulus parameters, has not been previously considered in models. Here we present such a model, and also show its dependence on stimulus duration and its turning off rate. The rebound response enables detection of temporal changes when a visual stimulus involves spatial changes. The temporal change detection is affected by the actual stimulus duration, which can also be seen as a cell memory operation.

Task difficulty: ignoring, attending to, and discriminating a visual stimulus yield progressively more activity in inferior temporal neurons

To study the influence of task difficulty on the stimulus-elicited responses of inferior temporal (IT) neurons, the stimulus-elicited responses of 64 neurons were recorded from IT cortex of three rhesus monkeys while they performed three behavioral tasks-an irrelevant-stimulus task, a stimulus detection task, and a stimulus discrimination task. The monkey could ignore the stimulus entirely in the irrelevant-stimulus task, was required only to detect stimulus dimming in the stimulus detection task, and was required to attend to specific properties of the stimulus in the discrimination task. The excitatory responses in the discrimination and stimulus detection tasks were larger than those in the irrelevant-stimulus task (61% and 33%, respectively, of the individual differences were significant), and excitatory responses in the discrimination task were larger than those in the detection task (49% of the individual differences reached significance). Twenty percent of the stimulus presentations elicited inhibitory responses that were followed by off-responses. The off-responses were modulated by the tasks in the same order as the excitatory on-responses. Assuming that the off-response strengths indicate the depth of the stimulus-induced inhibition, these results suggest that inhibitory responses were influenced across these tasks in a manner similar to the excitatory responses. When the neuronal responses were related to the difficulties of these tasks, both the response strength and errors were seen to be least during the irrelevant-stimulus task and greatest during the discrimination task. This relationship suggests that the visual responsiveness of IT neurons is related to the degree of attention the animal pays to the stimulus.(ABSTRACT TRUNCATED AT 250 WORDS)

Temporal encoding of two-dimensional patterns by single units in primate primary visual cortex. I. Stimulus-response relations

1. Previously we developed a new approach for investigating visual system neuronal activity in which single neurons are considered to be communication channels transmitting stimulus-dependent codes in their responses. Application of this approach to the stimulus-response relations of inferior temporal (IT) neurons showed that these carry stimulus-dependent information in the temporal modulation as well as in the strength of their responses. IT cortex is a late station in the visual processing stream. Presumably the neuronal properties arise from the properties of the inputs. However, the discovery that IT neuronal spike trains transmit information in stimulus-dependent temporally modulated codes could not be assumed to be true for those earlier stations, so the techniques used in the earlier study were applied to single-striate cortical neurons in the studies reported here. 2. Single-striate cortical neurons were recorded from three awake, fixating rhesus monkeys. The neurons were stimulated by two sets of patterns. The first set was made up of 128 black-and-white patterns based on a complete, orthogonal set of two-dimensional Walsh-Hadamard functions. These stimuli appear as combinations of black-and-white rectangles and squares, and they fully span the range of all possible black-and-white pictures that can be constructed in an 8 x 8 grid. Except for the stimulus that appeared as an all-white or all-black square, each stimulus had equal areas of white and black. The second stimulus set was made up of single bars constructed in the same 8 x 8 grid as the Walsh stimuli. These were presented both as black against a gray background and white against a gray background. The stimuli were centered on the receptive field, and each member of the stimulus set was presented once before any stimulus appeared again. 3. The responses of 21 striate cortical neurons were recorded and analyzed. Two were identified as simple cells and the other 19 as complex cells according to the criteria originally used by Hubel and Wiesel. The stimulus set elicited a wide variety of response strengths and patterns from each neuron. The responses from both the bars and the Walsh set could be used to differentiate and classify simple and complex cells. 4. The responses of both simple and complex cells showed striking stimulus-related strength and temporal modulation. For all of the complex cells there were instances where the responses to a stimulus and its contrast-reversed mate were substantially different in response strength or pattern, or both.(ABSTRACT TRUNCATED AT 400 WORDS)

Increased attention enhances both behavioral and neuronal performance

Single cells were recorded from cortical area V4 of two rhesus monkeys (Macaca mulatta) trained on a visual discrimination task with two levels of difficulty. Behavioral evidence indicated that the monkeys' discriminative abilities improved when the task was made more difficult. Correspondingly, neuronal responses to stimuli became larger and more selective in the difficult task. A control experiment demonstrated that changes in general arousal could not account for the effects of task difficulty on neuronal responses. It is concluded that increasing the amount of attention directed toward a stimulus can enhance the responsiveness and selectivity of the neurons that process it.

Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. I. Response characteristics

We seek a general approach to determine what stimulus features visual neurons are sensitive to and how those features are represented by the neuron's responses. Because lesions of inferior temporal (IT) cortex interfere with a monkey's ability to perform pattern discrimination tasks we studied IT neurons. Previous single-unit studies have shown that IT neurons sometimes respond more strongly to complex stimuli (brushes, hands, faces) than to simple stimuli (bars, slits, edges). However, it is not known how specific stimulus parameters are represented by responses. We studied the responses of IT neurons in alert behaving monkeys to a large set of two-dimensional black and white patterns. The stimulus set was based on 64 Walsh functions that can be used to represent any picture with a resolution of one part in eight along each of two dimensions. The responses to these stimuli spanned a continuum from inhibition to strong excitation. A statistical test showed that the spike count was determined by which Walsh stimulus was presented. Hence, these stimuli form an adequate set for testing IT neurons. The responses showed temporal modulation of the spike train that could not be represented by a change in the spike count alone. Examples of this modulation were changes in latency, changes in the duration of the response, and alternating periods of excitation and inhibition. This temporal modulation may be important in representing stimulus parameters. The next paper in this series develops a method for quantifying this temporal modulation and shows that it is dependent on the stimulus. The third paper in this series shows that this temporal modulation contains more information about stimulus parameters than is contained in the spike count alone.

Visual receptive fields of cat cortical neurons lack the distinctive geniculate Y cell signature

Retinal ganglion and lateral geniculate cells of the primary visual pathway may be categorized as X or Y according to their spatial linearity summation properties. In particular, Y cell spatial-frequency transfer functions have a distinctive spatial--linearity signature. Their receptive fields comprise a temporally and spatially linear mechanism (center plus antagonistic surround) that responds to relatively low spatial frequency stimuli, and a temporally nonlinear mechanism, coextensive with the linear mechanism, that--though broad in extent--responds best to high spatial-frequency stimuli. This component exhibits spatially nonlinear properties. We looked for this Y cell signature in cat visual cortical cells. If the predominant excitatory input to a certain type of cortical cell were from lateral geniculate nucleus (LGN) Y cells, we would expect to find the Y cell signature underlying the cortical cell transfer function. However, we have not found this Y cell signature in any of the cortical cell studied, and in particular not in the nonlinear complex cells. This would suggest that cortical spatial summation nonlinearities are not functionally derived from input Y cell nonlinearities.

A complex-cell receptive-field model

The time course of the response of a single cortical neuron to counterphase-grating stimulation may vary as a function of stimulation parameters, as shown in the preceding paper (19). The poststimulus-time histograms of the response amplitudes against time are single or double peaked, and where double peaked, the two peaks are of equal or unequal amplitudes. Furthermore, the spatial-phase dependence of cortical complex-cell responses may be a function of spatial frequency, so that the receptive field appears to have linear spatial summation at some spatial frequencies and nonlinear spatial summation at others (19). In the first part of this paper, we analyze a model receptive field that displays this behavior, and in the second part experimental data are presented and analyzed with regard to the model. The model cortical receptive field in its simplest form contains (two rows) of geniculate X-cell-like, DOG (difference-of-Gaussians)-shaped, center-surround antagonistic, circular-input subunits. We propose nonlinear summation between these two subunits, by introducing a half-wave rectification stage before pooling. The model is tested for the responses it predicts for the application of counterphase-grating stimulation. This simple model predicts the appearance of three response forms as a function of counterphase-stimulation parameters. At periodic spatial frequencies the expected-response histogram has a single peak, whose amplitude has a sinusoidal dependence on spatial phase. At spatial frequencies halfway between these, the expected-response histogram has two equal peaks whose amplitudes have a full-wave rectified sinusoidal dependence on spatial phase. At all intermediate spatial frequencies the expected-response histogram has a "mixed" form; the histogram appears sometimes with one peak, sometimes with two equal peaks, and generally with two peaks of unequal amplitude, as a function of spatial phase. Null responses are expected to appear at specific spatial phases only for the periodic spatial frequencies that give "pure" response time courses as in paragraph 5 above, and not in the more common mixed response case of paragraph 6. The analysis procedure described in the preceding paper (19) is used, separating the odd and even Fourier components of the response histograms reflecting the receptive-field intrasubunit linear summation and intersubunit nonlinear summation, respectively. We propose that this model may be used as a working hypothesis for the analysis of these aspects of the various cortical receptive-field types. Experimental data are described and discussed in terms of the model.(ABSTRACT TRUNCATED AT 400 WORDS)

Simple- and complex-cell response dependences on stimulation parameters

We studied the response time course and amplitude dependence on stimulation parameters in cat cortical visual neurons to determine their receptive-field spatial-summation characteristics. Response poststimulus time (PST) histograms of cortical simple cells to contrast-reversal grating stimulation generally have a single peak for each stimulus temporal cycle, though the responses appear rectified. In response to contrast-reversal grating stimulation the general PST histogram time course for complex cells is two peaks, though often these peaks are of different amplitudes. The time course of complex-cell responses, and the ratio of these two response peaks often varies with stimulation parameters. The appearance of a single response peak in simple cells is reflected in the dominance of the odd harmonic Fourier portion, whereas the half-wave rectification leads to a considerable even harmonic portion. Still, this even portion is never significantly greater than the odd portion. When complex cell PST histograms have two nearly equal peaks, Fourier transformation reveals almost only even harmonic components. When the histogram contains two peaks of unequal amplitude Fourier analysis reveals large odd and even components. An even:odd Fourier harmonic portion ratio larger than 1 may be seen as a defining characteristic of complex cells, differentiating them from simple cells. Histograms with two unequal peaks appear "mixed," containing something of the "pure" single-peaked response and something of the pure double-peaked response. The degree to which the response is mixed may be measured by the ratio of the even:odd portion amplitudes. There is a great degree of variability with stimulation parameters (both spatial phase and spatial frequency) of the time course of mixed responses as opposed to the case of responses that have two equal peaks independent of stimulation grating phase and frequency. In both simple and complex cells there is a close coincidence of the spatial frequency ranges over which the even and odd portions are substantial, though many complex cells show a periodic variation of the even:odd portions ratio. This spatial-frequency dependence differs from that of LGN Y-cells where the odd portion dominates at low spatial frequencies and the even portion at high spatial frequencies. The ratio of even-to-odd portion cut-off is close to 3:1 in all Y-cells, a characteristic we did not find in cortical simple or complex cells. We suggest, therefore, that the nonlinearity of these complex cells does not derive from that of Y-cells.(ABSTRACT TRUNCATED AT 400 WORDS)

Zero-crossing detectors in primary visual cortex?

David Marr and others have hypothesized that the visual system processes complex scene information in stages, the first of which involves the detection of light intensity edges or "zero-crossings" (Marr, 1982). Ideal zero-crossing detector mechanisms have been described and modeled in terms of their possible physiological implementation (Marr and Hildreth, 1980; Poggio, 1983). We now present evidence of visual cortical receptive fields which resemble in spatial organizational terms the requirements of zero-crossing analysis. The linear and nonlinear summation within and between the receptive field subunits are described and compared with predicted processes. The relative subunit sizes and separations are analyzed in these terms. Our findings support the notion that receptive fields may correspond with zero-crossing filters rather than zero-crossing detector gates.