Flicker

The perceptual timescape: Perceptual history on the sub-second scale

There is a high-capacity store of brief time span (∼1000 ms) which information enters from perceptual processing, often called iconic memory or sensory memory. It is proposed that a main function of this store is to hold recent perceptual information in a temporally segregated representation, named the perceptual timescape. The perceptual timescape is a continually active representation of change and continuity over time that endows the perceived present with a perceived history. This is accomplished primarily by two kinds of time marking information: time distance information, which marks all items of information in the perceptual timescape according to how far in the past they occurred, and ordinal temporal information, which organises items of information in terms of their temporal order. Added to that is information about connectivity of perceptual objects over time. These kinds of information connect individual items over a brief span of time so as to represent change, persistence, and continuity over time. It is argued that there is a one-way street of information flow from perceptual processing either to the perceived present or directly into the perceptual timescape, and thence to working memory. Consistent with that, the information structure of the perceptual timescape supports postdictive reinterpretations of recent perceptual information. Temporal integration on a time scale of hundreds of milliseconds takes place in perceptual processing and does not draw on information in the perceptual timescape, which is concerned with temporal segregation, not integration.

3D Displays

Creating realistic three-dimensional (3D) experiences has been a very active area of research and development, and this article describes progress and what remains to be solved. A very active area of technical development has been to build displays that create the correct relationship between viewing parameters and triangulation depth cues: stereo, motion, and focus. Several disciplines are involved in the design, construction, evaluation, and use of 3D displays, but an understanding of human vision is crucial to this enterprise because in the end, the goal is to provide the desired perceptual experience for the viewer. In this article, we review research and development concerning displays that create 3D experiences. And we highlight areas in which further research and development is needed.

High temporal precision for perceiving event offsets

Characterizing the temporal limits of the human visual system has long been a central goal of vision research. Spanning three centuries of research, temporal order judgments have been used to estimate the temporal precision of visual processing, with nearly all the research focusing on onset asynchrony discriminations. Recent neurophysiological work, however, demonstrated that neural latencies for stimulus offsets are shorter and less variable than those following event onsets, suggesting that event offsets might provide more reliable timing cues to the visual system than event onsets. Here, we tested this hypothesis by measuring psychophysical thresholds for discriminating onset and offset asynchronies for both stationary and moving stimuli. In three experiments, we showed that offset asynchrony thresholds were indeed consistently lower and were less affected by stimulus variations than onset asynchrony thresholds. These findings are consistent with neurophysiology and suggest a possible role of offset signals as reliable timing references for visual events.

Behavioral measurement of temporal contrast sensitivity development in macaque monkeys (Macaca nemestrina)

We measured the developmental time course for temporal contrast sensitivity in macaque monkeys. The animals, aged 5 weeks to 4 years, detected an unpatterned field of light sinusoidally modulated over time at frequencies ranging from 1 to 40 Hz. Young infants showed reduced sensitivity for all frequencies, and a reduced range of detectable frequencies. Sensitivity to high and low frequencies developed at different rates, but the shape of the temporal contrast sensitivity function did not change significantly with age. Temporal contrast sensitivity matures earlier than spatial contrast sensitivity. The development of high, but not low, frequency sensitivity may be limited by maturation of the magnocellular pathway.

Visual persistence and cinema?

In Faraday and Plateau's days, both apparent motion and the fusion of intermittent lights, two phenomena that are hardly connected, were explained by retinal persistence. The works of Exner and of the 'Gestalt' psychologists, as well as the modern works on 'sampled' motion and smooth motion, disregarded retinal persistence. One tried, originally, to measure this persistence using intermittent stimulation, but under the pressure of practical concern, what was established in 1902 was the logarithmic relation between fusion frequency and the intensity of the stimulation. One had to wait until the 1950s for the use of harmonic analysis to finally allow a renewal in which many problems that, for decades, had only given rise to discussions that led nowhere and to groundless assertions, were correctly stated and easily solved.

[Visual field and road traffic. How does peripheral vision function?]

Peripheral vision is very important for visual perception in all fields of traffic. The central visual field is most important because the major part of information input occurs here. The peripheral parts of the visual field have excellent motion detection and the capability to perceive flicker stimuli. In addition to the central visual field the horizontal parts to the left and right are important, especially for road traffic. Information input occurs in a continuous sequence of saccadic eye movements which transport critical objects into the fovea. After fixation, the observer analyses the object and decides whether or not a reaction is necessary. Triggering of a saccadic eye movement only can occur if the critical object is suprathreshold in size, contrast, colour, motion and temporal modulation. This is the reason why perception of peripheral objects needs more time than the perception of objects in the fovea. Without an intact central and peripheral visual field participation in traffic is not possible.

Visual cues eliciting the feeding reaction of a planktivorous fish swimming in a current

The visual plankivorous feeding behaviour of the shiner perch(Cymatogaster aggregata) was investigated by means of a flow tank operated at various current speeds. Artemia salina was used as prey. In a second set of experiments, Artemia was darkened with black ink,to compare the visually mediated behaviour of C. aggregata while feeding on dark prey vs feeding on natural (i.e. semi-transparent)prey. The positions of the fish and its prey at the time of the feeding reaction of C. aggregata were measured in three dimensions. Prey were on average closer and more in line with the fish's axis when feeding reactions to darkened Artemia were considered, in comparison with natural Artemia. Three potential mechanisms triggering the feeding reaction of C. aggregata were explored: the prey may trigger a reaction in C. aggregata when it reaches a threshold (1) angular size, (2)angular velocity, or (3) rate of change of the angular size (i.e. loom) of the prey as it is carried passively by the current towards the fish. Our results show that angular velocity may trigger the fish's reaction when using semi-transparent prey, while loom may trigger the reaction to darkened prey. This suggests that feeding behaviour of planktivorous fish is flexible and can use different cues to trigger a motor reaction to prey with different visual characteristics. The feeding reaction appeared to occur at longer distances for semi-transparent rather than darkened Artemia. We suggest that semi-transparent Artemia were visible at greater distances because of their higher scattering (i.e. diffuse reflectance) that made them appear brighter when viewed against a dark background.

Temporal modulation sensitivity of tree shrew retinal ganglion cells

Tree shrews (Tupaia belangeri) are small diurnal mammals capable of quick and agile navigation. Electroretinographic and behavioral studies have indicated that tree shrews possess very good temporal vision, but the neuronal mechanisms underlying that temporal vision are not well understood. We used single-unit extracellular recording techniques to characterize the temporal response properties of individual retinal ganglion cell axons recorded from the optic tract. A prominent characteristic of most cells was their sustained or transient nature in responding to the flashing spot. Temporal modulation sensitivity functions were obtained using a Gaussian spot that was temporally modulated at different frequencies (2–60 Hz). Sustained cells respond linearly to contrast. They showed an average peak frequency of 6.9 Hz, a high-frequency cutoff at 31.3 Hz, and low-pass filtering. Transient cells showed nonlinear response to contrast. They had a peak frequency of 19.3 Hz, a high-frequency cutoff at about 47.6 Hz, band-pass filtering, and higher overall sensitivity than sustained cells. The responses of transient cells also showed a phase advance of about 88 deg whereas the phase advance for sustained cells was about 43 deg. Comparison with behavioral temporal modulation sensitivity results suggested that transient retinal ganglion cells may underlie detection for a wide range of temporal frequencies, with sustained ganglion cells possibly mediating detection below 4 Hz. These data suggest that two well-separated temporal channels exist at the retinal ganglion cell level in the tree shrew retina, with the transient channel playing a major role in temporal vision.

On temporal hyperacuity in the human visual system

The spatial grain of the human visual system has always been a central topic for visual sciences, and the optical and physiological basis of perceptual limitations are well described. In particular, we have thorough accounts of spatial hyperacuity, which refers to a precision in the spatial localisation of stimulus contours that is better than the photoreceptor grain that determines spatial resolution. However, although the temporal resolution of the human visual system is comparably well described, we have almost no direct knowledge about the precision of localising visual stimuli in time in the absence of correlated spatial cues. The present study addresses this question by comparing directly the temporal resolution of human observers with their temporal acuity as measured in a temporal bisection task. Despite some improvement with practice, temporal acuity in this task does not fall below 20-30 ms in the best case, which is similar to the temporal resolution limit, and performance does not improve for comparison tasks with multiple stimulus presentations. The absence of visual hyperacuity for purely temporal modulations as tested here contrasts with processing limitations for other types of visual information in comparable tasks, and with other sensory modalities, in particular to those of the auditory system. Such differences can be interpreted in the context of the ecological requirements for organising behaviour, and the functional design of nervous systems.

Evaluation of alternative waveforms for animated mimic displays

Animated mimic displays can be used to present system information regarding physical form, function, and causality. However, a potential limitation in current designs has been identified: the presence of ambiguous apparent motion. Two theoretical explanations of ambiguous apparent motion are discussed (Fourier and correspondence hypotheses). Two alternative designs (stair-step and approximate sinusoid luminance waveforms) were evaluated. The velocity matches obtained in Experiment 1 indicate that the sinusoidal waveform produced significantly better performance for both accuracy and latency than the stair-step wave-form. The velocity estimates obtained in Experiment 2 indicate that ambiguous apparent motion was not visible with the sinusoidal waveform, but was with the stair-step waveform. One of the two hypotheses (correspondence) provides a reasonable fit with the obtained velocity estimates. A fundamental goal in the design of animated mimic displays is to provide unambiguous mappings between perceived velocity and actual flow rates. Critical factors in design (e.g., waveform, chromatic/luminance contrast, spatial/temporal frequency) are discussed. Actual or potential applications of this research include the design of more effective animated mimic displays.

Temporal sensitivity of human luminance pattern mechanisms determined by masking with temporally modulated stimuli

Target contrast thresholds were measured using vertical spatial Gabor targets in the presence of full field maskers of the same spatial frequency and orientation. In the first experiment both target and masker were 2 cpd. The target was modulated at a frequency of 1 or 10 Hz and the maskers varied in temporal frequency from 1 to 30 Hz and in contrast from 0.03 to 0.50. In the second experiment both target and masker had a spatial frequency of 1, 5 or 8 cpd. The target was modulated at 7.5 Hz and the same set of maskers was used as in the first experiment. The results are not consistent with a widely used model that is based on mechanisms in which excitation is summed linearly and the sum is transformed by an S-shaped nonlinear excitation-response function. A new model of human pattern vision mechanisms, which has excitatory and divisive inhibitory inputs, describes the results well. Parameters from the best fit of the new model to the results of the first experiment show that the 1 Hz and 10 Hz targets were detected by mechanisms with temporal low-pass and band-pass excitatory sensitivity, respectively. Fits to the second experiment suggest that at 1 cpd, the excitatory tuning of the detecting mechanism is band-pass. At 5 and 8 cpd, the mechanisms are excited by a broad range of temporal frequencies. Mechanism sensitivity to divisive inhibition depends on temporal frequency in the same general way as sensitivity to excitation. Mechanisms are more broadly tuned to divisive inhibition than to excitation, except when the target temporal frequency is high.

On the elementary mechanism underlying secondary motion processing

The movement of luminance-defined targets can be easily extracted by elementary motion detectors (EMDs) of the correlation type which often are referred to as Reichardt-detectors. In contrast to such 'primary motion', in 'secondary motion' the moving target is defined by more complex features, like changes in texture, flicker, or local contrast. Such stimulus attributes have to be extracted from the retinal intensity distribution by some nonlinear preprocessing, before they are fed into motion detectors. An intriguing case is the perception of the movement of the motion signal, as is present in theta motion, where an object moves in a different direction than the texture on its surface. A two-layer model of hierarchically organised EMDs has been postulated to account for such motion extraction. Other than for the first layer, the computational nature of the mechanism underlying motion processing in the second layer so far is a matter of speculation, and is therefore characterized here by means of computer simulations and psychophysical experiments. Random dot kinematograms were generated in which sinusoidally modulated vertical dot motion defined gratings, and coherence thresholds were measured for the direction discrimination of a horizontally travelling modulation function. This was done for a variety of spatial frequencies and speeds of the modulation sinusoid. Thresholds turn out to be lowest not for a particular speed, but for a fixed temporal frequency of the modulation function (about 1 cycle per second), when various combinations of fine and coarse, and fast and slow secondary gratings are tested. This result favours a correlation-type mechanism over a gradient-type scheme which should lead to a speed-optimum independent of spatial frequency.

Flicker sensitivity as a function of spectral density of external white temporal noise

Foveal flicker sensitivity at 0.5-30 Hz was measured as a function of the spectral density of external, white, purely temporal noise for a sharp-edged 2.5 deg circular spot (mean luminance 3.4 log phot td). Sensitivity at any given temporal frequency was constant at low powers of external noise, but then decreased in inverse proportion to the square root of noise spectral density. Without external noise, sensitivity as function of temporal frequency had the well-known band-pass characteristics peaking at about 10 Hz, as previously documented in a large number of studies. In the presence of strong external noise, however, sensitivity was a monotonically decreasing function of temporal frequency. Our data are well described (goodness of fit 90%) by a model comprising (i) low-pass filtering by retinal cones, (ii) high-pass filtering in the subsequent neural pathways, (iii) adding of the temporal equivalent of internal white spatiotemporal noise, and (iv) detection by a temporal matched filter, the efficiency of which decreases approximately as the power -0.58 of temporal frequency.

Effects of practice and signal energy on duration discrimination of brief auditory intervals

In Experiment 1, the proposition that duration discrimination of filled auditory intervals is based on temporal information rather than on energy-dependent cues was tested in 64 naive subjects. The subjects were presented with two auditory stimuli at different levels of intensity within one trial, and had to decide which of the two was longer in duration. An adaptive psychophysical procedure was used. As a measure of performance, difference threshold estimates in relation to a 50-msec standard interval were computed. Duration discrimination showed no effect of energy values, indicating that the subjects' discrimination was independent of stimulus intensity. The goal of Experiments 2A and 2B was to investigate the effects of practice on duration discrimination which, in addition, may provide an indirect test for the potential use of energy-dependent cues. Effects of practice on duration discrimination of filled (Experiment 2A) and empty (Experiment 2B) intervals were studied in 6 subjects in each case, over 20 testing sessions. An adaptive psychophysical procedure that was similar to the one used in Experiment 1 was applied. Neither short-term effects of practice based on the first five testing sessions, nor long-term effects of practice based on the means of 4 consecutive weeks, could be demonstrated. The results of the present study suggest that duration discrimination of brief auditory intervals is based on temporal information and not on stimulus energy. Furthermore, implications for the notion of a very basic biological timing mechanism underlying temporal processing of brief auditory intervals in the range of milliseconds are discussed.

Age and functions of the transient component of ON and OFF responses in visual processes

Detections of appearances and disappearances in briefly interrupted complex patterns were examined in young and old subjects. According to neurophysiological evidence developed by Singer and Phillips (1974), the detection rates for the two types of events, which differ substantially as pattern durations and interstimulus intervals vary, are attributable to inhibitory interactions of ON- and OFF-centre relay cells of the lateral geniculate nucleus. The interactions affect the latency and amplitude of the transient component of the cells’ responses. Phillips and Singer (1974) found that the neural model predicted the ability to detect the events. Using the same paradigm, we replicated their findings and found that differences in patterns of detection rates for appearances and disappearances in young and old subjects were consistent with the hypothesis that inhibitory interactions are stronger in older subjects, producing longer latency of OFF-centre relay cells. The neural model and the hypothesized age-related increase in inhibitory interactions are consistent with findings

Flicker fusion as a typological index of nervous system 'reactivity'

Flicker fusion responses were determined under varying stimulus intensities for 43 subjects. A mathematical index of the responses was derived for each individual and compared to a single flicker fusion response. A correlation demonstrated independence between the two measures.

Meridional differences in temporal resolution

Previous investigations of temporal resolution have shown that performance is influenced by a number of stimulus parameters. The interstimulus interval needed for accurate two-pulse discrimination has been shown to (i) decrease monotonically with flash duration, luminance, and contrast; and (ii) increase monotonically with the spatial frequency of the target. A signal-detectability two-alternative forced-choice procedure was employed to reexamine the effects of spatial frequency on temporal resolution. Also assessed was the effect of grating orientation on such performance. The results confirm that temporal resolution declines with increases in spatial frequency. Furthermore, temporal resolution was significantly lower when oblique, as opposed to vertical, grating targets were used. The 'oblique effect' in temporal resolution was observed only with the highest-spatial-frequency target (15 cycles deg-1), and not with stimuli of lower spatial frequency (0.9 and 3.8 cycles deg-1). These findings suggest that stimulus parameters which elicit greater transient channel activity, as opposed to sustained channel activity, enhance temporal resolution. When transient activity is at a minimum, meridional differences in temporal resolution are likely to be attributable to sustained channel activity.

Spatio-temporal discrimination of frequency in the right and left visual fields: a preliminary report

Normal right-handed subjects were presented with luminance patterns varying from sinusoidally in both space and time to the left and right visual fields. With no temporal variation in the stimuli, detection thresholds for the left visual field were lower than those for the right visual field for all spatial frequencies. However, with increasing temporal variations, a reversal in detection of threshold occurred, with the right visual field surpassing the left. This finding suggests that left and right visual processing may be differentially efficient for temporal and spatial visual information.

Distortions of vision and pain: two functional facets of D-lysergic acid diethylamide

D-lysergic acid diethylamide (LSD) produces distortions of visual perception and analgesia. Evidence is advanced from a functional standpoint that the observed visual effects result from an attenuation of light-evoked input to the dorsal lateral geniculate nucleus (LGN) from the purely centripetal pathways of the retina. More slowly responding visual afferents or those with more complex receptive fields seem to be affected most. LSD analgesia, accompanied by severe psychotic symptoms, appears to result from drug actions on a centrifugally controlled pain system involving neurons of the midbrain raphe.