Misspecifications of stimulus presentation durations in experimental psychology: a systematic review of the psychophysics literature

The discrepancy in timing between synchronous signals and visual stimulation should not be underestimated

Response latency is a critical parameter in studying human behavior, representing the time interval between the onset of stimulus and the response. However, different time between devices can introduce errors. Serial port synchronization signal can mitigate this, but limited information is available regarding their accuracy. Optical signals offer another option, but the difference in the positioning of optical signals and visual stimuli can introduce errors, and there have been limited reports of error reduction. This study aims to investigate methods for reducing the time errors. We used the Psychtoolbox to generate visual stimuli and serial port synchronization signals to explore their accuracy. Subsequently, we proposed a calibration formula to minimize the error between optical signals and visual stimuli. The findings are as follows: Firstly, the serial port synchronization signal presenting precedes visual stimulation, with a smaller lead time observed at higher refresh rates. Secondly, the lead time increases as the stimulus position deviates to the right and downwards. In Linux and IOPort(), serial port synchronization signals exhibited greater accuracy. Considering the poor accuracy and the multiple influencing factors associated with serial port synchronization signals, it is recommended to use optical signals to complete time synchronization. The results indicate that under the darkening process, the time error is - 0.23 ~ 0.08 ms (mean). This calibration formula can help measure the response latency accurately. This study provides valuable insights for optimizing experimental design and improving the accuracy of response latency. Although it only involves visual stimuli, the methods and results of this study can still serve as a reference.

PTVR - A software in Python to make virtual reality experiments easier to build and more reproducible

Researchers increasingly use virtual reality (VR) to perform behavioral experiments, especially in vision science. These experiments are usually programmed directly in so-called game engines that are extremely powerful. However, this process is tricky and time-consuming as it requires solid knowledge of game engines. Consequently, the anticipated prohibitive effort discourages many researchers who want to engage in VR. This paper introduces the Perception Toolbox for Virtual Reality (PTVR) library, allowing visual perception studies in VR to be created using high-level Python script programming. A crucial consequence of using a script is that an experiment can be described by a single, easy-to-read piece of code, thus improving VR studies' transparency, reproducibility, and reusability. We built our library upon a seminal open-source library released in 2018 that we have considerably developed since then. This paper aims to provide a comprehensive overview of the PTVR software for the first time. We introduce the main objects and features of PTVR and some general concepts related to the three-dimensional (3D) world. This new library should dramatically reduce the difficulty of programming experiments in VR and elicit a whole new set of visual perception studies with high ecological validity.

Blue-Yellow VEP with Projector-Stimulation in Glaucoma

Background and aim

In the past, increased latencies of the blue-on-yellow pattern visually evoked potentials (BY-VEP), which predominantly originate in the koniocellular pathway, have proven to be a sensitive biomarker for early glaucoma. However, a complex experimental setup based on an optical bench was necessary to obtain these measurements because computer screens lack sufficient temporal, spatial, spectral, and luminance resolution. Here, we evaluated the diagnostic value of a novel setup based on a commercially available video projector.

Methods

BY-VEPs were recorded in 126 participants (42 healthy control participants, 12 patients with ocular hypertension, 17 with “preperimetric” glaucoma, and 55 with perimetric glaucoma). Stimuli were created with a video projector (DLP technology) by rear projection of a blue checkerboard pattern (460 nm) for 200 ms (onset) superimposed on a bright yellow background (574 nm), followed by an offset interval where only the background was active. Thus, predominantly S-cones were stimulated while L- and M-cone responses were suppressed by light adaptation. Times of stimulus onset to VEP onset-trough (N-peak time) and offset-peak (P-peak time) were analyzed after age-correction based on linear regression in the normal participants.

Results

The resulting BY-VEPs were quite similar to those obtained in the past with the optical bench: pattern-onset generated a negative deflection of the VEP, whereas the offset-response was dominated by a positive component. N-peak times were significantly increased in glaucoma patients (preperimetric 136.1 ± 10 ms, p < 0.05; perimetric 153.1 ± 17.8 ms, p < 0.001) compared with normal participants (123.6 ± 7.7 ms). Furthermore, they were significantly correlated with disease severity as determined by visual field losses retinal nerve fiber thinning (Spearman R = –0.7, p < 0.001).

Conclusions

Video projectors can be used to create optical stimuli with high temporal and spatial resolution, thus potentially enabling sophisticated electrophysiological measurements in clinical practice. BY-VEPs based on such a projector had a high diagnostic value for detection of early glaucoma.

Registration of study

Registration site: www.clinicaltrials.gov

Trial registration number: NCT00494923.

Time-Varying Light Exposure in Chronobiology and Sleep Research Experiments

Light exposure profoundly affects human physiology and behavior through circadian and neuroendocrine photoreception primarily through the melanopsin-containing intrinsically photosensitive retinal ganglion cells. Recent research has explored the possibility of using temporally patterned stimuli to manipulate circadian and neuroendocrine responses to light. This mini-review, geared to chronobiologists, sleep researchers, and scientists in adjacent disciplines, has two objectives: (1) introduce basic concepts in time-varying stimuli and (2) provide a checklist-based set of recommendations for documenting time-varying light exposures based on current best practices and standards.

Strongly masked content retained in memory made accessible through repetition

A growing body of evidence indicates that information can be stored even in the absence of conscious awareness. Despite these findings, unconscious memory is still poorly understood with limited evidence for unconscious iconic memory storage. Here we show that strongly masked visual data can be stored and accumulate to elicit clear perception. We used a repetition method across a wide range of conditions (Experiment 1) and a more focused follow-up experiment with enhanced masking conditions (Experiment 2). Information was stored despite being masked, demonstrating that masking did not erase or overwrite memory traces but limited perception. We examined the temporal properties and found that stored information followed a gradual but rapid decay. Extraction of meaningful information was severely impaired after 300 ms, and most data was lost after 700 ms. Our findings are congruent with theories of consciousness that are based on an integration of subliminal information and support theoretical predictions based on the global workspace theory of consciousness, especially the existence of an implicit iconic memory buffer store.

Entrainment within neuronal response in optic tectum of pigeon to video displays

The cathode ray tube (CRT) is a common and important tool that has been in use for decades, with which behavioral and visual neuroscientists deliver specific visual images generated by computers. Considering the operating principle of the CRT, the image it presents can flick at a constant rate, which will introduce distractions to the visual experiments on subjects with higher temporal resolutions. While this entrainment has been proved common in recordings of the primary visual cortex of mammals, it is uncertain whether it also exists in the intermediate to deep layers of pigeon's optic tectum, which is relevant to the spatial attention. Here, we present continuous visual stimuli with different refresh rates and luminances couples shown on a CRT to pigeons. The recordings in the intermediate to deep layers of optic tectum were significantly phase locking to the refresh of the CRT, and lower refresh rates of the CRT with higher brightness more likely introduced artifacts in electrophysiological recordings of pigeons, which may seriously damage their visual information perception.

How Monitor Characteristics Affect Human Perception in Visual Computer Experiments: CRT vs. LCD Monitors in Millisecond Precise Timing Research

Liquid crystal display (LCD) monitors are nowadays standard in computerized visual presentation. However, when millisecond precise presentation is concerned, they have often yielded imprecise and unreliable presentation times, with substantial variation across specific models, making it difficult to know whether they can be used for precise vision experiments or not. The present paper intends to act as hands-on guide to set up an experiment requiring millisecond precise visual presentation with LCD monitors. It summarizes important characteristics relating to precise visual stimulus presentation, enabling researchers to transfer parameters reported for cathode ray tube (CRT) monitors to LCD monitors. More importantly, we provide empirical evidence from a preregistered study showing the suitability of LCD monitors for millisecond precise timing research. Using sequential testing, we conducted a masked number priming experiment using CRT and LCD monitors. Both monitor types yielded comparable results as indicated by Bayes factor favoring the null hypothesis of no difference between display types. More specifically, we found masked number priming under conditions of zero awareness with both types of monitor. Thus, the present study highlights the importance of hardware settings for empirical psychological research; inadequate settings might lead to more “noise” in results thereby concealing potentially existing effects.

Accuracy and precision of stimulus timing and reaction times with Unreal Engine and SteamVR

The increasing interest in Virtual Reality (VR) as a tool for neuroscientific research contrasts with the current lack of established toolboxes and standards. In several recent studies, game engines like Unity or Unreal Engine were used. It remains to be tested whether these software packages provide sufficiently precise and accurate stimulus timing and time measurements that allow inferring ongoing mental and neural processes. We here investigated the precision and accuracy of the timing mechanisms of Unreal Engine 4 and SteamVR in combination with the HTC Vive VR system. In a first experiment, objective external measures revealed that stimulus durations were highly accurate. In contrast, in a second experiment, the assessment of the precision of built-in timing procedures revealed highly variable reaction time measurements and inaccurate determination of stimulus onsets. Hence, we developed a new software-based method that allows precise and accurate reaction time measurements with Unreal Engine and SteamVR. Instead of using the standard timing procedures implemented within Unreal Engine, time acquisition was outsourced to a background application. Timing benchmarks revealed that the newly developed method allows reaction time measurements with a precision and accuracy in the millisecond range. Overall, the present results indicate that the HTC Vive together with Unreal Engine and SteamVR can achieve high levels of precision and accuracy both concerning stimulus duration and critical time measurements. The latter can be achieved using a newly developed routine that allows not only accurate reaction time measures but also provides precise timing parameters that can be used in combination with time-sensitive functional measures such as electroencephalography (EEG) or transcranial magnetic stimulation (TMS).

Using the virtual reality device Oculus Rift for neuropsychological assessment of visual processing capabilities

Neuropsychological assessment of human visual processing capabilities strongly depends on visual testing conditions including room lighting, stimuli, and viewing-distance. This limits standardization, threatens reliability, and prevents the assessment of core visual functions such as visual processing speed. Increasingly available virtual reality devices allow to address these problems. One such device is the portable, light-weight, and easy-to-use Oculus Rift. It is head-mounted and covers the entire visual field, thereby shielding and standardizing the visual stimulation. A fundamental prerequisite to use Oculus Rift for neuropsychological assessment is sufficient test-retest reliability. Here, we compare the test-retest reliabilities of Bundesen’s visual processing components (visual processing speed, threshold of conscious perception, capacity of visual working memory) as measured with Oculus Rift and a standard CRT computer screen. Our results show that Oculus Rift allows to measure the processing components as reliably as the standard CRT. This means that Oculus Rift is applicable for standardized and reliable assessment and diagnosis of elementary cognitive functions in laboratory and clinical settings. Oculus Rift thus provides the opportunity to compare visual processing components between individuals and institutions and to establish statistical norm distributions.

A closer look at four-dot masking of a foveated target

Four-dot masking with a common onset mask was recently demonstrated in a fully attended and foveated target (Filmer, Mattingley & Dux, 2015). Here, we replicate and extend this finding by directly comparing a four-dot mask with an annulus mask while probing masking as a function of mask duration, and target-mask separation. Our results suggest that while an annulus mask operates via spatially local contour interactions, a four-dot mask operates through spatially global mechanisms. We also measure how the visual system’s representation of an oriented bar is impacted by a four-dot mask, and find that masking here does not degrade the precision of perceived targets, but instead appears to be driven exclusively by rendering the target completely invisible.

LCD Monitors as an Alternative for Precision Demanding Visual Psychophysical Experiments

Precise timing and presentation of stimuli is critical in vision research, still, the limiting factor in successful recognition is often the monitor itself that is used to present the stimuli. The most widespread method is the use of monitors controlled by personal computers. Traditionally, most experiments used cathode-ray tubes but they are more and more difficult to access, and instead, liquid-crystal displays are getting more and more popular. The two types have fundamentally different working principles and limitations in displaying the stimulus.In our experiments, the temporal precision of the stimulus presentation was in focus. We investigated whether liquid-crystal displays, which are not considered to be fit to display fast successive stimuli, can represent an alternative choice for cathode-ray tubes. We used the double flash and the flicker illusion to compare the technical capabilities of the two monitor types. These illusions not only do require a precise timing but also a very short exposure to the stimuli. At the same time, the interstimulus interval is also of extreme importance. In addition, these illusions require peripheral stimulation of the retina, which is more sensitive to the temporal aspects of the visual stimulus. On the basis of previous studies and our own psychophysical results, we suggest that liquid-crystal displays might be a good alternative for precise, frame-to-frame stimulus presentation even if parts of the stimuli are projected on the peripheral retina.

Effect of varying CRT refresh rate on the measurement of temporal summation

PURPOSE

To quantify the effect of cathode-tube-ray (CRT) monitor refresh rate on the measurement of the upper limit of complete temporal summation (critical duration) in the peripheral visual field of healthy observers.

METHODS

Contrast thresholds were measured for seven achromatic spot stimuli (diameter 0.48°) of varying duration (nominal values: 10-200 ms) at an eccentricity of 8.8° along the 45°, 135°, 225° and 315° meridians of the visual field in three healthy, psychophysically experienced observers. Stimuli were presented on a CRT display with a refresh rate of 60 and 160 Hz. Contrast thresholds were expressed as contrast energy with stimulus durations being estimated using (1) the sum-of-frames (SOF) method and (2) Bridgeman's method incorporating measurements of phosphor persistence. Estimates of the critical duration were produced using iterative two-phase regression analysis.

RESULTS

With stimulus duration expressed as SOF equivalent the critical duration was, on average, 10.6 ms longer with a refresh rate of 60 Hz (mean 45.7 ms, S.D. 10.1 ms) relative to 160 Hz (35.1 ms, S.D. 7.6 ms). When the Bridgeman method was used, minimal differences (1.8 ms) in critical duration values between the two refresh rates (60 Hz: 33.0 ms, S.D. 9.4 ms; 160 Hz: 31.2 ms, S.D. 7.0 ms) were observed. Identical trends were observed in all three subjects.

CONCLUSIONS

Psychophysical measurements of temporal summation are independent of variations in CRT refresh rate when the Bridgeman method, incorporating measured values of phosphor persistence, is used to estimate stimulus duration. This has significant implications for the specification of stimulus duration in psychophysical studies of vision employing conventional display monitors.

Modulation of perceived contrast in the brightness comparison of asynchronous stimuli

Comparative judgment is a crucial task in ecological settings, as well as in many experimental studies about basic aspects of perceptual processes. It has long been known that sequential comparison is prone to order effects. This phenomenon has received little attention and has often been discounted as a type of response bias. In the present study, we investigated brightness discrimination of two brief (100 ms) spatially disjoint luminance stimuli. In the first and second experiments, stimuli were presented against a dark background with a stimulus onset asynchrony (SOA) from 0 to 200 ms, in a paradigm controlling for response bias. In the third experiment, stimuli were presented against a bright background. We demonstrate that the time interval between stimuli modulates and even inverts their perceived brightness difference, enhancing the second stimulus relative to the first. When the background is brighter than the target stimuli, the sign of the effect is inverted, suggesting that the underlying mechanism operates on contrast rather than brightness. The magnitude of this effect is shown to depend on SOA and average luminance level of the target stimuli. Hypotheses in terms of neural and attentional dynamics are proposed.

Measuring software timing errors in the presentation of visual stimuli in cognitive neuroscience experiments

Because of the features provided by an abundance of specialized experimental software packages, personal computers have become prominent and powerful tools in cognitive research. Most of these programs have mechanisms to control the precision and accuracy with which visual stimuli are presented as well as the response times. However, external factors, often related to the technology used to display the visual information, can have a noticeable impact on the actual performance and may be easily overlooked by researchers. The aim of this study is to measure the precision and accuracy of the timing mechanisms of some of the most popular software packages used in a typical laboratory scenario in order to assess whether presentation times configured by researchers do not differ from measured times more than what is expected due to the hardware limitations. Despite the apparent precision and accuracy of the results, important issues related to timing setups in the presentation of visual stimuli were found, and they should be taken into account by researchers in their experiments.

Shape selectivity and remapping in dorsal stream visual area LIP

We explore the visual world by making rapid eye movements (saccades) to focus on objects and locations of interest. Despite abrupt retinal image shifts, we see the world as stable. Remapping contributes to visual stability by updating the internal image with every saccade. Neurons in macaque lateral intraparietal cortex (LIP) and other brain areas update information about salient locations around the time of a saccade. The depth of information transfer remains to be thoroughly investigated. Area LIP, as part of the dorsal visual stream, is regarded as a spatially selective area, yet there is evidence that LIP neurons also encode object features. We sought to determine whether LIP remaps shape information. This knowledge is important for understanding what information is retained from each glance. We identified 82 remapping neurons. First, we presented shapes within the receptive field and tested for shape selectivity in a fixation task. Among the remapping neurons, 28 neurons (34%) were selective for shape. Second, we presented the same shapes in the future location of the receptive field around the time of the saccade and tested for shape selectivity during remapping. Thirty-one (38%) neurons were selective for shape. Of 11 neurons that were shape selective in both tasks, 5 showed significant correlation between shape selectivity in the two tasks. Across the population, there was a weak but significant correlation between responses to shape in the two tasks. Our results provide neurophysiological evidence that remapped responses in area LIP can encode shape information as well as spatial information.

An evaluation of organic light emitting diode monitors for medical applications: great timing, but luminance artifacts

PURPOSE

In contrast to the dominant medical liquid crystal display (LCD) technology, organic light-emitting diode (OLED) monitors control the display luminance via separate light-emitting diodes for each pixel and are therefore supposed to overcome many previously documented temporal artifacts of medical LCDs. We assessed the temporal and luminance characteristics of the only currently available OLED monitor designed for use in the medical treatment field (SONY PVM2551MD) and checked the authors' main findings with another SONY OLED device (PVM2541).

METHODS

Temporal properties of the photometric output were measured with an optical transient recorder. Luminances of the three color primaries and white for all 256 digital driving levels (DDLs) were measured with a spectroradiometer. Between the luminances of neighboring DDLs, just noticeable differences were calculated according to a perceptual model developed for medical displays. Luminances of full screen (FS) stimuli were compared to luminances of smaller stimuli with identical DDLs.

RESULTS

All measured luminance transition times were below 300 μs. Luminances were independent of the luminance in the preceding frame. However, for the single color primaries, up to 50.5% of the luminances of neighboring DDLs were not perceptually distinguishable. If two color primaries were active simultaneously, between 36.7% and 55.1% of neighboring luminances for increasing DDLs of the third primary were even decreasing. Moreover, luminance saturation effects were observed when too many pixels were active simultaneously. This effect was strongest for white; a small white patch was close to 400 cd/m(2), but in FS the luminance of white saturated at 162 cd/m(2). Due to different saturation levels, the luminance of FS green and FS yellow could exceed the luminance of FS white for identical DDLs.

CONCLUSIONS

The OLED temporal characteristics are excellent and superior to those of LCDs. However, the OLEDs revealed severe perceptually relevant artifacts with implications for applicability to medical imaging.

Early ERPs to faces: aging, luminance, and individual differences

Recently, Rousselet et al. reported a 1 ms/year delay in visual processing speed in a sample of healthy aged 62 subjects (Frontiers in Psychology 2010, 1:19). Here, we replicate this finding in an independent sample of 59 subjects and investigate the contribution of optical factors (pupil size and luminance) to the age-related slowdown and to individual differences in visual processing speed. We conducted two experiments. In experiment 1 we recorded EEG from subjects aged 18–79. Subjects viewed images of faces and phase scrambled noise textures under nine luminance conditions, ranging from 0.59 to 60.8 cd/m². We manipulated luminance using neutral density filters. In experiment 2, 10 young subjects (age < 35) viewed similar stimuli through pinholes ranging from 1 to 5 mm. In both experiments, subjects were tested twice. We found a 1 ms/year slowdown in visual processing that was independent of luminance. Aging effects became visible around 125 ms post-stimulus and did not affect the onsets of the face-texture ERP differences. Furthermore, luminance modulated the entire ERP time-course from 60 to 500 ms. Luminance effects peaked in the N170 time window and were independent of age. Importantly, senile miosis and individual differences in pupil size did not account for aging differences and inter-subject variability in processing speed. The pinhole manipulation also failed to match the ERPs of old subjects to those of young subjects. Overall, our results strongly suggest that early ERPs to faces (<200 ms) are delayed by aging and that these delays are of cortical, rather than optical origin. Our results also demonstrate that even late ERPs to faces are modulated by low-level factors.

Eye movements reset visual perception

Human vision uses saccadic eye movements to rapidly shift the sensitive foveal portion of our retina to objects of interest. For vision to function properly amidst these ballistic eye movements, a mechanism is needed to extract discrete percepts on each fixation from the continuous stream of neural activity that spans fixations. The speed of visual parsing is crucial because human behaviors ranging from reading to driving to sports rely on rapid visual analysis. We find that a brain signal associated with moving the eyes appears to play a role in resetting visual analysis on each fixation, a process that may aid in parsing the neural signal. We quantified the degree to which the perception of tilt is influenced by the tilt of a stimulus on a preceding fixation. Two key conditions were compared, one in which a saccade moved the eyes from one stimulus to the next and a second simulated saccade condition in which the stimuli moved in the same manner but the subjects did not move their eyes. We find that there is a brief period of time at the start of each fixation during which the tilt of the previous stimulus influences perception (in a direction opposite to the tilt aftereffect)--perception is not instantaneously reset when a fixation starts. Importantly, the results show that this perceptual bias is much greater, with nearly identical visual input, when saccades are simulated. This finding suggests that, in real-saccade conditions, some signal related to the eye movement may be involved in the reset phenomenon. While proprioceptive information from the extraocular muscles is conceivably a factor, the fast speed of the effect we observe suggests that a more likely mechanism is a corollary discharge signal associated with eye movement.

Temporal properties of liquid crystal displays: implications for vision science experiments

Liquid crystal displays (LCD) are currently replacing the previously dominant cathode ray tubes (CRT) in most vision science applications. While the properties of the CRT technology are widely known among vision scientists, the photometric and temporal properties of LCDs are unfamiliar to many practitioners. We provide the essential theory, present measurements to assess the temporal properties of different LCD panel types, and identify the main determinants of the photometric output. Our measurements demonstrate that the specifications of the manufacturers are insufficient for proper display selection and control for most purposes. Furthermore, we show how several novel display technologies developed to improve fast transitions or the appearance of moving objects may be accompanied by side–effects in some areas of vision research. Finally, we unveil a number of surprising technical deficiencies. The use of LCDs may cause problems in several areas in vision science. Aside from the well–known issue of motion blur, the main problems are the lack of reliable and precise onsets and offsets of displayed stimuli, several undesirable and uncontrolled components of the photometric output, and input lags which make LCDs problematic for real–time applications. As a result, LCDs require extensive individual measurements prior to applications in vision science.

Interval timing in children: effects of auditory and visual pacing stimuli and relationships with reading and attention variables

Motor timing tasks have been employed in studies of neurodevelopmental disorders such as developmental dyslexia and ADHD, where they provide an index of temporal processing ability. Investigations of these disorders have used different stimulus parameters within the motor timing tasks that are likely to affect performance measures. Here we assessed the effect of auditory and visual pacing stimuli on synchronised motor timing performance and its relationship with cognitive and behavioural predictors that are commonly used in the diagnosis of these highly prevalent developmental disorders. Twenty-one children (mean age 9.6 years) completed a finger tapping task in two stimulus conditions, together with additional psychometric measures. As anticipated, synchronisation to the beat (ISI 329 ms) was less accurate in the visually paced condition. Decomposition of timing variance indicated that this effect resulted from differences in the way that visual and auditory paced tasks are processed by central timekeeping and associated peripheral implementation systems. The ability to utilise an efficient processing strategy on the visual task correlated with both reading and sustained attention skills. Dissociations between these patterns of relationship across task modality suggest that not all timing tasks are equivalent.

Binocular coordination in response to two-dimensional, three-dimensional and stereoscopic visual stimuli

PURPOSE

We were particularly interested in whether binocular coordination when viewing stereoscopic images would be more comparable to when viewing a 2D representation, or when viewing a real stimulus array in depth.

METHODS

Data are reported from an experiment examining binocular coordination in response to stereoscopically presented stimuli. Movements of both eyes were recorded as participants viewed LED stimuli in a real scene with depth, a 2D image of the scene, and a stereoscopic image of the scene.

RESULTS

When viewing real LEDs, vergence during saccades re-aligned the eyes in depth where necessary, with smaller adjustments during the following fixation. In contrast, when viewing the stereoscopic representation, vergence during saccades did not re-align the eyes in depth. The only effect of target depth on vergence occurred during the following fixation.

CONCLUSIONS

We conclude that disparity in parafoveal objects, in isolation from other depth cues (and, minimally, conflicting with blur), was insufficient for the visual system to target saccades appropriately in depth.