Blur clarified: A review and synthesis of blur discrimination

Two Disparity Channels in Human Visual Cortex With Different Contrast and Blur Sensitivity

Purpose

Our goal is to describe the contrast and blur sensitivity of multiple horizontal disparity subsystems and to relate them to the contrast and spatial sensitivities of their monocular inputs.

Methods

Steady-state visual evoked potential (SSVEP) amplitudes were recorded in response to dynamic random dot stereograms (DRDSs) alternating at 2 Hz between zero disparity and varying magnitudes of crossed disparity for disparity plane and disparity grating stimuli. Half-image contrasts ranged between 2.5% and 80% and over a range of Gaussian blurs from 1.4 to 12 arcmin. Separate experiments measured contrast and blur sensitivity for the monocular half-images.

Results

The first and second harmonics disparity responses were maximal for disparity gratings and for the disparity plane condition, respectively. The first harmonic of the disparity grating response was more affected by both contrast and blur than was the second harmonic of the disparity plane response, which had higher contrast sensitivity than the first harmonic.

Conclusions

The corrugation frequency, contrast, and blur tuning of the first harmonic suggest that it reflects activity of neurons tuned to higher luminance spatial frequencies that are selective for relative disparity, whereas the second harmonic reflects the activity of neurons sensitive to absolute disparity that are driven by low monocular spatial frequencies.

Translational Relevance

SSVEPs to DRDSs provide two objective neural measures of disparity processing, the first harmonic-whose stimulus preferences are similar to those of behavioral stereoacuity-and the second harmonic that represents an independent disparity-specific but not necessarily stereoscopic mechanism.

Impact of focus cue presentation on perceived realism of 3-D scene structure: Implications for scene perception and for display technology

Stereoscopic imagery often aims to evoke three-dimensional (3-D) percepts that are accurate and realistic-looking. The "gap" between 3-D imagery and real scenes is small, but focus cues typically remain incorrect because images are displayed on a single focal plane. Research has concentrated on the resulting vergence-accommodation conflicts. Yet, incorrect focus cues may also affect the appearance of 3-D imagery. We investigated whether incorrect focus cues reduce perceived realism of 3-D structure ("depth realism"). Experiment 1 used a multiple-focal-planes display to compare depth realism with correct focus cues vs. conventional stereo presentation. The stimuli were random-dot stereograms, which isolated the role of focus cues. Depth realism was consistently lower with incorrect focus cues, providing proof-of-principle evidence that they contribute to perceptual realism. Experiments 2 and 3 examined whether focus cues play a similar role with realistic objects, presented with an almost complete set of visual cues using a high-resolution, high-dynamic-range multiple-focal-planes display. We also examined the efficacy of approximating correct focus cues via gaze-contingent depth-of-field rendering. Improvements in depth realism with correct focus cues were less clear in more realistic scenes, indicating that the role of focus cues in depth realism depends on scene content. Rendering-based approaches, if anything, reduced depth realism, which we attribute to their inability to present higher-order aspects of blur correctly. Our findings suggest future general 3-D display solutions may need to present focus cues correctly to maximise perceptual realism.

Spatiotemporal defocus sensitivity function of the human visual system

Tunable lenses make it possible to measure visual sensitivity to rapid changes in optical power, surpassing the limits imposed by mechanical elements. Using a tunable lens system, we measured, for the first time, the spatiotemporal defocus sensitivity function (STDSF), and the limits of human defocus perception. Specifically, we measured defocus sensitivity using a QUEST adaptive psychophysical procedure for different stimuli (Gabor patches of different spatial frequencies, natural images, and edges) and we developed descriptive models of defocus perception. For Gabor patches, we found on average (across seven subjects) that the maximum sensitivity to defocus is 0.22 D at 14 cpd and 10 Hz, and that the upper limits of sensitivity are 40 cpd and 40 Hz. Our results suggest that accommodation remains fixed while performing the defocus flicker-detection task. These results have implications for new technologies whose working principles make use of fast changes to defocus.

Blurring the boundary between models and reality: Visual perception of scale assessed by performance

One of the primary jobs of visual perception is to build a three-dimensional representation of the world around us from our flat retinal images. These are a rich source of depth cues but no single one of them can tell us about scale (i.e., absolute depth and size). For example, the pictorial depth cues in a (perfect) scale model are identical to those in the real scene that is being modelled. Here we investigate image blur gradients, which derive naturally from the limited depth of field available for any optical device and can be used to help estimate visual scale. By manipulating image blur artificially to produce what is sometimes called fake tilt shift miniaturization, we provide the first performance-based evidence that human vision uses this cue when making forced-choice judgements about scale (identifying which of an image pair was a photograph of a full-scale railway scene, and which was a 1:76 scale model). The orientation of the blur gradient (relative to the ground plane) proves to be crucial, though its rate of change is less important for our task, suggesting a fairly coarse visual analysis of this image parameter.

Distinguishing shadows from surface boundaries using local achromatic cues

In order to accurately parse the visual scene into distinct surfaces, it is essential to determine whether a local luminance edge is caused by a boundary between two surfaces or a shadow cast across a single surface. Previous studies have demonstrated that local chromatic cues may help to distinguish edges caused by shadows from those caused by surface boundaries, but the information potentially available in local achromatic cues like contrast, texture, and penumbral blur remains poorly understood. In this study, we develop and analyze a large database of hand-labeled achromatic shadow edges to better understand what image properties distinguish them from occlusion edges. We find that both the highest contrast as well as the lowest contrast edges are more likely to be occlusions than shadows, extending previous observations based on a more limited image set. We also find that contrast cues alone can reliably distinguish the two edge categories with nearly 70% accuracy at 40x40 resolution. Logistic regression on a Gabor Filter bank (GFB) modeling a population of V1 simple cells separates the categories with nearly 80% accuracy, and furthermore exhibits tuning to penumbral blur. A Filter-Rectify Filter (FRF) style neural network extending the GFB model performed at better than 80% accuracy, and exhibited blur tuning and greater sensitivity to texture differences. We compare human performance on our edge classification task to that of the FRF and GFB models, finding the best human observers attaining the same performance as the machine classifiers. Several analyses demonstrate both classifiers exhibit significant positive correlation with human behavior, although we find a slightly better agreement on an image-by-image basis between human performance and the FRF model than the GFB model, suggesting an important role for texture.

Distinguishing edges caused by changes in illumination from edges caused by surface boundaries is an essential computation for accurately parsing the visual scene. Previous psychophysical investigations examining the utility of various locally available cues to classify edges as shadows or surface boundaries have primarily focused on color, as surface boundaries often give rise to more significant change in color than shadows. However, even in grayscale images we can readily distinguish shadows from surface boundaries, suggesting an important role for achromatic cues in addition to color. We demonstrate using statistical analysis of natural shadow and surface boundary edges that locally available achromatic cues can be exploited by machine classifiers to reliably distinguish these two edge categories. These classifiers exhibit sensitivity to blur and local texture differences, and exhibit reasonably good agreement with humans classifying edges as shadows or surface boundaries. As trichromatic vision is relatively rare in the animal kingdom, our work suggests how organisms lacking rich color vision can still exploit other cues to avoid mistaking illumination changes for surface changes.

Using Blur for Perceptual Investigation and Training in Sport? A Clear Picture of the Evidence and Implications for Future Research

Dynamic, interactive sports require athletes to identify, pick-up and process relevant information in a very limited time, in order to then make an appropriate response. Perceptual-cognitive skills are, therefore, a key determinant of elite sporting performance. Recently, sport scientists have investigated ways to assess and train perceptual-cognitive skills, with one such method involving the use of blurred stimuli. Here, we describe the two main methods used to generate blur (i.e., dioptric and Gaussian) and then review the current findings in a sports context. Overall, it has been shown the use of blur can enhance performance and learning of sporting tasks in novice participants, especially when the blur is applied to peripheral stimuli. However, while intermediate and expert level participants are relatively impervious to the presence of blur, it remains to be determined if they are positive effects on learning. In a final section, we describe some of the methodological issues that limit the application of blur and then discuss the potential use of virtual reality to extend the current research base in sporting contexts.

Effects of glaucoma on detection and discrimination of image blur

PURPOSE

Blur is one of the most commonly reported visual symptoms of glaucoma, but it is not directly measured by current clinical tests. We aimed to investigate the effects of glaucoma on detection and discrimination of image blur.

METHODS

Participants were people with glaucoma, separated into two groups with (n = 15) or without (n = 17) central visual field defects measured by 10-2 perimetry, and an age-similar control group (n = 18). First, we measured contrast detection thresholds centrally using a 2-interval forced choice procedure. We then measured blur detection and discrimination thresholds for the same stimuli (reference blurs 0, 1 arcmin) using a 2-alternative forced choice procedure under two contrast conditions: 4× individual detection threshold for the low contrast condition; 95% contrast for the high contrast condition. The stimulus was a horizontal edge bisecting a hard-edged circle of 4.5° diameter. Data were analysed by linear mixed modelling.

RESULTS

Contrast detection thresholds for the glaucoma group with central visual field defects were raised by 0.01 ± 0.004 (mean ± SE, Michelson units) (p = 0.002) and by 0.01 ± 0.004 (p = 0.03) relative to control and glaucoma without central visual field defect groups, respectively. Blur detection and discrimination thresholds were similar between groups, with small elevations in blur detection thresholds in the glaucoma groups not reaching statistical significance (detection p = 0.29, discrimination p = 0.91). The lower contrast level increased thresholds from the higher contrast level by 1.30 ± 0.10 arcmin (p < 0.001) and 1.05 ± 0.10 arcmin (p < 0.001) for blur detection and discrimination thresholds, respectively.

CONCLUSIONS

Early-moderate glaucoma resulted in only minimal elevations of blur detection thresholds that did not reach statistical significance in this study. Despite the prevalence of blur as a visual symptom of glaucoma, psychophysical measurements of blur detection or discrimination may not be good candidates for development as clinical tests for glaucoma.

Assessing the Effect of the Refresh Rate of a Device on Various Motion Stimulation Frequencies Based on Steady-State Motion Visual Evoked Potentials

The refresh rate is one of the important parameters of visual presentation devices, and assessing the effect of the refresh rate of a device on motion perception has always been an important direction in the field of visual research. This study examined the effect of the refresh rate of a device on the motion perception response at different stimulation frequencies and provided an objective visual electrophysiological assessment method for the correct selection of display parameters in a visual perception experiment. In this study, a flicker-free steady-state motion visual stimulation with continuous scanning frequency and different forms (sinusoidal or triangular) was presented on a low-latency LCD monitor at different refresh rates. Seventeen participants were asked to observe the visual stimulation without head movement or eye movement, and the effect of the refresh rate was assessed by analyzing the changes in the intensity of their visual evoked potentials. The results demonstrated that an increased refresh rate significantly improved the intensity of motion visual evoked potentials at stimulation frequency ranges of 7-28 Hz, and there was a significant interaction between the refresh rate and motion frequency. Furthermore, the increased refresh rate also had the potential to enhance the ability to perceive similar motion. Therefore, we recommended using a refresh rate of at least 120 Hz in motion visual perception experiments to ensure a better stimulation effect. If the motion frequency or velocity is high, a refresh rate of≥240 Hz is also recommended.

Blur Representation in the Amblyopic Visual System Using Natural and Synthetic Images

Purpose

Amblyopia is diagnosed as a reduced acuity in an otherwise healthy eye, which indicates that the deficit is not happening in the eye, but in the brain. One suspected mechanism explaining these deficits is an elevated amount of intrinsic blur in the amblyopic visual system compared to healthy observers. This "internally produced blur" can be estimated by the "equivalent intrinsic blur method", which measures blur discrimination thresholds while systematically increasing the external blur in the physical stimulus. Surprisingly, amblyopes do not exhibit elevated intrinsic blur when measured with an edge stimulus. Given the fundamental ways in which they differ, synthetic stimuli, such as edges, are likely to generate contrasting blur perception compared to natural stimuli, such as pictures. Because our visual system is presumably tuned to process natural stimuli, testing artificial stimuli only could result in performances that are not ecologically valid.

Methods

We tested this hypothesis by measuring, for the first time, the perception of blur added to natural images in amblyopia and compared discrimination performance for natural images and synthetic edges in healthy and amblyopic groups.

Results

Our results demonstrate that patients with amblyopia exhibit higher levels of intrinsic blur than control subjects when tested on natural images. This difference was not observed when using edges.

Conclusions

Our results suggest that intrinsic blur is elevated in the visual system representing vision from the amblyopic eye and that distinct statistics of images can generate different blur perception.

The channel for detecting contrast modulation also responds to density modulation (or vice versa)

In textures composed of black and white dots, we modulated dot density and/or dot contrast in one direction of visual space. Just as Mulligan and MacLeod (Vision Research 28 (1988) 503-519) found a strong reciprocity between density and luminance for dots viewed against a darker background, we found a strong reciprocity between density and contrast: detection thresholds for in-phase modulations of density and contrast were 30% - 55% lower than detection thresholds for density and contrast modulations that were 180° out of phase. These findings support the existence of at least one psychophysical channel that is excited by both density modulations and contrast modulations. A good, quantitative fit to our data can be obtained with a two-channel model.

Predicting blur visual discomfort for natural scenes by the loss of positional information

The perception of blur due to accommodation failures, insufficient optical correction or imperfect image reproduction is a common source of visual discomfort, usually attributed to an anomalous and annoying distribution of the image spectrum in the spatial frequency domain. In the present paper, this discomfort is related to a loss of the localization accuracy of the observed patterns. It is assumed, as a starting perceptual principle, that the visual system is optimally adapted to pattern localization in a natural environment. Thus, since the best possible accuracy of the image patterns localization is indicated by the positional Fisher Information, it is argued that blur discomfort is strictly related to a loss of this information. Following this concept, a receptive field functional model is adopted to predict the visual discomfort. It is a complex-valued operator, orientation-selective both in the space domain and in the spatial frequency domain. Starting from the case of Gaussian blur, the analysis is extended to a generic type of blur by applying a positional Fisher Information equivalence criterion. Out-of-focus blur and astigmatic blur are presented as significant examples. The validity of the proposed model is verified by comparing its predictions with subjective ratings. The model fits linearly with the experiments reported in independent databases, based on different protocols and settings.

The cause of myopia development and progression: Theory, evidence, and treatment

I review the key findings and our current knowledge of the cause of myopia, making the connections among the reliable observations on myopia development and theory to arrive at a summary of what we know about myopia, the proposed prevailing theory, and applicable action. Myopia is reaching epidemic proportions. It is estimated that half of the world's population will be myopic by 2050 unless new strategies to fight myopia are developed. Our high-level mathematical description of myopia is translated into clinical applications involving effective treatment and prevention. A regulating mechanism controlling the refraction of the eye is intimately related to myopia. The approach at hand is to review our knowledge about emmetropization, connecting myopia and emmetropization feedback theory to unveil the cause of myopia. Many observations discussed here test the validity of feedback theory positively. The cause of human myopia fits perfectly with the idea that emmetropization, in particular its feedback theory implementation, is the controlling mechanism behind myopia. They include near work, atropine, lenses, defocus, and outdoor versus indoor activities. The key findings in myopia research point the same way: myopia is the result of corrective lenses interfering with emmetropization. We have enough knowledge to answer the question of whether myopia can be reversed or prevented. There is no need to have mathematical skills to apply theory to real cases. It is enough to know the predictions of the feedback theory of emmetropization.

Vision is protected against blue defocus

Due to chromatic aberration, blue images are defocused when the eye is focused to the middle of the visible spectrum, yet we normally are not aware of chromatic blur. The eye suffers from monochromatic aberrations which degrade the optical quality of all images projected on the retina. The combination of monochromatic and chromatic aberrations is not additive and these aberrations may interact to improve image quality. Using Adaptive Optics, we investigated the optical and visual effects of correcting monochromatic aberrations when viewing polychromatic grayscale, green, and blue images. Correcting the eye’s monochromatic aberrations improved optical quality of the focused green images and degraded the optical quality of defocused blue images, particularly in eyes with higher amounts of monochromatic aberrations. Perceptual judgments of image quality tracked the optical findings, but the perceptual impact of the monochromatic aberrations correction was smaller than the optical predictions. The visual system appears to be adapted to the blur produced by the native monochromatic aberrations, and possibly to defocus in blue.

Image Valence Modulates the Processing of Low-Resolution Affective Natural Scenes

In natural vision, noisy and distorted visual inputs often change our perceptual strategy in scene perception. However, it is unclear the extent to which the affective meaning embedded in the degraded natural scenes modulates our scene understanding and associated eye movements. In this eye-tracking experiment by presenting natural scene images with different categories and levels of emotional valence (high-positive, medium-positive, neutral/low-positive, medium-negative, and high-negative), we systematically investigated human participants' perceptual sensitivity (image valence categorization and arousal rating) and image-viewing gaze behaviour to the changes of image resolution. Our analysis revealed that reducing image resolution led to decreased valence recognition and arousal rating, decreased number of fixations in image-viewing but increased individual fixation duration, and stronger central fixation bias. Furthermore, these distortion effects were modulated by the scene valence with less deterioration impact on the valence categorization of negatively valenced scenes and on the gaze behaviour in viewing of high emotionally charged (high-positive and high-negative) scenes. It seems that our visual system shows a valence-modulated susceptibility to the image distortions in scene perception.

Mutual comparative analysis: a new topography-guided custom ablation protocol referencing subjective refraction to modify corneal topographic data

Background

Several planning algorithms have been developed for topography-guided custom ablation treatment (T-CAT), but each has its own deficiencies. The purpose of this study is to demonstrate the potential of a novel mutual comparative analysis (MCA) informed by manifest refraction and corneal topographic data and the patient’s subjective perception in correcting ametropia.

Methods

This retrospective review included patients with significant preoperative differences in the power or axis of astigmatism according to the manifest refraction and corneal topographic data (power > 0.75 D and/or axis > 10°). T-CAT planning was designed using MCA. Follow-ups were conducted for at least 6 months.

Results

Seventy-nine patients (121 eyes) were included. The mean preoperative deviation in the astigmatic power and axis were 0.72 ± 0.43 D and 20.18 ± 23.68°, respectively. The average oculus residual astigmatism (ORA) was 0.81 ± 0.32 D (range: 0.08–1.66 D). Six months postoperatively, the mean spherical equivalent refraction was 0.04 ± 0.42 D, and the mean cylinder was − 0.27 ± 0.24 D. The mean efficacy and safety indices were 1.10 and 1.15, respectively. The uncorrected distance visual acuity in 92% of the eyes was the same or better than the corrected distance visual acuity. The angle of error was ±5° in 61% of eyes and ± 15° in 84% of eyes. Residual astigmatism was ≤0.5 D in 91% of eyes. Optical quality and photopic contrast sensitivity did not change significantly (p > 0.05), and the scotopic contrast sensitivity decreased at 3, 6, and 12 cpd (p < 0.05). The vertical coma and horizontal coma of the anterior corneal surface significantly decreased postoperatively but increased during follow-up.

Conclusions

The MCA demonstrated safety, efficacy, accuracy, predictability, and stability and can be used as a complementary and feasible method for T-CAT.

Models for discriminating image blur from loss of contrast

Observers can discriminate between blurry and low-contrast images (Morgan, 2017). Wang and Simoncelli (2004) demonstrated that a code for blur is inherent to the phase relationships between localized pattern detectors of different scales. To test whether human observers actually use local phase coherence when discriminating between image blur and loss of contrast, we compared phase-scrambled chessboards with unscrambled chessboards. Although both stimuli had identical amplitude spectra, local phase coherence was disrupted by phase-scrambling. Human observers were required to concurrently detect and identify (as contrast or blur) image manipulations in the 2 × 2 forced-choice paradigm (Nachmias & Weber, 1975; Watson & Robson, 1981) traditionally considered to be a litmus test for “labelled lines” (i.e. detection mechanisms that can be distinguished on the basis of their preferred stimuli). Phase scrambling reduced some observers’ ability to discriminate between blur and a reduction in contrast. However, none of our observers produced data consistent with Watson and Robson's most stringent test for labeled lines, regardless whether phases were scrambled or not. Models of performance fit significantly better when (a) the blur detector also responded to contrast modulations, (b) the contrast detector also responded to blur modulations, or (c) noise in the two detectors was anticorrelated.

Prior Experience Alters the Appearance of Blurry Object Borders

Object memories activated by borders serve as priors for figure assignment: figures are more likely to be perceived on the side of a border where a well-known object is sketched. Do object memories also affect the appearance of object borders? Memories represent past experience with objects; memories of well-known objects include many with sharp borders because they are often fixated. We investigated whether object memories affect appearance by testing whether blurry borders appear sharper when they are contours of well-known objects versus matched novel objects. Participants viewed blurry versions of one familiar and one novel stimulus simultaneously for 180 ms; then made comparative (Exp. 1) or equality judgments regarding perceived blur (Exps. 2–4). For equivalent levels of blur, the borders of well-known objects appeared sharper than those of novel objects. These results extend evidence for the influence of past experience to object appearance, consistent with dynamic interactive models of perception.

Temporal modulation improves dynamic peripheral acuity

Macular degeneration and related visual disorders greatly limit foveal function, resulting in reliance on the peripheral retina for tasks requiring fine spatial vision. Here we investigate stimulus manipulations intended to maximize peripheral acuity for dynamic targets. Acuity was measured using a single interval orientation discrimination task at 10° eccentricity. Two types of image motion were investigated along with two different forms of temporal manipulation. Smooth object motion was generated by translating targets along an isoeccentric path at a constant speed (0-20°/s). Ocular motion was simulated by jittering target location using previously recorded fixational eye movement data, amplified by a variable gain factor (0-8). In one stimulus manipulation, the sequence was temporally subsampled by displaying the target on an evenly spaced subset of video frames. In the other, the contrast polarity of the stimulus was reversed at a variable rate. We found that threshold under object motion was improved at all speeds by reversing contrast polarity, while temporal subsampling improved resolution at high speeds but impaired performance at low speeds. With simulated ocular motion, thresholds were consistently improved by contrast polarity reversal, but impaired by temporal subsampling. We find that contrast polarity reversal and temporal subsampling produce differential effects on peripheral acuity. Applying contrast polarity reversal may offer a relatively simple image manipulation that could enhance visual performance in individuals with central vision loss.

A Perception-driven Hybrid Decomposition for Multi-layer Accommodative Displays

Multi-focal plane and multi-layered light-field displays are promising solutions for addressing all visual cues observed in the real world. Unfortunately, these devices usually require expensive optimizations to compute a suitable decomposition of the input light field or focal stack to drive individual display layers. Although these methods provide near-correct image reconstruction, a significant computational cost prevents real-time applications. A simple alternative is a linear blending strategy which decomposes a single 2D image using depth information. This method provides real-time performance, but it generates inaccurate results at occlusion boundaries and on glossy surfaces. This paper proposes a perception-based hybrid decomposition technique which combines the advantages of the above strategies and achieves both real-time performance and high-fidelity results. The fundamental idea is to apply expensive optimizations only in regions where it is perceptually superior, e.g., depth discontinuities at the fovea, and fall back to less costly linear blending otherwise. We present a complete, perception-informed analysis and model that locally determine which of the two strategies should be applied. The prediction is later utilized by our new synthesis method which performs the image decomposition. The results are analyzed and validated in user experiments on a custom multi-plane display.

Is blur sensitivity altered in children with progressive myopia?

School aged children with progressive myopia show large accommodative lags to blur only cue which is suggestive of a large depth of focus (DOF). While DOF measures are lacking in this age group, their blur detection and discrimination capacities appear to be similar to their non-myopic peers. Accordingly, the current study quantified DOF and blur detection ability in progressive myopic children showing large accommodative lags compared to their non-myopic peers and adults. Blur sensitivity measures were taken from 12 children (8-13 years, 6 myopes and 6 emmetropes) and 6 adults (20-35 years). DOF was quantified using step changes in the lens induced defocus while the subjects viewed a high contrast target through a Badal lens at either 2 or 4D demand. Blur detection thresholds (BDT) were tested using a similar high contrast target in a 2-alternate forced-choice paradigm (2AFC) at both the demands. In addition to the large accommodative lags, micro fluctuations and DOF were significantly larger in myopic children compared to the other groups. However, BDTs were similar across the three groups. When limited to blur cues, the findings of a large DOF coupled with large response lags suggests that myopes are less sensitive to retinal defocus. However, in agreement to a previous study, refractive error had no influence on their BDTs suggesting that the reduced sensitivity to the defocus in a myopic eye appears to be compensated by some form of an adjustment in the higher visual processes to preserve the subjective percept even with a poor retinal image quality.

Creating correct blur and its effect on accommodation

Blur occurs naturally when the eye is focused at one distance and an object is presented at another distance. Computer-graphics engineers and vision scientists often wish to create display images that reproduce such depth-dependent blur, but their methods are incorrect for that purpose. They take into account the scene geometry, pupil size, and focal distances, but do not properly take into account the optical aberrations of the human eye. We developed a method that, by incorporating the viewer's optics, yields displayed images that produce retinal images close to the ones that occur in natural viewing. We concentrated on the effects of defocus, chromatic aberration, astigmatism, and spherical aberration and evaluated their effectiveness by conducting experiments in which we attempted to drive the eye's focusing response (accommodation) through the rendering of these aberrations. We found that accommodation is not driven at all by conventional rendering methods, but that it is driven surprisingly quickly and accurately by our method with defocus and chromatic aberration incorporated. We found some effect of astigmatism but none of spherical aberration. We discuss how the rendering approach can be used in vision science experiments and in the development of ophthalmic/optometric devices and augmented- and virtual-reality displays.

Expression-dependent susceptibility to face distortions in processing of facial expressions of emotion

Our capability of recognizing facial expressions of emotion under different viewing conditions implies the existence of an invariant expression representation. As natural visual signals are often distorted and our perceptual strategy changes with external noise level, it is essential to understand how expression perception is susceptible to face distortion and whether the same facial cues are used to process high- and low-quality face images. We systematically manipulated face image resolution (experiment 1) and blur (experiment 2), and measured participants' expression categorization accuracy, perceived expression intensity and associated gaze patterns. Our analysis revealed a reasonable tolerance to face distortion in expression perception. Reducing image resolution up to 48 × 64 pixels or increasing image blur up to 15 cycles/image had little impact on expression assessment and associated gaze behaviour. Further distortion led to decreased expression categorization accuracy and intensity rating, increased reaction time and fixation duration, and stronger central fixation bias which was not driven by distortion-induced changes in local image saliency. Interestingly, the observed distortion effects were expression-dependent with less deterioration impact on happy and surprise expressions, suggesting this distortion-invariant facial expression perception might be achieved through the categorical model involving a non-linear configural combination of local facial features.

Blur Detection, Depth of Field, and Accommodation in Emmetropic and Hyperopic Children

SIGNIFICANCE

Our results demonstrate that blur detection thresholds are elevated in young children compared with adults, and poorer blur detection thresholds are significantly correlated with the magnitude of accommodative microfluctuations. Given that accommodative microfluctuations are greater with greater accommodative responses, these findings may have implications for young uncorrected hyperopes.

PURPOSE

This study investigated the association between subjective blur detection thresholds and accommodative microfluctuations in children 3 years to younger than 10 years old and adults.

METHODS

Blur detection thresholds were determined in 49 children with habitually uncorrected refractive error (+0.06 to +4.91 diopters [D] spherical equivalent) and 10 habitually uncorrected adults (+0.08 to +1.51 D spherical equivalent) using a custom blur chart with 1° sized optotypes at 33 cm. Letters were blurred by convolution using a Gaussian kernel (SDs of 0.71 to 11.31 arc minutes in √2 steps). Subjective depth of field was determined in subjects 6 years or older and adults. Accommodative microfluctuations, pupils, and lag were measured using infrared photorefraction (25 Hz).

RESULTS

Children had greater blur detection thresholds (P < .001), accommodative microfluctuations (P = .001), and depth of field (P < .001) than adults. In children, increased blur detection thresholds were associated with increased accommodative microfluctuations (P < .001), increased uncorrected hyperopia (P = .01), decreased age (P < .001), and decreased pupil size (P = .01). In a multiple linear regression analysis, blur detection thresholds were associated with accommodative microfluctuations (P < .001) and age (P < .001). Increased accommodative microfluctuations were associated with increased uncorrected hyperopia (P = .004) and decreased pupil size (P = .003) and independently associated with uncorrected hyperopia (P = .001) and pupil size (P = .003) when controlling for age and lag.

CONCLUSIONS

Children did not have adult-like blur detection thresholds or depth of field. Increased accommodative microfluctuations and decreased age were independently associated with greater blur detection thresholds in children 3 years to younger than 10 years. Larger amounts of uncorrected hyperopia in children appear to increase blur detection thresholds because the greater accommodative demand and resulting response increase accommodative microfluctuations.

Joint coding of shape and blur in area V4

Edge blur, a prevalent feature of natural images, is believed to facilitate multiple visual processes including segmentation and depth perception. Furthermore, image descriptions that explicitly combine blur and shape information provide complete representations of naturalistic scenes. Here we report the first demonstration of blur encoding in primate visual cortex: neurons in macaque V4 exhibit tuning for both object shape and boundary blur, with observed blur tuning not explained by potential confounds including stimulus size, intensity, or curvature. A descriptive model wherein blur selectivity is cast as a distinct neural process that modulates the gain of shape-selective V4 neurons explains observed data, supporting the hypothesis that shape and blur are fundamental features of a sufficient neural code for natural image representation in V4.

Blurred edges of objects can aid in depth perception and segmentation, yet how it is combined with shape information in the visual pathway is unknown. Here the authors report that neurons in higher visual area V4 represent both object shape and boundary blur, controlling for stimulus size, intensity and curvature.

Visual adaptation and the amplitude spectra of radiological images

We examined how visual sensitivity and perception are affected by adaptation to the characteristic amplitude spectra of X-ray mammography images. Because of the transmissive nature of X-ray photons, these images have relatively more low-frequency variability than natural images, a difference that is captured by a steeper slope of the amplitude spectrum (~ − 1.5) compared to the ~ 1/f (slope of − 1) spectra common to natural scenes. Radiologists inspecting these images are therefore exposed to a different balance of spectral components, and we measured how this exposure might alter spatial vision. Observers (who were not radiologists) were adapted to images of normal mammograms or the same images sharpened by filtering the amplitude spectra to shallower slopes. Prior adaptation to the original mammograms significantly biased judgments of image focus relative to the sharpened images, demonstrating that the images are sufficient to induce substantial after-effects. The adaptation also induced strong losses in threshold contrast sensitivity that were selective for lower spatial frequencies, though these losses were very similar to the threshold changes induced by the sharpened images. Visual search for targets (Gaussian blobs) added to the images was also not differentially affected by adaptation to the original or sharper images. These results complement our previous studies examining how observers adapt to the textural properties or phase spectra of mammograms. Like the phase spectrum, adaptation to the amplitude spectrum of mammograms alters spatial sensitivity and visual judgments about the images. However, unlike the phase spectrum, adaptation to the amplitude spectra did not confer a selective performance advantage relative to more natural spectra.

Defocus Discrimination in Video: Motion in Depth

We perform two psychophysics experiments to investigate a viewer's ability to detect defocus in video; in particular, the defocus that arises in video during motion in depth when the camera does not maintain sharp focus throughout the motion. The first experiment demonstrates that blur sensitivity during viewing is affected by the speed at which the target moves towards the camera. The second experiment measures a viewer's ability to notice momentary defocus and shows that the threshold of blur detection in arc minutes decreases significantly as the duration of the blur increases. Our results suggest that it is important to have good control of focus while recording video and that momentary defocus should be kept as short as possible so it goes unnoticed.

Vision improvement in pilots with presbyopia following perceptual learning

Israeli Air Force (IAF) pilots continue flying combat missions after the symptoms of natural near-vision deterioration, termed presbyopia, begin to be noticeable. Because modern pilots rely on the displays of the aircraft control and performance instruments, near visual acuity (VA) is essential in the cockpit. We aimed to apply a method previously shown to improve visual performance of presbyopes, and test whether presbyopic IAF pilots can overcome the limitation imposed by presbyopia. Participants were selected by the IAF aeromedical unit as having at least initial presbyopia and trained using a structured personalized perceptual learning method (GlassesOff application), based on detecting briefly presented low-contrast Gabor stimuli, under the conditions of spatial and temporal constraints, from a distance of 40 cm. Our results show that despite their initial visual advantage over age-matched peers, training resulted in robust improvements in various basic visual functions, including static and temporal VA, stereoacuity, spatial crowding, contrast sensitivity and contrast discrimination. Moreover, improvements generalized to higher-level tasks, such as sentence reading and aerial photography interpretation (specifically designed to reflect IAF pilots' expertise in analyzing noisy low-contrast input). In concert with earlier suggestions, gains in visual processing speed are plausible to account, at least partially, for the observed training-induced improvements.

Blur perception throughout the visual field in myopia and emmetropia

We evaluated the ability of emmetropic and myopic observers to detect and discriminate blur across the retina under monocular or binocular viewing conditions. We recruited 39 young (23-30 years) healthy adults (n = 19 myopes) with best-corrected visual acuity 0.0 LogMAR (20/20) or better in each eye and no binocular or accommodative dysfunction. Monocular and binocular blur discrimination thresholds were measured as a function of pedestal blur using naturalistic stimuli with an adaptive 4AFC procedure. Stimuli were presented in a 46° diameter window at 40 cm. Gaussian blur pedestals were confined to an annulus at either 0°, 4°, 8°, or 12° eccentricity, with a blur increment applied to only one quadrant of the image. The adaptive procedure efficiently estimated a dipper shaped blur discrimination threshold function with two parameters: intrinsic blur and blur sensitivity. The amount of intrinsic blur increased for retinal eccentricities beyond 4° (p < 0.001) and was lower in binocular than monocular conditions (p < 0.001), but was similar across refractive groups (p = 0.47). Blur sensitivity decreased with retinal eccentricity (p < 0.001) and was highest for binocular viewing, but only for central vision (p < 0.05). Myopes showed worse blur sensitivity than emmetropes monocularly (p < 0.05) but not binocularly (p = 0.66). As expected, blur perception worsens in the visual periphery and binocular summation is most evident in central vision. Furthermore, myopes exhibit a monocular impairment in blur sensitivity that improves under binocular conditions. Implications for the development of myopia are discussed.

A texture-processing model of the 'visual sense of number'

It has been suggested that numerosity is an elementary quality of perception, similar to colour. If so (and despite considerable investigation), its mechanism remains unknown. Here, we show that observers require on average a massive difference of approximately 40% to detect a change in the number of objects that vary irrelevantly in blur, contrast and spatial separation, and that some naive observers require even more than this. We suggest that relative numerosity is a type of texture discrimination and that a simple model computing the contrast energy at fine spatial scales in the image can perform at least as well as human observers. Like some human observers, this mechanism finds it harder to discriminate relative numerosity in two patterns with different degrees of blur, but it still outpaces the human. We propose energy discrimination as a benchmark model against which more complex models and new data can be tested.

Defocus blur discrimination in natural images with natural optics

The lens system in the human eye is able to best focus light from only one distance at a time.Therefore, many objects in the natural environment are not imaged sharply on the retina. Furthermore, light from objects in the environment is subject to the particular aberrations of the observer's lens system (e.g., astigmatism and chromatic aberration). We refer to blur created by the observer's optics as "natural" or "defocus" blur as opposed to "on-screen" blur created by software on a display screen. Although blur discrimination has been studied extensively, human ability to discriminate defocus blur in images of natural scenes has not been systematically investigated. Here, we measured discrimination of defocus blur for a collection of natural image patches, sampled from well-focused photographs. We constructed a rig capable of presenting stimuli at three physical distances simultaneously. In Experiment 1, subjects viewed monocularly two simultaneously presented natural image patches through a 4-mm artificial pupil at ±1° eccentricity. The task was to identify the sharper patch. Discrimination thresholds varied substantially between stimuli but were correlated between subjects. The lowest thresholds were at or below the lowest thresholds ever reported. In a second experiment, we paralyzed accommodation and retested a subset of conditions from Experiment 1. A third experiment showed that removing contrast as a cue to defocus blur had only a modest effect on thresholds. Finally, we describe a simple masking model and evaluate how well it can explain our experimental results and the results from previous blur discrimination experiments.

On the number of perceivable blur levels in naturalistic images

Blur is a useful cue for depth. Natural images contain objects at a range of depths whose depth can be signaled by their perceived blur. Here, to evaluate the usefulness of blur as a depth cue, we estimate the number blur levels that observers can perceive simultaneously. To estimate this value, observers discriminated and classified dead leaves patterns that contained a controlled distribution of blur levels but are more complex or naturalistic than stimuli typically used in blur research. We used a 2-IFC discrimination task, in which observers reported the interval that contained more blur levels and a classification task, in which observers reported the number of perceived blur levels. In both tasks, observers could not discriminate or classify more than four levels of blur in the stimulus reliably. In isolation from other cues, blur may provide only a coarse cue to depth and add limited depth information when present in natural scenes with complex distributions of blur and multiple depth cues.

Are blur and disparity complementary cues to depth?

The image blur and binocular disparity of a 3D scene point both increase with distance in depth away from fixation. Perceived depth from disparity has been studied extensively and is known to be most precise near fixation. Perceived depth from blur is much less well understood. A recent experiment (Held, R. T, Cooper, E. A., & Banks, M. S. (2012). Current Biology, 22, 426-431) which used a volumetric stereo display found evidence that blur and disparity are complementary cues to depth, namely the disparity cue dominates over the blur cue near the fixation depth and blur dominates over disparity at depths that are far from fixation. Here we present a similar experiment but which used a traditional 3D display so that blur was produced by image processing rather than by the subjects' optics. Contrary to Held et al., we found that subjects did not rely more on blur to discriminate depth at distances far from fixation, even though a sufficient level of blur was available to do so. The discrepancy between the findings of the two studies can be explained in at least two ways. First, Held et al.'s subjects received trial-to-trial feedback in a training phase and may have learned how to perform the task using blur discrimination. Second, Held et al.'s volumetric stereo display may have provided other optical cues that indicated that the blur was real rather than rendered. The latter possibility would have significant implications about how depth is perceived from blur under different viewing conditions.

Human discrimination of depth of field in stereoscopic and nonstereoscopic photographs

Depth of field (DOF) is defined as the distance range within which objects are perceived as sharp. Previous research has focused on blur discrimination in artificial stimuli and natural photographs. The discrimination of DOF, however, has received less attention. Since DOF introduces blur which is related to distance in depth, many levels of blur are simultaneously present. As a consequence, it is unclear whether discrimination thresholds for blur are appropriate for predicting discrimination thresholds for DOF. We therefore measured discrimination thresholds for DOF using a two-alternative forced-choice task. Ten participants were asked to observe two images and to select the one with the larger DOF. We manipulated the scale of the scene--that is, the actual depth in the scene. We conducted the experiment under stereoscopic and nonstereoscopic viewing conditions. We found that the threshold for a large DOF (39.1 mm) was higher than for a small DOF (10.1 mm), and the thresholds decreased when scale of scene increased. We also found that there was no significant difference between stereoscopic and nonstereoscopic conditions. We compared our results with thresholds predicted from the literature. We concluded that using blur discrimination thresholds to discriminate DOF may lead to erroneous conclusions because the depth in the scene significantly affects people's DOF discrimination ability.

Perceptual Learning for Rehabilitation in Traumatic Optic Neuropathy

Traumatic optic neuropathy is a cause of sudden irreversible visual loss due to optic nerve damage following trauma. Reports of improvement have been noted after observation alone, treatment with corticosteroids, and surgical decompression. However, final visual acuity may not be predictable, with individual patients having little improvement in visual function despite therapy. Perceptual learning improves visual functions by improving the neural processing so as to allow image perception at low signal-to-noise ratios. The case report describes the beneficial effect of perceptual learning in traumatic optic neuropathy, the first to describe the use of perceptual learning in an optic neuropathy. A larger case-controlled study of the effect of perceptual learning in optic neuropathies is required to substantiate the beneficial effect and elaborate the scale of improvement that may be possible with this form of therapy.

The effect of blur on the perception of up

PURPOSE

Knowing one's orientation relative to the environment is important for many aspects of vision including object recognition, action planning, and balance. Here we assess how inadequate optical correction for typical refractive errors might influence this. We measured the effect of blur on the perception of orientation as measured by the subjective visual vertical (SVV) and the perceptual upright (PU).

METHODS

The SVV and the PU were determined using a tilted line (was the line tilted left or right of vertical?) and the Oriented CHAracter Recognition Test (OCHART; was a character a "p" or a "d"?), respectively, in the presence of tilted visual backgrounds that were blurred using Gaussian blur with a radius of from 0 to 91 arc min. This is approximately equivalent to between 0 and 13 diopters of refractive error.

RESULTS

Blur reduced the influence of vision on both the SVV and PU by one just noticeable difference (84%) when vision was blurred by 11 to 13 arc min. That is, visual cues to self-orientation remain effective until vision is degraded to about 20/240 - roughly equivalent of taking off a pair of 2 diopter prescription glasses.

CONCLUSIONS

This reduction in the effectiveness of vision for determining orientation has important implications for the visually impaired and the elderly. Attempting tasks that require balance in the presence of uncorrected refractive errors may be more hazardous than expected. The effect of not optically correcting peripheral vision may also be consequential owing to the role of the far periphery in balance control.

Spatial frequency selectivity of visual suppression during convergence eye movements

Visual suppression of low-spatial frequency information during eye movements is believed to contribute to a stable perception of our visual environment. While visual perception has been studied extensively during saccades, vergence has been somewhat neglected. Here, we show that convergence eye movements reduce contrast sensitivity to low spatial frequency information around the onset of the eye movements, but do not affect sensitivity to higher spatial frequencies. This suggests that visual suppression elicited by convergence eye movements may have the same temporal and spatial characteristics as saccadic suppression.

Persistent biases in subjective image focus following cataract surgery

We explored the perception of image focus in patients with cataracts, and how this perception changed following cataract removal and implantation of an intraocular lens. Thirty-three patients with immature senile cataract and with normal retinal function were tested before surgery and 2 days after surgery, with 18 of the patients retested again at 2 months following surgery. The subjective focus of natural images was quantified in each session by varying the slope of the image amplitude spectra. At each time, short-term adaptation to the spectral slope was also determined by repeating the measurements after exposure to images with blurred or sharpened spectra. Despite pronounced acuity deficits, before surgery images appeared "best-focused" when they were only slightly blurred, consistent with a strong compensation for the acuity losses. Post-operatively, the image slopes that were judged "in focus" before surgery appeared too sharp. This bias remained strong at 2 months, and was independent of the rapid blur aftereffects induced by viewing filtered images. The focus settings tended to renormalize more rapidly in patients with higher post-operative acuity, while acuity differences were unrelated to the magnitude of the short-term blur aftereffects. Our results suggest that subjective judgments of image focus are largely compensated as cataracts develop, but potentially through a very long-term form of adaptation that results in persistent biases after the cataract is removed.

The utility of defocus blur in binocular depth perception

The question of whether defocus blur is a quantitative cue for depth perception is a topic of renewed interest. A recent study suggests that relative defocus blur can be used in computing depth throughout the visual field, particularly in regions where disparity loses precision. However, elements of the study's experimental design and theoretical analysis appear to undermine this claim. First, the study did not provide evidence that blur can be used as a quantitative depth cue. It only measured blur discrimination thresholds, not perceived depth from for blur. Second, the study's conceptualization of the complementary use of blur and disparity, and related conjectures, are based on the specific viewing geometry and fixation distance tested. They do not appear to generalize to natural viewing situations and tasks. I suggest a different way in which defocus blur might affect depth perception. Because depth-of-focus blur is a cue to egocentric distance, it could contribute to quantitative depth perception by scaling depth relations specified by other relative depth cues.

Training the brain to overcome the effect of aging on the human eye

Presbyopia, from the Greek for aging eye, is, like death and taxes, inevitable. Presbyopia causes near vision to degrade with age, affecting virtually everyone over the age of 50. Presbyopia has multiple negative effects on the quality of vision and the quality of life, due to limitations on daily activities – in particular, reading. In addition presbyopia results in reduced near visual acuity, reduced contrast sensitivity, and slower processing speed. Currently available solutions, such as optical corrections, are not ideal for all daily activities. Here we show that perceptual learning (repeated practice on a demanding visual task) results in improved visual performance in presbyopes, enabling them to overcome and/or delay some of the disabilities imposed by the aging eye. This improvement was achieved without changing the optical characteristics of the eye. The results suggest that the aging brain retains enough plasticity to overcome the natural biological deterioration with age.