Global precedence, spatial frequency channels, and the statistics of natural images

A bias in transsaccadic perception of spatial frequency changes

Visual processing differs between the foveal and peripheral visual field. These differences can lead to different appearances of objects in the periphery and the fovea, posing a challenge to perception across saccades. Differences in the appearance of visual features between the peripheral and foveal visual field may bias change discrimination across saccades. Previously it has been reported that spatial frequency (SF) appears higher in the periphery compared to the fovea (Davis et al., 1987). In this study, we investigated the visual appearance of SF before and after a saccade and the discrimination of SF changes during saccades. In addition, we tested the contributions of pre- and postsaccadic information to change discrimination performance. In the first experiment, we found no differences in the appearance of SF before and after a saccade. However, participants showed a clear bias to report SF increases. Interestingly, a 200-ms postsaccadic blank improved the precision of the responses but did not affect the bias. In the second experiment, participants showed lower thresholds for SF increases than for decreases, suggesting that the bias in the first experiment was not just a response bias. Finally, we asked participants to discriminate the SF of stimuli presented before a saccade. Thresholds in the presaccadic discrimination task were lower than in the change discrimination task, suggesting that transsaccadic change discrimination is not merely limited by presaccadic discrimination in the periphery. The change direction bias might stem from more effective masking or overwriting of the presaccadic stimulus by the postsaccadic low SF stimulus.

Some like it "local": A review of hierarchical processing in non-human animals

When seeing a visual image, humans prioritize the perception of global features, which is followed by the assessment of the local ones. This global precedence has been investigated using hierarchical stimuli that consist of a large, global shape formed by the spatial arrangement of small local shapes. Comparing non-human animals to humans, research on global and local processing has revealed a heterogeneous pattern of results with some species exhibiting a local precedence and others a global one. Many factors have been proposed to influence the global and local processing: internal factors (e.g., age, sex) and external elements or perceptual field variables (e.g., stimulus size, visual angle, eccentricity, sparsity). In this review, studies showing that different non-human species process hierarchical stimuli in the same (global precedence) or reverse (local precedence) direction as humans are first collated. Different ecological, perceptual, and anatomical features that may influence global and local processing are subsequently proposed based on a detailed analysis of these studies. This information is likely to improve our understanding of the mechanisms behind the perceptual organization and visual processing, and could explain the observed differences in hierarchical processing between species.

Backward masking reveals coarse-to-fine dynamics in human V1

Natural images exhibit luminance variations aligned across a broad spectrum of spatial frequencies (SFs). It has been proposed that, at early stages of processing, the coarse signals carried by the low SF (LSF) of the visual input are sent rapidly from primary visual cortex (V1) to ventral, dorsal and frontal regions to form a coarse representation of the input, which is later sent back to V1 to guide the processing of fine-grained high SFs (i.e., HSF). We used functional resonance imaging (fMRI) to investigate the role of human V1 in the coarse-to-fine integration of visual input. We disrupted the processing of the coarse and fine content of full-spectrum human face stimuli via backward masking of selective SF ranges (LSFs: <1.75cpd and HSFs: >1.75cpd) at specific times (50, 83, 100 or 150ms). In line with coarse-to-fine proposals, we found that (1) the selective masking of stimulus LSF disrupted V1 activity in the earliest time window, and progressively decreased in influence, while (2) an opposite trend was observed for the masking of stimulus' HSF. This pattern of activity was found in V1, as well as in ventral (i.e. the Fusiform Face area, FFA), dorsal and orbitofrontal regions. We additionally presented subjects with contrast negated stimuli. While contrast negation significantly reduced response amplitudes in the FFA, as well as coupling between FFA and V1, coarse-to-fine dynamics were not affected by this manipulation. The fact that V1 response dynamics to strictly identical stimulus sets differed depending on the masked scale adds to growing evidence that V1 role goes beyond the early and quasi-passive transmission of visual information to the rest of the brain. It instead indicates that V1 may yield a 'spatially registered common forum' or 'blackboard' that integrates top-down inferences with incoming visual signals through its recurrent interaction with high-level regions located in the inferotemporal, dorsal and frontal regions.

Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition

Deep neural networks have surpassed human performance in key visual challenges such as object recognition, but require a large amount of energy, computation, and memory. In contrast, spiking neural networks (SNNs) have the potential to improve both the efficiency and biological plausibility of object recognition systems. Here we present a SNN model that uses spike-latency coding and winner-take-all inhibition (WTA-I) to efficiently represent visual stimuli using multi-scale parallel processing. Mimicking neuronal response properties in early visual cortex, images were preprocessed with three different spatial frequency (SF) channels, before they were fed to a layer of spiking neurons whose synaptic weights were updated using spike-timing-dependent-plasticity. We investigate how the quality of the represented objects changes under different SF bands and WTA-I schemes. We demonstrate that a network of 200 spiking neurons tuned to three SFs can efficiently represent objects with as little as 15 spikes per neuron. Studying how core object recognition may be implemented using biologically plausible learning rules in SNNs may not only further our understanding of the brain, but also lead to novel and efficient artificial vision systems.

How Do Repeated Viewings in Forest Landscapes Influence Young People's Visual Behaviors and Cognitive Evaluations?

BACKGROUND

With the spread of the COVID-19 epidemic, it has gradually become normal to periodically visit and enjoy forest landscape resources in the suburbs of cities. For designers and managers of forest landscapes, exploring change in the visual behaviors and cognitive evaluations of people who repeatedly view forest landscapes and the characteristics of this change will aid the design and sustainable utilization of forest landscape resources in the suburbs of cities.

PURPOSE

From the perspective of users' preferences for forest landscape space, this study explored the changes in visual behavior characteristics and psychological preference characteristics for individuals who repeatedly view forest landscapes and their drivers under different preferences.

METHODS

This study collected data from 52 graduate and undergraduate students. We used a difference test to compare the differences in the visual behavior coincidence degree and the changes in psychological evaluations; a descriptive statistical analysis to explore young peoples' likes and dislikes of landscape elements; and Spearman correlation analysis to explore the correlation between the psychological evaluations and visual behaviors.

MAIN RESULTS

1. At the second viewing, the participants' regression behavior tended to decrease for various spaces, and they were more inclined to view areas that they had not viewed before. In addition, at the second viewing, the degree of fixation behavior coincidence was generally low, and there were obvious differences across spaces; 2. The participants' feature evaluations and comprehensive evaluations for landscapes did not change significantly with their increased familiarity with the spaces; 3. There was a significant positive correlation between the participants' psychological evaluations of landscape stimuli and the degree of fixation coincidence when viewing the spaces, among which the rate of distant clarity and the degree of fixation behavior coincidence were significantly and positively correlated. Meanwhile, at the second viewing, the number of favorite elements in the lookout space, which belongs to high-preference spaces, noticeably increased.

The influence of magnocellular and parvocellular visual information on global processing in White and Asian populations

Humans have the remarkable ability to efficiently group elements of a scene together to form a global whole. However, cross-cultural comparisons show that East Asian individuals process scenes more globally than White individuals. This experiment presents new insights into global processing, revealing the relative contributions of two types of visual cells in mediating global and local visual processing in these two groups. Participants completed the Navon hierarchical letters task under divided-attention conditions, indicating whether a target letter “H” was present in the stimuli. Stimuli were either ‘unbiased’, displayed as black letters on a grey screen, or biased to predominantly process low spatial frequency information using psychophysical thresholds that converted unbiased stimuli into achromatic magnocellular-biased stimuli and red-green isoluminant parvocellular-biased stimuli. White participants processed stimuli more globally than Asian participants when low spatial frequency information was conveyed via the parvocellular pathway, while Asian participants showed a global processing advantage when low spatial frequency information was conveyed via the magnocellular pathway, and to a lesser extent through the parvocellular pathway. These findings suggest that the means by which a global processing bias is achieved depends on the subcortical pathway through which visual information is transmitted, and provides a deeper understanding of the relationship between global/local processing, subcortical pathways and spatial frequencies.

Age-differences in interpreting the valence of ambiguous facial expressions: evidence for multiple contributing processes

Surprised facial expressions, which are ambiguous in valence, are interpreted more positively by older adults than by younger adults. To evaluate the processes contributing to this age difference, we varied the spatial frequency of the surprised-face stimuli. When faces were presented in a low-spatial-frequency band, it biased participants to rate them negatively. Although this occurred for both younger and older adults, the older adults' ratings of the low-spatial-frequency faces were more positive than that of the younger adults. This suggests that there is an age-related reduction in the default negativity of interpretations. We also found that older adults, as a whole, rated the high-spatial-frequency faces more positively than did younger adults. However, this effect was eliminated for the subset of older adults with poor high-spatial-frequency perception abilities for whom these faces were difficult to perceive. Thus, older adults' more positive interpretations of surprised faces may also reflect cognitively-effortful regulatory processes.

No Reference Quality Assessment for Screen Content Images Using Stacked Autoencoders in Pictorial and Textual Regions

Recently, the visual quality evaluation of screen content images (SCIs) has become an important and timely emerging research theme. This article presents an effective and novel blind quality evaluation metric for SCIs by using stacked autoencoders (SAE) based on pictorial and textual regions. Since the SCI consists of not only the pictorial area but also the textual area, the human visual system (HVS) is not equally sensitive to their different distortion types. First, the textual and pictorial regions can be obtained by dividing an input SCI via an SCI segmentation metric. Next, we extract quality-aware features from the textual region and pictorial region, respectively. Then, two different SAEs are trained via an unsupervised approach for quality-aware features that are extracted from these two regions. After the training procedure of the SAEs, the quality-aware features can evolve into more discriminative and meaningful features. Subsequently, the evolved features and their corresponding subjective scores are input into two regressors for training. Each regressor can obtain one output predictive score. Finally, the final perceptual quality score of a test SCI is computed by these two predicted scores via a weighted model. Experimental results on two public SCI-oriented databases have revealed that the proposed scheme can compare favorably with the existing blind image quality assessment metrics.

Flexible time course of spatial frequency use during scene categorization

Human observers can quickly and accurately categorize scenes. This remarkable ability is related to the usage of information at different spatial frequencies (SFs) following a coarse-to-fine pattern: Low SFs, conveying coarse layout information, are thought to be used earlier than high SFs, representing more fine-grained information. Alternatives to this pattern have rarely been considered. Here, we probed all possible SF usage strategies randomly with high resolution in both the SF and time dimensions at two categorization levels. We show that correct basic-level categorizations of indoor scenes are linked to the sampling of relatively high SFs, whereas correct outdoor scene categorizations are predicted by an early use of high SFs and a later use of low SFs (fine-to-coarse pattern of SF usage). Superordinate-level categorizations (indoor vs. outdoor scenes) rely on lower SFs early on, followed by a shift to higher SFs and a subsequent shift back to lower SFs in late stages. In summary, our results show no consistent pattern of SF usage across tasks and only partially replicate the diagnostic SFs found in previous studies. We therefore propose that SF sampling strategies of observers differ with varying stimulus and task characteristics, thus favouring the notion of flexible SF usage.

Object expectations alter information use during visual recognition

Prior expectations influence how we perceive and recognize objects. However, how they do so remains unclear, especially in the case of real-world complex objects. Expectations of objects may affect which features are used to recognize them subsequently. In this study, we used reverse correlation to reveal with high precision how the use of information across time is modulated by real-world object expectations in a visual recognition task. We show that coarse information leads to accurate responses earlier when an object is expected, indicating that observers use diagnostic features earlier in this situation. We also demonstrate an increased variability in the use of coarse information depending on the expected object, indicating that observers adopt a more specialized recognition strategy when they expect a specific object. In summary, our results reveal potential mechanisms underlying the effect of expectations on the recognition of complex objects.

Partial awareness can be induced by independent cognitive access to different spatial frequencies

Partial awareness-an intermediate state between complete consciousness and unconsciousness-has been explained by independent cognitive access to different levels of representation in hierarchical visual processing. This account, however, cannot explain graded visual experiences in low levels. We aimed to explain partial awareness in low levels of visual processing by independent cognitive access to different spatial frequencies. To observe partial awareness stably, we used a novel method. Stimuli were presented briefly (12 ms) and repeatedly with a specific inter-stimulus interval, ranging from 0 to 235 ms. By using various stimuli containing high and low spatial frequencies (superimposed sinusoidal gratings, Navon letters, and scenes), we found that conscious percept was degraded with increasing inter-stimulus intervals. However, the degree of degradation was smaller for low spatial frequency than for high spatial frequency information. Our results reveal that cognitive access to different spatial frequencies can occur independently and this can explain partial awareness in low levels of visual processing.

Differential neurodynamics and connectivity in the dorsal and ventral visual pathways during perception of emotional crowds and individuals: a MEG study

Reading the prevailing emotion of groups of people ("crowd emotion") is critical to understanding their overall intention and disposition. It alerts us to potential dangers, such as angry mobs or panicked crowds, giving us time to escape. A critical aspect of processing crowd emotion is that it must occur rapidly, because delays often are costly. Although knowing the timing of neural events is crucial for understanding how the brain guides behaviors using coherent signals from a glimpse of multiple faces, this information is currently lacking in the literature on face ensemble coding. Therefore, we used magnetoencephalography to examine the neurodynamics in the dorsal and ventral visual streams and the periamygdaloid cortex to compare perception of groups of faces versus individual faces. Forty-six participants compared two groups of four faces or two individual faces with varying emotional expressions and chose which group or individual they would avoid. We found that the dorsal stream was activated as early as 68 msec after the onset of stimuli containing groups of faces. In contrast, the ventral stream was activated later and predominantly for individual face stimuli. The latencies of the dorsal stream activation peaks correlated with participants' response times for facial crowds. We also found enhanced connectivity earlier between the periamygdaloid cortex and the dorsal stream regions for crowd emotion perception. Our findings suggest that ensemble coding of facial crowds proceeds rapidly and in parallel by engaging the dorsal stream to mediate adaptive social behaviors, via a distinct route from single face perception.

A cell model in the ventral visual pathway for the detection of circles of curvature constituting figures

The contour of an arbitrary figure can be represented as a group of circles of curvature in contact with it, with each curvature circle represented by its center O_C and radius r. We propose a series of cell models for detecting this circle, which is composed of a lateral geniculate nucleus (LGN) cell, nondirectionally selective (NDS) simple cell, and curvature-circle detection cell (CDC). The LGN and NDS simple cells were previously modeled. The CDC has been modeled as follows. Each tangent in contact with this circle is detected by an NDS simple cell that performs the Hough transformation of LGN cell responses, and then this tangent is transformed to a three-dimensional (3D) normal line in a CDC column. This transformation has been named a 3D normal-line transform. Performing this transformation for all tangents causes a CDC at the intersection of these normal lines to fire most intensively, and thus the O_C and r of the circle is detected as the coordinates of this intersection. Therefore, the CDC has been modeled as this 3D normal-line transform. Based on this CDC, we model two types of constancy CDC: a position-invariant CDC and a curvature-invariant CDC. These three types of CDC reflect the response to various stimuli in actual area V4 cells. In order to validate these CDC types neurophysiologically, we propose an experimental method using microelectrodes. Cell models previously reported correspond to this hierarchy: the S1, S2, and C2 cells correspond to the NDS simple cell, CDC, and position-invariant CDC, respectively.

A Neural Network Model With Gap Junction for Topological Detection

Visual information processing in the brain goes from global to local. A large volume of experimental studies has suggested that among global features, the brain perceives the topological information of an image first. Here, we propose a neural network model to elucidate the underlying computational mechanism. The model consists of two parts. The first part is a neural network in which neurons are coupled through gap junctions, mimicking the neural circuit formed by alpha ganglion cells in the retina. Gap junction plays a key role in the model, which, on one hand, facilitates the synchronized firing of a neuron group covering a connected region of an image, and on the other hand, staggers the firing moments of different neuron groups covering disconnected regions of the image. These two properties endow the network with the capacity of detecting the connectivity and closure of images. The second part of the model is a read-out neuron, which reads out the topological information that has been converted into the number of synchronized firings in the retina network. Our model provides a simple yet effective mechanism for the neural system to detect the topological information of images in ultra-speed.

Forest before the trees in the aquatic world: global and local processing in teleost fishes

Background

The study of illusory phenomena is important to understanding the similarities and differences between mammals and birds’ perceptual systems. In recent years, the analysis has been enlarged to include cold-blooded vertebrates, such as fish. However, evidence collected in the literature have drawn a contradictory picture, with some fish species exhibiting a human-like perception of visual illusions and others showing either a reversed perception or no susceptibility to visual illusions. The possibility exists that these mixed results relate to interspecific variability in perceptual grouping mechanisms. Therefore, we studied whether fish of five species exhibit a spontaneous tendency to prioritize a global analysis of the visual scene—also known as global-to-local precedence—instead of focusing on local details.

Methods

Using Navon-like stimuli (i.e., larger recognisable shapes composed of copies of smaller different shapes), we trained redtail splitfin, zebrafish, angelfish, Siamese fighting fish and three spot gourami to discriminate between two figures characterized by congruency between global and local information (a circle made by small circles and a cross made by small crosses). In the test phase, we put global and local cues (e.g., a circle made by small crosses) into contrast to see whether fish spontaneously rely on global or local information.

Results

Like humans, fish seem to have an overall global-to-local precedence, with no significant differences among the species. However, looking at the species-specific level, only four out of five species showed a significant global-to-local precedence, and at different degrees. Because these species are distantly related and occupy a broad spectrum of ecological adaptations, we suggest that the tendency to prioritize a global analysis of visual inputs may be more similar in fish than expected by the mixed results of visual illusion studies.

Disentangling presentation and processing times in the brain

Visual object recognition seems to occur almost instantaneously. However, not only does it require hundreds of milliseconds of processing, but our eyes also typically fixate the object for hundreds of milliseconds. Consequently, information reaching our eyes at different moments is processed in the brain together. Moreover, information received at different moments during fixation is likely to be processed differently, notably because different features might be selectively attended at different moments. Here, we introduce a novel reverse correlation paradigm that allows us to uncover with millisecond precision the processing time course of specific information received on the retina at specific moments. Using faces as stimuli, we observed that processing at several electrodes and latencies was different depending on the moment at which information was received. Some of these variations were caused by a disruption occurring 160-200 ​ms after the face onset, suggesting a role of the N170 ERP component in gating information processing; others hinted at temporal compression and integration mechanisms. Importantly, the observed differences were not explained by simple adaptation or repetition priming, they were modulated by the task, and they were correlated with differences in behavior. These results suggest that top-down routines of information sampling are applied to the continuous visual input, even within a single eye fixation.

Magnocellular and parvocellular pathway contributions to facial threat cue processing

Human faces evolved to signal emotions, with their meaning contextualized by eye gaze. For instance, a fearful expression paired with averted gaze clearly signals both presence of threat and its probable location. Conversely, direct gaze paired with facial fear leaves the source of the fear-evoking threat ambiguous. Given that visual perception occurs in parallel streams with different processing emphases, our goal was to test a recently developed hypothesis that clear and ambiguous threat cues would differentially engage the magnocellular (M) and parvocellular (P) pathways, respectively. We employed two-tone face images to characterize the neurodynamics evoked by stimuli that were biased toward M or P pathways. Human observers (N = 57) had to identify the expression of fearful or neutral faces with direct or averted gaze while their magnetoencephalogram was recorded. Phase locking between the amygdaloid complex, orbitofrontal cortex (OFC) and fusiform gyrus increased early (0–300 ms) for M-biased clear threat cues (averted-gaze fear) in the β-band (13–30 Hz) while P-biased ambiguous threat cues (direct-gaze fear) evoked increased θ (4–8 Hz) phase locking in connections with OFC of the right hemisphere. We show that M and P pathways are relatively more sensitive toward clear and ambiguous threat processing, respectively, and characterize the neurodynamics underlying emotional face processing in the M and P pathways.

Influence of Artificially Generated Interocular Blur Difference on Fusion Stability Under Vergence Stress

The stability of fusion was evaluated by its breakage when interocular blur differences were presented under vergence demand to healthy subjects. We presumed that these blur differences cause suppression of the more blurred image (interocular blur suppression, IOBS), disrupt binocular fusion and suppressed eye leaves its forced vergent position. During dichoptic presentation of static grayscale images of natural scenes, the luminance contrast (mode B) or higher-spatial frequency content (mode C) or luminance contrast plus higher-spatial frequency content (mode A) were stepwise reduced in the image presented to the non-dominant eye. We studied the effect of these types of blur on fusion stability at various levels of the vergence demand. During the divergence demand, the fusion was disrupted with approximately half blur than during convergence. Various modes of blur influenced fusion differently. The mode C (isolated reduction of higher-spatial frequency content) violated fusion under the lowest vergence demand significantly more than either isolated or combined reduction of luminance contrast (mode B and A). According to our results, the image´s details (i.e. higher-spatial frequency content) protects binocular fusion from disruption by the lowest vergence demand.

Coarse-to-fine information integration in human vision

Coarse-to-fine theories of vision propose that the coarse information carried by the low spatial frequencies (LSF) of visual input guides the integration of finer, high spatial frequency (HSF) detail. Whether and how LSF modulates HSF processing in naturalistic broad-band stimuli is still unclear. Here we used multivariate decoding of EEG signals to separate the respective contribution of LSF and HSF to the neural response evoked by broad-band images. Participants viewed images of human faces, monkey faces and phase-scrambled versions that were either broad-band or filtered to contain LSF or HSF. We trained classifiers on EEG scalp-patterns evoked by filtered scrambled stimuli and evaluated the derived models on broad-band scrambled and intact trials. We found reduced HSF contribution when LSF was informative towards image content, indicating that coarse information does guide the processing of fine detail, in line with coarse-to-fine theories. We discuss the potential cortical mechanisms underlying such coarse-to-fine feedback.

Early Visual Processing of Feature Saliency Tasks: A Review of Psychophysical Experiments

The visual system is constantly bombarded with information originating from the outside world, but it is unable to process all the received information at any given time. In fact, the most salient parts of the visual scene are chosen to be processed involuntarily and immediately after the first glance along with endogenous signals in the brain. Vision scientists have shown that the early visual system, from retina to lateral geniculate nucleus (LGN) and then primary visual cortex, selectively processes the low-level features of the visual scene. Everything we perceive from the visual scene is based on these feature properties and their subsequent combination in higher visual areas. Different experiments have been designed to investigate the impact of these features on saliency and understand the relative visual mechanisms. In this paper, we review the psychophysical experiments which have been published in the last decades to indicate how the low-level salient features are processed in the early visual cortex and extract the most important and basic information of the visual scene. Important and open questions are discussed in this review as well and one might pursue these questions to investigate the impact of higher level features on saliency in complex scenes or natural images.

The Effect of Size Statistics of the Background Texture on Perceived Target Size

We investigated the effect of the size distribution statistics of background elements on the perceived size of a target. We manipulated the first, second, and third order statistics (i.e., mean, variance, and skewness) of the background element size distribution. We used a two-interval forced-choice paradigm to measure perceived target size at different background size distributions. In each trial, a standard disk, or target, was presented in one interval with a textured background and a comparison disk, on a blank background, in the other. The task for the observers was to determine which interval contained a larger disk. We measured the point of subjective equality for the perceived target size with a staircase procedure. The perceived target size decreased with the increment of mean background disk size. The variance and skewness of the background element size did not affect the perceived target size. Our results showed that only the first order statistics of the background modulated the perceived target size, not the higher order statistics. A computational model, in which the visual system extracts size information by averaging the responses of different size channels, whose response is modulated by the size of the background elements, can account for the results.

The role of spatial frequency information in the decoding of facial expressions of pain: a novel hybrid task

Spatial frequency (SF) information contributes to the recognition of facial expressions, including pain. Low-SF encodes facial configuration and structure and often dominates over high-SF information, which encodes fine details in facial features. This low-SF preference has not been investigated within the context of pain. In this study, we investigated whether perpetual preference differences exist for low-SF and high-SF pain information. A novel hybrid expression paradigm was used in which 2 different expressions, one containing low-SF information and the other high-SF information, were combined in a facial hybrid. Participants are instructed to identify the core expression contained within the hybrid, allowing for the measurement of SF information preference. Three experiments were conducted (46 participants in each) that varied the expressions within the hybrid faces: respectively pain-neutral, pain-fear, and pain-happiness. In order to measure the temporal aspects of image processing, each hybrid image was presented for 33, 67, 150, and 300 ms. As expected, identification of pain and other expressions was dominated by low-SF information across the 3 experiments. The low-SF preference was largest when the presentation of hybrid faces was brief and reduced as the presentation duration increased. A sex difference was also found in experiment 1. For women, the low-SF preference was dampened by high-SF pain information, when viewing low-SF neutral expressions. These results not only confirm the role that SF information has in the recognition of pain in facial expressions but suggests that in some situations, there may be sex differences in how pain is communicated.

Revealing Detail along the Visual Hierarchy: Neural Clustering Preserves Acuity from V1 to V4

How primates perceive objects along with their detailed features remains a mystery. This ability to make fine visual discriminations depends upon a high-acuity analysis of spatial frequency (SF) along the visual hierarchy from V1 to inferotemporal cortex. By studying the transformation of SF across macaque parafoveal V1, V2, and V4, we discovered SF-selective functional domains in V4 encoding higher SFs up to 12 cycles/°. These intermittent higher-SF-selective domains, surrounded by domains encoding lower SFs, violate the inverse relationship between SF preference and retinal eccentricity. The neural activities of higher- and lower-SF domains correspond to local and global features, respectively, of the same stimuli. Neural response latencies in high-SF domains are around 10 ms later than in low-SF domains, consistent with the coarse-to-fine nature of perception. Thus, our finding of preserved resolution from V1 into V4, separated both spatially and temporally, may serve as a connecting link for detailed object representation.

Global Dominance outside the Focus of Attention

Identification of the local aspect of a relevant compound stimulus has been found to be delayed by the presence of target-set members at the global aspect of an irrelevant compound stimulus, whereas identification of the global aspect is unaffected by the presence of local target-set members within the irrelevant object (Paquet & Merikle, 1988). This effect has been termed the global category effect, and it suggests that global dominance occurs for objects located outside the attentional focus, as well as within an attended hierarchical object. In the present experiments, attention was directed to the relevant one of two compound stimuli by using either shape information (Experiments 1 and 2) or a 100-msec peripheral rapid onset precue (Experiment 3). Results revealed a global category effect even when the physical features of the displays containing global target-set members within the irrelevant object were closely matched with those of the control displays. Critically, the magnitude of the global category effect was affected by how well attention could be focused on the relevant compound stimulus. These findings suggest (a) that the analysis of global information for irrelevant objects is more elaborate than the simple detection of features; and (b) that both perceptual and attentional mechanisms are involved in global dominance.

Attention to distinguishing features in object recognition: An interactive-iterative framework

This article advances a framework that casts object recognition as a process of discrimination between alternative object identities, in which top-down and bottom-up processes interact-iteratively when necessary-with attention to distinguishing features playing a critical role. In two experiments, observers discriminated between different types of artificial fish. In parallel, a secondary, variable-SOA visual-probe detection task was used to examine the dynamics of visual attention. In Experiment 1, the fish varied in three distinguishing features: one indicating the general category (saltwater, freshwater), and one of the two other features indicating the specific type of fish within each category. As predicted, in the course of recognizing each fish, attention was allocated iteratively to the distinguishing features in an optimal manner: first to the general category feature, and then, based on its value, to the second feature that identified the specific fish. In Experiment 2, two types of fish could be discriminated on the basis of either of two distinguishing features, one more visually discriminable than the other. On some of the trials, one of the two alternative distinguishing features was occluded. As predicted, in the course of recognizing each fish, attention was directed initially to the more discriminable distinguishing feature, but when this feature was occluded, it was then redirected to the less discriminable feature. The implications of these findings, and the interactive-iterative framework they support, are discussed with regard to several fundamental issues having a long history in the literatures on object recognition, object categorization, and visual perception in general.

Object Categorization in Finer Levels Relies More on Higher Spatial Frequencies and Takes Longer

The human visual system contains a hierarchical sequence of modules that take part in visual perception at different levels of abstraction, i.e., superordinate, basic, and subordinate levels. One important question is to identify the “entry” level at which the visual representation is commenced in the process of object recognition. For a long time, it was believed that the basic level had a temporal advantage over two others. This claim has been challenged recently. Here we used a series of psychophysics experiments, based on a rapid presentation paradigm, as well as two computational models, with bandpass filtered images of five object classes to study the processing order of the categorization levels. In these experiments, we investigated the type of visual information required for categorizing objects in each level by varying the spatial frequency bands of the input image. The results of our psychophysics experiments and computational models are consistent. They indicate that the different spatial frequency information had different effects on object categorization in each level. In the absence of high frequency information, subordinate and basic level categorization are performed less accurately, while the superordinate level is performed well. This means that low frequency information is sufficient for superordinate level, but not for the basic and subordinate levels. These finer levels rely more on high frequency information, which appears to take longer to be processed, leading to longer reaction times. Finally, to avoid the ceiling effect, we evaluated the robustness of the results by adding different amounts of noise to the input images and repeating the experiments. As expected, the categorization accuracy decreased and the reaction time increased significantly, but the trends were the same. This shows that our results are not due to a ceiling effect. The compatibility between our psychophysical and computational results suggests that the temporal advantage of the superordinate (resp. basic) level to basic (resp. subordinate) level is mainly due to the computational constraints (the visual system processes higher spatial frequencies more slowly, and categorization in finer levels depends more on these higher spatial frequencies).

Global shape integration and illusory form perception in the absence of awareness

Previous research on perceptual organization operations still provides contradictory evidence on whether the integration of sparse local elements into coherently unified shapes and the construction of the illusory form are accomplished without the need of awareness. In the present study, three experiments were conducted in which participants were presented with masked (Experiment 1, SOA=27ms; Experiment 2; SOA=53ms) and unmasked (Experiment 3) primes consisting of geometric shapes (a square or a diamond) that could be congruent or incongruent with subsequent probe stimuli (square vs. diamond). Furthermore, the primes were divided into: a grouping condition (where local elements may group together into global shapes), an illusory condition (where the arrangement of local elements produced illusory shapes) and a hybrid condition (where both operations were presented simultaneously). While no priming effects were found for the shortest SOA (27ms), both grouping and illusory primes produced significant priming effects in the longer SOA (53ms). On the other hand, results in Experiment 3 (unmasked) showed strong priming effects for the grouping of the inducers in both the grouping and the hybrid conditions, and also a significant but weaker priming effect for the illusory condition. Overall, our results support the possibility of the integration of local visual features into a global shape in the absence of awareness and, likewise, they suggest an early -subliminal- construction of the illusory shape, implying that feedback projections from higher to lower visual areas are not crucial in the construction of the illusory form.

All in the first glance: first fixation predicts individual differences in valence bias

Surprised expressions are interpreted as negative by some people, and as positive by others. When compared to fearful expressions, which are consistently rated as negative, surprise and fear share similar morphological structures (e.g. widened eyes), but these similarities are primarily in the upper part of the face (eyes). We hypothesised, then, that individuals would be more likely to interpret surprise positively when fixating faster to the lower part of the face (mouth). Participants rated surprised and fearful faces as either positive or negative while eye movements were recorded. Positive ratings of surprise were associated with longer fixation on the mouth than negative ratings. There were also individual differences in fixation patterns, with individuals who fixated the mouth earlier exhibiting increased positive ratings. These findings suggest that there are meaningful individual differences in how people process faces.

The Effect of Spatial-Frequency Filtering on the Visual Processing of Global Structure

In three experiments we measured reaction times (RTs) and error rates in identifying the global structure of spatially filtered stimuli whose spatial-frequency content was selected by means of three types of 2-D isotropic filters (Butterworth of order 2, Butterworth of order 10, and a filters with total or partial Gaussian spectral profile). In each experiment, low-pass (LP), band-pass (BP), and high-pass (HP) filtered stimuli, with nine centre or cut-off spatial frequencies, were used. Irrespective of the type of filter, the experimental results showed that: (a) RTs to stimuli with low spatial frequencies were shorter than those to stimuli with medium or high spatial frequencies, (b) RTs to LP filtered stimuli were nearly constant, but they increased in a non-monotonic way with the filter centre spatial frequency in BP filtered stimuli and with the filter cut-off frequency in HP filtered stimuli, and (c) the identification of the global pattern occurred with all visible stimuli used, including BP and HP images without low spatial frequencies. To remove the possible influence of the energy, a fourth experiment was conducted with Gaussian filtered stimuli of equal contrast power ( crms = 0.065). Similar results to those described above were found for stimuli with spatial-frequency content higher than 2 cycles deg−1. A model of isotropic first-order visual channels collecting the stimulus spectral energy in all orientations explains the RT data. A subsequent second-order nonlinear amplitude demodulation process, applied to the output of the most energetic first-order channel, could explain the perception of global structure of each spatially filtered stimulus, including images lacking low spatial frequencies.

Dissociating early and late visual processing via the Ebbinghaus illusion

Visual perception is not instantaneous; the perceptual representation of our environment builds up over time. This can strongly affect our responses to visual stimuli. Here, we study the temporal dynamics of visual processing by analyzing the time course of priming effects induced by the well-known Ebbinghaus illusion. In slower responses, Ebbinghaus primes produce effects in accordance with their perceptual appearance. However, in fast responses, these effects are reversed. We argue that this dissociation originates from the difference between early feedforward-mediated gist of the scene processing and later feedback-mediated more elaborate processing. Indeed, our findings are well explained by the differences between low-frequency representations mediated by the fast magnocellular pathway and high-frequency representations mediated by the slower parvocellular pathway. Our results demonstrate the potentially dramatic effect of response speed on the perception of visual illusions specifically and on our actions in response to objects in our visual environment generally.

Atypical Time Course of Object Recognition in Autism Spectrum Disorder

In neurotypical observers, it is widely believed that the visual system samples the world in a coarse-to-fine fashion. Past studies on Autism Spectrum Disorder (ASD) have identified atypical responses to fine visual information but did not investigate the time course of the sampling of information at different levels of granularity (i.e. Spatial Frequencies, SF). Here, we examined this question during an object recognition task in ASD and neurotypical observers using a novel experimental paradigm. Our results confirm and characterize with unprecedented precision a coarse-to-fine sampling of SF information in neurotypical observers. In ASD observers, we discovered a different pattern of SF sampling across time: in the first 80 ms, high SFs lead ASD observers to a higher accuracy than neurotypical observers, and these SFs are sampled differently across time in the two subject groups. Our results might be related to the absence of a mandatory precedence of global information, and to top-down processing abnormalities in ASD.

Are Spatial Frequencies Integrated from Coarse to Fine?

The existence of a temporal anisotropy in the integration of spatial frequencies, such that spatial frequencies are integrated more effectively if they are available from low to high through time, has been examined in a series of experiments. In the first experiment, the first three harmonics of a square wave were presented in a low-to-high or a high-to-low sequence in a temporal two-interval forced-choice experiment. Subjects were asked to indicate which sequence appeared to resemble a square wave more. A high-to-low sequence of spatial frequencies was judged to more resemble the target than the low-to-high sequence. These results support a temporal anisotropy in the integration of spatial frequencies of exactly the opposite form to that suggested from previous results. Further experiments established that this was not due to task differences or to subjects basing their decision on the final spatial frequency shown. An interpretation is offered in which an isotropic mechanism for spatial-frequency integration is combined with a recency bias.

When Beauty Breaks Down: Investigation of the Effect of Spatial Quantisation on Aesthetic Evaluation of Facial Images

Research on the perception of facial attractiveness has been dominated by aspects of averageness, symmetry, and secondary sex characteristics of faces. Almost absent is systematic research on the spatial scale (coarseness) of detail sufficient to carry information about facial attractiveness. In the present study, subjects were asked to evaluate the attractiveness of faces while the coarseness of detail of the face images was systematically decreased. Subjects discriminated a set of attractive faces from the set of unattractive faces when the coarseness of spatial quantisation changed from 10 to 17 pixels per face. Some of the faces regarded as attractive had the steepest shift in the rating towards the more attractive end of the scale at different resolutions. Once perceived as attractive in the coarse scale of image resolution, the faces generally did not return to the unattractive group with a subsequent finer scale of description. No single critical scale of detail was revealed that would have dramatically changed the perception of facial attractiveness from uncertain to distinct.

Varieties of Binocular Interaction in Human Vision

Binocular processing was investigated using a quantitative, process-oriented metatheory of response times. The analyses are not confined to particular distributional assumptions or specific models. Upper and lower performance boundaries for probability summation in parallel processing are defined and compared with observed distributions of reaction times using a variety of dichoptic stimuli. Performance that exceeds the upper bound strongly suggests facilitatory convergence between the two eyes (binocular channel summation). Performance below the lower bound suggests that inputs to the two eyes are processed serially. The results indicate that binocular channel summation in subjects with normal stereo vision requires targets of the same luminance polarity (paired increments or decrements) in corresponding retinal locations. When corresponding retinal locations are stimulated with opposing luminance polarities (increment to one eye, decrement to the other), performance is consistent with probability summation, indicating that parallel ON and OFF pathways remain segregated at least to the level of binocular fusion. Further analyses of data from a stereo-blind observer suggest serial processing of binocular inputs.

Nature and Dynamics of Reference Frames in Visual Search for Orientation: Implications for Early Visual Processing

Visual detection of a line target differing in orientation from a background of lines is assumed to occur early in vision and to involve filter mechanisms acting in parallel over the visual field in retinotopic maps (Foster & Ward, 1991; Treisman, 1985; Wolfe, 1994). But retinotopicality does not imply that early vision takes place in a retinal reference frame. This article briefly reviews experiments on this issue and analyzes their implications regarding early visual processing. The review shows that the spatial frame of reference used in visual search for orientation is dynamically determined by various sensory cues to orientation (Marendaz, Stivalet, Barraclough, & Walkowiac, 1993; Stivalet, Marendaz, Barraclough, & Mourareau, 1995). These findings suggest that intersensory integration and perceptual organization are involved at a processing level preceding visual search. This functional viewpoint is discussed in relation to data from neuroscience and psychology (visual search, microgravity).

Gestalt Reasoning with Conjunctions and Disjunctions

Reasoning, solving mathematical equations, or planning written and spoken sentences all must factor in stimuli perceptual properties. Indeed, thinking processes are inspired by and subsequently fitted to concrete objects and situations. It is therefore reasonable to expect that the mental representations evoked when people solve these seemingly abstract tasks should interact with the properties of the manipulated stimuli. Here, we investigated the mental representations evoked by conjunction and disjunction expressions in language-picture matching tasks. We hypothesised that, if these representations have been derived using key Gestalt principles, reasoners should use perceptual compatibility to gauge the goodness of fit between conjunction/disjunction descriptions (e.g., the purple and/ or the green) and corresponding binary visual displays. Indeed, the results of three experimental studies demonstrate that reasoners associate conjunction descriptions with perceptually-dependent stimuli and disjunction descriptions with perceptually-independent stimuli, where visual dependency status follows the key Gestalt principles of common fate, proximity, and similarity.

Examining the role of red background in magnocellular contribution to face perception

This study examines the role of the magnocellular system in the early stages of face perception, in particular sex categorization. Utilizing the specific property of magnocellular suppression in red light, we investigated visually guided reaching to low and high spatial frequency hybrid faces against red and grey backgrounds. The arm movement curvature measure shows that reduced response of the magnocellular pathway interferes with the low spatial frequency component of face perception. This finding provides behavioral evidence for magnocellular contribution to non-emotional aspect of face perception.

The Neural Bases of the Semantic Interference of Spatial Frequency-based Information in Scenes

Current models of visual perception suggest that during scene categorization, low spatial frequencies (LSF) are processed rapidly and activate plausible interpretations of visual input. This coarse analysis would then be used to guide subsequent processing of high spatial frequencies (HSF). The present fMRI study examined how processing of LSF may influence that of HSF by investigating the neural bases of the semantic interference effect. We used hybrid scenes as stimuli by combining LSF and HSF from two different scenes, and participants had to categorize the HSF scene. Categorization was impaired when LSF and HSF scenes were semantically dissimilar, suggesting that the LSF scene was processed automatically and interfered with categorization of the HSF scene. fMRI results revealed that this semantic interference effect was associated with increased activation in the inferior frontal gyrus, the superior parietal lobules, and the fusiform and parahippocampal gyri. Furthermore, a connectivity analysis (psychophysiological interaction) revealed that the semantic interference effect resulted in increasing connectivity between the right fusiform and the right inferior frontal gyri. Results support influential models suggesting that, during scene categorization, LSF information is processed rapidly in the pFC and activates plausible interpretations of the scene category. These coarse predictions would then initiate top–down influences on recognition-related areas of the inferotemporal cortex, and these could interfere with the categorization of HSF information in case of semantic dissimilarity to LSF.

The forest or the trees: preference for global over local image processing is reversed by prior experience in honeybees

Traditional models of insect vision have assumed that insects are only capable of low-level analysis of local cues and are incapable of global, holistic perception. However, recent studies on honeybee (Apis mellifera) vision have refuted this view by showing that this insect also processes complex visual information by using spatial configurations or relational rules. In the light of these findings, we asked whether bees prioritize global configurations or local cues by setting these two levels of image analysis in competition. We trained individual free-flying honeybees to discriminate hierarchical visual stimuli within a Y-maze and tested bees with novel stimuli in which local and/or global cues were manipulated. We demonstrate that even when local information is accessible, bees prefer global information, thus relying mainly on the object's spatial configuration rather than on elemental, local information. This preference can be reversed if bees are pre-trained to discriminate isolated local cues. In this case, bees prefer the hierarchical stimuli with the local elements previously primed even if they build an incorrect global configuration. Pre-training with local cues induces a generic attentional bias towards any local elements as local information is prioritized in the test, even if the local cues used in the test are different from the pre-trained ones. Our results thus underline the plasticity of visual processing in insects and provide new insights for the comparative analysis of visual recognition in humans and animals.

Age-Related Differences in Spatial Frequency Processing during Scene Categorization

Visual analysis of real-life scenes starts with the parallel extraction of different visual elementary features at different spatial frequencies. The global shape of the scene is mainly contained in low spatial frequencies (LSF), and the edges and borders of objects are mainly contained in high spatial frequencies (HSF). The present fMRI study investigates the effect of age on the spatial frequency processing in scenes. Young and elderly participants performed a categorization task (indoor vs. outdoor) on LSF and HSF scenes. Behavioral results revealed performance degradation for elderly participants only when categorizing HSF scenes. At the cortical level, young participants exhibited retinotopic organization of spatial frequency processing, characterized by medial activation in the anterior part of the occipital lobe for LSF scenes (compared to HSF), and the lateral activation in the posterior part of the occipital lobe for HSF scenes (compared to LSF). Elderly participants showed activation only in the anterior part of the occipital lobe for LSF scenes (compared to HSF), but not significant activation for HSF (compared to LSF). Furthermore, a ROI analysis revealed that the parahippocampal place area, a scene-selective region, was less activated for HSF than LSF for elderly participants only. Comparison between groups revealed greater activation of the right inferior occipital gyrus in young participants than in elderly participants for HSF. Activation of temporo-parietal regions was greater in elderly participants irrespective of spatial frequencies. The present findings indicate a specific low-contrasted HSF deficit for normal elderly people, in association with an occipito-temporal cortex dysfunction, and a functional reorganization of the categorization of filtered scenes.

You can detect the trees as well as the forest when adding the leaves: evidence from visual search tasks containing three-level hierarchical stimuli

The present study investigated how multiple levels of hierarchical stimuli (i.e., global, intermediate and local) are processed during a visual search task. Healthy adults participated in a visual search task in which a target was either present or not at one of the three levels of hierarchical stimuli (global geometrical form made by intermediate forms themselves constituted by local forms). By varying the number of distractors, the results showed that targets presented at global and intermediate levels were detected efficiently (i.e., the detection times did not vary with the number of distractors) whereas local targets were processed less efficiently (i.e., the detection times increased with the number of distractors). Additional experiments confirmed that these results were not due to the size of the target elements or to the spatial proximity among the structural levels. Taken together, these results show that the most local level is always processed less efficiently, suggesting that it is disadvantaged during the competition for attentional resources compared to higher structural levels. The present study thus supports the view that the processing occurring in visual search acts dichotomously rather than continuously. Given that pure structuralist and pure space-based models of attention cannot account for the pattern of our findings, we discuss the implication for perception, attentional selection and executive control of target position on hierarchical stimuli.

Spatial frequency processing in scene-selective cortical regions

Visual analysis begins with the parallel extraction of different attributes at different spatial frequencies. Low spatial frequencies (LSF) convey coarse information and are characterized by high luminance contrast, while high spatial frequencies (HSF) convey fine details and are characterized by low luminance contrast. In the present fMRI study, we examined how scene-selective regions-the parahippocampal place area (PPA), the retrosplenial cortex (RSC) and the occipital place area (OPA)-responded to spatial frequencies when contrast was either equalized or not equalized across spatial frequencies. Participants performed a categorization task on LSF, HSF and non-filtered scenes belonging to two different categories (indoors and outdoors). We either left contrast across scenes untouched, or equalized it using a root-mean-square contrast normalization. We found that when contrast remained unmodified, LSF and NF scenes elicited greater activation than HSF scenes in the PPA. However, when contrast was equalized across spatial frequencies, the PPA was selective to HFS. This suggests that PPA activity relies on an interaction between spatial frequency and contrast in scenes. In the RSC, LSF and NF elicited greater response than HSF scenes when contrast was not modified, while no effect of spatial frequencies appeared when contrast was equalized across filtered scenes, suggesting that the RSC is sensitive to high-contrast information. Finally, we observed selective activation of the OPA in response to HSF, irrespective of contrast manipulation. These results provide new insights into how scene-selective areas operate during scene processing.