Spatial asymmetries in viewing and remembering scenes: consequences of an attentional bias?

Setting the scene for boundary extension: Methods, findings, connections, and theories

A previously viewed scene is often remembered as containing a larger extent of the background than was actually present, and information that was likely present just outside the boundaries of that view is often incorporated into the representation of that scene. This has been referred to as boundary extension. Methodologies used in studies on boundary extension (terminology, stimulus presentation, response measures) are described. Empirical findings regarding effects of characteristics of the stimulus (whether the stimulus depicts a scene, semantics of the scene, view angle, object size, object cropping, object orientation, object color, number of objects, depth of field, object distance, viewpoint production, scene orientation, motion, faces, emotions, modality, whether the scene is multimodal), characteristics of the display (aperture shape, aperture size, target duration, retention interval), and characteristics of the observer (allocation of attention, imagination, age, expectations and strategies, eye fixation, eye movements, monocular or binocular view, vantage point, confinement, prior exposure, expertise, arousal, pathology) on boundary extension are reviewed. Connections of boundary extension to other cognitive phenomena and processes (evolutionary adaptation, Gestalt principles, illusions, psychophysics, invariant physical principles, aesthetics, temporal boundary extension, normalization) are noted, and theories and theoretical considerations regarding boundary extension (multisource model, boundary transformation, mental imagery, 4E cognition, cognitive modularity, neurological mechanisms of scene representation) are discussed.

Perceptual lateralization on the Rod-and-Frame Test in young and older adults

INTRODUCTION

There is an overall left visual field/right hemisphere advantage in young adults for masked, tachistoscopically presented images on the Rod-and-Frame Test (RFT). This study explored potential age-related lateralization differences in processing of visual context on the RFT.

METHODS

The 35 young and 33 older adults aligned a rod surrounded either by no frame, a vertical, or leftward/rightward tilted frame to their perceived vertical. Algebraic errors of rod alignment were used to derive the rod-and-frame effect (RFE) and asymmetry index.

RESULTS

Young adults had frequent indirect effects, mostly to the right-tilted frame, while older adults hardly produced any. Compared with nontilted frames, young adults displayed larger alignment errors with left-tilted frames; however, older adults exhibited this same effect for both frame tilt conditions. Young adults had smaller RFE values than older adults for the right-tilted frame, with no age-related difference in RFE for the left-tilted frame or asymmetry index. The negative asymmetry index was statistically different from the true vertical only in young adults.

CONCLUSION

There is an age-related reduction in the right hemisphere processing of left-sided visual contexts on the RFT. Such findings can assist clinicians to improve interpretation of RFT findings in clinical patients.

Gaze data of 4243 participants shows link between leftward and superior attention biases and age

Healthy individuals typically show more attention to the left than to the right (known as pseudoneglect), and to the upper than to the lower visual field (known as altitudinal pseudoneglect). These biases are thought to reflect asymmetries in neural processes. Attention biases have been used to investigate how these neural asymmetries change with age. However, inconsistent results have been reported regarding the presence and direction of age-related effects on horizontal and vertical attention biases. The observed inconsistencies may be due to insensitive measures and small sample sizes, that usually only feature extreme age groups. We investigated whether spatial attention biases, as indexed by gaze position during free viewing of a single image, are influenced by age. We analysed free-viewing data from 4,243 participants aged 5-65 years and found that attention biases shifted to the right and superior directions with increasing age. These findings are consistent with the idea of developing cerebral asymmetries with age and support the hypothesis of the origin of the leftward bias. Age modulations were found only for the first seven fixations, corresponding to the time window in which an absolute leftward bias in free viewing was previously observed. We interpret this as evidence that the horizontal and vertical attention biases are primarily present when orienting attention to a novel stimulus - and that age modulations of attention orienting are not global modulations of spatial attention. Taken together, our results suggest that attention orienting may be modulated by age and that cortical asymmetries may change with age.

The functional role of spatial anisotropies in ensemble perception

BACKGROUND

The human brain can rapidly represent sets of similar stimuli by their ensemble summary statistics, like the average orientation or size. Classic models assume that ensemble statistics are computed by integrating all elements with equal weight. Challenging this view, here, we show that ensemble statistics are estimated by combining parafoveal and foveal statistics in proportion to their reliability. In a series of experiments, observers reproduced the average orientation of an ensemble of stimuli under varying levels of visual uncertainty.

RESULTS

Ensemble statistics were affected by multiple spatial biases, in particular, a strong and persistent bias towards the center of the visual field. This bias, evident in the majority of subjects and in all experiments, scaled with uncertainty: the higher the uncertainty in the ensemble statistics, the larger the bias towards the element shown at the fovea.

CONCLUSION

Our findings indicate that ensemble perception cannot be explained by simple uniform pooling. The visual system weights information anisotropically from both the parafovea and the fovea, taking the intrinsic spatial anisotropies of vision into account to compensate for visual uncertainty.

Does Boundary Extension Need Attention?

When we look at a picture, we tend to remember it by enriching the constructed mental representation with elements not present but probable outside the current view. The tendency to remember the perceived view with a broader scope is known as boundary extension (BE). Does BE benefit from paying reduced attention to the picture? While attention plays a central role in memory, only a few studies to date have investigated this question in the field of BE. In this research, participants completed a BE task in single- and dual-task conditions. The results indicate that BE is eliminated when the attention is divided on the onset of scene construction. We therefore discuss the role of attention in BE.

Pseudoneglect during object search in naturalistic scenes

Pseudoneglect, that is the tendency to pay more attention to the left side of space, is typically assessed with paper-and-pencil tasks, particularly line bisection. In the present study, we used an everyday task with more complex stimuli. Subjects' task was to look for pre-specified objects in images of real-world scenes. In half of the scenes, the search object was located on the left side of the image (L-target); in the other half of the scenes, the target was on the right side (R-target). To control for left-right differences in the composition of the scenes, half of the scenes were mirrored horizontally. Eye-movement recordings were used to track the course of pseudoneglect on a millisecond timescale. Subjects' initial eye movements were biased to the left of the scene, but less so for R-targets than for L-targets, indicating that pseudoneglect was modulated by task demands and scene guidance. We further analyzed how horizontal gaze positions changed over time. When the data for L- and R-targets were pooled, the leftward bias lasted, on average, until the first second of the search process came to an end. Even for right-side targets, the gaze data showed an early left-bias, which was compensated by adjustments in the direction and amplitude of later saccades. Importantly, we found that pseudoneglect affected search efficiency by leading to less efficient scan paths and consequently longer search times for R-targets compared with L-targets. It may therefore be prudent to take spatial asymmetries into account when studying visual search in scenes.

Flexible constraint hierarchy during the visual encoding of tool-object interactions

Tools and objects are associated with numerous action possibilities that are reduced depending on the task-related internal and external constraints presented to the observer. Action hierarchies propose that goals represent higher levels of the hierarchy while kinematic patterns represent lower levels of the hierarchy. Prior work suggests that tool-object perception is heavily influenced by grasp and action context. The current study sought to evaluate whether the presence of action hierarchy can be perceptually identified using eye tracking during tool-object observation. We hypothesize that gaze patterns will reveal a perceptual hierarchy based on the observed task context and grasp constraints. Participants viewed tool-objects scenes with two types of constraints: task-context and grasp constraints. Task-context constraints consisted of correct (e.g., frying pan-spatula) and incorrect tool-object pairings (e.g., stapler-spatula). Grasp constraints involved modified tool orientations, which requires participants to understand how initially awkward grasp postures can help achieve the task. The visual scene contained three areas of interests (AOIs): the object, the functional tool-end (e.g., spoon handle) and the manipulative tool-end (e.g., spoon bowl). Results revealed two distinct processes based on stimuli constraints. Goal-oriented encoding, the attentional bias towards the object and manipulative tool-end, was demonstrated when grasp did not lead to meaningful tool-use. In images where grasp postures were critical to action performance, attentional bias was primarily between the object and functional tool-end, which suggests means-related encoding of the graspable properties of the object. This study expands from previous work and demonstrates a flexible constraint hierarchy depending on the observed task constraints.

Spatial asymmetries ("pseudoneglect") in free visual exploration-modulation of age and relationship to line bisection

When humans visually explore an image, they typically tend to start exploring its left side. This phenomenon, so-called pseudoneglect, is well known, but its time-course has only sparsely been studied. Furthermore, it is unclear whether age influences pseudoneglect, and the relationship between visuo-spatial attentional asymmetries in a free visual exploration task and a classical line bisection task has not been established. To address these questions, 60 healthy participants, aged between 22 and 86, were assessed by means of a free visual exploration task with a series of naturalistic, colour photographs of everyday scenes, while their gaze was recorded by means of a contact-free eye-tracking system. Furthermore, a classical line bisection task was administered, and information concerning handedness and subjective alertness during the experiment was obtained. The results revealed a time-sensitive window during visual exploration, between 260 and 960 ms, in which age was a significant predictor of the leftward bias in gaze position, i.e., of pseudoneglect. Moreover, pseudoneglect as assessed by the line bisection task correlated with the average gaze position throughout a time-window of 300–1490 ms during the visual exploration task. These results suggest that age influences visual exploration and pseudoneglect in a time-sensitive fashion, and that the degree of pseudoneglect in the line bisection task correlates with the average gaze position during visual exploration in a time-sensitive manner.

The anisotropic field of ensemble coding

Human observers can accurately estimate statistical summaries from an ensemble of multiple stimuli, including the average size, hue, and direction of motion. The efficiency and speed with which statistical summaries are extracted suggest an automatic mechanism of ensemble coding that operates beyond the capacity limits of attention and memory. However, the extent to which ensemble coding reflects a truly parallel and holistic mode of processing or a non-uniform and biased integration of multiple items is still under debate. In the present work, we used a technique, based on a Spatial Weighted Average Model (SWM), to recover the spatial profile of weights with which individual stimuli contribute to the estimated average during mean size adjustment tasks. In a series of experiments, we derived two-dimensional SWM maps for ensembles presented at different retinal locations, with different degrees of dispersion and under different attentional demands. Our findings revealed strong spatial anisotropies and leftward biases in ensemble coding that were organized in retinotopic reference frames and persisted under attentional manipulations. These results demonstrate an anisotropic spatial contribution to ensemble coding that could be mediated by the differential activation of the two hemispheres during spatial processing and scene encoding.

A compressibility account of the color-sharing bonus in working memory

It has been established that objects sharing color in a visual display can boost working memory. The capacity to encode singletons particularly benefits from the repetition of colors encoded as perceptual groups. We manipulated the algorithmic complexity of visual displays to test whether compressibility of information could account for the color-sharing bonus. This study used a free recall working memory task in which the participants were shown displays of 2 to 8 color items. We examined the influence of set size, complexity, number of same-color clusters and amount of color redundancy. The results showed that the probability of correct recall of the pattern and the proportion of similarity between the pattern and the response decreased with an increase of each manipulated variable, except for color redundancy in terms of probability of correct recall. The model performance of complexity did not differ from that of clusters, but complexity was found more accurate than either set size or color redundancy. The results also showed that similar items were more often recalled adjacently, and complexity correlated strongly with the number of extra color repetitions in the response, suggesting that more complex patterns encouraged the use of information compression. Moreover, color repetitions were more often recalled first and the probability of correct recall for singletons and sub-patterns could be predicted by the compressibility measure. We discuss the potential advantage of using compressibility measures to capture the effects of regularities in visual patterns, in particular to refine analysis of the color-sharing bonus.

Right Hemisphere Memory Bias Does Not Extend to Involuntary Memories for Negative Scenes

Attention is unequally distributed across the visual field. Due to greater right than left hemisphere activation for visuospatial attention, people attend slightly more to the left than the right side. As a result, people voluntarily remember visual stimuli better when it first appears in the left than the right visual field. But does this effect-termed a right hemisphere memory bias-also enhance involuntary memory? We manipulated the presentation location of 100 highly negative images (chosen to increase the likelihood that participants would experience any involuntary memories) in three conditions: predominantly leftward (right hemisphere bias), predominantly rightward (left hemisphere bias), or equally in both visual fields (bilateral). We measured subsequent involuntary memories immediately and for 3 days after encoding. Contrary to predictions, biased hemispheric processing did not affect short- or long-term involuntary memory frequency or duration. Future research should measure hemispheric differences at retrieval, rather than just encoding.

Eye Tracking Studies Exploring Cognitive and Affective Processes among Alcohol Drinkers: a Systematic Review and Perspectives

Acute alcohol intoxication and alcohol use disorders are characterized by a wide range of psychological and cerebral impairments, which have been widely explored using neuropsychological and neuroscientific techniques. Eye tracking has recently emerged as an innovative tool to renew this exploration, as eye movements offer complementary information on the processes underlying perceptive, attentional, memory or executive abilities. Building on this, the present systematic and critical literature review provides a comprehensive overview of eye tracking studies exploring cognitive and affective processes among alcohol drinkers. Using PRISMA guidelines, 36 papers that measured eye movements among alcohol drinkers were extracted from three databases (PsycINFO, PubMed, Scopus). They were assessed for methodological quality using a standardized procedure, and categorized based on the main cognitive function measured, namely perceptive abilities, attentional bias, executive function, emotion and prevention/intervention. Eye tracking indexes showed that alcohol-related disorders are related to: (1) a stable pattern of basic eye movement impairments, particularly during alcohol intoxication; (2) a robust attentional bias, indexed by increased dwell times for alcohol-related stimuli; (3) a reduced inhibitory control on saccadic movements; (4) an increased pupillary reactivity to visual stimuli, regardless of their emotional content; (5) a limited visual attention to prevention messages. Perspectives for future research are proposed, notably encouraging the exploration of eye movements in severe alcohol use disorders and the establishment of methodological gold standards for eye tracking measures in this field.

Viewing of figurative paintings affects pseudoneglect as measured by line bisection

Neurologically intact individuals usually show a leftward bias in spatial attention, known as pseudoneglect, likely reflecting a right-hemisphere dominance in the control of spatial attention. A leftward bias also seems to manifest when individuals are asked to provide aesthetic judgments about visual stimuli, like artworks. However, whether artwork perception affects the allocation of spatial attention has never been directly investigated. Here, we assessed whether viewing figurative paintings affects hemispheric imbalance in the control of spatial attention by asking participants to bisect a series of lines presented on a grey background, on figurative paintings or on non-artistic photographs of real-world scenes, while either simply observing or explicitly evaluating each image. In line with previous evidence, participants showed a leftward bisection bias in the baseline condition, reflecting pseudoneglect. Critically, the presence of a painting in the background (irrespective of whether an aesthetic evaluation was required or not) significantly shifted the bias further to the left compared to when lines were bisected over a grey background (baseline) or a photographed scene. This finding suggests that perception of visual art may affect the control of spatial attention, possibly tapping on right-hemisphere resources related to visuospatial exploration, regardless of reward apprehension mechanisms (at least when images do not evoke strong emotional reactions leading to polarized like/dislike judgements).

Visual exploration of emotional body language: a behavioural and eye-tracking study

Bodily postures are essential to correctly comprehend others' emotions and intentions. Nonetheless, very few studies focused on the pattern of eye movements implicated in the recognition of emotional body language (EBL), demonstrating significant differences in relation to different emotions. A yet unanswered question regards the presence of the "left-gaze bias" (i.e. the tendency to look first, to make more fixations and to spend more looking time on the left side of centrally presented stimuli) while scanning bodies. Hence, the present study aims at exploring both the presence of a left-gaze bias and the modulation of EBL visual exploration mechanisms, by investigating the fixation patterns (number of fixations and latency of the first fixation) of participants while judging the emotional intensity of static bodily postures (Angry, Happy and Neutral, without head). While results on the latency of first fixations demonstrate for the first time the presence of the left-gaze bias while scanning bodies, suggesting that it could be related to the stronger expressiveness of the left hand (from the observer's point of view), results on fixations' number only partially fulfil our hypothesis. Moreover, an opposite viewing pattern between Angry and Happy bodily postures is showed. In sum, the present results, by integrating the spatial and temporal dimension of gaze exploration patterns, shed new light on EBL visual exploration mechanisms.

The role of arousal in boundary judgement errors

Eyewitnesses to a crime rely heavily on their visual memory; however, there are many ways that the details of visual scenes can be missed, or distorted. In particular, for emotional scenes, the "boundaries" are narrowed at retrieval, whereas central details-such as a weapon-are remembered in greater detail. This phenomenon is known as boundary restriction, the reverse of boundary extension whereby people tend to expand the boundaries of a neutral scene at retrieval. In the present series of experiments, we investigated whether arousal is the element of an emotional scene that leads to increased boundary restriction or reduced boundary extension. We presented neutral images to participants either with or without a stress-inducing noise. In Experiment 1a and 1b, at test, participants viewed the image they originally viewed next to the same image but with narrower or wider boundaries and selected which of the two images they originally viewed. In Experiment 2, at test, participants viewed the identical image they originally viewed, but were told the boundaries had been changed. Participants selected the extent to which the images at test had restricted or extended boundaries compared to their memory of the original image. When the noise stressor was present, participants made more boundary restriction errors-selecting the image with narrower boundaries than the original-and fewer boundary extension errors than when the noise was absent. Our data suggest that arousal plays a key role in boundary judgements.

Evidence for a common mechanism of spatial attention and visual awareness: Towards construct validity of pseudoneglect

Present knowledge of attention and awareness centres on deficits in patients with right brain damage who show severe forms of inattention to the left, called spatial neglect. Yet the functions that are lost in neglect are poorly understood. In healthy people, they might produce “pseudoneglect”—subtle biases to the left found in various tests that could complement the leftward deficits in neglect. But pseudoneglect measures are poorly correlated. Thus, it is unclear whether they reflect anything but distinct surface features of the tests. To probe for a common mechanism, here we asked whether visual noise, known to increase leftward biases in the grating-scales task, has comparable effects on other measures of pseudoneglect. We measured biases using three perceptual tasks that require judgments about size (landmark task), luminance (greyscales task) and spatial frequency (grating-scales task), as well as two visual search tasks that permitted serial and parallel search or parallel search alone. In each task, we randomly selected pixels of the stimuli and set them to random luminance values, much like a poor TV signal. We found that participants biased their perceptual judgments more to the left with increasing levels of noise, regardless of task. Also, noise amplified the difference between long and short lines in the landmark task. In contrast, biases during visual searches were not influenced by noise. Our data provide crucial evidence that different measures of perceptual pseudoneglect, but not exploratory pseudoneglect, share a common mechanism. It can be speculated that this common mechanism feeds into specific, right-dominant processes of global awareness involved in the integration of visual information across the two hemispheres.

Further to the right: Viewing distance modulates attentional asymmetries ('pseudoneglect') during visual exploration

Previous studies showed that the small leftward bias found in healthy humans' spatial judgments of lines ("pseudoneglect") shifts to the right with increasing distance between stimuli and observer. In this study, we investigated whether such a modulation of attentional asymmetry can also be observed in free visual exploration. Participants freely explored photographs of naturalistic scenes for 7 s in near (60 cm) and far (140 cm) space. After an initial leftward bias, followed by a compensatory rightward bias, gaze positions were significantly more leftward in near compared to far space (around 4 s from scene onset). Our results show that the modulation of attentional asymmetries by viewing distance previously reported for spatial judgments generalizes to free visual exploration, and we revealed the temporal dynamics of these asymmetries by fine-grained eye movement analysis. In contrast, an effect of viewing distance was reduced or absent when eye movements are under strong top-down control, as in systematic serial visual search (Sensitive Negelct Test). Finally, there was no effect of viewing distance in the landmark task (as also reported in a minority of other studies), suggesting that this effect may depend on specific, yet unidentified task characteristics.

The Role of Attention and Saccades on Parietofrontal Encoding of Contextual and Grasp-specific Affordances of Tools: An ERP Study

The ability to recognize a tool's affordances (how a spoon should be appropriately grasped and used), is vital for daily life. Prior research has identified parietofrontal circuits, including mirror neurons, to be critical in understanding affordances. However, parietofrontal action-encoding regions receive extensive visual input and are adjacent to parietofrontal attention control networks. It is unclear how eye movements and attention modulate parietofrontal encoding of affordances. To address this issue, scenes depicting tools in different use-contexts and grasp-postures were presented to healthy subjects across two experiments, with stimuli durations of 100 ms or 500 ms. The 100-ms experiment automatically restricted saccades and required covert attention, while the 500-ms experiment allowed overt attention. The two experiments elicited similar behavioral decisions on tool-use correctness and isolated the influence of attention on parietofrontal activity. Parietofrontal ERPs (P600) distinguishing tool-use contexts (e.g., spoon-yogurt vs. spoon-ball) were similar in both experiments. Conversely, parietofrontal ERPs distinguishing tool-grasps were characterized by posterior to frontal N130-N200 ERPs in the 100-ms experiment and by saccade-perturbed N130-N200 ERPs, frontal N400 and parietal P500 in the 500-ms experiment. Particularly, only overt gaze toward the hand-tool interaction engaged mirror neurons (frontal N400) when discerning grasps that manipulate but not functionally use a tool - (grasp bowl rather than stem of spoon). Results here detail the first human electrophysiological evidence on how attention selectively modulates multiple parietofrontal grasp-perception circuits, especially the mirror neuron system, while unaffecting parietofrontal encoding of tool-use contexts. These results are pertinent to neurophysiological models of affordances that typically neglect the role of attention in action perception.

Spatial selective attention biases are shaped by long-term musical experience and short-term exposure to tones

Selective attention is a dynamic process that rapidly shifts processing resources to information that is most relevant to our goals. Although individuals often show spatial biases in attention, these biases can be modified by both long-term factors, such as musical training, or by momentary changes in the auditory context. The present study used a visual search task to examine the influence of these factors on spatial attention biases while increasing demands on selective attention. Experiment 1 examined the effects of musical experience on baseline spatial selective attention biases during search. Individuals with little musical experience showed a typical leftward response bias that became stronger as the number of distractors increased. However, those with more musical experience showed similar responses to targets on the left and right sides, indicating an attenuation of the typical leftward spatial attention bias. Experiment 2 examined whether the addition of low- and high-frequency tones dynamically influenced participants' spatial attention biases during visual search. Participants showed increased orienting to and scanning of left-side distractor locations in response to low-frequency tones regardless of musical experience. The present results demonstrate that spatial attention biases are dynamic and can be shaped by both long-term experiences and momentary contextual effects.

Effects of methamphetamine abuse on spatial cognitive function

Methamphetamine (MA) abuse has been rising rapidly over the past decade, however, its impact in spatial cognitive function remains unknown. To understand its effect on visuospatial ability and spatial orientation ability, 40 MA users and 40 non-MA users conducted the Simple Reaction Task (Task 1), the Spatial Orientation Task (Task 2), and the Mental Rotation Task (Task 3), respectively. There was no significant difference in either accuracy or reaction time (RT) between 2 groups in Task 1. During Task 2, in comparison with non-MA users, MA users performed poorer on RT, but not in accuracy for foot and hand stimuli. In addition, both non-MA and MA users responded much more quickly to upward stimuli than downward stimuli on vertical surface, however, only non-MA users exhibited leftward visual field advantage in horizontal orientation processing. As for Task 3, MA users exhibited poorer performance and more errors than their healthy counterparts. For each group, linear relationship was revealed between RT and orientation angle, whereas MA abuse led to longer intercept for all stimuli involved. Our findings suggested that MA abuse may lead to a general deficit in the visuospatial ability and the spatial orientation ability with more serious impact in the former.

Pseudoneglect is maintained in aging but not in mild Alzheimer's disease: new insights from an enumeration task

Neurologically healthy young adults display a behavioral bias, called pseudoneglect, which favors the processing of stimuli appearing in the left visual field. Pseudoneglect arises from the right hemisphere dominance for visuospatial attention. Previous studies investigating the effects of normal aging on pseudoneglect in line bisection and greyscale tasks have produced divergent results. In addition, scarce systematic investigations of visual biases in dementia have been reported. The aim of the present study was to evaluate whether the leftward bias appearing during an enumeration task in young adults would be preserved in normal aging and at different stages of severity of Alzheimer's disease. In Experiment 1, young and older healthy adults showed a comparable pseudoneglect, performing better when targets appeared in the left visual field. In Experiment 2, the leftward bias was maintained in amnesic mild cognitive impairment patients (aMCI), but it vanished in mild Alzheimer's disease patients (AD). The maintenance of pseudoneglect in normal aging and in aMCI patients is consistent with compensatory phenomena involving the right fronto-parietal network, which allow maintaining the right hemisphere dominance. Conversely, the lack of pseudoneglect in the sample of AD patients likely results from a loss of the right hemisphere dominance, caused by the selective degeneration of the right fronto-parietal network. These results highlight the need of further systematic investigations of visuospatial biases along the continuum of normal and pathological aging, both for a better understanding of the changes characterizing cognitive aging and for improvements in the evaluation of neglect in Alzheimer's disease.

The Ebbinghaus illusion with small inducers appears larger on the right side

The effects of left and right alignment on the Ebbinghaus illusion were investigated in three experiments. In Experiment 1, the Ebbinghaus illusion was presented on the left or right side, and the points of subjective equality (PSE) were measured. Only the central disk of the figure with small inducers was perceived larger when it was positioned on the right side rather than on the left. In Experiments 2 and 3, left, right, and central placement were used to determine if the results of Experiment 1 were caused by a decrease of the illusion on the left side or an increase of the illusion on the right side. There was no difference in the illusion effect between the left and the center; however, the illusion effect increased when the figure was presented on the right side. These results suggest that a hemispheric asymmetry for global and local spatial attention influences the laterality of the Ebbinghaus illusion.

Assessing the Graphical Perception of Time and Speed on 2D+Time Trajectories

We empirically evaluate the extent to which people perceive non-constant time and speed encoded on 2D paths. In our graphical perception study, we evaluate nine encodings from the literature for both straight and curved paths. Visualizing time and speed information is a challenge when the x and y axes already encode other data dimensions, for example when plotting a trip on a map. This is particularly true in disciplines such as time-geography and movement analytics that often require visualizing spatio-temporal trajectories. A common approach is to use 2D+time trajectories, which are 2D paths for which time is an additional dimension. However, there are currently no guidelines regarding how to represent time and speed on such paths. Our study results provide InfoVis designers with clear guidance regarding which encodings to use and which ones to avoid; in particular, we suggest using color value to encode speed and segment length to encode time whenever possible.

Boundary Extension in Face Processing

Boundary extension is a common false memory error, in which people confidently remember seeing a wider angle view of the scene than was viewed. Previous research found that boundary extension is scene-specific and did not examine this phenomenon in nonscenes. The present research explored boundary extension in cropped face images. Participants completed either a short-term or a long-term condition of the task. During the encoding, they observed photographs of faces, cropped either in a forehead or in a chin area, and subsequently performed face recognition through a forced-choice selection. The recognition options represented different degrees of boundary extension and boundary restriction errors. Eye-tracking and performance data were collected. The results demonstrated boundary extension in both memory conditions. Furthermore, previous literature reported the asymmetry in amounts of expansion at different sides of an image. The present work provides the evidence of asymmetry in boundary extension. In the short-term condition, boundary extension errors were more pronounced for forehead, than for chin face areas. Finally, this research examined the relationships between the measures of boundary extension, imagery, and emotion. The results suggest that individual differences in emotional ability and object, but not spatial, imagery could be associated with boundary extension in face processing.

Influence of initial fixation position in scene viewing

During scene perception our eyes generate complex sequences of fixations. Predictors of fixation locations are bottom-up factors such as luminance contrast, top-down factors like viewing instruction, and systematic biases, e.g., the tendency to place fixations near the center of an image. However, comparatively little is known about the dynamics of scanpaths after experimental manipulation of specific fixation locations. Here we investigate the influence of initial fixation position on subsequent eye-movement behavior on an image. We presented 64 colored photographs to participants who started their scanpaths from one of two experimentally controlled positions in the right or left part of an image. Additionally, we used computational models to predict the images' fixation locations and classified them as balanced images or images with high conspicuity on either the left or right side of a picture. The manipulation of the starting position influenced viewing behavior for several seconds and produced a tendency to overshoot to the image side opposite to the starting position. Possible mechanisms for the generation of this overshoot were investigated using numerical simulations of statistical and dynamical models. Our model comparisons show that inhibitory tagging is a viable mechanism for dynamical planning of scanpaths.

Are Categorical Spatial Relations Encoded by Shifting Visual Attention between Objects?

Perceiving not just values, but relations between values, is critical to human cognition. We tested the predictions of a proposed mechanism for processing categorical spatial relations between two objects-the shift account of relation processing-which states that relations such as 'above' or 'below' are extracted by shifting visual attention upward or downward in space. If so, then shifts of attention should improve the representation of spatial relations, compared to a control condition of identity memory. Participants viewed a pair of briefly flashed objects and were then tested on either the relative spatial relation or identity of one of those objects. Using eye tracking to reveal participants' voluntary shifts of attention over time, we found that when initial fixation was on neither object, relational memory showed an absolute advantage for the object following an attention shift, while identity memory showed no advantage for either object. This result is consistent with the shift account of relation processing. When initial fixation began on one of the objects, identity memory strongly benefited this fixated object, while relational memory only showed a relative benefit for objects following an attention shift. This result is also consistent, although not as uniquely, with the shift account of relation processing. Taken together, we suggest that the attention shift account provides a mechanistic explanation for the overall results. This account can potentially serve as the common mechanism underlying both linguistic and perceptual representations of spatial relations.

The Connected Scatterplot for Presenting Paired Time Series

The connected scatterplot visualizes two related time series in a scatterplot and connects the points with a line in temporal sequence. News media are increasingly using this technique to present data under the intuition that it is understandable and engaging. To explore these intuitions, we (1) describe how paired time series relationships appear in a connected scatterplot, (2) qualitatively evaluate how well people understand trends depicted in this format, (3) quantitatively measure the types and frequency of misinter pretations, and (4) empirically evaluate whether viewers will preferentially view graphs in this format over the more traditional format. The results suggest that low-complexity connected scatterplots can be understood with little explanation, and that viewers are biased towards inspecting connected scatterplots over the more traditional format. We also describe misinterpretations of connected scatterplots and propose further research into mitigating these mistakes for viewers unfamiliar with the technique.

Representational pseudoneglect for detecting changes to Rey-Osterrieth figures

When dividing attention between the left and right sides of physical space, most individuals pay slightly more attention to the left side. This phenomenon, known as pseudoneglect, may also occur for the left and right sides of mental representations of stimuli. Representational pseudoneglect has been shown for the recall of real-world scenes and for simple, briefly presented stimuli. The current study sought to investigate the effect of exposure duration and complexity using adaptations of the Rey-Osterrieth figures. Undergraduates (n = 97) were shown a stimulus for 20 s and asked to remember it. Participants were then shown a probe and indicated whether it was the same or different. Results showed that, irrespective of whether an element was added or subtracted, changes on the left side of the remembered image were better detected. These results are consistent with representational pseudoneglect and demonstrate that this effect occurs for complex stimuli when presented for an extended period of time. Representation neglect is therefore unlikely to be the result of an initial saccade to the left-but could be related to the formation or recall of the representation.

Reading and writing direction effects on the aesthetic appreciation of photographs

Does reading and writing direction (RWD) influence the aesthetic appreciation of photography? Pérez González showed that nineteenth-century Iranian and Spanish professional photographers manifest lateral biases linked to RWD in their compositions. The present study aimed to test whether a population sample showed similar biases. Photographs with left-to-right (L-R) and right-to-left (R-L) directionality were selected from Pérez González's collections and presented in both original and mirror-reversed forms to Spanish (L-R readers) and Moroccan (R-L readers) participants. In Experiment 1, participants rated each picture for its aesthetic pleasingness. The results showed neither effects of lateral organization nor interactions with RWD. In Experiment 2, each picture and its mirror version were presented together and participants chose the one they liked better. Spaniards preferred rightward versions and Moroccans preferred leftward versions. RWD therefore affects aesthetic impressions of photography in our participants when people pay attention to the lateral spatial dimension of pictures. The observed directional aesthetic preferences were not sensitive to the sex of the model in the photographs, failing to support expectations from the hypotheses of emotionality and agency. Preferences were attributable to the interaction between general scanning strategies and scanning habits linked to RWD.

Visual routines for extracting magnitude relations

Linking relations described in text with relations in visualizations is often difficult. We used eye tracking to measure the optimal way to extract such relations in graphs, college students, and young children (6- and 8-year-olds). Participants compared relational statements ("Are there more blueberries than oranges?") with simple graphs, and two systematic patterns emerged: eye movements that followed the verbal order of the question (inspecting the "blueberry" value first) versus those that followed a left-first bias (regardless of the left value's identity). Question-order patterns led substantially to faster responses and increased in prevalence with age, whereas the left-first pattern led to far slower responses and was the dominant strategy for younger children. We argue that the optimal way to verify a verbally expressed relation's consistency with visualization is for the eyes to mimic the verbal ordering but that this strategy requires executive control and coordination with language.

Talking about Relations: Factors Influencing the Production of Relational Descriptions

In a production experiment (Experiment 1) and an acceptability rating one (Experiment 2), we assessed two factors, spatial position and salience, which may influence the production of relational descriptions (such as "the ball between the man and the drawer"). In Experiment 1, speakers were asked to refer unambiguously to a target object (a ball). In Experiment 1a, we addressed the role of spatial position, more specifically if speakers mention the entity positioned leftmost in the scene as (first) relatum. The results showed a small preference to start with the left entity, which leaves room for other factors that could influence spatial reference. Thus, in the following studies, we varied salience systematically, by making one of the relatum candidates animate (Experiment 1b), and by adding attention capture cues, first subliminally by priming one relatum candidate with a flash (Experiment 1c), then explicitly by using salient colors for objects (Experiment 1d). Results indicate that spatial position played a dominant role. Entities on the left were mentioned more often as (first) relatum than those on the right (Experiments 1a-d). Animacy affected reference production in one out of three studies (in Experiment 1d). When salience was manipulated by priming visual attention or by using salient colors, there were no significant effects (Experiments 1c, d). In the acceptability rating study (Experiment 2), participants expressed their preference for specific relata, by ranking descriptions on the basis of how good they thought the descriptions fitted the scene. Results show that participants preferred most the description that had an animate entity as the first mentioned relatum. The relevance of these results for models of reference production is discussed.

The transference of visual search between two unrelated tasks: Measuring the temporal characteristics of carry-over

Investigations into the persistence of top-down control settings do not accurately reflect the nature of dynamic tasks. They typically involve extended practice with an initial task, and this initial task usually shares similar stimuli with a second task. Recent work shows that visual attention and search can be affected by limited exposure to a preceding, unrelated task, and the current study explored the temporal characteristics of this “carry-over” effect. Thirty-four participants completed one, four, or eight simple letter searches and then searched a natural scene. The spatial layout of letters influenced spread of search in the pictures, and this was further impacted by the time spent in the initial task, yet the carry-over effect diminished quickly. The results have implications for theories of top-down control and models that attempt to predict search in natural scenes. They are also relevant to real-world tasks in which performance is closely related to visual attention and search.

Irrelevant tactile stimulation biases visual exploration in external coordinates

We evaluated the effect of irrelevant tactile stimulation on humans’ free-viewing behavior during the exploration of complex static scenes. Specifically, we address the questions of (1) whether task-irrelevant tactile stimulation presented to subjects’ hands can guide visual selection during free viewing; (2) whether tactile stimulation can modulate visual exploratory biases that are independent of image content and task goals; and (3) in which reference frame these effects occur. Tactile stimulation to uncrossed and crossed hands during the viewing of static images resulted in long-lasting modulation of visual orienting responses. Subjects showed a well-known leftward bias during the early exploration of images, and this bias was modulated by tactile stimulation presented at image onset. Tactile stimulation, both at image onset and later during the trials, biased visual orienting toward the space ipsilateral to the stimulated hand, both in uncrossed and crossed hand postures. The long-lasting temporal and global spatial profile of the modulation of free viewing exploration by touch indicates that cross-modal cues produce orienting responses, which are coded exclusively in an external reference frame.

Objects influence the shape of remembered views: examining global and local aspects of boundary extension

Boundary extension is a constructive memory error for views of scenes in which viewx tendto be remembered as more spatially expansive than they appeared. In seven experiments xwe examinedwhether local differences in boundary extension within views might exist by presenting par ticipants ith overhead views of single, elongated objects or object pairs on textured ground surfaces i:n whichobjects were oriented either vertically or horizontally. Memory for views' spatial expanse xwas testedwith either a view-recognition test or a border-adjustment test in which participants could ad just thespatial expanse of a test view using the computer's mouse. The border-adjustment test was uused tossess local boundary extension (primarily); the view-recognition test was used to assess paparticipants'emories for the overall spatial expanse of views (ie global boundary extension). Across exexperiments,n the border-adjustment tests specifically, participants showed more spatial expanse along the obobject'songer axis, in some cases restricting the view along the object's shorter axis. In addition, the rerecognition-t data revealed greater boundary extension for views with vertically oriented objects than for x.iviewsth horizontally oriented objects. Taken together, the results suggest that objects in scene x iviews canfect both local and global aspects of memory for spatial expanse of scene views.

Behavioural asymmetries on the greyscales task: The influence of native reading direction

Reliable leftward attentional and perceptual biases demonstrated in a variety of visuospatial tasks have been found to deviate from the left in research examining the influence of scanning habits. The aim of the current research was to examine the influence of native script direction on pseudoneglect during the greyscales task in a representative sample of native right-to-left readers. Fifty-four native left-to-right readers and 43 right-to-left readers completed the greyscales task, which required judging the darker of two left-right mirrored brightness gradients. Native left-to-right readers demonstrated a left response bias on the greyscales task, whereas right-to-left readers failed to demonstrate a bias, however, both groups responded more quickly when making leftward choices. The research suggests that the strength of attentional biases are influenced by behavioural biases, such as scanning habits, and neural and anatomical asymmetries in the right parietal and frontal cortices. Thus, to improve the clinical utility of the greyscales task for diagnosing neglect, right-to-left readers should be examined to fully understand the normal range of biases displayed by neurologically healthy individuals.

Latent memory of unattended stimuli reactivated by practice: an FMRI study on the role of consciousness and attention in learning

Although we can only report about what is in the focus of our attention, much more than that is actually processed. And even when attended, stimuli may not always be reportable, for instance when they are masked. A stimulus can thus be unreportable for different reasons: the absence of attention or the absence of a conscious percept. But to what extent does the brain learn from exposure to these unreportable stimuli? In this fMRI experiment subjects were exposed to textured figure-ground stimuli, of which reportability was manipulated either by masking (which only interferes with consciousness) or with an inattention paradigm (which only interferes with attention). One day later learning was assessed neurally and behaviorally. Positive neural learning effects were found for stimuli presented in the inattention paradigm; for attended yet masked stimuli negative adaptation effects were found. Interestingly, these inattentional learning effects only became apparent in a second session after a behavioral detection task had been administered during which performance feedback was provided. This suggests that the memory trace that is formed during inattention is latent until reactivated by behavioral practice. However, no behavioral learning effects were found, therefore we cannot conclude that perceptual learning has taken place for these unattended stimuli.

Representational pseudoneglect: a review

Pseudoneglect, the tendency to be biased towards the left-hand side of space, is a robust and consistent behavioural observation best demonstrated on the task of visuospatial line bisection, where participants are asked to centrally bisect visually presented horizontal lines at the perceived centre. A number of studies have revealed that a representational form of pseudoneglect exists, occurring when participants are asked to either mentally represent a stimulus or explore a stimulus using touch in the complete absence of direct visuospatial processing. Despite the growing number of studies that have demonstrated representational pseudoneglect there exists no current and comprehensive review of these findings and no discussion of a theoretical framework into which these findings may fall. An important gap in the current representational pseudoneglect literature is a discussion of the developmental trajectory of the bias. The focus of the current review is to outline studies that have observed representational pseudoneglect in healthy participants, consider a theoretical framework for these observations, and address the impact of lifespan factors such as cognitive ageing on the phenomenon.

Lateralized hybrid faces: evidence of a valence-specific bias in the processing of implicit emotions

It is well known that hemispheric asymmetries exist for both the analyses of low-level visual information (such as spatial frequency) and high-level visual information (such as emotional expressions). In this study, we assessed which of the above factors underlies perceptual laterality effects with "hybrid faces": a type of stimulus that allows testing for unaware processing of emotional expressions, when the emotion is displayed in the low-frequency information while an image of the same face with a neutral expression is superimposed to it. Despite hybrid faces being perceived as neutral, the emotional information modulates observers' social judgements. In the present study, participants were asked to assess friendliness of hybrid faces displayed tachistoscopically, either centrally or laterally to fixation. We found a clear influence of the hidden emotions also with lateral presentations. Happy faces were rated as more friendly and angry faces as less friendly with respect to neutral faces. In general, hybrid faces were evaluated as less friendly when they were presented in the left visual field/right hemisphere than in the right visual field/left hemisphere. The results extend the validity of the valence hypothesis in the specific domain of unaware (subcortical) emotion processing.

Does Perceptual Learning Require Consciousness or Attention?

It has been proposed that visual attention and consciousness are separate [Koch, C., & Tsuchiya, N. Attention and consciousness: Two distinct brain processes. Trends in Cognitive Sciences, 11, 16–22, 2007] and possibly even orthogonal processes [Lamme, V. A. F. Why visual attention and awareness are different. Trends in Cognitive Sciences, 7, 12–18, 2003]. Attention and consciousness converge when conscious visual percepts are attended and hence become available for conscious report. In such a view, a lack of reportability can have two causes: the absence of attention or the absence of a conscious percept. This raises an important question in the field of perceptual learning. It is known that learning can occur in the absence of reportability [Gutnisky, D. A., Hansen, B. J., Iliescu, B. F., & Dragoi, V. Attention alters visual plasticity during exposure-based learning. Current Biology, 19, 555–560, 2009; Seitz, A. R., Kim, D., & Watanabe, T. Rewards evoke learning of unconsciously processed visual stimuli in adult humans. Neuron, 61, 700–707, 2009; Seitz, A. R., & Watanabe, T. Is subliminal learning really passive? Nature, 422, 36, 2003; Watanabe, T., Náñez, J. E., & Sasaki, Y. Perceptual learning without perception. Nature, 413, 844–848, 2001], but it is unclear which of the two ingredients—consciousness or attention—is not necessary for learning. We presented textured figure-ground stimuli and manipulated reportability either by masking (which only interferes with consciousness) or with an inattention paradigm (which only interferes with attention). During the second session (24 hr later), learning was assessed neurally and behaviorally, via differences in figure-ground ERPs and via a detection task. Behavioral and neural learning effects were found for stimuli presented in the inattention paradigm and not for masked stimuli. Interestingly, the behavioral learning effect only became apparent when performance feedback was given on the task to measure learning, suggesting that the memory trace that is formed during inattention is latent until accessed. The results suggest that learning requires consciousness, and not attention, and further strengthen the idea that consciousness is separate from attention.

Optimal and Preferred Eye Landing Positions in Objects and Scenes

Viewing position effects are commonly observed in reading, but they have only rarely been investigated in object perception or in the realistic context of a natural scene. In two experiments, we explored where people fixate within photorealistic objects and the effects of this landing position on recognition and subsequent eye movements. The results demonstrate an optimal viewing position—objects are processed more quickly when fixation is in the centre of the object. Viewers also prefer to saccade to the centre of objects within a natural scene, even when making a large saccade. A central landing position is associated with an increased likelihood of making a refixation, a result that differs from previous reports and suggests that multiple fixations within objects, within scenes, occur for a range of reasons. These results suggest that eye movements within scenes are systematic and are made with reference to an early parsing of the scene into constituent objects.