Object-centered not scene-based visual neglect

Computer-based assessment of unilateral spatial neglect: A systematic review

Background

To date, no gold standard exists for the assessment of unilateral spatial neglect (USN), a common post-stroke cognitive impairment, with limited sensitivity provided by currently used clinical assessments. Extensive research has shown that computer-based (CB) assessment can be more sensitive, but these have not been adopted by stroke services yet.

Objective

We conducted a systematic review providing an overview of existing CB tests for USN to identify knowledge gaps and positive/negative aspects of different methods. This review also investigated the benefits and barriers of introducing CB assessment tasks to clinical settings and explored practical implications for optimizing future designs.

Methodology

We included studies that investigated the efficacy of CB neglect assessment tasks compared to conventional methods in detecting USN for adults with brain damage. Study identification was conducted through electronic database searches (e.g., Scopus), using keywords and standardized terms combinations, without date limitation (last search: 08/06/2022). Literature review and study selection were based on prespecified inclusion criteria. The quality of studies was assessed with the quality assessment of diagnostic accuracy studies tool (Quadas-2). Data synthesis included a narrative synthesis, a table summarizing the evidence, and vote counting analysis based on a direction of effect plot.

Results

A total of 28 studies met the eligibility criteria and were included in the review. According to our results, 13/28 studies explored CB versions of conventional tasks, 11/28 involved visual search tasks, and 5/28 other types of tasks. The vote counting analysis revealed that 17/28 studies found CB tasks had either equal or higher sensitivity than conventional methods and positive correlation with conventional methods (15/28 studies). Finally, 20/28 studies showed CB tasks effectively detected patients with USN within different patient groups and control groups (17/28).

Conclusions

The findings of this review provide practical implications for the implementation of CB assessment in the future, offering important information to enhance a variety of methodological issues. The study adds to our understanding of using CB tasks for USN assessment, exploring their efficacy and benefits compared to conventional methods, and considers their adoption in clinical environments.

The form of reference frames in vision: The case of intermediate shape-centered representations

Although a great deal is known about the early sensory and the later, perceptual, stages of visual processing, far less is known about the nature of intermediate representational units and reference frames. Progress in understanding intermediate levels of representations in vision is hindered by the complexity of interactions among multiple levels of representation in the visual system, making it difficult to isolate and study the nature of each particular level. Nature occasionally provides the opportunity to peer inside complex systems by isolating components of a system through accidental damage or genetic modification of neural components. We have recently reported the case of a young woman who perceives 2D bounded regions of space as if they were plane-rotated by 90, 180 or 270° around their center, mirrored across their own axes, or both. This suggested that an intermediate stage of processing consists in representing mutually exclusive 2D bounded regions extracted from the retinal image in their own "shape-centered" perceptual frame. We proposed to refer to this level of representation as "intermediate shape-centered representation" (ISCR). Here, we used Davida's pattern of errors across 9 experiments as a tool for specifying in greater detail the geometrical properties of the reference frame in which elongated and/or symmetrical shapes are represented at the level of the ISCR. The nature of Davida's errors in these experiments suggests that ISCRs are represented in reference frames composed of orthogonal axes aligned with and centered on the most elongated segment of elongated shapes and, for symmetrical shapes deprived of a straight segment, aligned with their axis of symmetry, and centered on their centroid.

The Ties that Bind: Agnosia, Neglect and Selective Attention to Visual Scale

PURPOSE OF REVIEW

Historical and contemporary treatments of visual agnosia and neglect regard these disorders as largely unrelated. It is thought that damage to different neural processes leads directly to one or the other condition, yet apperceptive variants of agnosia and object-centered variants of neglect share remarkably similar deficits in the quality of conscious experience. Here we argue for a closer association between "apperceptive" variants of visual agnosia and "object-centered" variants of visual neglect. We introduce a theoretical framework for understanding these conditions based on "scale attention", which refers to selecting boundary and surface information at different levels of the structural hierarchy in the visual array.

RECENT FINDINGS

We review work on visual agnosia, the cortical structures and cortico-cortical pathways that underlie visual perception, visuospatial neglect and object-centered neglect, and attention to scale. We highlight direct and indirect pathways involved in these disorders and in attention to scale. The direct pathway involves the posterior vertical segments of the superior longitudinal fasciculus that are positioned to link the established dorsal and ventral attentional centers in the parietal cortex with structures in the inferior occipitotemporal cortex associated with visual apperceptive agnosia. The connections in the right hemisphere appear to be more important for visual conscious experience, whereas those in the left hemisphere appear to be more strongly associated with the planning and execution of visually guided grasps directed at multi-part objects such as tools. In the latter case, semantic and functional information must drive the selection of the appropriate hand posture and grasp points on the object. This view is supported by studies of grasping in patients with agnosia and in patients with neglect that show that the selection of grasp points when picking up a tool involves both scale attention and semantic contributions from inferotemporal cortex. The indirect pathways, which include the inferior fronto-occipital and horizontal components of the superior longitudinal fasciculi, involve the frontal lobe, working memory and the "multiple demands" network, which can shape the content of visual awareness through the maintenance of goal- and task-based abstractions and their influence on scale attention. Recent studies of human cortico-cortical pathways necessitate revisions to long-standing theoretical views on visual perception, visually guided action and their integrations. We highlight findings from a broad sample of seemingly disparate areas of research to support the proposal that attention to scale is necessary for typical conscious visual experience and for goal-directed actions that depend on functional and semantic information. Furthermore, we suggest that vertical pathways between the parietal and occipitotemporal cortex, along with indirect pathways that involve the premotor and prefrontal cortex, facilitate the operations of scale attention.

Shape-centered representations of bounded regions of space mediate the perception of objects

We report the study of a woman who perceives 2D bounded regions of space ("shapes") defined by sharp edges of medium to high contrast as if they were rotated by 90, 180 degrees around their centre, mirrored across their own axes, or both. In contrast, her perception of 3D, strongly blurred or very low contrast shapes, and of stimuli emerging from a collection of shapes, is intact. This suggests that a stage in the process of constructing the conscious visual representation of a scene consists of representing mutually exclusive bounded regions extracted from the initial retinotopic space in "shape-centered" frames of reference. The selectivity of the disorder to shapes originally biased toward the parvocellular subcortical pathway, and the absence of any other type of error, additionally invite new hypotheses about the operations involved in computing these "intermediate shape-centered representations" and in mapping them onto higher frames for perception and action.

Automatic object-based spatial selection depends on the distribution of sustained attention

Several space-based and object-based attention studies suggest these selection mechanisms may be voluntarily deployed, depending on task parameters and the attentional scope of the observer. Here, we sought to elucidate factors related to involuntary deployment of object-mediated space-based attention through two experiments. Experiment 1 used a modified flanker task where a target and nearby distractor were presented within the same or different object frames, such that an object-based attentional spread should be detrimental to performance. Results showed the presence of a flanker effect with no significant difference in magnitude between grouping conditions, indicating participants may have uniformly used a diffused attentional spotlight regardless of object segmentation. In a second experiment, we manipulated the extent of the observer’s sustained attentional scope via an inducer task to determine whether object-based selection depends on the initial spotlight size. The results revealed object-based effects solely when attention narrowly encompassed the target, but not when it was widened to include the distracting flanker. This suggests the deployment of object-based attention may occur when spatial attention is initially focused narrowly. Because selecting the whole object frame directly interfered with task goals, we conclude that object-based attention may not always fully conform to relevant task goals or operate in a goal-oriented manner. We discuss these results in the context of existing literature while proposing a reconciliation of previously inconsistent findings of object-based selection.

Within-category representational stability through the lens of manipulable objects

Our ability to recognize an object amongst many exemplars is one of our most important features, and one that putatively distinguishes humans from non-human animals and potentially from (current) computational and artificial intelligence models. We can recognize objects consistently regardless of when we see them suggesting that we have stable representations across time and different contexts. Importantly, little is known about how humans can replicate within-category object representations across time. Here, we investigate neural stability of within-category object representations by computing the similarity between representational geometries of activity patterns for 80 images of tools obtained on different functional magnetic resonance imaging (fMRI) scanning days. We show that within-category representational stability is observable in regions that span lateral and ventral temporal cortex, inferior and superior parietal cortex, and premotor cortex - regions typically associated with tool processing and visuospatial processing. We then focus on what kinds of representations best explain the representational geometries within these regions. We test the similarity of these geometries with those coming from the different layers of a convolutional neural network, and those coming from perceived and veridical visual similarity models. We find that regions supporting within-category representational stability show stronger relationship with higher-level visual/semantic features, suggesting that neural replicability is derived from perceived and higher-level visual information. Within category representational stability may thus originate from long-range cross talk between category-specific regions (and in this case strongly within ventral and lateral temporal cortex) over more abstract, rather than veridical/lower-level, visual (sensorial) representations, and perhaps in the service of object-centered representations.

Neural Mechanisms of Attentional Control for Objects: Decoding EEG Alpha When Anticipating Faces, Scenes,and Tools

Attentional selection mechanisms in visual cortex involve changes in oscillatory activity in the EEG alpha band (8-12 Hz), with decreased alpha indicating focal cortical enhancement and increased alpha indicating suppression. This has been observed for spatial selective attention and attention to stimulus features such as color versus motion. We investigated whether attention to objects involves similar alpha-mediated changes in focal cortical excitability. In experiment 1, 20 volunteers (8 males; 12 females) were cued (80% predictive) on a trial-by-trial basis to different objects (faces, scenes, or tools). Support vector machine decoding of alpha power patterns revealed that late (>500 ms latency) in the cue-to-target foreperiod, only EEG alpha differed with the to-be-attended object category. In experiment 2, to eliminate the possibility that decoding of the physical features of cues led to our results, 25 participants (9 males; 16 females) performed a similar task where cues were nonpredictive of the object category. Alpha decoding was now only significant in the early (<200 ms) foreperiod. In experiment 3, to eliminate the possibility that task set differences between the different object categories led to our experiment 1 results, 12 participants (5 males; 7 females) performed a predictive cuing task where the discrimination task for different objects was identical across object categories. The results replicated experiment 1. Together, these findings support the hypothesis that the neural mechanisms of visual selective attention involve focal cortical changes in alpha power not only for simple spatial and feature attention, but also for high-level object attention in humans.SIGNIFICANCE STATEMENT Attention is the cognitive function that enables relevant information to be selected from sensory inputs so it can be processed in the support of goal-directed behavior. Visual attention is widely studied, yet the neural mechanisms underlying the selection of visual information remain unclear. Oscillatory EEG activity in the alpha range (8-12 Hz) of neural populations receptive to target visual stimuli may be part of the mechanism, because alpha is thought to reflect focal neural excitability. Here, we show that alpha-band activity, as measured by scalp EEG from human participants, varies with the specific category of object selected by attention. This finding supports the hypothesis that alpha-band activity is a fundamental component of the neural mechanisms of attention.

How to Create Objects With Your Mind: From Object-Based Attention to Attention-Based Objects

When staring at a blank grid, one can readily "see" simple shapes-a peculiar experience that does not occur when viewing an empty background. But just what does this "seeing" entail? Previous work has explored many cues to object-based attention (e.g., involving continuity and closure), but here we asked whether attention can be object based even when there are no cues to objecthood. Observers viewed simple grids and attended to particular squares until they could effectively "see" shapes such as a capital H or I. During this scaffolded attention, two probes appeared, and observers reported whether they were the same or different. Remarkably, this produced a traditional same-object advantage: In several experiments (including high-powered direct replications), performance was enhanced for probes presented on the same (purely imagined) object, compared with equidistant probes presented on different objects. We conclude that attention not only operates over objects but also can effectively create object representations.

The role of the right superior temporal gyrus in stimulus-centered spatial processing

Although emerging neuropsychological evidence supports the involvement of temporal areas, and in particular the right superior temporal gyrus (STG), in allocentric neglect deficits, the role of STG in healthy spatial processing remains elusive. While several functional brain imaging studies have demonstrated involvement of the STG in tasks involving explicit stimulus-centered judgments, prior rTMS studies targeting the right STG did not find the expected neglect-like rightward bias in size judgments using the conventional landmark task. The objective of the current study was to investigate whether disruption of the right STG using inhibitory repetitive transcranial magnetic stimulation (rTMS) could impact stimulus-centered, allocentric spatial processing in healthy individuals. A lateralized version of the landmark task was developed to accentuate the dissociation between viewer-centered and stimulus-centered reference frames. We predicted that inhibiting activity in the right STG would decrease accuracy because of induced rightward bias centered on the line stimulus irrespective of its viewer-centered or egocentric locations. Eleven healthy, right-handed adults underwent the lateralized landmark task. After viewing each stimulus, participants had to judge whether the line was bisected, or whether the left (left-long trials) or the right segment (right-long trials) of the line was longer. Participants repeated the task before (pre-rTMS) and after (post-rTMS) receiving 20 min of 1 Hz rTMS over the right STG, the right supramarginal gyrus (SMG), and the vertex (a control site) during three separate visits. Linear mixed models for binomial data were generated with either accuracy or judgment errors as dependent variables, to compare 1) performance across trial types (bisection, non-bisection), and 2) pre- vs. post-rTMS performance between the vertex and the STG and the vertex and the SMG. Line eccentricity (z = 4.31, p < 0.0001) and line bisection (z = 5.49, p < 0.0001) were significant predictors of accuracy. In the models comparing the effects of rTMS, a significant two-way interaction with STG (z = -3.09, p = 0.002) revealed a decrease in accuracy of 9.5% and an increase in errors of the right-long type by 10.7% on bisection trials, in both left and right viewer-centered locations. No significant changes in leftward errors were found. These findings suggested an induced stimulus-centered rightward bias in our participants after STG stimulation. Notably, accuracy or errors were not influenced by SMG stimulation compared to vertex. In line with our predictions, the findings provide compelling evidence for right STG's involvement in healthy stimulus-centered spatial processing.

Perceptual Biases in the Horizontal and Vertical Dimensions are Driven by Separate Cognitive Mechanisms

Perceptual attention in healthy participants is characterized by two biases, one operating in the horizontal plane, which draws attention leftward, and the other operating in the vertical plane, which draws attention upward. Given that these biases are reliably found in the same individual, and appear similar at a surface level, a number of researchers have investigated the relationship between horizontal and vertical attentional biases. To date, these investigations have failed to find an association, and this may be due to the fact that one-dimensional vertical and horizontal stimuli were presented separately rather than being measured from a single, two-dimensional stimulus. Across three experiments, two dimensional stimuli were presented, and participants marked the centre of the stimuli. In addition, the shapes of the stimuli were manipulated to determine whether this produced the same modulation of the two biases. Across 13 stimuli and three experiments there were no correlations between the vertical and horizontal biases. In addition, manipulations of stimulus shape, which affected biases in one dimension, did not affect biases in the other dimension. There were, however, consistent correlations between the degree of bias within each dimension across the different stimuli. This study has produced converging evidence that horizontal and vertical biases in spatial judgments rely on separate cognitive mechanisms. To account for these results we discuss a model whereby horizontal asymmetries rely more on space-based mechanisms whereas vertical asymmetries rely more on object-based mechanisms.

The Modulation of Haptic Line Bisection by a Visual Illusion and Optokinetic Stimulation

Research has shown that a variety of different sensory manipulations, including visual illusions, transcutaneous nerve stimulation, vestibular caloric stimulation, optokinetic stimulation, and prism adaptation, can all influence people's performance on spatial tasks such as line bisection. It has been suggested that these manipulations may act upon the ‘higher-order’ levels of representation used to code spatial information. We investigated whether we could influence haptic line bisection in normal participants crossmodally by varying the visual background that participants viewed. In experiment 1, participants haptically bisected wooden rods while looking at a variant of the Oppel–Kundt visual illusion. Haptic-bisection judgments were influenced by the orientation of the visual illusion (in line with previous unimodal visual findings). In experiment 2, haptic-bisection judgments were also influenced by the presence of a leftward or rightward moving visual background. In experiments 3 and 4, the position of the to-be-bisected stimuli was varied with respect to the participant's body midline. The results confirmed an effect of optokinetic stimulation, but not of the Oppel–Kundt illusion, on participants' tactile-bisection errors, suggesting that the two manipulations might differentially affect haptic processing. Taken together, these results suggest that the ‘higher-order’ levels of spatial representation upon which perceptual judgments and/or motor responses are made may have multisensory or amodal characteristics.

Object-Based Visual Selection: Evidence From Perceptual Completion

A large body of evidence suggests that visual attention selects objects as well as spatial locations. If attention is to be regarded as truly object based, then it should operate not only on object representations that are explicit in the image, but also on representations that are the result of earlier perceptual completion processes. Reporting the results of two experiments, we show that when attention is directed to part of a perceptual object, other parts of that object enjoy an attentional advantage as well. In particular, we show that this object-specific attentional advantage accrues to partly occluded objects and to objects defined by subjective contours. The results corroborate the claim that perceptual completion precedes object-based attentional selection.

Effects of Perceived Space on Spatial Attention

This study demonstrates that a perceptual illusion that alters the perceived length of two lines also affects spatial attention. We used a cuing method that was introduced to study space- versus object-based attention. Two parallel lines of equal length were placed so that the distance between them was equal to the length of the lines. We then added a scene with depth cues to produce a strong illusion that one line was longer than the other. The results showed that spatial attention is distributed in space as it is perceived and altered by perceptual organization. These data have implications for assumptions concerning the spatial medium that guides attention and the role of depth and distance cues in spatial orienting, as well as for understanding attentional systems related to neuropsychological functions that respond to space and objects.

Visually Tracking and Localizing Expanding and Contracting Objects

The maintenance of attention on moving objects is required for cognition to reliably engage with the visual world. Theories of object tracking need to explain on which patterns of visual stimulation one can easily maintain attention and on which patterns one cannot. A previous study has shown that it is easier to track rigid objects than objects that expand and contract along their direction of motion, in a manner that resembles a substance pouring from one location to another (vanMarle and Scholl 2003 Psychological Science14 498–504). Here we investigate six possible explanations for this finding and find evidence supporting two of them. Our results show that, first, objects that expand and contract tend to overlap and crowd each other more, and this increases tracking difficulty. Second, expansion and contraction make it harder to localize objects, even when there is only a single target to attend to, and this may also increase tracking difficulty. Currently, there is no theory of object tracking that can account for the second finding.

When connectedness increases hemispatial neglect

Patients with left neglect were tested with “chimeric” figures composed of the right and left halves of two different objects. The connectivity relation was modulated between the two half figures. For some displays, the two chimeric halves were separated by a small gap, while in others, the separate halves were connected by a line segment. In line with previous reports, performance on reporting the left half improved when the chimera were separated; but when a line connected the two separated halves the advantage was lost. If the connecting line was broken, the performance was again enhanced. The results suggest an important role for connectedness in the representation of perceptual objects and in the distribution of attention in neglect.

Shifting attention in viewer- and object-based reference frames after unilateral brain injury

The aims of the present study were to investigate the respective roles that object- and viewer-based reference frames play in reorienting visual attention, and to assess their influence after unilateral brain injury. To do so, we studied 16 right hemisphere injured (RHI) and 13 left hemisphere injured (LHI) patients. We used a cueing design that manipulates the location of cues and targets relative to a display comprised of two rectangles (i.e., objects). Unlike previous studies with patients, we presented all cues at midline rather than in the left or right visual fields. Thus, in the critical conditions in which targets were presented laterally, reorienting of attention was always from a midline cue. Performance was measured for lateralized target detection as a function of viewer-based (contra- and ipsilesional sides) and object-based (requiring reorienting within or between objects) reference frames. As expected, contralesional detection was slower than ipsilesional detection for the patients. More importantly, objects influenced target detection differently in the contralesional and ipsilesional fields. Contralesionally, reorienting to a target within the cued object took longer than reorienting to a target in the same location but in the uncued object. This finding is consistent with object-based neglect. Ipsilesionally, the means were in the opposite direction. Furthermore, no significant difference was found in object-based influences between the patient groups (RHI vs. LHI). These findings are discussed in the context of reference frames used in reorienting attention for target detection.

Understanding the parietal lobe syndrome from a neurophysiological and evolutionary perspective

In human and nonhuman primates parietal cortex is formed by a multiplicity of areas. For those of the superior parietal lobule (SPL) there exists a certain homology between man and macaques. As a consequence, optic ataxia, a disturbed visual control of hand reaching, has similar features in man and monkeys. Establishing such correspondence has proven difficult for the areas of the inferior parietal lobule (IPL). This difficulty depends on many factors. First, no physiological information is available in man on the dynamic properties of cells in the IPL. Second, the number of IPL areas identified in the monkey is paradoxically higher than that so far described in man, although this issue will probably be reconsidered in future years, thanks to comparative imaging studies. Third, the consequences of parietal lesions in monkeys do not always match those observed in humans. This is another paradox if one considers that, in certain cases, the functional properties of neurons in the monkey's IPL would predict the presence of behavioral skills, such as construction capacity, that however do not seem to emerge in the wild. Therefore, constructional apraxia, which is well characterized in man, has never been described in monkeys and apes. Finally, only certain aspects, i.e. hand directional hypokinesia and gaze apraxia (Balint's psychic paralysis of gaze), of the multifaceted syndrome hemispatial neglect have been described in monkeys. These similarities, differences and paradoxes, among many others, make the study of the evolution and function of parietal cortex a challenging case.

Hemispatial asymmetries in judgment of stimulus size

Recent research has demonstrated a leftward bias in judgments of size. In the present experiments, hemispatial size bias was measured through simultaneous presentation of a circle and an ellipse varying in horizontal or vertical extent. A consistent leftward bias of horizontal size judgments (but not vertical) was obtained; at the point of subjective equality, the width of the objects that were presented in left hemispace was smaller than the width of the objects that were presented in right hemispace. These data suggest that the horizontal extent of stimuli appear larger in left hemispace than in right hemispace. Results also indicated that symmetrical stimulus presentation, with respect to the vertical meridian, is required for the bias to emerge. Furthermore, increasing or decreasing stimulus eccentricity weakened the effect. Attenuation of this bias upon the manipulation of parameters indicates that this phenomenon is context specific and is affected by similar parameters that are known to influence the magnitude of error in pseudoneglect.

Brain states: top-down influences in sensory processing

All cortical and thalamic levels of sensory processing are subject to powerful top-down influences, the shaping of lower-level processes by more complex information. New findings on the diversity of top-down interactions show that cortical areas function as adaptive processors, being subject to attention, expectation, and perceptual task. Brain states are determined by the interactions between multiple cortical areas and the modulation of intrinsic circuits by feedback connections. In perceptual learning, both the encoding and recall of learned information involves a selection of the appropriate inputs that convey information about the stimulus being discriminated. Disruption of this interaction may lead to behavioral disorders, including schizophrenia.

Representing spatial relationships in posterior parietal cortex: single neurons code object-referenced position

The brain computes spatial relationships as necessary to achieve behavioral goals. Loss of this spatial cognitive ability after damage to posterior parietal cortex may contribute to constructional apraxia, a syndrome in which a patient's ability to reproduce spatial relationships between the parts of an object is disrupted. To explore neural correlates of object-relative spatial representation, we recorded neural activity in parietal area 7a of monkeys performing an object construction task. We found that neurons were activated as a function of the spatial relationship between a task-critical coordinate and a reference object. Individual neurons exhibited an object-relative spatial preference, such that different neural populations were activated when the spatial coordinate was located to the left or right of the reference object. In each case, the representation was robust to translation of the reference object, and neurons maintained their object-relative preference when the position of the object varied relative to the angle of gaze and viewer-centered frames of reference. This provides evidence that the activity of a subpopulation of parietal neurons active in the construction task represented relative position as referenced to an object and not absolute position with respect to the viewer.

Understanding the object benefit in visual short-term memory: the roles of feature proximity and connectedness

Past research has identified visual objects as the units of information processing in visual short-term memory (VSTM) and has shown that two features from the same object can be remembered in VSTM as well (or almost as well) as one feature of that object and are much better remembered than the same two features from two spatially separated objects. It is not clear, however, what drives this object benefit in VSTM. Is it the shared spatial location (proximity), the connectedness among features of an object, or both? In six change detection experiments, both location/proximity and connectedness were found to be crucial in determining the magnitude of the object benefit in VSTM. Together, these results indicate that location/proximity and connectedness are essential elements in defining a coherent visual object representation in VSTM.

Recovering Space in Unilateral Neglect: A Neurological Dissociation Revealed by Virtual Reality

Neglect patients often show deficits in responding to targets in the contralesional side of space. Past studies were able to ameliorate these deficits through manipulation of visual input. Here, the neural bases of the recovery of space following virtual reality (VR) training in neglect patients were investigated. Neglect patients were trained to respond to targets in the left side of space that appeared in the central or in the right side of space in a VR system. It was found that only patients with lesions that spared the inferior parietal/superior temporal regions were able to benefit from the VR training. It was concluded that these regions play a crucial role in the recovery of space that underlies the improvement of neglect patients when trained with VR. The implications of these results for determining the neural bases of a higher order attentional and/or spatial representation and for treating patients with unilateral neglect are discussed.

Classification images of two right hemisphere patients: a window into the attentional mechanisms of spatial neglect

While spatial neglect most commonly occurs after right hemisphere lesions, damage to diverse areas within the right hemisphere may lead to neglect, possibly through different mechanisms. To identify potentially different causes of neglect, the visual information used (the 'perceptual template') in a cueing task was estimated with a novel technique known as 'classification images' for five normal observers and two male patients with right-hemisphere lesions and previous histories of spatial neglect (CM, age 85; HL, age 69). Observers made a yes/no decision on the presence of a 'White X' checkerboard signal (1.5 degrees ) at one of two locations, with trial-to-trial stimulus noise added to the 9 checkerboard squares. Prior to the stimulus, a peripheral precue (140 ms) indicated the signal location with 80% validity. The cueing effects and estimated perceptual templates for the normal observers showed no visual field differences. Consistent with previous studies of spatial neglect, both patients had difficulty with left (contralesional) signals when preceded by a right (ipsilesional) cue. Despite similar behavioral results, the patients' estimated perceptual templates in the left field suggested two different types of attentional deficits. For CM, the left template matched the signal with left-sided cues but was opposite in sign to the signal with right-sided cues, suggesting a severely disrupted selective attentional strategy. For HL, the left templates indicated a general uncertainty in localizing the signal regardless of the cue's field. In conclusion, the classification images suggested different underlying mechanisms of neglect for these two patients with similar behavioral results and hold promise in further elucidating the underlying attentional mechanisms of spatial neglect.

Gaze cues evoke both spatial and object-centered shifts of attention

When someone observes another individual suddenly shifting gaze, the observer's attention automatically and rapidly orients to the same location. Such gaze cuing of attention has properties similar to those of exogenous cuing. We investigated whether gaze cuing is also like exogenous cuing in that it is observed for both spatial and object-/head-centered frames of reference. That is, when the face that produces the gaze cue is presented on its side, tilted 90 degrees from upright, will attention be simultaneously directed to where the eyes would have been looking if the face had been presented upright and toward the actual spatial direction of gaze? It is demonstrated that gaze cues do indeed orient attention in both spatial and object-centered frames, that these effects are of similar magnitude, and that such orienting is relatively rapidly computed.

The egocentric reference deviation of neglect patients is influenced by visuospatial attention

The right deviation of the subjective straight-ahead (SSA), representing a deviation of the body centered spatial reference frame (egocentric reference), is a frequent phenomenon in spatial neglect. Little is known about the influence of visuo-spatial attention on this SSA shift. The aim of this study was to investigate the influence of eye direction (overt attention) and perception of the visual background (covert attention) on the SSA pointing. We included 12 patients with right hemisphere stroke. Six were classified as neglect (N+) and compared to the six non neglect (N-) patients and 19 normal control subjects (C). They had to point straight-ahead (right hand) on an horizontal board. Pointing was performed in the light or in darkness, first with spontaneous eye direction, then while fixating a visual target (-15 degrees , 0 degrees , +15 degrees ). A first ANOVA of factors group, eye direction (left, center, right fixation) and visual context (light, darkness) showed a right SSA deviation in N+ patients only, which was more severe in the light than in darkness. In this group, the SSA was shifted in the same direction as the target, while that of N- and C groups was mildly shifted in the opposite direction. The comparison of spontaneous and central fixation conditions also showed an eye direction by group interaction, as the spontaneous right SSA deviation was reduced by central fixation in N+ patients only. These results suggest that, in neglect patients, the egocentric reference deviation is not a fixed phenomenon, and that it can be influenced by manipulation of both overt and covert spatial attention.

Object-centred spatial reference in 4-month-old infants

An appreciation of object-centred spatial relations involves representing a 'within-object' spatial relation across changes in the object orientation. This representational ability is important in adult object recognition [Biederman, I. (1987). Recognition-by-components: A theory of human image understanding. Psychological Review, 94, 115-147; Marr, D., & Nishihara, H. K. (1978). Representation and recognition of the spatial organisation of three-dimensional structure. Proceedings of the Royal Society of London, Series B (Biological Sciences), 200, 269-294; Tarr, M. J., & Pinker, S. (1990). When does human object recognition use a viewer-centred reference frame? Psychological Science, 1, 253-256] and is also thought to be a fundamental component of the mature object concept [Piaget, J. (1954). The Construction of Reality in the Child. Routledge & Kegan-Paul: London, UK. (Originally published in French in 1937)]. An experiment is reported in which eighteen 4-month-old infants were familiarised to a specific spatial relation within an object, across six different orientations of the object. On subsequent test trials the object was presented to the infants in an entirely novel orientation. Between successive test trials the within-object spatial relation was alternated between novel and familiar. The infants demonstrated significant sensitivity of their looking to both the novelty of the stimuli and the order in which novel and familiar stimuli were presented. It is concluded that by 4 months of age infants are able to form object-centred spatial frames of reference. These findings are discussed in the light of our current understanding of the development of object representation during infancy.

The effect of strategy on pseudoneglect for luminance judgements

When judging the relative magnitude of the left and right sides of a stimulus, normal participants overestimate the leftward features (pseudoneglect). Although pseudoneglect and clinical neglect operate in opposite directions, the two phenomena may have a common cognitive and neural basis. For neglect, two strategies may be employed when inspecting horizontally aligned stimuli: (1) A global strategy where the stimuli are treated as a gestalt and asymmetries are detected or, (2) a comparison strategy where the qualities on the left and right sides of the stimuli are explicitly compared. To investigate the effect of these strategies on pseudoneglect, normal dextrals (n = 25 and 17) made two-alternative, forced-choice luminance discriminations between two mirror-reversed luminance gradients (greyscales). In an unseparated form, the stimuli are amenable to a global strategy. A comparison strategy was imposed by separating the stimuli into halves (Experiment 1) or quarters (Experiment 2). Despite the fact that the stimuli were equiluminant, participants predominantly chose the stimulus that was dark on the left as being darker overall in the unseparated condition. Response times were also faster for leftward responses. When the stimuli were separated into halves or quarters, the leftward bias was reduced, but not eliminated. The results demonstrate that both strategies contribute to pseudoneglect--though the global strategy may produce stronger pseudoneglect.

The ontology of neglect

As shown by neuroscientific evidence, neglect may occur without elementary sensorimotor impairments. The deficit is to be found at a higher, more abstract level of representation, which prevents the patient not only from seeing, but from conceiving the contralesional space. By analysing a series of neuropsychological results, in this paper we suggest a crucial role of time for the construction of a world: on this basis, we try to explain how it is possible that half the ontology gets lost. The analysis of the ontological implication of neglect will allow us to shed light on manifestations of the pathology apparently disconnected.

Selecting Spatial Frames of Reference for Visual Target Localization

Abstract. This study examined the selection of spatial frames of reference for target localization in visual search. Participants searched for local target characters in global character configurations. The local targets could be localized relative to the character configuration in which they were embedded or relative to the presentation screen on which the configurations were displayed. We investigated under which conditions the configurations, or the screen served as frame of reference for target localization. Three experiments revealed an increasing impact of screen-related target localization with decreasing spatial uncertainty of targets in screen-related coordinates. The results indicate the capability of the visual system to localize relevant visual stimuli with respect to those frames of reference that yield the most redundant spatial distribution of these stimuli.

The nature and contribution of space- and object-based attentional biases to free-viewing perceptual asymmetries

Two experiments investigated the contribution of space- and object-based coordinates to previously reported leftward perceptual biases (pseudoneglect) at various locations across visual space. Neurologically intact participants (n = 34 and 27) made luminance discriminations between two left/right mirror-reversed luminance gradients (greyscales task), which were variously displaced around the midline in the participants' left and right hemispaces. The orientations of the stimuli were manipulated so that object- and space-based coordinates were congruent or incongruent. Experiment 1 confirmed the presence of a leftward object-based perceptual bias. The bias was moderated, however, by overattention to the more central stimulus. This central spatial effect could have resulted from the use of task-specific strategies, which were controlled by presenting the stimuli sequentially in Experiment 2. The findings of Experiment 1, a leftward object-based bias and a central spatial bias, were replicated. Overall, the results indicate a leftward object-based bias and a central spatial bias, both of which are relevant for the allocation of attention. The results are discussed with reference to a variety of models of the distribution of attention across space.

A biased competition based neurodynamical model of visual neglect

On the computational basis of a neurodynamical cortical model, we investigate a specific top-down visual cognitive impairment in brain-damaged patients known as visual spatial neglect. The computational cortical model accounts the neurodynamics underlying selective visual attention, is based on the "biased competition hypothesis" and structured in several network modules which can be related with the different areas of the dorsal and ventral path of the visual cortex. Spatial and object attention are accomplished by a multiplicative gain control that emerges dynamically through intercortical mutual biased coupling. By damaging the model in different ways, a variety of dysfunctions associated with visual neglect can be simulated and explained as disruption of specific subsystems. Essentially, the damage destabilizes the underlying intra- and intermodular mutually biased neurodynamical competition that macroscopically yields the functional deficits observed in visual neglect patients. In particular, we are able to explain the asymmetrical effect of spatial cueing on neglect, and the phenomenon of extinction in the framework of visual search.

Orienting of attention via observed eye gaze is head-centred

Observing averted eye gaze results in the automatic allocation of attention to the gazed-at location. The role of the orientation of the face that produces the gaze cue was investigated. The eyes in the face could look left or right in a head-centred frame, but the face itself could be oriented 90 degrees clockwise or anticlockwise such that the eyes were gazing up or down. Significant cueing effects to targets presented to the left or right of the screen were found in these head orientation conditions. This suggests that attention was directed to the side to which the eyes would have been looking towards, had the face been presented upright. This finding provides evidence that head orientation can affect gaze following, even when the head orientation alone is not a social cue. It also shows that the mechanism responsible for the allocation of attention following a gaze cue can be influenced by intrinsic object-based (i.e. head-centred) properties of the task-irrelevant cue.

Visual neglect can be object-based or scene-based depending on task representation

Three patients with visual neglect were tested on their ability to detect target letters at ipsilesional and contralesional locations on a monitor, and at different locations within large shapes on the monitor. When patients were asked to detect targets within the entire monitor, they showed neglect for all the contralesional hemifield. In contrast when they were asked to detect targets within a particular object, they showed object-based neglect. In these two conditions the displays, the targets and the response were identical, with the only difference being the space that is represented for the task. These results show that the reference frame of visual neglect may be altered by task-instructions changing how a structured visual scene is represented, with neglect applying to the contralesional side of this represented space.

Object-centred neglect for non-verbal visual stimuli

In a first experiment, 11 neglect patients repeatedly bisected the elongated caricature of a basset hound with head on the right and tail on the left side with respect to the viewer. On the last (critical) trial, in which the figure was left-right reversed, the bisection error towards the ipsilesional side reversed its direction in three patients and significantly decreased in one patient. In a second experiment, 13 different neglect patients had to bisect the elongated caricature of the basset hound with head on the left and tail on the right side. On the last trial, the bisection error reversed its direction in three patients and significantly decreased in three patients. These results suggest that object-centred neglect (OCN) may affect newly established knowledge about the canonical orientation of a non-verbal visual stimulus.

Brain representation of object-centered space in monkeys and humans

Visuospatial cognition requires taking into account where things are relative to each other and not just relative to the viewer. Consequently it would make sense for the brain to form an explicit representation of object-centered and not just of ego-centered space. Evidence bearing on the presence and nature of neural maps of object-centered space has come from two sources: single-neuron recording in behaving monkeys and assessment of the visual abilities of human patients with hemispatial neglect. Studies of the supplementary eye field of the monkey have revealed that it contains neurons with object-centered spatial selectivity. These neurons fire when the monkey has selected, as target for an eye movement or attention, a particular location defined relative to a reference object. Studies of neglect have revealed that in some patients the condition is expressed with respect to an object-centered and object-aligned reference frame. These patients neglect one side of an object, as defined relative to its intrinsic midline, regardless of its location and orientation relative to the viewer. The two sets of observations are complementary in the sense that the loss of neurons, such as observed in the monkey, could explain the spatial distribution of neglect in these patients.

Trunk- and head-centred spatial coordinates do not affect free-viewing perceptual asymmetries

Turning the trunk or head to the left can reduce the severity of leftward neglect. This study sought to determine whether turning the trunk or head to the right would reduce pseudoneglect: A phenomenon where normal participants underestimate the rightward features of a stimulus. Participants made luminance judgements of two mirror-reversed greyscales stimuli. A preference for selecting the stimulus dark on the left was found. The effect of trunk-centred coordinates was examined in Expt. 1 by facing the head toward the display and turning the trunk to the left, right or toward the display. Head-centred coordinates were examined in Expt. 2 by directing the eyes toward the display and then turning the head and trunk. No effect of rotation was observed. It was concluded that the leftward bias for the greyscales task could be based on an object-centred attentional bias or left-to-right eye scanning habits.

Basis functions for object-centered representations

In an object-centered representation, the position of the subparts of an object are encoded with respect to a set of axes and an origin centered on the object. Several physiological and neuropsychological results support the existence of such representations in humans and monkeys. An explicit representation would involve neurons with invariant response properties in object-centered coordinates. We consider an alternative scheme using basis functions in which the cells have retinotopic receptive fields modulated by the orientation of the object and task-related signals. We show that this alternative is consistent with single-cell data, is computationally efficient, and accounts for object-centered hemineglect, a syndrome observed in humans after fronto-parietal lesions.

Attention, spatial representation, and visual neglect: simulating emergent attention and spatial memory in the selective attention for identification model (SAIM)

The selective attention for identification model (SAIM) is presented. This uses a spatial window to select visual information for recognition, binding parts to objects and generating translation-invariant recognition. The model provides a qualitative account of both normal and disordered attention. Simulations of normal attention demonstrate 2-object costs and effects of object familiarity on selection, global precedence, spatial cueing, and inhibition of return. When lesioned, SAIM demonstrated either view- or object-centered neglect or spatial extinction, depending on the type and extent of lesion. The model provides a framework to unify (a) object- and space-based theories of normal selection, (b) dissociations within the syndrome of unilateral neglect, and (c) attentional and representational accounts of neglect.

View from the top: hierarchies and reverse hierarchies in the visual system

We propose that explicit vision advances in reverse hierarchical direction, as shown for perceptual learning. Processing along the feedforward hierarchy of areas, leading to increasingly complex representations, is automatic and implicit, while conscious perception begins at the hierarchy's top, gradually returning downward as needed. Thus, our initial conscious percept--vision at a glance--matches a high-level, generalized, categorical scene interpretation, identifying "forest before trees." For later vision with scrutiny, reverse hierarchy routines focus attention to specific, active, low-level units, incorporating into conscious perception detailed information available there. Reverse Hierarchy Theory dissociates between early explicit perception and implicit low-level vision, explaining a variety of phenomena. Feature search "pop-out" is attributed to high areas, where large receptive fields underlie spread attention detecting categorical differences. Search for conjunctions or fine discriminations depends on reentry to low-level specific receptive fields using serial focused attention, consistent with recently reported primary visual cortex effects.

Trunk orientation induces neglect-like lateral biases in covert attention

The purpose of this study was to resolve a paradox in the literature on the effects of body orientation on spatial attention. Neuropsychological studies have found that real or simulated trunk rotation relieves contralesional inattention in patients with unilateral neglect, suggesting that trunk orientation affects how attention is allocated to space. However in two previous studies, trunk orientation did not affect spatial attention in other populations. In this study we investigated the effects of trunk orientation on the performance of a covert attention task by neurologically intact adults. The covert attention task allowed the evaluation of the effects of trunk orientation on both the allocation of attention to space and the ability to shift that attention to new locations. As in previous research, trunk orientation did not affect participants' response times (RTs) to validly cued targets. However rotating participants' trunks to the left increased their RTs to invalidly cued targets on the right and decreased their RTs to invalidly cued targets on the left. These results indicate that trunk orientation induces directional biases in the ability to shift attention. Thus, for intact participants, trunk rotation created lateral biases in the covert attention task similar to those seen in neglect patients.

Multiple reference frames in neglect? An investigation of the object-centred frame and the dissociation between "near" and "far" from the body by use of a mirror

In this single case study of a man (AE) who suffered a right hemisphere stroke we showed the co-existence of neglect within different spatial frames: (a) In left hemispace and (b) in 'far' versus 'near' space, both as defined from the patient's viewpoint, as well as (c) for the left side of an object (as defined from an object-centred view). In the experiment, AE's latencies to name the colour of two cubes, each located in one hemispace, were measured. In some conditions, the cubes were placed on a table but in other conditions each cube was held in one hand of an experimenter who could either face the patient or show the cubes while her back was turned towards him. One prediction was that AE would show longer latencies for cubes in left hemispace; however, if object-centred neglect also occurred, then latencies should be even longer for cubes held in the experimenter's left hand. In order to reveal the presence of neglect for 'far' versus 'near' space, the cubes could also be positioned either near to (i.e. reaching distance) or far from the patient (i.e., several metres out of reach), by moving the table or the experimenter. Finally, in some conditions, AE looked at the cubes into a mirror that was positioned far away from his body. Because external objects seen in a mirror can be 'near' the patient's body, the patient actually looked at a 'far' location (i.e. the surface of the mirror) to see an object that is 'near'. The experiment confirmed the presence of all forms of neglect, since AE not only named the colour of a cube seen in his left hemispace more slowly than in right hemispace, but latencies increased for a cube held by the experimenter in her left hand and in left hemispace (both when the left hand was seen directly or as a mirror reflection). Finally, AE's performance was worse for 'far' than 'near' locations, when the cubes were physically located near his body (i.e., within "grasping" space) but seen in the mirror.

Functional coupling between the limbs during bimanual reach-to-grasp movements

While it is frequently advantageous to be able to use our hands independently, many actions demand that we use our hands co-operatively. In this paper we present two experiments that examine functional binding between the limbs during the execution of bimanual reach-to-grasp movements. The first experiment examines the effect of gaze direction on unimanual and bimanual reaches. Even when subjects' eye movements are restricted during bimanual reaches so that they may only foveate one target object, the limbs remain tightly synchronized to a common movement duration. In contrast, grip aperture is independently scaled to the size of the target for each hand. The second experiment demonstrates however, that the independent scaling of grip aperture is task dependent. If the two target objects are unified so that they appear to be part of a single object, grip apertures become more similar across the hands (i.e., grip aperture to the large target object is reduced in size while peak aperture to the small target item is increased in size). These results suggest that the coupling of the limbs can operate at a functional level.