Grab it! Biased attention in functional hand and tool space

Visual perceptual learning is enhanced by training in the illusory far space

Visual objects in the peripersonal space (PPS) are perceived faster than farther ones appearing in the extrapersonal space (EPS). This shows preferential processing for visual stimuli near our body. Such an advantage should favour visual perceptual learning occurring near, as compared with far from observers, but opposite evidence has been recently provided from online testing protocols, showing larger perceptual learning in the far space. Here, we ran two laboratory-based experiments investigating whether visual training in PPS and EPS has different effects. We used the horizontal Ponzo Illusion to create a lateralized depth perspective while participants completed a visual search task in which they reported whether or not a specific target object orientation (e.g., a triangle pointing upwards) was present among distractors. This task was completed before and after a training phase in either the (illusory) near or far space for 1 h. In Experiment 1, the near space was in the left hemispace, whereas in Experiment 2, it was in the right. Results showed that, in both experiments, participants were more accurate after training in the far space, whereas training in the near space led to either improvement in the far space (Experiment 1), or no change (Experiment 2). Moreover, we found a larger visual perceptual learning when stimuli were presented in the left compared with the right hemispace. Differently from visual processing, visual perceptual learning is more effective in the far space. We propose that depth is a key dimension that can be used to improve human visual learning.

Action does not drive visual biases in peri-tool space

Observers experience visual biases in the area around handheld tools. These biases may occur when active use leads an observer to incorporate a tool into the body schema. However, the visual salience of a handheld tool may instead create an attentional prioritization that is not reliant on body-based representations. We investigated these competing explanations of near-tool visual biases in two experiments during which participants performed a target detection task. Targets could appear near or far from a tool positioned next to a display. In Experiment 1, participants showed facilitation in detecting targets that appeared near a simple handheld rake tool regardless of whether they first used the rake to retrieve objects, but participants who only viewed the tool without holding it were no faster to detect targets appearing near the rake than targets that appeared on the opposite side of the display. In a second experiment, participants who held a novel magnetic tool again showed a near-tool bias even when they refrained from using the tool. Taken together, these results suggest active use is unnecessary, but visual salience is not sufficient, to introduce visual biases in peri-tool space.

Influence of hand starting position on radial line bisection

When normal individuals are asked to localize and mark the midpoint of a radial line, they tend to bisect it farther than the true center. It has been suggested that radial misbisection depends on the presence of a visual attentional bias directed toward the far space. The aim of the present study was to investigate whether the localization of the center of radial lines was affected by the starting position of the hand. There were two starting positions: one between the body and the radial line ("near"), the other beyond the radial line ("far"). Thirty-four subjects participated in the experiment. The results showed that (i) participants bisected radial lines farther than the true center, measured with reference to their body, in both near and far condition, and (ii) bisection errors in the near condition were greater than those in the far condition. We suggest that hand starting position and direction of ongoing movement influenced radial line misbisection by modulating visual attentional bias directed to far space.

Opposing influences of global and local stimulus-hand proximity on crosstalk interference in dual tasks

In contrast to traditional dualistic views of cognition, visual stimulus processing appears not independent of bodily factors such as hand positioning. For example, reduced crosstalk between two temporally overlapping tasks has been observed when the hands are moved into the attentional window alongside their respective stimuli (i.e., establishing global stimulus-hand proximity). This result indicates that hand-specific attentional processing enhancements support a more serial rather than parallel processing of the two tasks. To further elucidate the nature of these processing modulations and their effect on multitasking performance, the present study consisted of three interrelated crosstalk experiments. Experiment 1 manipulated global stimulus-hand proximity and stimulus-effect proximity orthogonally, with results demonstrating that hand proximity rather than effect proximity drives the crosstalk reduction. Experiment 2 manipulated the physical distance between both hands (i.e., varying local stimulus-hand proximity), with results showing weak evidence of increased crosstalk when both hands are close to each other. Experiment 3 tested opposing influences of global and local stimulus-hand proximity as observed in Experiment 1 and 2 rigorously within one experiment, by employing an orthogonal manipulation of these two proximity measures. Again, we observed slightly increased crosstalk for hands close to each other (replicating Experiment 2); however, in contrast to Experiment 1, the effect of global stimulus-hand proximity on the observed crosstalk was not significant this time. Taken together, the experiments support the notion of hand-specific modulations of perception-action coupling, which can either lead to more or less interference in multitasking, depending on the exact arrangement of hands and stimuli.

Effects of finger and mouse pointing on learning from online split-attention examples

BACKGROUND

Self-management of cognitive load is a recent development in cognitive load theory. Finger pointing has been shown to be a potential self-management strategy to support learning from spatially separated, but mutually referring text and pictures (i.e., split-attention examples).

AIMS

The present study aimed to extend the prior research on the pointing strategy and investigated the effects of finger pointing on learning from online split-attention examples. Moreover, we examined an alternative pointing strategy using the computer mouse, and a combination of finger pointing and computer-mouse pointing.

SAMPLE

One-hundred and forty-five university students participated in the present study.

METHOD

All participants studied an online split-attention example about the human nervous system and were randomly allocated to one of four conditions: (1) pointing with the index finger, (2) pointing with the computer mouse, (3) pointing with the index finger and the computer mouse and (4) no pointing.

RESULTS

Results confirmed our main hypothesis, indicating that finger pointing led to higher retention performance than no pointing. However, the mouse pointing strategy and the combined finger and mouse pointing strategy did not show supportive effects.

CONCLUSIONS

Finger pointing can be used as a simple and convenient self-management strategy in online learning environments. Mouse pointing may not be as effective as finger pointing.

Tool use moves the peri-personal space from the hand to the tip of the tool

In this study, we used a visual target detection task to investigate three hypotheses about how the peri-personal space is extended after tool-use training: Addition, Extension, and Projection hypotheses. We compared the target detection performance before and after tool-use training. In both conditions, the participants held a hockey stick-like tool in their hands during the detection task. Furthermore, we added the no-tool-holding condition to the experimental design. In the no-tool-holding condition, a peri-hand space advantage in the visual target detection task was observed. When the participants held the tool with their hands, this peri-hand space advantage was lost. Furthermore, there was no peri-tool space advantage before tool training. After tool training, the peri-tool space advantage was observed. However, after tool training, the advantage of the peri-hand space was not observed. This result suggested that the peri-hand advantage was reduced by simply holding the tool because the participants lost the functionality of their hands. Furthermore, tool-use training improved detection performance only in the peri-tool space. Thus, these results supported the projection hypothesis that the peri-personal space advantage would move from the body to the functional part of the tool.

Rethinking Vision and Action

Action is an important arbitrator as to whether an individual or a species will survive. Yet, action has not been well integrated into the study of psychology. Action or motor behavior is a field apart. This is traditional science with its need for specialization. The sequence in a typical laboratory experiment of see → decide → act provides the rationale for broad disciplinary categorizations. With renewed interest in action itself, surprising and exciting anomalous findings at odds with this simplified caricature have emerged. They reveal a much more intimate coupling of vision and action, which we describe. In turn, this prompts us to identify and dwell on three pertinent theories deserving of greater notice.

Does hand position affect orienting when no action is required? An electrophysiological study

Previous research has shown that attention can be biased to targets appearing near the hand that require action responses, arguing that attention to the hand facilitates upcoming action. It is unclear whether attention orients to non-targets near the hand not requiring responses. Using electroencephalography/event-related potentials (EEG/ERP), this study investigated whether hand position affected visual orienting to non-targets under conditions that manipulated the distribution of attention. We modified an attention paradigm in which stimuli were presented briefly and rapidly on either side of fixation; participants responded to infrequent targets (15%) but not standard non-targets and either a hand or a block was placed next to one stimulus location. In Experiment 1, attention was distributed across left and right stimulus locations to determine whether P1 or N1 ERP amplitudes to non-target standards were differentially influenced by hand location. In Experiment 2, attention was narrowed to only one stimulus location to determine whether attentional focus affected orienting to non-target locations near the hand. When attention was distributed across both stimulus locations, the hand increased overall N1 amplitudes relative to the block but not selectively to stimuli appearing near the hand. However, when attention was focused on one location, amplitudes were affected by the location of attentional focus and the stimulus, but not by hand or block location. Thus, hand position appears to contribute only a non-location-specific input to standards during visual orienting, but only in cases when attention is distributed across stimulus locations.

Does hand proximity enhance letter identification?

Adam et al. (2012) found that letters were identified more accurately when presented near, compared to away from, the hands. Participants performed the task in two conditions: with their hands held stationary and with their hands moving towards and away from the target letters. The near-hands effect included the contribution of both static and dynamic trials. Further studies showed that accuracy in letter discrimination was higher when hands were away from a target (a far-hands effect) and moving toward it, suggesting an interaction between hand position and movement direction. The present study aimed to test whether hand proximity affects letter identification when the hands are stationary, as it remains unclear if this effect can be reliably observed. Participants viewed strings of three consonants, briefly presented and masked, and had to verbally report their identity. Stimuli were presented under two different hand conditions: proximal and distal. The predicted effects of letter position and stimulus duration were all statistically significant and robust; however, we did not observe a hand proximity effect.

Use-dependent increase in attention to the prosthetic foot in patients with lower limb amputation

Patients with lower limb amputation experience “embodiment” while using a prosthesis, perceiving it as part of their body. Humans control their biological body parts and receive appropriate information by directing attention toward them, which is called body-specific attention. This study investigated whether patients with lower limb amputation similarly direct attention to prosthetic limbs. The participants were 11 patients with lower limb amputation who started training to walk with a prosthesis. Attention to the prosthetic foot was measured longitudinally by a visual detection task. In the initial stage of walking rehabilitation, the index of attention to the prosthetic foot was lower than that to the healthy foot. In the final stage, however, there was no significant difference between the two indexes of attention. Correlation analysis revealed that the longer the duration of prosthetic foot use, the greater the attention directed toward it. These findings indicate that using a prosthesis focuses attention akin to that of an individual’s biological limb. Moreover, they expressed that the prosthesis felt like a part of their body when they could walk independently. These findings suggest that the use of prostheses causes integration of visual information and movement about the prosthesis, resulting in its subjective embodiment.

Implicit Body Representation of the Hand Enlarged by Repetitive Peripheral Magnetic Stimulation within the Boundary of a Real Hand

Deafferentation induced by local anesthesia causes a larger perceived area than the real area of the mouth, which, in the perspective of body representation, belongs to implicit body representation. In this study, we applied repetitive peripheral magnetic stimulation (rPMS) on the motor branch of the radial nerve of participants’ non-dominant-side forearm to induce extension movements of wrist and fingers. This intervention was supposed to increase proprioception to the brain and had an enlargement effect on implicit body representation of the hand in our hypothesis. A total of 39 participants were randomly allocated to the real rPMS group (n = 19) or the sham rPMS group (n = 20). Implicit representation of the hand was measured by a simplified paradigm based on the proposal of Longo and Haggard that depicted perceived locations of fingertips and metacarpophalangeal joints of participants’ occluded hand, in which they showed that implicit body representation of the hand was smaller than the real hand. We compare the main effect of real rPMS vs. sham rPMS and its interaction effect with time by setting four timepoints—before stimulation, right after stimulation, 10 min after stimulation and 20 min after stimulation—to demonstrate the possible short-lasting effect. Results showed that real rPMS had a short-lasting enlargement effect on implicit representation of the hand in general, which was significant especially on the ulnar side of fingers. What is more, the enlarged implicit body representation of the hand was still within the boundary of a real hand, which might indicate the identification role of a real body part.

Relationship Between Body-Specific Attention to a Paretic Limb and Real-World Arm Use in Stroke Patients: A Longitudinal Study

Learned nonuse is a major problem in upper limb (UL) rehabilitation after stroke. Among the various factors that contribute to learned nonuse, recent studies have focused on body representation of the paretic limb in the brain. We previously developed a method to measure body-specific attention, as a marker of body representation of the paretic limb and revealed a decline in body-specific attention to the paretic limb in chronic stroke patients by a cross-sectional study. However, longitudinal changes in body-specific attention and paretic arm use in daily life (real-world arm use) from the onset to the chronic phase, and their relationship, remain unknown. Here, in a longitudinal, prospective, observational study, we sought to elucidate the longitudinal changes in body-specific attention to the paretic limb and real-world arm use, and their relationship, by using accelerometers and psychophysical methods, respectively, in 25 patients with subacute stroke. Measurements were taken at baseline (TBL), 2 weeks (T2w), 1 month (T1M), 2 months (T2M), and 6 months (T6M) after enrollment. UL function was measured using the Fugl-Meyer Assessment (FMA) and Action Research Arm Test (ARAT). Real-world arm use was measured using accelerometers on both wrists. Body-specific attention was measured using a visual detection task. The UL function and real-world arm use improved up to T6M. Longitudinal changes in body-specific attention were most remarkable at T1M. Changes in body-specific attention up to T1M correlated positively with changes in real-world arm use up to T6M, and from T1M to T6M, and the latter more strongly correlated with changes in real-world arm use. Changes in real-world arm use up to T2M correlated positively with changes in FMA up to T2M and T6M. No correlation was found between body-specific attention and FMA scores. Thus, these results suggest that improved body-specific attention to the paretic limb during the early phase contributes to increasing long-term real-world arm use and that increased real-world use is associated with the recovery of UL function. Our results may contribute to the development of rehabilitation strategies to enhance adaptive changes in body representation in the brain and increase real-world arm use after stroke.

Visual attention around a hand location localized by proprioceptive information

Facilitation of visual processing has been reported in the space near the hand. To understand the underlying mechanism of hand proximity attention, we conducted experiments that isolated hand-related effects from top–down attention, proprioceptive information from visual information, the position effect from the influence of action, and the distance effect from the peripersonal effect. The flash-lag effect was used as an index of attentional modulation. Because the results showed that the flash-lag effect was smaller at locations near the hand, we concluded that there was a facilitation effect of the visual stimuli around the hand location identified through proprioceptive information. This was confirmed by conventional reaction time measures. We also measured steady-state visual evoked potential (SSVEP) in order to investigate the spatial properties of hand proximity attention and top–down attention. The results showed that SSVEP reflects the effect of top–down attention but not that of hand proximity attention. This suggests that the site of hand proximity attention is at a later stage of visual processing, assuming that SSVEP responds to neural activities at the early stages. The results of left-handers differed from those of right-handers, and this is discussed in relation to handedness variation.

Body-Specific Attention to the Hands and Feet in Healthy Adults

To execute the intended movement, the brain directs attention, called body-specific attention, to the body to obtain information useful for movement. Body-specific attention to the hands has been examined but not to the feet. We aimed to confirm the existence of body-specific attention to the hands and feet, and examine its relation to motor and sensory functions from a behavioral perspective. The study included two groups of 27 right-handed and right-footed healthy adults, respectively. Visual detection tasks were used to measure body-specific attention. We measured reaction times to visual stimuli on or off the self-body and calculated the index of body-specific attention score to subtract the reaction time on self-body from that off one. Participants were classified into low and high attention groups based on each left and right body-specific attention index. For motor functions, Experiment 1 comprised handgrip strength and ball-rotation tasks for the hands, and Experiment 2 comprised toe grip strength involved in postural control for the feet. For sensory functions, the tactile thresholds of the hands and feet were measured. The results showed that, in both hands, the reaction time to visual stimuli on the hand was significantly lesser than that offhand. In the foot, this facilitation effect was observed in the right foot but not the left, which showed the correlation between body-specific attention and the normalized toe gripping force, suggesting that body-specific attention affected postural control. In the hand, the number of rotations of the ball was higher in the high than in the low attention group, regardless of the elaboration exercise difficulty or the left or right hand. However, this relation was not observed in the handgripping task. Thus, body-specific attention to the hand is an important component of elaborate movements. The tactile threshold was higher in the high than in the low attention group, regardless of the side in hand and foot. The results suggested that more body-specific attention is directed to the limbs with lower tactile abilities, supporting the sensory information reaching the brain. Therefore, we suggested that body-specific attention regulates the sensory information to help motor control.

Individual Optimal Attentional Strategy in Motor Learning Tasks Characterized by Steady-State Somatosensory and Visual Evoked Potentials

Focus of attention is one of the most influential factors facilitating motor performance. Previous evidence supports that the external focus (EF) strategy, which directs attention to movement outcomes, is associated with better motor performance than the internal focus (IF) strategy, which directs attention to body movements. However, recent studies have reported that the EF strategy is not effective for some individuals. Furthermore, neuroimaging studies have demonstrated that the frontal and parietal areas characterize individual optimal attentional strategies for motor tasks. However, whether the sensory cortices are also functionally related to individual optimal attentional strategy remains unclear. Therefore, the present study examined whether an individual’s sensory processing ability would reflect the optimal attentional strategy. To address this point, we explored the relationship between responses in the early sensory cortex and individuals’ optimal attentional strategy by recording steady-state somatosensory evoked potentials (SSSEP) and steady-state visual evoked potentials (SSVEP). Twenty-six healthy young participants first performed a motor learning task with reaching movements under IF and EF conditions. Of the total sample, 12 individuals showed higher after-effects under the IF condition than the EF condition (IF-dominant group), whereas the remaining individuals showed the opposite trend (EF-dominant group). Subsequently, we measured SSSEP from bilateral primary somatosensory cortices while presenting vibrotactile stimuli and measured SSVEP from bilateral primary visual cortices while presenting checkerboard visual stimuli. The degree of increasing SSSEP response when the individuals in the IF-dominant group directed attention to vibrotactile stimuli was significantly more potent than those in the EF-dominant individuals. By contrast, the individuals in the EF-dominant group showed a significantly larger SSVEP increase while they directed attention to visual stimuli compared with the IF-dominant individuals. Furthermore, a significant correlation was observed such that individuals with more robust IF dominance showed more pronounced SSSEP attention modulation. These results suggest that the early sensory areas have crucial brain dynamics to characterize an individual’s optimal attentional strategy during motor tasks. The response characteristics may reflect the individual sensory processing ability, such as control of priority to the sensory inputs. Considering individual cognitive traits based on the suitable attentional strategy could enhance adaptability in motor tasks.

Does response facilitation to visuo-tactile stimuli around a remote-controlled hand avatar reflect peripersonal space or attentional bias?

People react faster to visuo-tactile stimuli presented near the body (i.e., in peripersonal space) than to tactile stimuli presented alone. This multi-sensory facilitation effect has been used as a measurement of peripersonal space. Previous research has reported that peripersonal space representations can be modulated by actively using hand-held tools or disconnected hand avatars. However, previous research has ignored the possibility that the attentional effect of active tool use could affect multi-sensory facilitation. In the present study, we delivered tactile stimuli to participants' left or right hand concurrently with visual stimuli presented near a virtual hand avatar operated by the movements of participants' left or right hand, which was shown far in a virtual environment and disconnected from the body. Participants reacted to tactile stimuli while ignoring the visual stimuli. The results indicated a multi-sensory facilitation effect when tactile stimuli were delivered to the hand used to operate the hand avatar. In contrast, the facilitation was not observed when the tactile stimuli were delivered to the hand that is not operating the hand avatar. These results suggest that the strength of the multi-sensory facilitation effect differed across conditions, even though the visual attention captured around the hand avatar was controlled across conditions. We concluded that the modulation of peripersonal space resulting from using tools or avatars is nearly independent of visual attention captured around tools or avatars.

Tool Use Affects Spatial Perception

Tools do not just expand our capabilities. They change what we can do, and in doing so, they change who we are. Serena is Serena because of what she can do with a tennis racket. Tiger is Tiger because of what he can do with a golf club. In changing what we can do, tools also change the very way we perceive the spatial layout of the world. Objects beyond arm's reach appear closer when we wield a tool that can expand out to the object. Catchable objects seem to move faster when we wield a tool that is less effective for catching the object. These examples illustrate how the basic processes of spatial vision are impacted by tool use.

Vision is biased near handheld, but not remotely operated, tools

Previous studies have shown that after actively using a handheld tool for a period of time, participants show visual biases toward stimuli presented near the end of the tool. Research suggests this is driven by an incorporation of the tool into the observer's body schema, extending peripersonal space to surround the tool. This study aims to investigate whether the same visual biases might be seen near remotely operated tools. Participants used tools-a handheld rake (Experiment 1), a remote-controlled drone (Experiment 2), a remote-controlled excavator (Experiment 3), or a handheld excavator (Experiment 4)-to rake sand for several minutes, then performed a target-detection task in which they made speeded responses to targets appearing near and far from the tool. In Experiment 1, participants detected targets appearing near the rake significantly faster than targets appearing far from the rake, replicating previous findings. We failed to find strong evidence of improved target detection near remotely operated tools in Experiments 2 and 3, but found clear evidence of near-tool facilitation in Experiment 4 when participants physically picked up the excavator and used it as a handheld tool. These results suggest that observers may not incorporate remotely operated tools into the body schema in the same manner as handheld tools. We discuss potential mechanisms that may drive these differences in embodiment between handheld and remote-controlled tools.

Disconnected hand avatar can be integrated into the peripersonal space

Several studies have shown that space immediately surrounding the body, or the peripersonal space is represented differently in the brain from the more distant extra-personal space. Moreover, the boundary of peripersonal space can be extended to space surrounding the tip of a tool held by the hand. However, it is not known if tools need to be connected to the body to modulate the peripersonal space. We used a line bisection task to investigate whether peripersonal space representation surrounds a virtual hand avatar that is disconnected from the body. Healthy participants conducted a line bisection task by responding with either a virtual hand avatar or a laser pointer. The to-be-bisected lines were presented either in peripersonal or extra-personal space. When the lines were placed in extra-personal space, the virtual hand avatar was presented near the line such that the hand avatar was far from participants and disconnected from their bodies. Results indicated a shift in the line bisection bias from the left to the right as the line presentation distance increased when using the laser pointer, whereas no shift in bias was observed when using the virtual hand avatar. This result indicates that objects resembling human hands presented even at a distance and disconnected from the body can be integrated into the peripersonal space, which suggests that peripersonal space representation is more flexible than previously reported.

Faster recognition of graspable targets defined by orientation in a visual search task

Peri-hand space is the area surrounding the hand. Objects within this space may be subject to increased visuospatial perception, increased attentional prioritization, and slower attentional disengagement compared to more distal objects. This may result from kinesthetic and visual feedback about the location of the hand that projects from the reach and grasp networks of the dorsal visual stream back to occipital visual areas, which in turn, refines cortical visual processing that can subsequently guide skilled motor actions. Thus, we hypothesized that visual stimuli that afford action, which are known to potentiate activity in the dorsal visual stream, would be associated with greater alterations in visual processing when presented near the hand. To test this, participants held their right hand near or far from a touchscreen that presented a visual array containing a single target object that differed from 11 distractor objects by orientation only. The target objects and their accompanying distractors either strongly afforded grasping or did not. Participants identified the target among the distractors by reaching out and touching it with their left index finger while eye-tracking was used to measure visual search times, target recognition times, and search accuracy. The results failed to support the theory of enhanced visual processing of graspable objects near the hand as participants were faster at recognizing graspable compared to non-graspable targets, regardless of the position of the right hand. The results are discussed in relation to the idea that, in addition to potentiating appropriate motor responses, object affordances may also potentiate early visual processes necessary for object recognition.

Tool-Use Training Induces Changes of the Body Schema in the Limb Without Using Tool

Previous studies have shown that tool use affects the plasticity of the body schema. In other words, people will perceive the tool as a part of their body, and thus feel like they have “longer limbs” after using tools. However, it is unclear whether tool embodiment could spread to a limb that is not using the tool, and whether other limbs could utilize the proprioception of a limb. In Experiment 1, blindfolded participants were asked to search with a cane (Condition 1) or to walk with a cane (Condition 2). The results in Condition 1 illustrated that the tactile distance perception on the forearm was lengthened after tool use, while other body parts did not significantly change. In Condition 2, the tactile distance perception on the hand and forearm extended significantly after using tools. Additionally, tool-use training even induced an increased perception of the calf that was not using the tool. Possible interference from the difference between walking and standing was excluded in Experiment 2. These results demonstrate that the proprioception information of one limb could be exploited by another limb to extend the body schema even though that limb was not using a tool. It was also observed that the effect of direction was task-dependent in the tactile perception task.

Action Fluency Facilitates Perceptual Discrimination

Perception and action interact in nearly every moment of daily life. Previous studies have demonstrated not only that perceptual input shapes action but also that various factors associated with action-including individual abilities and biomechanical costs-influence perceptual decisions. However, it is unknown how action fluency affects the sensitivity of early-stage visual perception, such as orientation. To address this question, we used a dual-task paradigm: Participants prepared an action (e.g., grasping), while concurrently performing an orientation-change-detection task. We demonstrated that as actions became more fluent (e.g., as grasping errors decreased), perceptual-discrimination performance also improved. Importantly, we found that grasping training prior to discrimination enhanced subsequent perceptual sensitivity, supporting the notion of a reciprocal relation between perception and action.

Change detection for real-world objects in perihand space

Recent evidence has demonstrated that observers experience visual-processing biases in perihand space that may be tied to the hands' relevance for grasping actions. Our previous work suggested that when the hands are positioned to afford a power-grasp action, observers show increased temporal sensitivity that could aid with fast and forceful action, whereas when the hands are instead at the ready to perform a precision-grasp action, observers show enhanced spatial sensitivity that benefits delicate and detail-oriented actions. In the present investigation we seek to extend these previous findings by examining how object affordances may interact with hand positioning to shape visual biases in perihand space. Across three experiments, we examined how long participants took to perform a change detection task on photos of real objects, while we manipulated hand position (near/far from display), grasp posture (power/precision), and change type (orientation/identity). Participants viewed objects that afforded either a power grasp or a precision grasp, or were ungraspable. Although we were unable to uncover evidence of altered vision in perihand space in our first experiment, mirroring previous findings, in Experiments 2 and 3 our participants showed grasp-dependent biases near the hands when detecting changes to target objects that afforded a power grasp. Interestingly, ungraspable target objects were not subject to the same perihand space biases. Taken together, our results suggest that the influence of hand position on change detection performance is mediated not only by the hands' grasp posture, but also by a target object's affordances for grasping.

Beyond one's body parts: Remote object movement with sense of agency involuntarily biases spatial attention

Humans' own body postures and/or actions bias visual attention. This study examined whether an object controlled remotely with a sense of agency (SoA) can bias attentional allocation, even if the mappings of body movement and object movement do not correspond (i.e., with a less extended body representation). In the experiments, participants shifted a circle toward an instructed direction via keypress. On some trials, the task changed to identification of visual characters instead of the circle shift. Strength of SoA was manipulated based on the probability that the circle actually moved to the participant's intended location, with high probability producing a strong SoA. Results showed that visual identification performance became higher for appearance of the target at the intended location than at the unintended location, but only when observers felt a strong SoA. This suggests that the object's movement attracts attention when the observer feels a strong SoA over its control.

Visual and proprioceptive recalibrations after exposure to a visuomotor rotation

Adaptation to a visuomotor rotation in a cursor-control task is accompanied by proprioceptive recalibration, whereas the existence of visual recalibration is uncertain and has even been doubted. In the present study, we tested both visual and proprioceptive recalibration; proprioceptive recalibration was not only assessed by means of psychophysical judgments of the perceived position of the hand, but also by an indirect procedure based on movement characteristics. Participants adapted to a gradually introduced visuomotor rotation of 30° by making center-out movements to remembered targets. In subsequent test trials, they made center-out movements without visual feedback or observed center-out motions of a cursor without moving the hand. In each test trial, they judged the endpoint of hand or cursor by matching the position of the hand or of a visual marker, respectively, moving along a semicircular path. This path ran through all possible endpoints of the center-out movements. We observed proprioceptive recalibration of 7.3° (3.1° with the indirect procedure) and a smaller, but significant, visual recalibration of 1.3°. Total recalibration of 8.6° was about half as strong as motor adaptation, the adaptive shift of the movement direction. The evidence of both proprioceptive and visual recalibration was obtained with a judgment procedure that suggests that recalibration is restricted to the type of movement performed during exposure to a visuomotor rotation. Consequently, identical physical positions of the hand can be perceived differently depending on how they have been reached, and similarly identical positions of a cursor on a monitor can be perceived differently.

Distorted gaze direction input to attentional priority map in spatial neglect

A contribution of the gaze signals to the attention imbalance in spatial neglect is presumed. Direct evidence however, is still lacking. Theoretical models for spatial attention posit an internal representation of locations that are selected in the competition for neural processing resources – an attentional priority map. Following up on our recent research showing an imbalance in the allocation of attention after an oculoproprioceptive perturbation in healthy volunteers, we investigated here whether the lesion in spatial neglect distorts the gaze direction input to this representation.

Information about one's own direction of gaze is critical for the coordinate transformation between retinotopic and hand proprioceptive locations. To assess the gaze direction input to the attentional priority map, patients with left spatial neglect performed a cross-modal attention task in their normal, right hemispace. They discriminated visual targets whose location was cued by the patient's right index finger hidden from view. The locus of attention in response to the cue was defined as the location with the largest decrease in reaction time for visual discrimination in the presence vs. absence of the cue. In two control groups consisting of healthy elderly and patients with a right hemisphere lesion without neglect, the loci of attention were at the exact location of the cues. In contrast, neglect patients allocated attention at 0.5⁰-2⁰ rightward of the finger for all tested locations. A control task using reaching to visual targets in the absence of visual hand feedback ruled out a general error in visual localization. These findings demonstrate that in spatial neglect the gaze direction input to the attentional priority map is distorted. This observation supports the emerging view that attention and gaze are coupled and suggests that interventions that target gaze signals could alleviate spatial neglect.

•

The mechanisms of left inattention in spatial neglect are incompletely understood.

•

Attention loci in visual space are displaced to the right of somatosensory cues.

•

This indicates a distorted gaze direction input to the attentional priority map.

•

Distorted gaze direction input could lead to left-right attention imbalance.

Embodied cognition in multitasking: increased hand-specific task shielding when stimuli are presented near the hand

The proximity of hand position alters the processing of visual stimuli. Stimuli presented close (proximal) to hands receive an enhanced allocation of visual attention compared to stimuli presented far (distal) from hands. In the present dual-task study we studied the consequences of this preferential processing when the stimulus for Task 1 (S1) and the stimulus for Task 2 (S2) were presented together and were assigned to specific response hands (R1 and R2) located proximal (at the monitor) versus distal (in the lap) to the stimuli. In two experiments, we tested whether stimulus-hand proximity affected the extent of between-task interference (i.e., influence of additional Task 2 processing on primary Task 1 processing). In Experiment 1, results showed that stimulus-hand proximity reduced the amount of between-task interference compared to the distal stimulus-hand condition. Extending these findings, in Experiment 2 a further reduction of between-task interference was obtained when a single hand was located at the monitor instead of two hands. These results are inconsistent with the assumption of a generally increased attentional processing benefit for multiple stimuli within hand space. Instead, these findings speak for a hand-specific processing benefit that supports more separate processing of two tasks. Together these findings demonstrate that stimulus-hand proximity affects the quality of multiple task performance, which is discussed in the context of both, basic and applied cognitive research.

Hand function, not proximity, biases visuotactile integration later in object processing: An ERP study

Behavioral studies document a functional hand proximity effect: objects near the palm, but not the back of the hand, affect visual processing. Although visuotactile bimodal neurons integrate visual and haptic inputs, their receptive fields in monkey cortex encompass the whole hand, not just the palm. Using ERPs, we investigated whether hand function influenced the topology of integrated space around the hand. In a visual detection paradigm, target and non-target stimuli appeared equidistantly in front or in back of the hand. Equivalent N1 amplitudes were found for both conditions. P3 target versus non-target amplitude differences were greater for palm conditions. Hand proximity biased processing of visual targets equidistant from the hand early in processing. However, hand function biases emerged later when targets were selected for potential action. Thus, early hand proximity effects on object processing depend on sensory-reliant neural responses, whereas later multisensory integration depend more on the hand's functional expertise.

Situational Determinants of Hand-Proximity Effects

Recent studies have demonstrated altered visual processing of stimuli in the proximal region of the hand. It has been challenging to characterize the range and nature of these processing differences. In our attempt to deconstruct the factors giving rise to the Hand-Proximity Effects (HPEs), we manipulated the organization of items in a visual search display. In two experiments, we observed the absence of HPE. Specifically, in Experiment 1, we presented the search display in only one half of the monitor (split diagonally), which could be either near or far from the hand placed on the corner of the monitor. The results of a Bayesian analysis showed that the search efficiency was not significantly different for neither ‘near’ nor ‘far’ condition when compared with the baseline condition in which the hand rested on the lap. In Experiment 2, the search display was arranged horizontally across the monitor. A Bayesian analysis showed that RTs did not vary depending on the proximity of the target to the hand as well as the baseline (lap) condition. The present results characterize features of the HPE that have not been reported previously and are in line with recent reports of the failure to replicate HPE under various circumstances.

Impaired conflict monitoring near the hands: Neurophysiological evidence

Recent evidence suggests that hand-stimulus proximity enhances the visuo-motor Simon effect. The present study used event-related potentials (ERP) to examine the timing at which hand-stimulus proximity modulates the Simon effect. The results show that the P1 and N1 components were not modulated by hand-stimulus proximity, suggesting that early sensory processing is not altered by hand-stimulus proximity. However, the interference effect (the difference between incompatible versus compatible trials) on the N2 component was significantly attenuated near the hands compared to far from the hands, indicating that hand-stimulus proximity impairs conflict monitoring. We also found significant effects on a later component, as the P3 was reduced and had a shorter latency for the hand-proximal condition relative to the hand-distal condition. These new findings suggest that the critical stage at which hand-stimulus proximity affects cognitive processing lies past the early perceptual processing, acting instead on later stages of processing related to executive functioning.

Time-dependent decline of body-specific attention to the paretic limb in chronic stroke patients

OBJECTIVE

To examine whether reduced body-specific attention to a paretic limb is found in chronic stroke patients in a time-dependent manner.

METHODS

Twenty-one patients with chronic hemiparesis (10 left and 11 right hemiparesis) after subcortical stroke and 18 age-matched healthy controls were recruited in this study. Standard neuropsychological examinations showed no clear evidence of spatial neglect in any patient. In order to quantitatively measure spatial attention to the paretic hand, a visual detection task for detecting a target appearing on the surface of either a paretic or dummy hand was used. This task can measure the body facilitation effect, which makes faster detection of a target on the body compared with one far from the body.

RESULTS

In stroke patients, there was no difference in the reaction time for a visual target between the paretic and the dummy hands, while the healthy participants showed faster detection for the visual target on the real hand than on the dummy one. The index of the body facilitation effect, subtracting the reaction time for the target-on-paretic hand from that for the target-on-dummy one, was correlated with the duration since onset and with finger function test on the Stroke Impairment Assessment Set.

CONCLUSIONS

The reduction of the body facilitation effect in the paretic limb suggests the decline of body-specific attention to the paretic one in patients with chronic hemiparesis. This decline of body-specific attention, leading to neglect for the paretic limb, will be one of the most serious problems for rehabilitation based on use-dependent plasticity.

The Fragility of the Near-Hand Effect

Recent literature has demonstrated that hand position can affect visual processing, a set of phenomena termed Near Hand Effects (NHEs). Across four studies we looked for single-hand NHEs on a large screen when participants were asked to discriminate stimuli based on size, colour, and orientation (Study 1), to detect stimuli after a manipulation of hand shaping (Study 2), to detect stimuli after the introduction of a peripheral cue (Study 3), and finally to detect stimuli after a manipulation of screen orientation (Study 4). Each study failed to find a NHE. Further examination of the pooled data using a Bayesian analysis also failed to reveal positive evidence for faster responses or larger cueing effects near a hand. These findings suggest that at least some NHEs may be surprisingly fragile, which dovetails with the recent proposition that NHEs may not form a unitary set of phenomena (Gozli & Deng, 2018). The implication is that visual processing may be less sensitive to hand position across measurement techniques than previously thought, and points to a need for well-powered, methodologically rigorous studies on this topic in the future.

Attention orienting near the hand following performed and imagined actions

Recent studies have documented that the hand's ability to perform actions affects the visual processing and attention for objects near the hand, suggesting that actions may have specific effects on visual orienting. However, most research on the relation between spatial attention and action focuses on actions as responses to visual attention manipulations. The current study examines visual attention immediately following an executed or imagined action. A modified spatial cuing paradigm tested whether a brief, lateralized hand-pinch performed by a visually hidden hand near the target location, facilitated or inhibited subsequent visual target detection. Conditions in which hand-pinches were fully executed (action) were compared to ones with no hand-pinch (inaction) in Experiment 1 and imagined pinches (imagine) in Experiment 2. Results from Experiment 1 indicated that performed hand pinches facilitated rather than inhibited subsequent detection responses to targets appearing near the pinch, but target detection was not affected by inaction. In Experiment 2, both action and imagined action conditions cued attention and facilitated responses, but along differing time courses. These results highlight the ongoing nature of visual attention and demonstrate how it is deployed to locations even following actions.

Immobilization does not disrupt near-hand attentional biases

Observers show biases in attention when viewing objects within versus outside of their hands' grasping space. While the hands' proximity to stimuli plays a key role in these effects, recent evidence suggests an observer's affordances for grasping actions also shape visual processing near the hands. The current study examined the relative contributions of proximity and affordances in introducing attentional biases in peripersonal space. Participants placed a single hand on a visual display and detected targets appearing near or far from the hand. Across conditions, the hand was either free, creating an affordance for a grasping action, or immobilized using an orthosis, interfering with the potential to grasp. Replicating previous findings, participants detected targets appearing near the hand more quickly than targets appearing far from the hand. Immobilizing the hands did not disrupt this effect, suggesting that proximity alone is sufficient to facilitate target detection in peripersonal space.

Situated and distributed cognition in artifact negotiation and trade-specific skills: A cognitive ethnography of Kashmiri carpet weaving practice

This article describes various ways actors in Kashmiri carpet weaving practice deploy a range of artifacts, from symbolic, to material, to hybrid, in order to achieve diverse cognitive accomplishments in their particular task domains: information representation, inter and intra-domain communication, distribution of cognitive labor across people and time, coordination of team activities, and carrying of cultural heritage. In this repertoire, some artifacts position themselves as naïve tools in the actors’ environment to the point of being ignored; however, their usage-in-context unfolds their cognitive involvement in the tasks. These usages-in-context are shown through artifact analysis of their routine, improvised, and opportunistic uses, where cognitive artifacts like talim—the central artifact of this practice—are shown to play not only multifunctional roles beyond representation, but are also complemented by trade-specific skills bearing strong cognitive implications in a task.

Hand proximity effects are fragile: a useful null result

Placing one’s hands near an object has been reported to enhance visual processing in a number of ways. We explored whether hand proximity confers an advantage when applied to complex visual search. In one experiment, participants indicated the presence or absence of a target item in a baggage x-ray image by pressing response boxes located at the edge of a tablet computer screen, requiring them to grip the display between their hands. Alternatively, they responded using a mouse held within their lap. Contrary to expectations, hand position did not influence search performance. In a second experiment, participants used their finger to trace along the x-ray image while searching. In addition to any effect of hand proximity it was predicted that this strategy would encourage a more systematic search strategy. Participants inspected bags longer using this strategy, but this did not translate into improved target detection. A third experiment attempted to replicate the near-hands advantage in a change detection paradigm featuring simple stimuli (Tseng and Bridgeman, Experimental Brain Research 209:257–269, 2011), and the same equipment and hand positions as Experiment 1, but was unable to do so. One possibility is that the grip posture associated with holding a tablet is not conducive to producing a near-hands advantage. A final experiment tested this hypothesis with a direct replication of Tseng and Bridgeman, in which participants responded to stimuli presented on a CRT monitor using keys attached to the side of the monitor. Still, no near-hands advantage was observed. Our results suggest that the near-hands advantage may be sensitive to small differences in procedure, a finding that has important implications for harnessing the near-hands advantage to produce better performance in applied contexts.

Engagement of the motor system in position monitoring: reduced distractor suppression and effects of internal representation quality on motor kinematics

The position monitoring task is a measure of divided spatial attention in which participants track the changing positions of one or more objects, attempting to represent positions with as much precision as possible. Typically precision of representations declines with each target object added to participants’ attention load. Since the motor system requires precise representations of changing target positions, we investigated whether position monitoring would be facilitated by increasing engagement of the motor system. Using motion capture, we recorded the positions of participants’ index finger during pointing responses. Participants attempted to monitor the changing positions of between one and four target discs as they moved randomly around a large projected display. After a period of disc motion, all discs disappeared and participants were prompted to report the final position of one of the targets, either by mouse click or by pointing to the final perceived position on the screen. For mouse click responses, precision declined with attentional load. For pointing responses, precision declined only up to three targets and remained at the same level for four targets, suggesting obligatory attention to all four objects for loads above two targets. Kinematic profiles for pointing responses for highest and lowest loads showed greater motor adjustments during the point, demonstrating that, like external environmental task demands, the quality of internal representations affects motor kinematics. Specifically, these adjustments reflect the difficulty of both pointing to very precisely represented locations as well as keeping representations distinct from one another.

Asymmetries in initiation of aiming movements in schizophrenia

Several studies have reported motor symptoms in schizophrenia (SCZ), in some cases describing asymmetries in their manifestation. To date, biases were mainly reported for sequential movements, and the hypothesis was raised of a dopamine-related hemispheric imbalance. Aim of this research is to better characterize asymmetries in movement initiation in SCZ by exploring single actions. Fourteen SCZ patients and fourteen healthy subjects were recruited. On a trial-by-trial basis, participants were instructed to reach for one of eight possible targets. Measures of movement initiation and execution were collected. Starting point, target and moving limb were systematically varied to check for asymmetric responses. Results showed that SCZ patients, besides being overall slower than controls, additionally presented with a bias affecting both the moving hand and the side from which movements were initiated. This finding is discussed in relation to hemispheric lateralization in motor control.

Grasp preparation modulates early visual processing of size and detection of local/global stimulus features

Preparing to grasp objects facilitates visual processing of object location, orientation and size, compared to preparing actions such as pointing. This influence of action on perception reflects mechanisms of selection in visual perception tuned to current action goals, such that action relevant sensory information is prioritized relative to less relevant information. In three experiments, rather than varying movement type (grasp vs point), the magnitude of a prepared movement (power vs precision grasps) was manipulated while visual processing of object size, as well as local/global target detection was measured. Early event-related potentials (ERP) elicited by task-irrelevant visual probes were enhanced for larger probes during power grasp preparation and smaller probes during precision grasp preparation. Local targets were detected faster following precision, relative to power grasp cues. The results demonstrate a direct influence of grasp preparation on sensory processing of size and suggest that the hierarchical dimension of objects may be a relevant perceptual feature for grasp programming. To our knowledge, this is the first evidence that preparing different magnitudes of the same basic action has systematic effects on visual processing.

Eye-hand coordination during visuomotor adaptation: effects of hemispace and joint coordination

We previously examined adaptive changes of eye-hand coordination during learning of a visuomotor rotation. Gazes during reaching movements were initially directed to a feedback cursor in early practice, but were gradually shifted toward the target with more practice, indicating an emerging gaze anchoring behavior. This adaptive pattern reflected a functional change of gaze control from exploring the cursor-hand relation to guiding the hand to the task goal. The present study further examined the effects of hemispace and joint coordination associated with target directions on this behavior. Young adults performed center-out reaching movements to four targets with their right hand on a horizontal digitizer, while looking at a rotated visual feedback cursor on a computer monitor. To examine the effect of hemispace related to visual stimuli, two out of the four targets were located in the ipsilateral workspace relative to the hand used, the other two in the contralateral workspace. To examine the effect of hemispace related to manual actions, two among the four targets were related to reaches made in the ipsilateral workspace, the other two to reaches made in the contralateral workspace. Furthermore, to examine the effect of the complexity of joint coordination, two among the four targets were reaches involving a direct path from the start to the target involving elbow movements (simple), whereas the other two targets were reaches involving both shoulder and elbow movements (complex). The results showed that the gaze anchoring behavior gradually emerged during practice for reaches made in all target directions. The speed of this change was affected mainly by the hemispace related to manual actions, whereas the other two effects were minimal. The gaze anchoring occurred faster for the ipsilateral reaches than for the contralateral reaches; gazes prior to the gaze anchoring were also directed less at the cursor vicinity but more at the mid-area between the starting point and the target. These results suggest that ipsilateral reaches result in a better predictability of the cursor-hand relation under the visuomotor rotation, thereby prompting an earlier functional change of gaze control through practice from a reactive to a predictive control.

Effector-based attention systems

Visual processing is known to be enhanced at the end point of eye movements. Feedback within the oculomotor system has been shown to drive these alterations in visual processing. However, we do not simply view the world; we also reach out and interact using our hands. Consequently, it is not surprising that visual processing has also been shown to be altered in near-hand space. A growing body of work documents a myriad of alterations in near-hand visual processing, with little consensus on the neural underpinnings of the effect of the hand. Since movement of the eyes and hands is governed by parallel frontoparietal networks and since within the oculomotor system feedback from these motor control regions has been shown to drive enhanced visual processing at saccade end points, it is plausible that a similar feedback mechanism is at play in near-hand improvements in visual processing. Here, we compare and contrast oculomotor-driven and hand-driven changes in visual processing and provide support for the hypothesis that feedback within the reaching and grasping systems enhances visual processing near the hand in a novel way.