When Does One Decide How Heavy an Object Feels While Picking It Up?

New evidence for the sensorimotor mismatch theory of weight perception and the size-weight illusion

The size-weight illusion is a phenomenon where a smaller object is perceived heavier than an equally weighted larger object. The sensorimotor mismatch theory proposed that this illusion occurs because of a mismatch between efferent motor commands and afferent sensory feedback received when lifting large and small objects (i.e., the application of too little and too much lifting force, respectively). This explanation has been undermined by studies demonstrating a separation between the perceived weight of objects and the lifting forces that are applied on them. However, this research suffers from inconsistencies in the choice of lifting force measures reported. Therefore, we examined the contribution of sensorimotor mismatch in the perception of weight in the size-weight illusion and in non-size-weight illusion stimuli and evaluated the use of a lifting force aggregate measure comprising the four most common lifting force measures used in previous research. In doing so, the sensorimotor mismatch theory was mostly supported. In a size-weight illusion experiment, the lifting forces correlated with weight perception and, contrary to some earlier research, did not adapt over time. In a non-size-weight illusion experiment, switches between lifting light and heavy objects resulted in perceiving the weight of these objects differently compared to no switch trials, which mirrored differences in the manner participants applied forces on the objects. Additionally, we reveal that our force aggregate measure can allow for a more sensitive and objective examination of the effects of lifting forces on objects.

Size, weight, and expectations

The size-weight illusion is well-known: if two equally heavy objects differ in size, the large one feels lighter than the small one. Most explanations for this illusion assume that because the information about the relevant attribute (weight itself) is unreliable, information about an irrelevant but correlated attribute (size) is used as well. If such reasoning is correct, one would expect that the illusion can be inverted: if size information is unreliable, weight information will be used to judge size. We explored whether such a weight-size illusion exists by asking participants to lift Styrofoam balls that were coated with glow in the dark paint. The balls (2 sizes, 3 weights) were lifted using a pulley system in complete darkness at 2 distances. Participants reported the size using free magnitude estimation. The visual size information was indeed unreliable: balls that were presented at a 20% larger distance were judged 15% smaller. Nevertheless, the judgments of size were not systematically affected by the 20% weight change (differences < 0.5%). We conclude that because the weight-size illusion does not exist, the mechanism behind the size-weight illusion is specific for judging heaviness.

The role of the anterior intraparietal sulcus and the lateral occipital cortex in fingertip force scaling and weight perception during object lifting

Skillful object lifting relies on scaling fingertip forces according to the object’s weight. When no visual cues about weight are available, force planning relies on previous lifting experience. Recently, we showed that previously lifted objects also affect weight estimation, as objects are perceived to be lighter when lifted after heavy objects compared with after light ones. Here, we investigated the underlying neural mechanisms mediating these effects. We asked participants to lift objects and estimate their weight. Simultaneously, we applied transcranial magnetic stimulation (TMS) during the dynamic loading or static holding phase. Two subject groups received TMS over either the anterior intraparietal sulcus (aIPS) or the lateral occipital area (LO), known to be important nodes in object grasping and perception. We hypothesized that TMS over aIPS and LO during object lifting would alter force scaling and weight perception. Contrary to our hypothesis, we did not find effects of aIPS or LO stimulation on force planning or weight estimation caused by previous lifting experience. However, we found that TMS over both areas increased grip forces, but only when applied during dynamic loading, and decreased weight estimation, but only when applied during static holding, suggesting time-specific effects. Interestingly, our results also indicate that TMS over LO, but not aIPS, affected load force scaling specifically for heavy objects, which further indicates that load and grip forces might be controlled differently. These findings provide new insights on the interactions between brain networks mediating action and perception during object manipulation.

NEW & NOTEWORTHY This article provides new insights into the neural mechanisms underlying object lifting and perception. Using transcranial magnetic stimulation during object lifting, we show that effects of previous experience on force scaling and weight perception are not mediated by the anterior intraparietal sulcus or the lateral occipital cortex (LO). In contrast, we highlight a unique role for LO in load force scaling, suggesting different brain processes for grip and load force scaling in object manipulation.

Dynamic size-weight changes after object lifting reduce the size-weight illusion

In the size-weight illusion, the smaller object from two equally weighted objects is typically judged as being heavier. One explanation is that the mismatch between the weight expectation based on object size and actual sensory feedback influences heaviness perception. In most studies, the size of an object is perceived before its weight. We investigated whether size changes would influence weight judgement if both would be perceived simultaneously. We used virtual reality to change the size and weight of an object after lifting and asked participants to judge whether the object became lighter or heavier. We found that simultaneous size-weight changes greatly reduced the size-weight illusion to perceptual biases below discrimination thresholds. In a control experiment in which we used a standard size-weight illusion protocol with sequential lifts of small and large objects in the same virtual reality setup, we found a larger, typical perceptual bias. These results show that the size-weight illusion is smaller when size and weight information is perceived simultaneously. This provides support for the prediction mismatch theory explaining the size-weight illusion. The comparison between perceived and expected weight during the lifting phase could be a critical brain mechanism for mediating the size-weight illusion.

Low-level sensory processes play a more crucial role than high-level cognitive ones in the size-weight illusion

The size-weight illusion (SWI) pertains to the experience of perceiving the smaller of two equally weighted objects as heavier. Competing theories to explain the illusion can be generally grouped into cognitive and sensory theories, which place more importance on top-down processing of cognitive expectations and bottom-up processing of sensory information about the size and weight of objects, respectively. The current study examined the relative contribution of these two general explanations. This was done by varying the amounts of cognitive load in a dual-task and the quality of somatosensory feedback by wearing or not wearing gloves. Participants placed their hands through a curtain inside a box so they could not see the test objects. Inside the box, they were presented with either a small or large sphere of varying weights, which they explored manually without vision. Participants provided magnitude estimates about each object's weight in four experimental conditions (no-load with gloves, no-load without gloves, low-load without gloves, and high-load without gloves). The dual-task involved the visual presentation of a cross on a computer monitor that changed in both colour and orientation. With foot pedals, the participants responded to a target colour and / or orientation, which varied across conditions, while they hefted an object. Some conditions were designed to be more cognitively taxing than others (high-load > low-load > no-load conditions). The results revealed that the strength of the SWI diminished when participants wore the gloves but did not change as cognitive load increased on the dual-task. We conclude that the illusion is more influenced by bottom-up sensory than top-down cognitive processes.

Container size exerts a stronger influence than liquid volume on the perceived weight of objects

Many features of an object can influence how we predict and perceive its weight. The current study evaluated the relative contributions of sensory and conceptual processing of object features on weight perception. We employed a novel paradigm to investigate how container size and the amount of liquid inside can influence the perceived weight of bottles and the forces deployed when lifting them. Stimulus pairs always had the same mass but could vary in liquid volume (full vs half-full bottle) or size (large vs small bottle; size-weight illusion (SWI)). In Experiment 1, participants lifted the stimuli via strings, which served to isolate the influence of visual from kinaesthetic information about the size of stimuli on perception and lifting behaviour. In Experiment 2, participants lifted the stimuli via handles that were attached directly to the objects. This lifting style is more likely to include deviations from true vertical lifting, which should theoretically provide more kinaesthetic information about the size of the stimuli. Experiment 1 did not produce any weight illusion. Experiment 2 produced a weight illusion but only when container size differed. Thus, liquid volume did not influence perceived weight when container size was held constant in either experiment. Curiously, additional control experiments revealed that participants could not discriminate between the different sized bottles solely from the kinaesthetic information received from a handle-based lift, suggesting that size might be processed differently when making explicit perceptual judgements about it than when influencing weight perception. Together, these findings suggest that weight illusions are driven more strongly by the kinaesthetic processing of stimulus features than predictions arising from conceptual weight cues.