The Influence of Prior Knowledge on Perception and Action: Relationships to Autistic Traits

New evidence for the sensorimotor mismatch theory of weight perception and the size-weight illusion

The size-weight illusion is a phenomenon where a smaller object is perceived heavier than an equally weighted larger object. The sensorimotor mismatch theory proposed that this illusion occurs because of a mismatch between efferent motor commands and afferent sensory feedback received when lifting large and small objects (i.e., the application of too little and too much lifting force, respectively). This explanation has been undermined by studies demonstrating a separation between the perceived weight of objects and the lifting forces that are applied on them. However, this research suffers from inconsistencies in the choice of lifting force measures reported. Therefore, we examined the contribution of sensorimotor mismatch in the perception of weight in the size-weight illusion and in non-size-weight illusion stimuli and evaluated the use of a lifting force aggregate measure comprising the four most common lifting force measures used in previous research. In doing so, the sensorimotor mismatch theory was mostly supported. In a size-weight illusion experiment, the lifting forces correlated with weight perception and, contrary to some earlier research, did not adapt over time. In a non-size-weight illusion experiment, switches between lifting light and heavy objects resulted in perceiving the weight of these objects differently compared to no switch trials, which mirrored differences in the manner participants applied forces on the objects. Additionally, we reveal that our force aggregate measure can allow for a more sensitive and objective examination of the effects of lifting forces on objects.

Visuomotor tracking strategies in children: associations with neurodevelopmental symptoms

Children with neurodevelopmental disorders (NDDs) often display motor problems that may impact their daily lives. Studying specific motor characteristics related to spatiotemporal control may inform us about the mechanisms underlying their challenges. Fifty-eight children with varying neurodevelopmental symptoms load (median age: 5.6 years, range: 2.7-12.5 years) performed an interactive tablet-based tracking task. By investigating digit touch errors relative to the target's movement direction, we found that a load of neurodevelopmental symptoms was associated with reduced performance in the tracking of abrupt alternating directions (zigzag) and overshooting the target. In contrast, reduced performance in children without neurodevelopmental symptoms was associated with lagging behind the target. Neurodevelopmental symptom load was also associated with reduced flexibility in correcting for lateral deviations in smooth tracking (spiral). Our findings suggest that neurodevelopmental symptoms are associated with difficulties in motor regulation related to inhibitory control and reduced flexibility, impacting motor control in NDDs.

Investigating how prior knowledge influences perception and action in developmental coordination disorder

Developmental coordination disorder (DCD) is characterised by a broad spectrum of difficulties in performing motor tasks. It has recently been proposed that a specific deficit in sensorimotor prediction and feedforward planning might underpin these motoric impairments. The purpose of this study was to use a naturalistic object lifting paradigm to examine whether deficits in sensorimotor prediction might underpin the broad spectrum of difficulties individuals with DCD face when interacting with objects in their environment. We recruited 60 children with probable DCD and 61 children without DCD and measured perceptions of heaviness and fingertip force rate application when interacting with objects which varied in their apparent weight. If deficits in sensorimotor prediction do underpin the broad-ranging motor difficulties seen in DCD, we would expect to see a reduced effect of visual size cues on fingertip force rates and illusory misperceptions of object heaviness. We found no evidence of differences in any metrics of sensorimotor prediction between children with (n = 46) and without DCD (n = 61). Furthermore, there was no correlation between any metrics of sensorimotor prediction and motor performance (as assessed by the standard diagnostic movement assessment battery). Illusory misperceptions of object weight also did not appear to differ between groups. These findings suggest that issues with sensorimotor prediction are unlikely to affect the performance of simple real-world movements in those with DCD.

Testing predictive coding theories of autism spectrum disorder using models of active inference

Several competing neuro-computational theories of autism have emerged from predictive coding models of the brain. To disentangle their subtly different predictions about the nature of atypicalities in autistic perception, we performed computational modelling of two sensorimotor tasks: the predictive use of manual gripping forces during object lifting and anticipatory eye movements during a naturalistic interception task. In contrast to some accounts, we found no evidence of chronic atypicalities in the use of priors or weighting of sensory information during object lifting. Differences in prior beliefs, rates of belief updating, and the precision weighting of prediction errors were, however, observed for anticipatory eye movements. Most notably, we observed autism-related difficulties in flexibly adapting learning rates in response to environmental change (i.e., volatility). These findings suggest that atypical encoding of precision and context-sensitive adjustments provide a better explanation of autistic perception than generic attenuation of priors or persistently high precision prediction errors. Our results did not, however, support previous suggestions that autistic people perceive their environment to be persistently volatile.

Prior knowledge as a moderator between signaling and learning performance in immersive virtual reality laboratories

The purpose of this study is to investigate the effects of signaling and prior knowledge on the cognitive loads, motivations, and learning of college students in an immersive virtual reality (IVR) environment. This study applied a 2 (signaling vs. no signaling) by 2 (high vs. low prior knowledge levels) between-subjects factorial design. The results revealed that signaling directed the attention of students with low prior knowledge levels, effectively helped them select relevant information and reduced their cognitive loads, whereas signaling had no significant effect on the cognitive loads, intrinsic motivation, and learning performance of learners with high levels of prior knowledge. These results suggest that IVR environments for students with low prior knowledge levels should reduce cognitive load and improve learning, and signals in the form of text annotations and color changes are recommended for additional support. Students with high prior knowledge levels do not require additional signals to support learning; therefore, the IVR environment needs to be designed in such a way as to be tailored to the individual differences of students.

Sensory Perception in Autism: What Can We Learn?

Autism is a neurodevelopmental disorder of unknown etiology. Recently, there has been a growing interest in sensory processing in autism as a core phenotype. However, basic questions remain unanswered. Here, we review the major findings and models of perception in autism and point to methodological issues that have led to conflicting results. We show that popular models of perception in autism, such as the reduced prior hypothesis, cannot explain the many and varied findings. To resolve these issues, we point to the benefits of using rigorous psychophysical methods to study perception in autism. We advocate for perceptual models that provide a detailed explanation of behavior while also taking into account factors such as context, learning, and attention. Furthermore, we demonstrate the importance of tracking changes over the course of development to reveal the causal pathways and compensatory mechanisms. Finally, we propose a developmental perceptual narrowing account of the condition. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Loving Objects: Can Autism Explain Objectophilia?

Objectophilia (also known as objectum-sexuality) involves romantic and sexual attraction to specific objects. Objectophiles often develop deep and enduring emotional, romantic, and sexual relations with specific inanimate (concrete or abstract) objects such as trains, bridges, cars, or words. The determinants of objectophilia are poorly understood. The aim of this paper is to examine the determining factors of objectophilia. We examine four hypotheses about the determinants of objectophilia (pertaining to fetishism, synesthesia, cross-modal mental imagery, and autism) and argue that the most likely determining factors of objectophilia are the social and non-social features of autism. Future studies on the determinants of objectophilia could enhance our understanding and potentially lessen the marginalization experienced by objectophiles.

Increased influence of prior choices on perceptual decisions in autism

Autism spectrum disorder (ASD) manifests sensory and perceptual atypicalities. Recent theories suggest that these may reflect a reduced influence of prior information in ASD. Some studies have found reduced adaptation to recent sensory stimuli in ASD. However, the effects of prior stimuli and prior perceptual choices can counteract one-another. Here, we investigated this using two different tasks (in two different cohorts): (i) visual location discrimination and (ii) multisensory (visual-vestibular) heading discrimination. We fit the data using a logistic regression model to dissociate the specific effects of prior stimuli and prior choices. In both tasks, perceptual decisions were biased toward recent choices. Notably, the 'attractive' effect of prior choices was significantly larger in ASD (in both tasks and cohorts), while there was no difference in the influence of prior stimuli. These results challenge theories of reduced priors in ASD, and rather suggest an increased consistency bias for perceptual decisions in ASD.

Predictive sensorimotor control in autism

Autism spectrum disorder has been characterized by atypicalities in how predictions and sensory information are processed in the brain. To shed light on this relationship in the context of sensorimotor control, we assessed prediction-related measures of cognition, perception, gaze and motor functioning in a large general population (n = 92; Experiment 1) and in clinically diagnosed autistic participants (n = 29; Experiment 2). In both experiments perception and action were strongly driven by prior expectations of object weight, with large items typically predicted to weigh more than equally-weighted smaller ones. Interestingly, these predictive action models were used comparably at a sensorimotor level in both autistic and neurotypical individuals with varying levels of autistic-like traits. Specifically, initial fingertip force profiles and resulting action kinematics were both scaled according to participants' pre-lift heaviness estimates, and generic visual sampling behaviours were notably consistent across groups. These results suggest that the weighting of prior information is not chronically underweighted in autism, as proposed by simple Bayesian accounts of the disorder. Instead, our results cautiously implicate context-sensitive processing mechanisms, such as precision modulation and hierarchical volatility inference. Together, these findings present novel implications for both future scientific investigations and the autism community.

Examining Whether Semantic Cues Can Affect Felt Heaviness When Lifting Novel Objects

It is well established that manipulations of low-level stimulus properties unrelated to mass can impact perception of heaviness, the most famous example being the size-weight illusion whereby small objects feel heavier than equally-weighted larger objects. Interestingly, manipulations of high-level cues such as material have also induced weight illusions, highlighting that cognitive expectations alone are enough to create illusory weight differences. Less is known, however, about what type of cognitive expectations can influence perception of heaviness. As labels are often used to signify the heaviness of objects, this study examined whether semantic cues could induce a novel weight illusion. Participants lifted equally-sized and equally-weighted sets of objects labelled as ‘light’ and ‘heavy’ and reported their perceived heaviness both prior to and after lifting. Fingertip forces were also measured to understand how semantic cues may influence sensorimotor prediction. The labels clearly affected pre-lift-off expectations of heaviness. By contrast, we found no effect of these labels on the perceived heaviness of objects, nor on the forces used to grip and lift them on early trials. In other words, we find no evidence that semantic cues affect perception or action enough to induce a novel weight illusion. These findings suggest that the explicit expectations created by the labels did not dominate the implicit expectations created by the equal sizes of the objects, highlighting the segregated nature of cognitive expectations and their variable influences on perception and action.

A meta-analysis of the size-weight and material-weight illusions

The current study comprises the first systematic meta-analysis of weight illusions. We obtained descriptive data from studies in which subjective heaviness estimates were made for pairs or groups of objects that had the same mass and different volumes (size-weight illusion; SWI) or different apparent material properties (material-weight illusion; MWI). Using these data, we calculated mean effect sizes to represent illusion strength. Other study details, including stimulus mass, volume, density, and degree of visual and somatosensory access to the stimuli were also recorded to quantify the contribution of these variables to effect sizes for the SWI. The results indicate that the SWI has a larger mean effect size than the MWI and that the former is consistent in strength when information about stimulus size is gained through somatosensory channels, regardless of visual access. The SWI is weaker when only the visual system provides size information. Effect sizes for the SWI were larger when there was a greater difference in volume across the stimuli. There was also a positive correlation between SWI strength and the difference in physical density across the different experimental stimuli, even after controlling for volume differences. Together, we argue that these findings provide support for theories of weight illusions that are based on conceptual expectancies as well as those that are based on bottom-up processing of physical density. We further propose that these processes, which have been considered dichotomously in the past, may not be mutually exclusive from each other and could both contribute to our perception of weight when we handle objects in everyday life.

Exploring how material cues drive sensorimotor prediction across different levels of autistic-like traits

Recent research proposes that sensorimotor difficulties, such as those experienced by many autistic people, may arise from atypicalities in prediction. Accordingly, we examined the relationship between non-clinical autistic-like traits and sensorimotor prediction in the material-weight illusion, where prior expectations derived from material cues typically bias one’s perception and action. Specifically, prediction-related tendencies in perception of weight, gaze patterns, and lifting actions were probed using a combination of self-report, eye-tracking, motion-capture, and force-based measures. No prediction-related associations between autistic-like traits and sensorimotor control emerged for any of these variables. Follow-up analyses, however, revealed that greater autistic-like traits were correlated with reduced adaptation of gaze with changes in environmental uncertainty. These findings challenge proposals of gross predictive atypicalities in autistic people, but suggest that the dynamic integration of prior information and environmental statistics may be related to autistic-like traits. Further research into this relationship is warranted in autistic populations, to assist the development of future movement-based coaching methods.

Preserved Object Weight Processing after Bilateral Lateral Occipital Complex Lesions

Object interaction requires knowledge of the weight of an object, as well as its shape. The lateral occipital complex (LOC), an area within the ventral visual pathway, is well known to be critically involved in processing visual shape information. Recently, however, LOC has also been implicated in coding object weight before grasping-a result that is surprising because weight is a nonvisual object property that is more relevant for motor interaction than visual perception. Here, we examined the causal role of LOC in perceiving heaviness and in determining appropriate fingertip forces during object lifting. We studied perceptions of heaviness and lifting behavior in a neuropsychological patient (M.C.) who has large bilateral occipitotemporal lesions that include LOC. We compared the patient's performance to a group of 18 neurologically healthy age-matched controls. Participants were asked to lift and report the perceived heaviness of a set of equally weighted spherical objects of various sizes-stimuli which typically induce the size-weight illusion, in which the smaller objects feel heavier than the larger objects despite having identical mass. Despite her ventral stream lesions, M.C. experienced a robust size-weight illusion induced by visual cues to object volume, and the magnitude of the illusion in M.C. was comparable to age-matched controls. Similarly, M.C. evinced predictive fingertip force scaling to visual size cues during her initial lifts of the objects that were well within the normal range. These single-case neuropsychological findings suggest that LOC is unlikely to play a causal role in computing object weight.

How Prior Expectations Influence Older Adults’ Perception and Action During Object Interaction

The apparent size of an object can influence how we interact with and perceive the weight of objects in our environment. Little is known, however, about how this cue affects behaviour across the lifespan. Here, in the context of the size–weight illusion, we examined how visual size cues influenced the predictive application of fingertip forces and perceptions of heaviness in a group of older participants. We found that our older sample experienced a robust size–weight illusion, which did not differ from that experienced by younger participants. Older and young participants also experienced a real weight difference to a similar degree. By contrast, compared to younger participants our older group showed no evidence that size cues influenced the way they initially gripped and lifted the objects. These results highlight a unique dissociation between how perception and action diverge across the lifespan, and suggest that deficits in the ability to use prediction to guide actions might underpin some of the manual interaction difficulties experienced by the older adults.

Influence of Size-Weight Illusion on Usability in Haptic Human-Robot Collaboration

Collaborative power amplifying robots are accepted as one solution to overcome flexibility and ergonomic issues in future work and life scenarios. The handling of various sized and weighted objects in heterogeneous environments pose a particular challenge to the often applied admittance control. Haptic illusions, especially the Size-Weight Illusion (SWI), where the smaller of two equally weighted objects is perceived to be heavier, can have malicious, disturbing, or to some extent useful influence on system stability and usability. A within-subjects experiment was conducted with 40 participants and three within-factors (size, weight, and movement type), to investigate the occurrence and influence of SWI in bimanual fast-imprecise and slow-precise planar manipulation tasks. The illusion was replicated and an influence on usability was found. Further, different control strategies according to object size and mass (static, compensatory, and mismatch) were analyzed and did not show significant effects on task performance. It appears that either no change in assistance or a change according to object size is advisable.

Visual information about object size and object position are retained differently in the visual brain: Evidence from grasping studies

Many experiments have examined how the visual information used for action control is represented in our brain, and whether or not visually-guided and memory-guided hand movements rely on dissociable visual representations that are processed in different brain areas (dorsal vs. ventral). However, little is known about how these representations decay over longer time periods and whether or not different visual properties are retained in a similar fashion. In three experiments we investigated how information about object size and object position affect grasping as visual memory demands increase. We found that position information decayed rapidly with increasing delays between viewing the object and initiating subsequent actions - impacting both the accuracy of the transport component (lower end-point accuracy) and the grasp component (larger grip apertures) of the movement. In contrast, grip apertures and fingertip forces remained well-adjusted to target size in conditions in which positional information was either irrelevant or provided, regardless of delay, indicating that object size is encoded in a more stable manner than object position. The findings provide evidence that different grasp-relevant properties are encoded differently by the visual system. Furthermore, we argue that caution is required when making inferences about object size representations based on alterations in the grip component as these variations are confounded with the accuracy with which object position is represented. Instead fingertip forces seem to provide a reliable and confound-free measure to assess internal size estimations in conditions of increased visual uncertainty.