Fractal fluctuations in quiet standing predict the use of mechanical information for haptic perception

How bipedalism shapes humans' actions with hand tools

The task for an embodied cognitive understanding of humans' actions with tools is to elucidate how the human body, as a whole, supports the perception of affordances and dexterous action with objects in relation to other objects. Here, we focus on the relationship between humans' actions with handheld tools and bipedal posture. Posture plays a pivotal role in shaping animals' perception and action dynamics. While humans stand and locomote bipedally, other primates predominantly employ quadrupedal postures and locomotion, relying on both hands and feet to support the body. Drawing upon evidence from evolutionary biology, developmental psychology and performance studies, we elucidate the influence of bipedalism on our actions with objects and on our proficiency in using tools. We use the metaphor of cascades to capture the dynamic, nonlinear transformations in morphology and behaviour associated with posture and the use of tools across evolutionary and developmental timescales. Recent work illustrates the promise of multifractal cascade analysis to reveal nonlinear, cross-scale interactions across the entire body in real-time, supporting the perception of affordances for actions with tools. Cascade analysis enriches our comprehension of real-time performance and facilitates exploration of the relationships among whole-body coordination, individual development, and evolutionary processes.This article is part of the theme issue 'Minds in movement: embodied cognition in the age of artificial intelligence'.

Sitting vs. standing: an urgent need to rebalance our world

During their activities of daily living, humans run, walk, stand, sit and lie down. Recent changes in our environment have favored sedentary behavior over more physically active behavior to such a degree that our health is in danger. Here, we sought to address the problem of excessive time spent seated from various theoretical viewpoints, including postural control, human factors engineering, human history and health psychology. If nothing is done now, the high prevalence of sitting will continue to increase. We make a case for the standing position by demonstrating that spending more time upright can mitigate the physiological and psychological problems associated with excessive sitting without lowering task performance and productivity. The psychological literature even highlights potential benefits of performing certain tasks in the standing position. We propose a number of recommendations on spending more time (but not too much) in the standing position and on more active, nonambulatory behaviors. There is a need to inform people about (i) harmful consequences of excessive sitting and (ii) benefits of spending more time performing active, nonambulatory behaviors. One clear benefit is to reduce detrimental health consequences of excessive sitting and to provide potential additional benefits in terms of productivity and performance.

Benefits associated with the standing position during visual search tasks

The literature on postural control highlights that task performance should be worse in challenging dual tasks than in a single task, because the brain has limited attentional resources. Instead, in the context of visual tasks, we assumed that (i) performance in a visual search task should be better when standing than when sitting and (ii) when standing, postural control should be better when searching than performing the control task. 32 and 16 young adults participated in studies 1 and 2, respectively. They performed three visual tasks (searching to locate targets, free-viewing and fixating a stationary cross) displayed in small images (visual angle: 22°) either when standing or when sitting. Task performance, eye, head, upper back, lower back and center of pressure displacements were recorded. In both studies, task performance in searching was as good (and clearly not worse) when standing as when sitting. Sway magnitude was smaller during the search task (vs. other tasks) when standing but not when sitting. Hence, only when standing, postural control was adapted to perform the challenging search task. When exploring images, and especially so in the search task, participants rotated their head instead of their eyes as if they used an eye-centered strategy. Remarkably in Study 2, head rotation was greater when sitting than when standing. Overall, we consider that variability in postural control was not detrimental but instead useful to facilitate visual task performance. When sitting, this variability may be lacking, thus requiring compensatory movements.

Physiological measurements in social acceptance of self driving technologies

The goal of the present study is to examine the cognitive/affective physiological correlates of passenger travel experience in autonomously driven transportation systems. We investigated the social acceptance and cognitive aspects of self-driving technology by measuring physiological responses in real-world experimental settings using eye-tracking and EEG measures simultaneously on 38 volunteers. A typical test run included human-driven (Human) and Autonomous conditions in the same vehicle, in a safe environment. In the spectrum analysis of the eye-tracking data we found significant differences in the complex patterns of eye movements: the structure of movements of different magnitudes were less variable in the Autonomous drive condition. EEG data revealed less positive affectivity in the Autonomous condition compared to the human-driven condition while arousal did not differ between the two conditions. These preliminary findings reinforced our initial hypothesis that passenger experience in human and machine navigated conditions entail different physiological and psychological correlates, and those differences are accessible using state of the art in-world measurements. These useful dimensions of passenger experience may serve as a source of information both for the improvement and design of self-navigating technology and for market-related concerns.

Turing's cascade instability supports the coordination of the mind, brain, and behavior

Turing inspired a computer metaphor of the mind and brain that has been handy and has spawned decades of empirical investigation, but he did much more and offered behavioral and cognitive sciences another metaphor-that of the cascade. The time has come to confront Turing's cascading instability, which suggests a geometrical framework driven by power laws and can be studied using multifractal formalism and multiscale probability density function analysis. Here, we review a rapidly growing body of scientific investigations revealing signatures of cascade instability and their consequences for a perceiving, acting, and thinking organism. We review work related to executive functioning (planning to act), postural control (bodily poise for turning plans into action), and effortful perception (action to gather information in a single modality and action to blend multimodal information). We also review findings on neuronal avalanches in the brain, specifically about neural participation in body-wide cascades. Turing's cascade instability blends the mind, brain, and behavior across space and time scales and provides an alternative to the dominant computer metaphor.

Fast Hand Movements Unveil Multifractal Roots of Adaptation in the Visuomotor Cognitive System

Beyond apparent simplicity, visuomotor dexterity actually requires the coordination of multiple interactions across a complex system that links the brain, the body and the environment. Recent research suggests that a better understanding of how perceptive, cognitive and motor activities cohere to form executive control could be gained from multifractal formalisms applied to movement behavior. Rather than a central executive "talking" to encapsuled components, the multifractal intuition suggests that eye-hand coordination arises from multiplicative cascade dynamics across temporal scales of activity within the whole system, which is reflected in movement time series. Here we examined hand movements of sport students performing a visuomotor task in virtual reality (VR). The task involved hitting spatially arranged targets that lit up on a virtual board under critical time pressure. Three conditions were compared where the visual search field changed: whole board (Standard), half-board lower view field (LVF) and upper view field (UVF). Densely sampled (90 Hz) time series of hand motions captured by VR controllers were analyzed by a focus-based multifractal detrended fluctuation analysis (DFA). Multiplicative rather than additive interactions across temporal scales were evidenced by testing comparatively phase-randomized surrogates of experimental series, which confirmed nonlinear processes. As main results, it was demonstrated that: (i) the degree of multifractality in hand motion behavior was minimal in LVF, a familiar visual search field where subjects correlatively reached their best visuomotor response times (RTs); (ii) multifractality increased in the less familiar UVF, but interestingly only for the non-dominant hand; and (iii) multifractality increased further in Standard, for both hands indifferently; in Standard, the maximal expansion of the visual search field imposed the highest demand as evidenced by the worst visuomotor RTs. Our observations advocate for visuomotor dexterity best described by multiplicative cascades dynamics and a system-wide distributed control rather than a central executive. More importantly, multifractal metrics obtained from hand movements behavior, beyond the confines of the brain, offer a window on the fine organization of control architecture, with high sensitivity to hand-related control behavior under specific constraints. Appealing applications may be found in movement learning/rehabilitation, e.g., in hemineglect people, stroke patients, maturing children or athletes.

Heavy-tailed distributions in haptic perception of wielded rods

Humans identify properties (e.g., the length or weight) of objects through touch using somatosensory perceptions in the limbs. Humans identify these properties by manipulating an object to access its inertial qualities. However, there is little work evidencing a unifying pattern of movements humans use to access these inertial properties. The current study examined if participants' wielding movements followed a systematic distribution-specifically, a Lévy-like distribution that is characterized by heavy-tails and is often seen in efficient foraging behavior. Participants wielded rods they could not see and were tasked to identify whether the rod they were wielding was the longer or shorter of two rods. While participants wielded the rod, the rod's motion was captured. Results demonstrate that the sampling of angular accelerations produced heavy-tailed distributions. Since angular acceleration has a distinct physical-mathematical relationship with inertia, this finding is consistent with the interpretation that the haptic subsystems are sensitive to the inertial properties of an object. Angular acceleration from wielding motions appear to follow a similar distribution as optimal foraging strategies-perhaps it is the case that humans are foraging for information about the inertia of an object through changes in angular acceleration and wielding movements.

Multifractal roots of suprapostural dexterity

Visually guided postural control emerges in response to task constraints. Task constraints generate physiological fluctuations that foster the exploration of available sensory information at many scales. Temporally correlated fluctuations quantified using fractal and multifractal metrics have been shown to carry perceptual information across the body. The risk of temporally correlated fluctuations is that stable sway appears to depend on a healthy balance of standard deviation (SD): too much or too little SD entails destabilization of posture. This study presses on the visual guidance of posture by prompting participants to quietly stand and fixate at distances within, less than, and beyond comfortable viewing distance. Manipulations of the visual precision demands associated with fixating nearer and farther than comfortable viewing distance reveals an adaptive relationship between SD and temporal correlations in postural fluctuations. Changing the viewing distance of the fixation target shows that increases in temporal correlations and SD predict subsequent reductions in each other. These findings indicate that the balance of SD within stable bounds may depend on a tendency for temporal correlations to self-correct across time. Notably, these relationships became stronger with greater distance from the most comfortable viewing and reaching distance, suggesting that this self-correcting relationship allows the visual layout to press the postural system into a poise for engaging with objects and events. Incorporating multifractal analysis showed that all effects attributable to monofractal evidence were better attributed to multifractal evidence of nonlinear interactions across scales. These results offer a glimpse of how current nonlinear dynamical models of self-correction may play out in biological goal-oriented behavior. We interpret these findings as part of the growing evidence that multifractal nonlinearity is a modeling strategy that resonates strongly with ecological-psychological approaches to perception and action.

Proprioceptive afferents differentially contribute to effortful perception of object heaviness and length

When humans handle a tool, such as a tennis racket or hammer, for the first time, they often wield it to determine its inertial properties. The mechanisms that contribute to perception of inertial properties are not fully understood. The present study's goal was to investigate how proprioceptive afferents contribute to effortful perception of heaviness and length of a manually wielded object in the absence of vision. Blindfolded participants manually wielded specially designed objects with different mass, the static moment, and the moment of inertia at different wrist angles and angular kinematics. These manipulations elicited different tonic and rhythmic activity levels in the muscle spindles of the wrist, allowing us to relate differences in muscle activity to perceptual judgments of heaviness and length. Perception of heaviness and length depended on an object's static moment and the moment of inertia, respectively. Manipulations of wrist angle and angular kinematics affected perceived heaviness and length in distinct ways. Ulnar deviation resulted in an object being perceived heavier but shorter. Compared to static holding, wielding the object resulted in it being perceived heavier but wielding did not affect perceived length. These results suggest that proprioceptive afferents differentially contribute to effortful perception of object heaviness and length. Critically, the role of afferent is specific to the mechanical variable used to derive a given object property. These findings open a new possibility of studies on the link between physiology, and different mechanical variables picked up by the perceptual system.

Multifractality in postural sway supports quiet eye training in aiming tasks: A study of golf putting

The 'quiet eye' (QE) approach to visually-guided aiming behavior invests fully in perceptual information's potential to organize coordinated action. Sports psychologists refer to QE as the stillness of the eyes during aiming tasks and increasingly into self- and externally-paced tasks. Amidst the 'noisy' fluctuations of the athlete's body, quiet eyes might leave fewer saccadic interruptions to the coupling between postural sway and optic flow. Postural sway exhibits fluctuations whose multifractal structure serves as a robust predictor of visual and haptic perceptual responses. Postural sway generates optic flow centered on an individual's eye height. We predicted that perturbing the eye height by attaching wooden blocks below the feet would perturb the putting more so in QE-trained participants than participants trained technically. We also predicted that QE's efficacy and responses to perturbation would depend on multifractality in postural sway. Specifically, we predicted that less multifractality would predict more adaptive responses to the perturbation and higher putting accuracy. Results showed that lower multifractality led to more accurate putts, and the perturbation of eye height led to less accurate putts, particularly for QE-trained participants. Models of radial error (i.e., the distance between the ball's final position and the hole) indicated that lower estimates of multifractality due to nonlinearity coincided with a more adaptive response to the perturbation. These results suggest that reduced multifractality may act in a context-sensitive manner to restrain motoric degrees of freedom to achieve the task goal.

Complexity of postural sway affects affordance perception of reachability in virtual reality

Visual perception of whether an object is within reach while standing in different postures was investigated. Participants viewed a three-dimensional (3D) virtual reality (VR) environment with a stimulus object (red ball) placed at different egocentric distances. Participants reported whether the object was reachable while in a standard pose as well as in two separate active balance poses (yoga tree pose and toe-to-heel pose). Feedback on accuracy was not provided, and participants were not allowed to attempt to reach. Response time, affordance judgements (reachable and not reachable), and head movements were recorded on each trial. Consistent with recent research on perception of reaching ability, the perceived boundary occurred at approximately 120% of arm length, indicating overestimation of perceived reaching ability. Response times increased with distance, and were shortest for the most difficult pose-the yoga tree pose. Head movement amplitude increased with increases in balance demands. Unexpectedly, the coefficient of variation was comparable in the two active balance poses, and was more extreme in the standard control pose for the shortest and longest distances. More complex descriptors of postural sway (i.e., effort-to-compress) were predictive of perception while in the tree pose and the toe-to-heel pose, as compared with control stance. This demonstrates that standard measures of central tendency are not sufficient for describing multiscale interactions of postural dynamics in functional tasks.

Multifractal signatures of perceptual processing on anatomical sleeves of the human body

Research into haptic perception typically concentrates on mechanoreceptors and their supporting neuronal processes. This focus risks ignoring crucial aspects of active perception. For instance, bodily movements influence the information available to mechanoreceptors, entailing that movement facilitates haptic perception. Effortful manual wielding of an object prompts feedback loops at multiple spatio-temporal scales, rippling outwards from the wielding hand to the feet, maintaining an upright posture and interweaving to produce a nonlinear web of fluctuations throughout the body. Here, we investigated whether and how this bodywide nonlinearity engenders a flow of multifractal fluctuations that could support perception of object properties via dynamic touch. Blindfolded participants manually wielded weighted dowels and reported judgements of heaviness and length. Mechanical fluctuations on the anatomical sleeves (i.e. peripheries of the body), from hand to the upper body, as well as to the postural centre of pressure, showed evidence of multifractality arising from nonlinear temporal correlations across scales. The modelling of impulse-response functions obtained from vector autoregressive analysis revealed that distinct sets of pairwise exchanges of multifractal fluctuations entailed accuracy in heaviness and length judgements. These results suggest that the accuracy of perception via dynamic touch hinges on specific flowing patterns of multifractal fluctuations that people wear on their anatomical sleeves.

Bodywide fluctuations support manual exploration: Fractal fluctuations in posture predict perception of heaviness and length via effortful touch by the hand

The human haptic perceptual system respects a bodywide organization that responds to local stimulation through full-bodied coordination of nested tensions and compressions across multiple nonoverlapping scales. Under such an organization, the suprapostural task of manually hefting objects to perceive their heaviness and length should depend on roots extending into the postural control for maintaining upright balance on the ground surface. Postural sway of the whole body should thus carry signatures predicting what the hand can extract by hefting an object. We found that fractal fluctuations in Euclidean displacement in the participants' center of pressure (CoP) contributed to perceptual judgments by moderating how the participants' hand picked up the informational variable of the moment of inertia. The role of fractality in CoP displacement in supporting heaviness and length judgments increased across trials, indicating that the participants progressively implicate their fractal scaling in their perception of heaviness and length. Traditionally, we had to measure fractality in hand movements to predict perceptual judgments by manual hefting. However, our findings suggest that we can observe what is happening at hand in the relatively distant-from-hand measure of CoP. Our findings reveal the complex relationship through which posture supports manual exploration, entailing perception of the intended properties of hefted objects (heaviness or length) putatively through the redistribution of forces throughout the body.

Fractal fluctuations in exploratory movements predict differences in dynamic touch capabilities between children with Attention-Deficit Hyperactivity Disorder and typical development

Children with Attention-Deficit Hyperactivity Disorder (ADHD) struggle to perform a host of daily activities. Many of these involve forceful interaction with objects and thus implicate dynamic touch. Therefore, deficits in dynamic touch could underlie functional difficulties presented by ADHD children. We investigated whether performance on a dynamic touch task (length perception by wielding) differ between children with ADHD and age-matched controls. We further examined whether this difference could be explained by fractal temporal correlations (wielding dynamics). Forty-two children (ADHD: 21; typically developing: 21) wielded unseen wooden rods and reported their perceived length in the form of magnitude productions. The rods varied in the magnitude of the first principal moment of inertia (I₁). Three-dimensional displacements of hand and rod positions were submitted to Detrended Fluctuation Analysis to estimate trial-by-trial temporal correlations. Children with ADHD reported shorter length for rods with higher I₁ than their typically developing peers, indicative of reduced sensitivity to mechanical information supporting dynamic touch. Importantly, temporal correlations in wielding dynamics moderated children’s usage of I_1. This finding points to a role of exploratory movements in perceptual deficits presented by children with ADHD and, thus, should be considered a new potential target for interventions.

Switching between reading tasks leads to phase-transitions in reading times in L1 and L2 readers

Reading research uses different tasks to investigate different levels of the reading process, such as word recognition, syntactic parsing, or semantic integration. It seems to be tacitly assumed that the underlying cognitive process that constitute reading are stable across those tasks. However, nothing is known about what happens when readers switch from one reading task to another. The stability assumptions of the reading process suggest that the cognitive system resolves this switching between two tasks quickly. Here, we present an alternative language-game hypothesis (LGH) of reading that begins by treating reading as a softly-assembled process and that assumes, instead of stability, context-sensitive flexibility of the reading process. LGH predicts that switching between two reading tasks leads to longer lasting phase-transition like patterns in the reading process. Using the nonlinear-dynamical tool of recurrence quantification analysis, we test these predictions by examining series of individual word reading times in self-paced reading tasks where native (L1) and second language readers (L2) transition between random word and ordered text reading tasks. We find consistent evidence for phase-transitions in the reading times when readers switch from ordered text to random-word reading, but we find mixed evidence when readers transition from random-word to ordered-text reading. In the latter case, L2 readers show moderately stronger signs for phase-transitions compared to L1 readers, suggesting that familiarity with a language influences whether and how such transitions occur. The results provide evidence for LGH and suggest that the cognitive processes underlying reading are not fully stable across tasks but exhibit soft-assembly in the interaction between task and reader characteristics.

Multifractal evidence of nonlinear interactions stabilizing posture for phasmids in windy conditions: A reanalysis of insect postural-sway data

The present work is a reanalysis of prior work documenting postural sway in phasmids (i.e., “stick insects”) [1]. The prior work pursued the possibility that postural sway was an evolutionary adaptation supporting motion camouflage to avoid the attention of predators. For instance, swaying along with leaves blown by the wind might reduce the likelihood of standing out to a predator. The present work addresses the alternative—but by no means conflicting and perhaps more explanatory—proposal that phasmid postural sway carries evidence of the tensegrity-like structures allowing postural stabilization under wind-like stimulation. Tensegrity structures are prestressed architectures embodying nonlinear interactions across scales of space and time that provide context-sensitive responses faster than neural tissue can support. Multifractal modeling of the postural-displacement series initially recorded in [1] offers a metric equally effective for quantifying complexity of phasmid postural sway under wind stimulation as for quantifying complexity of human postural sway [2–7]. Furthermore, multifractal modeling offers a means to demonstrate empirically the nonlinear interactions across space and time scales in body-wide coordination that tensegrity-based hypotheses predict. Specifically, multifractal modeling allows diagnosing the strength and direction of nonlinear interactions across time scale as the difference between multifractal estimates for the original postural-displacement series and for a sample of best-fitting linear models of the series. The reduction of postural sway directly following the application of wind stimulus appears as a significant decrease in the multifractal structure for original postural-displacement series as compared to best-fitting linear models of those series. This decrease indicates the capacity for nonlinear interactions across time scale to constrict variability, which is an aspect of nonlinear dynamics often overshadowed by the possibility that nonlinearity can produce more variability. This work offers the longer-range opportunity that multifractal modeling could provide a common language within which to coordinate behavioral sciences across a wide range of species.

Non-visually-guided distance perception depends on matching torso fluctuations between training and test

Blindwalking to replicate an instructed distance requires various sensory signals. Recent evidence in movement science across many organisms suggests that multifractal organization of connective tissue supports the use of these signals. Multifractal structure is a multiplicity of power laws defining distribution of proportion across many time scales that helps predict judgments of the objects' length. Present work tests whether the multifractal structure in postural accelerometry during blindwalking predicts blindwalking distance replications. Ten undergraduate student participants each completed 20 trials of distance-perception each comprising two laps. On each Lap 1, experimenters led participants to walk on any of five prescribed distances, randomly assigning half to walk Lap 1 with eyes open and another half to walked Lap 1 with eyes closed. On Lap 2, all participants walked with eyes closed to replicate instructed distances from Lap 1. We collected postural accelerometry from the torso during each lap. Regression modeling showed that multifractality of postural accelerometry on both Lap 1 and Lap 2 contributed significantly to Lap-2 blindwalking responses. According to this model, more accurate Lap-2 replications of Lap-1 distance came from eyes-closed participants whose posture had comparable multifractality on both laps. Multifractality provides insights into the sequence of exploratory behaviors for blindwalking responses to distance perception.

Multifractal foundations of visually-guided aiming and adaptation to prismatic perturbation

Visually-guided action of tossing to a target allows examining coordination between mechanical information for maintaining posture while throwing and visual information for aiming. Previous research indicates that relationships between visual and mechanical information persist in tossing behavior long enough for mechanical cues to prompt recall of past visual impressions. Multifractal analysis might model the long-term coordinations among movement components as visual information changes. We asked 32 adult participants (6 female, 25 male, one not conforming to gender binary; aged M=19.77, SD=0.88) to complete an aimed-tossing task in three blocks of ten trials each. Block 1 oriented participants to the task. Participants wore right-shifting goggles in Block 2 and removed them for Block 3. Motion-capture suits collected movement data of the head, hips, and hands. According to regression modeling of tossing performance, multifractality at hand and at hips together supported use of visual information, and adaptation to wearing/removing of goggles depended on multifractality across the hips, head, and hands. Vector-autoregression modeling shows that hip multifractality promoted head multifractality but that hand fluctuations drew on head and hip multifractality. We propose that multifractality could be an information substrate whose spread across the movements systems supports the perceptual coordination for the development of dexterity.

Postural sway in men and women during nauseogenic motion of the illuminated environment

We exposed standing men and women to motion relative to the illuminated environment in a moving room. During room motion, we measured the kinematics of standing body sway. Participants were instructed to discontinue immediately if they experienced any symptoms of motion sickness, however mild. For this reason, our analysis of body sway included only movement before the onset of motion sickness. We analyzed the spatial magnitude of postural sway in terms of the positional variability and mean velocity of the center of pressure. We analyzed the multifractality of postural sway in terms of the width of the multifractal spectrum and the degree of multiplicativity of center of pressure positions. Results revealed that postural sway differed between participants who later reported motion sickness and those who did not, replicating previous effects. In a novel effect, postural responses to motion of the illuminated environment differed between women and men. In addition, we identified statistically significant interactions that involved both Sex and motion sickness status. Effects were observed separately in the spatial magnitude and multifractality of sway. The results were consistent with the postural instability theory of motion sickness (Riccio and Stoffregen in Ecol Psychol 3:195-240, 1991) and suggest that Sex differences in motion sickness may be related to Sex differences in the control and stabilization of bodily activity.