The Senses Considered as One Perceptual System

How bipedalism shapes humans' actions with hand tools

The task for an embodied cognitive understanding of humans' actions with tools is to elucidate how the human body, as a whole, supports the perception of affordances and dexterous action with objects in relation to other objects. Here, we focus on the relationship between humans' actions with handheld tools and bipedal posture. Posture plays a pivotal role in shaping animals' perception and action dynamics. While humans stand and locomote bipedally, other primates predominantly employ quadrupedal postures and locomotion, relying on both hands and feet to support the body. Drawing upon evidence from evolutionary biology, developmental psychology and performance studies, we elucidate the influence of bipedalism on our actions with objects and on our proficiency in using tools. We use the metaphor of cascades to capture the dynamic, nonlinear transformations in morphology and behaviour associated with posture and the use of tools across evolutionary and developmental timescales. Recent work illustrates the promise of multifractal cascade analysis to reveal nonlinear, cross-scale interactions across the entire body in real-time, supporting the perception of affordances for actions with tools. Cascade analysis enriches our comprehension of real-time performance and facilitates exploration of the relationships among whole-body coordination, individual development, and evolutionary processes.This article is part of the theme issue 'Minds in movement: embodied cognition in the age of artificial intelligence'.

What, if anything, can be considered an amodal sensory dimension?

The term 'amodal' is a key topic in several different research fields across experimental psychology and cognitive neuroscience, including in the areas of developmental and perception science. However, despite being regularly used in the literature, the term means something different to the researchers working in the different contexts. Many developmental scientists conceive of the term as referring to those perceptual qualities, such as, for example, the size and shape of an object, that can be picked up by multiple senses (e.g., vision and touch potentially providing information relevant to the same physical stimulus/property). However, the amodal label is also widely used in the case of those qualities that are not directly sensory, such as, for example, numerosity, rhythm, synchrony, etc. Cognitive neuroscientists, by contrast, tend to use the term amodal to refer to those central cognitive processes and brain areas that do not appear to be preferentially responsive to a particular sensory modality or to those symbolic or formal representations that essentially lack any modality and that are assumed to play a role in the higher processing of sensory information. Finally, perception scientists sometimes refer to the phenomenon of 'amodal completion', referring to the spontaneous completion of perceptual information that is missing when occluded objects are presented to observers. In this paper, we review the various different ways in which the term 'amodal' has been used in the literature and the evidence supporting the various uses of the term. Morever, we highlight some of the various properties that have been suggested to be 'amodal' over the years. Then, we try to address some of the questions that arise from the reviewed evidence, such as: Do different uses of the 'term' refer to different domains, for example, sensory information, perceptual processes, or perceptual representations? Are there any commonalities among the different uses of the term? To what extent is research on cross-modal associations (or correspondences) related to, or can shed light on, amodality? And how is the notion of amodal related to multisensory integration? Based on the reviewed evidence, it is argued that there is, as yet, no convincing empirical evidence to support the claim that amodal sensory qualities exist. We thus suggest that use of the term amodal would be more meaningful with respect to abstract cognition rather than necessarily sensory perception, the latter being more adequately explained/understood in terms of highly redundant cross-modal correspondences.

Higher order affordances

Affordances are opportunities for action for a given animal (or animals) in a given environment or situation. The concept of affordance has been widely adopted in the behavioral sciences, but important questions remain. We propose a new way of understanding the nature of affordances; in particular, how affordances are related to one another. We claim that many - perhaps most - affordances emerge from non-additive relations among other affordances, such that some affordances are of higher order relative to other affordances. That is, we propose that affordances form a continuous category of perceiveables that differ only in whether and how they relate to other affordances. We argue that: (1) opportunities for behaviors of all kinds can be described as affordances, (2) some affordances emerge from relations between animal and environment, whereas most affordances emerge from relations between other affordances, and (3) all affordances lawfully structure ambient energy arrays and, therefore, can be perceived directly. Our concept of higher order affordances provides a general account of behavioral phenomena that traditionally have been interpreted in terms of cognitive processes (e.g., remembering or imagining) as well as behavioral phenomena that have traditionally been interpreted in terms of cultural rules, such as conventions, or customs.

Conversational facial signals combine into compositional meanings that change the interpretation of speaker intentions

Human language is extremely versatile, combining a limited set of signals in an unlimited number of ways. However, it is unknown whether conversational visual signals feed into the composite utterances with which speakers communicate their intentions. We assessed whether different combinations of visual signals lead to different intent interpretations of the same spoken utterance. Participants viewed a virtual avatar uttering spoken questions while producing single visual signals (i.e., head turn, head tilt, eyebrow raise) or combinations of these signals. After each video, participants classified the communicative intention behind the question. We found that composite utterances combining several visual signals conveyed different meaning compared to utterances accompanied by the single visual signals. However, responses to combinations of signals were more similar to the responses to related, rather than unrelated, individual signals, indicating a consistent influence of the individual visual signals on the whole. This study therefore provides first evidence for compositional, non-additive (i.e., Gestalt-like) perception of multimodal language.

Humans gradually integrate sudden gain or loss of visual information into spatial orientation perception

Introduction

Vestibular and visual information is used in determining spatial orientation. Existing computational models of orientation perception focus on the integration of visual and vestibular orientation information when both are available. It is well-known, and computational models capture, differences in spatial orientation perception with visual information or without (i.e., in the dark). For example, during earth vertical yaw rotation at constant angular velocity without visual information, humans perceive their rate of rotation to decay. However, during the same sustained rotation with visual information, humans can continue to more accurately perceive self-rotation. Prior to this study, there was no existing literature on human motion perception where visual information suddenly become available or unavailable during self-motion.

Methods

Via a well verified psychophysical task, we obtained perceptual reports of self-rotation during various profiles of Earth-vertical yaw rotation. The task involved transitions in the availability of visual information (and control conditions with visual information available throughout the motion or unavailable throughout).

Results

We found that when visual orientation information suddenly became available, subjects gradually integrated the new visual information over ~10 seconds. In the opposite scenario (visual information suddenly removed), past visual information continued to impact subject perception of self-rotation for ~30 seconds. We present a novel computational model of orientation perception that is consistent with the experimental results presented in this study.

Discussion

The gradual integration of sudden loss or gain of visual information is achieved via low pass filtering in the visual angular velocity sensory conflict pathway. In conclusion, humans gradually integrate sudden gain or loss of visual information into their existing perception of self-motion.

Interactionally Embedded Gestalt Principles of Multimodal Human Communication

Natural human interaction requires us to produce and process many different signals, including speech, hand and head gestures, and facial expressions. These communicative signals, which occur in a variety of temporal relations with each other (e.g., parallel or temporally misaligned), must be rapidly processed as a coherent message by the receiver. In this contribution, we introduce the notion of interactionally embedded, affordance-driven gestalt perception as a framework that can explain how this rapid processing of multimodal signals is achieved as efficiently as it is. We discuss empirical evidence showing how basic principles of gestalt perception can explain some aspects of unimodal phenomena such as verbal language processing and visual scene perception but require additional features to explain multimodal human communication. We propose a framework in which high-level gestalt predictions are continuously updated by incoming sensory input, such as unfolding speech and visual signals. We outline the constituent processes that shape high-level gestalt perception and their role in perceiving relevance and prägnanz. Finally, we provide testable predictions that arise from this multimodal interactionally embedded gestalt-perception framework. This review and framework therefore provide a theoretically motivated account of how we may understand the highly complex, multimodal behaviors inherent in natural social interaction.

Sensory emotion regulation

Decades of evidence reveal intimate links between sensation and emotion. Yet, discussion of sensory experiences as tools that promote emotion regulation is largely absent from current theorizing on this topic. Here, we address this gap by integrating evidence from social-personality, clinical, cognitive-neuroscience, and animal research to highlight the role of sensation as a tool that can be harnessed to up- or downregulate emotion. Further, we review evidence implicating sensation as a rapid and relatively effortless emotion regulation modality and highlight future research directions. Notably, we emphasize the need to examine the duration of sensory emotion regulation effects, the moderating role of individual and cultural differences, and how sensory strategies interact with other strategies.

Eating, Smelling, and Seeing: Investigating Multisensory Integration and (In)congruent Stimuli while Eating in VR

Integrating taste in AR/VR applications has various promising use cases - from social eating to the treatment of disorders. Despite many successful AR/VR applications that alter the taste of beverages and food, the relationship between olfaction, gustation, and vision during the process of multisensory integration (MSI) has not been fully explored yet. Thus, we present the results of a study in which participants were confronted with congruent and incongruent visual and olfactory stimuli while eating a tasteless food product in VR. We were interested (1) if participants integrate bi-modal congruent stimuli and (2) if vision guides MSI during congruent/incongruent conditions. Our results contain three main findings: First, and surprisingly, participants were not always able to detect congruent visual-olfactory stimuli when eating a portion of tasteless food. Second, when confronted with tri-modal incongruent cues, a majority of participants did not rely on any of the presented cues when forced to identify what they eat; this includes vision which has previously been shown to dominate MSI. Third, although research has shown that basic taste qualities like sweetness, saltiness, or sourness can be influenced by congruent cues, doing so with more complex flavors (e.g., zucchini or carrot) proved to be harder to achieve. We discuss our results in the context of multimodal integration, and within the domain of multisensory AR/VR. Our results are a necessary building block for future human-food interaction in XR that relies on smell, taste, and vision and are foundational for applied applications such as affective AR/VR.

Multifractal Nonlinearity Moderates Feedforward and Feedback Responses to Suprapostural Perturbations

An adaptive response to unexpected perturbations requires near-term and long-term adjustments over time. We used multifractal analysis to test how nonlinear interactions across timescales might support an adaptive response following an unpredictable perturbation. We reanalyzed torque data from 44 young and 24 older adults who performed a single-leg squat task challenged by an unexpected mechanical perturbation and a secondary visual-cognitive task. We report three findings: (a) multifractal nonlinearity interacted with pre-perturbation torque production and task error to presage greater pre-voluntary feedforward increases and greater voluntary reductions, respectively, in post-perturbation task error; (b) multifractal nonlinearity presaged relatively smaller task error than standard deviations of both pre-perturbation torques and pre-perturbation task error; and (c) increased task demand (e.g., age-related changes in dexterity and dual-task settings) led to multifractal nonlinearity presaging reduced task error. All these results were consistent with our expectations, except that a pre-perturbation knee torque-dependent increase in post-perturbation task error appeared later for older than for younger participants. This correlational multifractal modeling offered theoretical clarity on the possible roles of nonlinear interactions across timescales, moderating both feedforward and feedback processes, and presaging greater stability when the standard deviation is relatively large and task demands are strong. Thus, multifractal nonlinearity usefully describes movement variability even when paired with classical descriptors like the standard deviation. We discuss potential insights from these findings for understanding suprapostural dexterity and developing rehabilitative interventions.

Affordances of musical instruments: Conceptual consideration

While the concept of affordances has been applied in music research, it has not been satisfyingly developed regarding musical instruments. The resulting vagueness restricts the potential of the concept to guide exploration, discussion, and development of new approaches towards musical learning. Also, the concept of affordances comes with strong ontological claims and thus prompts the researcher to be careful when merging it with other theoretical domains or applying it in empirical studies. Consequently, the present article aims at contributing to a conceptualization of affordances of musical instruments by highlighting and discussing components that are necessary to consider in such a project. The first part consists of an overview of key elements of ecological psychology and more recent theoretical contributions, which are of relevance to the aim of the article: Material Engagement Theory, Skilled Intentionality Framework, and Sensorimotor Contingency Theory. A brief review of examples on how the concept of affordances has been applied in music research is presented. The main section of the article discusses four components, vital to further theoretical developments on affordances of musical instruments: the musical niche, spatial networks, sensorimotor relationship, and the amodal nature of affordances. Central to the argument is an understanding of affordances as relational, limited in scope and bound up with the physical interaction between musician and instrument. Accordingly, it is proposed that analytical focus in studies of musical instruments should be the sensorimotor relationship, spatiotemporally unfolding through a musical event. The article is concluded with comments upon educational implications of the presented perspective and suggestions on further research on the topic.

Against free energy, for direct perception

We question the free energy principle (FEP) as it is used in contemporary physics. If the FEP is incorrect in physics, then it cannot ground the authors' arguments. We also question the assumption that perception requires inference. We argue that perception (including perception of social affordances) can be direct, in which case inference is not required.

Turing's cascade instability supports the coordination of the mind, brain, and behavior

Turing inspired a computer metaphor of the mind and brain that has been handy and has spawned decades of empirical investigation, but he did much more and offered behavioral and cognitive sciences another metaphor-that of the cascade. The time has come to confront Turing's cascading instability, which suggests a geometrical framework driven by power laws and can be studied using multifractal formalism and multiscale probability density function analysis. Here, we review a rapidly growing body of scientific investigations revealing signatures of cascade instability and their consequences for a perceiving, acting, and thinking organism. We review work related to executive functioning (planning to act), postural control (bodily poise for turning plans into action), and effortful perception (action to gather information in a single modality and action to blend multimodal information). We also review findings on neuronal avalanches in the brain, specifically about neural participation in body-wide cascades. Turing's cascade instability blends the mind, brain, and behavior across space and time scales and provides an alternative to the dominant computer metaphor.

On the psychological origins of tool use

The ubiquity of tool use in human life has generated multiple lines of scientific and philosophical investigation to understand the development and expression of humans' engagement with tools and its relation to other dimensions of human experience. However, existing literature on tool use faces several epistemological challenges in which the same set of questions generate many different answers. At least four critical questions can be identified, which are intimately intertwined-(1) What constitutes tool use? (2) What psychological processes underlie tool use in humans and nonhuman animals? (3) Which of these psychological processes are exclusive to tool use? (4) Which psychological processes involved in tool use are exclusive to Homo sapiens? To help advance a multidisciplinary scientific understanding of tool use, six author groups representing different academic disciplines (e.g., anthropology, psychology, neuroscience) and different theoretical perspectives respond to each of these questions, and then point to the direction of future work on tool use. We find that while there are marked differences among the responses of the respective author groups to each question, there is a surprising degree of agreement about many essential concepts and questions. We believe that this interdisciplinary and intertheoretical discussion will foster a more comprehensive understanding of tool use than any one of these perspectives (or any one of these author groups) would (or could) on their own.

Exploring to learn and learning to explore

In respect to ecological psychology processes of attunement and calibration, this critical review focusses on how exploratory behaviors may contribute to skilled perception and action, with particular attention to sport. Based on the theoretical insights of Gibson (The senses considered as perceptual systems, Houghton Mifflin, Boston, 1966) and Reed (Encountering the world: Toward an ecological psychology, Oxford University Press, New York, 1996), exploratory and performatory actions have been differentiated in numerous experiments to study the perception of opportunities of action. The distinction between exploratory and performatory actions has informed the study of infant behavior in developmental psychology. In the current article, we highlight limitations with this distinction in the study of sports performers. We propose that a dynamic view of exploratory behavior would reveal how individuals develop exploratory activity that generates information about the fit between environmental properties and action capabilities. In this aim, practitioners should: (1) give learners the opportunity to safely develop exploratory behaviors even when they act outside their action boundary; and (2) guide learners to search for more reliable information to develop exploratory behaviors that would enhance the transfer of skills to various performance contexts.

Locomotor illusions are generated by perceptual body-environment organization

While one is walking, the stimulation by one's body forms a structure with the stimulation by the environment. This locomotor array of stimulation corresponds to the human-environment relation that one's body forms with the environment it is moving through. Thus, the perceptual experience of walking may arise from such a locomotor array of stimulation. Humans can also experience walking while they are sitting. In this case, there is no stimulation by one's walking body. Hence, one can experience walking although a basic component of a locomotor array of stimulation is missing. This may be facilitated by perception organizing the sensory input about one's body and environment into a perceptual structure that corresponds to a locomotor array of stimulation. We examined whether locomotor illusions are generated by this perceptual formation of a locomotor structure. We exposed sixteen seated individuals to environmental stimuli that elicited either the perceptual formation of a locomotor structure or that of a control structure. The study participants experienced distinct locomotor illusions when they were presented with environmental stimuli that elicited the perceptual formation of a locomotor structure. They did not experience distinct locomotor illusions when the stimuli instead elicited the perceptual formation of the control structure. These findings suggest that locomotor illusions are generated by the perceptual organization of sensory input about one's body and environment into a locomotor structure. This perceptual body-environment organization elucidates why seated human individuals experience the sensation of walking without any proprioceptive or kinaesthetic stimulation.

Multifractal roots of suprapostural dexterity

Visually guided postural control emerges in response to task constraints. Task constraints generate physiological fluctuations that foster the exploration of available sensory information at many scales. Temporally correlated fluctuations quantified using fractal and multifractal metrics have been shown to carry perceptual information across the body. The risk of temporally correlated fluctuations is that stable sway appears to depend on a healthy balance of standard deviation (SD): too much or too little SD entails destabilization of posture. This study presses on the visual guidance of posture by prompting participants to quietly stand and fixate at distances within, less than, and beyond comfortable viewing distance. Manipulations of the visual precision demands associated with fixating nearer and farther than comfortable viewing distance reveals an adaptive relationship between SD and temporal correlations in postural fluctuations. Changing the viewing distance of the fixation target shows that increases in temporal correlations and SD predict subsequent reductions in each other. These findings indicate that the balance of SD within stable bounds may depend on a tendency for temporal correlations to self-correct across time. Notably, these relationships became stronger with greater distance from the most comfortable viewing and reaching distance, suggesting that this self-correcting relationship allows the visual layout to press the postural system into a poise for engaging with objects and events. Incorporating multifractal analysis showed that all effects attributable to monofractal evidence were better attributed to multifractal evidence of nonlinear interactions across scales. These results offer a glimpse of how current nonlinear dynamical models of self-correction may play out in biological goal-oriented behavior. We interpret these findings as part of the growing evidence that multifractal nonlinearity is a modeling strategy that resonates strongly with ecological-psychological approaches to perception and action.

Multifractality in postural sway supports quiet eye training in aiming tasks: A study of golf putting

The 'quiet eye' (QE) approach to visually-guided aiming behavior invests fully in perceptual information's potential to organize coordinated action. Sports psychologists refer to QE as the stillness of the eyes during aiming tasks and increasingly into self- and externally-paced tasks. Amidst the 'noisy' fluctuations of the athlete's body, quiet eyes might leave fewer saccadic interruptions to the coupling between postural sway and optic flow. Postural sway exhibits fluctuations whose multifractal structure serves as a robust predictor of visual and haptic perceptual responses. Postural sway generates optic flow centered on an individual's eye height. We predicted that perturbing the eye height by attaching wooden blocks below the feet would perturb the putting more so in QE-trained participants than participants trained technically. We also predicted that QE's efficacy and responses to perturbation would depend on multifractality in postural sway. Specifically, we predicted that less multifractality would predict more adaptive responses to the perturbation and higher putting accuracy. Results showed that lower multifractality led to more accurate putts, and the perturbation of eye height led to less accurate putts, particularly for QE-trained participants. Models of radial error (i.e., the distance between the ball's final position and the hole) indicated that lower estimates of multifractality due to nonlinearity coincided with a more adaptive response to the perturbation. These results suggest that reduced multifractality may act in a context-sensitive manner to restrain motoric degrees of freedom to achieve the task goal.

Postural precursors of motion sickness in head-mounted displays: drivers and passengers, women and men

Motion sickness is preceded by distinctive patterns of postural activity that differ between the sexes. We asked whether such postural precursors of motion sickness might exist before participants were exposed to a virtual driving game presented via a head-mounted display. Men and women either controlled a virtual vehicle (drivers), or viewed a recording of virtual vehicle motion (passengers). Before exposure to the game, we recorded standing body sway while participants performed simple visual tasks (staring at a blank page vs. counting target letters in a block of text). Following game exposure, participants were classified into Well and Sick groups. In a statistically significant interaction, the multifractality of body sway varied as a function of sex, vehicle control, and motion sickness status. The results confirm that postural precursors of motion sickness differ between the sexes, and extend these to the control of virtual vehicles in head-mounted displays. Practitioner Summary: We asked whether postural sway might predict motion sickness during exposure to a driving game via a head-mounted display. Participants drove a virtual car (drivers), or watched recorded car motion (passengers). Beforehand, we measured standing body sway. Postural precursors of motion sickness differed between the sexes and drivers and passengers. Abbreviations: M: meters; SD: standard deviation; kg: kilograms; COP: centre of pressure; AP: anterior-posterior; ML: mediolateral; cm: centimeters; s: seconds; min: minutes; MF: DFA: multifractal detrended fluctuation analysis; DFA: detrended fluctuation analysis; ANOVA: analysis of variance; CI: confidence interval; Hz: hertz; SE: standard error of the mean.

Visual and Haptic Perception of Affordances of Feelies

Most objects have well-defined affordances. Investigating perception of affordances of objects that were not created for a specific purpose would provide insight into how affordances are perceived. In addition, comparison of perception of affordances for such objects across different exploratory modalities (visual vs. haptic) would offer a strong test of the lawfulness of information about affordances (i.e., the invariance of such information over transformation). Along these lines, "feelies"- objects created by Gibson with no obvious function and unlike any common object-could shed light on the processes underlying affordance perception. This study showed that when observers reported potential uses for feelies, modality significantly influenced what kind of affordances were perceived. Specifically, visual exploration resulted in more noun labels (e.g., "toy") than haptic exploration which resulted in more verb labels (i.e., "throw"). These results suggested that overlapping, but distinct classes of action possibilities are perceivable using vision and haptics. Semantic network analyses revealed that visual exploration resulted in object-oriented responses focused on object identification, whereas haptic exploration resulted in action-oriented responses. Cluster analyses confirmed these results. Affordance labels produced in the visual condition were more consistent, used fewer descriptors, were less diverse, but more novel than in the haptic condition.

Convergently Emergent: Ecological and Enactive Approaches to the Texture of Agency

Enactive and ecological approaches to cognitive science both claim a “mutuality” between agents and their environments – that they have a complementary nature and should be addressed as a single whole system. Despite this apparent agreement, each offers criticisms of the other on precisely this point – enactivists claiming that ecological psychologists over-emphasize the environment, while the complementary criticism, of agent-centered constructivism, is leveled by ecological psychologists at enactivists. In this paper I suggest that underlying the confusion between the two approaches is the complexity of agency, which comes in different forms, at different scales or levels of analysis. Cognitive science has not theorized the relationship between these different forms in a sufficiently disciplined manner, and a task therefore remains of finding a way to map the complex territory of agency.

Complexity of postural sway affects affordance perception of reachability in virtual reality

Visual perception of whether an object is within reach while standing in different postures was investigated. Participants viewed a three-dimensional (3D) virtual reality (VR) environment with a stimulus object (red ball) placed at different egocentric distances. Participants reported whether the object was reachable while in a standard pose as well as in two separate active balance poses (yoga tree pose and toe-to-heel pose). Feedback on accuracy was not provided, and participants were not allowed to attempt to reach. Response time, affordance judgements (reachable and not reachable), and head movements were recorded on each trial. Consistent with recent research on perception of reaching ability, the perceived boundary occurred at approximately 120% of arm length, indicating overestimation of perceived reaching ability. Response times increased with distance, and were shortest for the most difficult pose-the yoga tree pose. Head movement amplitude increased with increases in balance demands. Unexpectedly, the coefficient of variation was comparable in the two active balance poses, and was more extreme in the standard control pose for the shortest and longest distances. More complex descriptors of postural sway (i.e., effort-to-compress) were predictive of perception while in the tree pose and the toe-to-heel pose, as compared with control stance. This demonstrates that standard measures of central tendency are not sufficient for describing multiscale interactions of postural dynamics in functional tasks.

Drivers' Visual Perception Quantification Using 3D Mobile Sensor Data for Road Safety

To prevent driver accidents in cities, local governments have established policies to limit city speeds and create child protection zones near schools. However, if the same policy is applied throughout a city, it can be difficult to obtain smooth traffic flows. A driver generally obtains visual information while driving, and this information is directly related to traffic safety. In this study, we propose a novel geometric visual model to measure drivers' visual perception and analyze the corresponding information using the line-of-sight method. Three-dimensional point cloud data are used to analyze on-site three-dimensional elements in a city, such as roadside trees and overpasses, which are normally neglected in urban spatial analyses. To investigate drivers' visual perceptions of roads, we have developed an analytic model of three types of visual perception. By using this proposed method, this study creates a risk-level map according to the driver's visual perception degree in Pangyo, South Korea. With the point cloud data from Pangyo, it is possible to analyze actual urban forms such as roadside trees, building shapes, and overpasses that are normally excluded from spatial analyses that use a reconstructed virtual space.

Bodywide fluctuations support manual exploration: Fractal fluctuations in posture predict perception of heaviness and length via effortful touch by the hand

The human haptic perceptual system respects a bodywide organization that responds to local stimulation through full-bodied coordination of nested tensions and compressions across multiple nonoverlapping scales. Under such an organization, the suprapostural task of manually hefting objects to perceive their heaviness and length should depend on roots extending into the postural control for maintaining upright balance on the ground surface. Postural sway of the whole body should thus carry signatures predicting what the hand can extract by hefting an object. We found that fractal fluctuations in Euclidean displacement in the participants' center of pressure (CoP) contributed to perceptual judgments by moderating how the participants' hand picked up the informational variable of the moment of inertia. The role of fractality in CoP displacement in supporting heaviness and length judgments increased across trials, indicating that the participants progressively implicate their fractal scaling in their perception of heaviness and length. Traditionally, we had to measure fractality in hand movements to predict perceptual judgments by manual hefting. However, our findings suggest that we can observe what is happening at hand in the relatively distant-from-hand measure of CoP. Our findings reveal the complex relationship through which posture supports manual exploration, entailing perception of the intended properties of hefted objects (heaviness or length) putatively through the redistribution of forces throughout the body.

Multifractality of posture modulates multisensory perception of stand-on-ability

By definition, perception is a multisensory process that unfolds in time as a complex sequence of exploratory activities of the organism. In such a system perception and action are integrated, and multiple energy arrays are available simultaneously. Perception of affordances interweaves sensory and motor activities into meaningful behavior given task constraints. The present contribution offers insight into the manner in which perception and action usher the organism through competent functional apprehension of its surroundings. We propose that the tensegrity structure of the body, manifested via multifractality of exploratory bodily movements informs perception of affordances. The affordance of stand-on-ability of ground surfaces served as the experimental paradigm. Observers viewed a surface set to a discrete angle and attempted to match it haptically with a continuously adjustable surface occluded by a curtain, or felt an occluded surface set to a discrete angle then matched it visually with a continuously adjustable visible surface. The complex intertwining of perception and action was demonstrated by the interactions of multifractality of postural sway with multiple energy arrays, responses, and changing geometric task demands.

Balance control during stance - A comparison between horseback riding athletes and non-athletes

Horseback riding requires the ability to adapt to changes in balance conditions, to maintain equilibrium on the horse and to prevent falls. Postural adaptation involves specific sensorimotor processes integrating visual information and somesthesic information. The objective of this study was to examine this multisensorial integration on postural control, especially the use of visual and plantar information in static (stable) and dynamic (unstable) postures, among a group of expert horse rider women (n = 10) and a group of non-athlete women (n = 12). Postural control was evaluated through the center of pressure measured with a force platform on stable and unstable supports, with the eyes open and the eyes closed, and with the presence of foam on the support or not. Results showed that expert horse rider women had a better postural stability with unstable support in the mediolateral axis compared to non-athletes. Moreover, on the anteroposterior axis, expert horse riders were less visual dependent and more stable in the presence of foam. Results suggested that horseback riding could help developing particular proprioceptive abilities on standing posture as well as better postural muscle tone during particular bipodal dynamic perturbations. These outcomes provide new insights into horseback riding assets and methodological clues to assess the impact of sport practice.

Higher order affordances for reaching: Perception and performance

Affordances are available behaviours emerging from relations between properties of animals and their environment. In any situation, multiple behaviours are available, that is, multiple affordances exist. We asked whether participants could detect means–ends relations among affordances (i.e., higher order affordances) in the context of reaching to a maximum height. We both assessed perceived affordances and evaluated actual reaching ability. In Experiment 1, we co-varied higher order goals (reaching to touch vs reaching to grasp) and the lower order effectors used to achieve the goals (fingertips vs a hand-held tool). In Experiment 2, we varied the lower order posture from which reaching would occur (standing vs kneeling). In both experiments, perceived maximum reaching height reflected relations between lower order means (effectors and postures) and higher order ends (reaching goals), and judgments closely reflected actual performance. We conclude that participants demonstrated prospective sensitivity to higher order affordances for reaching extended across multiple levels of the means–ends hierarchy.

Affordance Realization in Climbing: Learning and Transfer

The aim of this study was to investigate how the affordances of an indoor climbing wall changed for intermediate climbers following a period of practice during which hold orientation was manipulated within a learning and transfer protocol. The learning protocol consisted of four sessions, in which eight climbers randomly ascended three different routes of fixed absolute difficulty (5c on the French scale), as fluently as possible. All three routes were 10.3 m in height and composed of 20 hand-holds at the same locations on an artificial climbing wall; only hold orientations were altered: (i) a horizontal-edge route (H) was designed to afford horizontal hold grasping, (ii) a vertical-edge route (V) afforded vertical hold grasping, and (iii), a double-edge route (D) was designed to afford both horizontal and vertical hold grasping. Five inertial measurement units (IMU) (3D accelerometer, 3D gyroscope, 3D magnetometer) were attached to the hip, feet and forearms to analyze the vertical acceleration and direction (3D unitary vector) of each limb and hip in ambient space during the entire ascent. Segmentation and classification processes supported detection of movement and stationary phases for each IMU. Depending on whether limbs and/or hip were moving, a decision tree distinguished four states of behavior: stationary (absence of limb and hip motion), hold exploration (absence of hip motion but at least one limb in motion), hip movement (hip in motion but absence of limb motion) and global motion (hip in motion and at least one limb in motion). Results showed that with practice, the learners decreased the relative duration of hold exploration, suggesting that they improved affordance perception of hold grasp-ability. The number of performatory movements also decreased as performance increased during learning sessions, confirming that participants' climbing efficacy improved as a function of practice. Last, the results were more marked for the H route, while the D route led to longer relative stationary duration and a shorter relative duration of performatory states. Together, these findings emphasized the benefit of manipulating task constraints to promote safe exploration during learning, which is particularly relevant in extreme sports involving climbing tasks.

Why and how the early-life environment affects development of coping behaviours

Understanding the ways in which individuals cope with threats, respond to challenges, make use of opportunities and mediate the harmful effects of their surroundings is important for predicting their ability to function in a rapidly changing world. Perhaps one of the most essential drivers of coping behaviour of adults is the environment experienced during their early-life development. Although the study of coping, defined as behaviours displayed in response to environmental challenges, has a long and rich research history in biology, recent literature has repeatedly pointed out that the processes through which coping behaviours develop in individuals are still largely unknown. In this review, we make a move towards integrating ultimate and proximate lines of coping behaviour research. After broadly defining coping behaviours (1), we review why, from an evolutionary perspective, the development of coping has become tightly linked to the early-life environment (2), which relevant developmental processes are most important in creating coping behaviours adjusted to the early-life environment (3), which influences have been shown to impact those developmental processes (4) and what the adaptive significance of intergenerational transmission of coping behaviours is, in the context of behavioural adaptations to a fast changing world (5). Important concepts such as effects of parents, habitat, nutrition, social group and stress are discussed using examples from empirical studies on mammals, fish, birds and other animals. In the discussion, we address important problems that arise when studying the development of coping behaviours and suggest solutions.