Synergies: atoms of brain and behavior

Speech perception difficulty modulates theta-band encoding of articulatory synergies

The human brain tracks available speech acoustics and extrapolates missing information such as the speaker's articulatory patterns. However, the extent to which articulatory reconstruction supports speech perception remains unclear. This study explores the relationship between articulatory reconstruction and task difficulty. Participants listened to sentences and performed a speech-rhyming task. Real kinematic data of the speaker's vocal tract were recorded via electromagnetic articulography (EMA) and aligned to corresponding acoustic outputs. We extracted articulatory synergies from the EMA data with principal component analysis (PCA) and employed partial information decomposition (PID) to separate the electroencephalographic (EEG) encoding of acoustic and articulatory features into unique, redundant, and synergistic atoms of information. We median-split sentences into easy (ES) and hard (HS) based on participants' performance and found that greater task difficulty involved greater encoding of unique articulatory information in the theta band. We conclude that fine-grained articulatory reconstruction plays a complementary role in the encoding of speech acoustics, lending further support to the claim that motor processes support speech perception.NEW & NOTEWORTHY Top-down processes originating from the motor system contribute to speech perception through the reconstruction of the speaker's articulatory movement. This study investigates the role of such articulatory simulation under variable task difficulty. We show that more challenging listening tasks lead to increased encoding of articulatory kinematics in the theta band and suggest that, in such situations, fine-grained articulatory reconstruction complements acoustic encoding.

Behavioral dynamics of conversation, (mis)communication and coordination in noisy environments

During conversations people coordinate simultaneous channels of verbal and nonverbal information to hear and be heard. But the presence of background noise levels such as those found in cafes and restaurants can be a barrier to conversational success. Here, we used speech and motion-tracking to reveal the reciprocal processes people use to communicate in noisy environments. Conversations between twenty-two pairs of typical-hearing adults were elicited under different conditions of background noise, while standing or sitting around a table. With the onset of background noise, pairs rapidly adjusted their interpersonal distance and speech level, with the degree of initial change dependent on noise level and talker configuration. Following this transient phase, pairs settled into a sustaining phase in which reciprocal speech and movement-based coordination processes synergistically maintained effective communication, again with the magnitude of stability of these coordination processes covarying with noise level and talker configuration. Finally, as communication breakdowns increased at high noise levels, pairs exhibited resetting behaviors to help restore communication-decreasing interpersonal distance and/or increasing speech levels in response to communication breakdowns. Approximately 78 dB SPL defined a threshold where behavioral processes were no longer sufficient for maintaining effective conversation and communication breakdowns rapidly increased.

Abduction and Deduction in Dynamical Cognitive Science

This paper reviews the recent history of a subset of research in dynamical cognitive science, in particular that subset that allies itself with the sciences of complexity and casts cognitive systems as interaction dominant, noncomputational, and nonmodular. I look at this history in the light of C.S. Peirce's understanding of scientific reasoning as progressing from abduction to deduction to induction. In particular, I examine the development of a controversy concerning the use of the interaction dominance of human cognitive systems as an explanation of the ubiquitous 1/f noise, multifractality, and complexity matching in human behavior.

Network Physiology of Exercise: Beyond Molecular and Omics Perspectives

Molecular Exercise Physiology and Omics approaches represent an important step toward synthesis and integration, the original essence of Physiology. Despite the significant progress they have introduced in Exercise Physiology (EP), some of their theoretical and methodological assumptions are still limiting the understanding of the complexity of sport-related phenomena. Based on general principles of biological evolution and supported by complex network science, this paper aims to contrast theoretical and methodological aspects of molecular and network-based approaches to EP. After explaining the main EP challenges and why sport-related phenomena cannot be understood if reduced to the molecular level, the paper proposes some methodological research advances related to the type of studied variables and measures, the data acquisition techniques, the type of data analysis and the assumed relations among physiological levels. Inspired by Network Physiology, Network Physiology of Exercise provides a new paradigm and formalism to quantify cross-communication among diverse systems across levels and time scales to improve our understanding of exercise-related phenomena and opens new horizons for exercise testing in health and disease.

Child language and autism diagnosis impact hierarchical temporal structure of parent-child vocal interactions in early childhood

Timing is critical to successful social interactions. The temporal structure of dyadic vocal interactions emerges from the rhythm, timing, and frequency of each individuals' vocalizations and reflects how the dyad dynamically organizes and adapts during an interaction. This study investigated the temporal structure of vocal interactions longitudinally in parent-child dyads of typically developing (TD) infants (n = 49; 9-18 months; 48% male) and toddlers with ASD (n = 23; 27.2 ± 5.0 months; 91.3% male) to identify how developing language and social skills impact the temporal dynamics of the interaction. Acoustic hierarchical temporal structure (HTS), a measure of the nested clustering of acoustic events across multiple timescales, was measured in free play interactions using Allan Factor. HTS reflects a signal's temporal complexity and variability, with greater HTS indicating reduced flexibility of the dyadic system. Child expressive language significantly predicted HTS (ß = -0.2) longitudinally across TD infants, with greater dyadic HTS associated with lower child language skills. ASD dyads exhibited greater HTS (i.e., more rigid temporal structure) than nonverbal matched (d = 0.41) and expressive language matched TD dyads (d = 0.28). Increased HTS in ASD dyads occurred at timescales >1 s, suggesting greater structuring of pragmatic aspects of interaction. Results provide a new window into how language development and social reciprocity serve as constraints to shape parent-child interaction dynamics and showcase a novel automated approach to characterizing vocal interactions across multiple timescales during early childhood.

On the psychological origins of tool use

The ubiquity of tool use in human life has generated multiple lines of scientific and philosophical investigation to understand the development and expression of humans' engagement with tools and its relation to other dimensions of human experience. However, existing literature on tool use faces several epistemological challenges in which the same set of questions generate many different answers. At least four critical questions can be identified, which are intimately intertwined-(1) What constitutes tool use? (2) What psychological processes underlie tool use in humans and nonhuman animals? (3) Which of these psychological processes are exclusive to tool use? (4) Which psychological processes involved in tool use are exclusive to Homo sapiens? To help advance a multidisciplinary scientific understanding of tool use, six author groups representing different academic disciplines (e.g., anthropology, psychology, neuroscience) and different theoretical perspectives respond to each of these questions, and then point to the direction of future work on tool use. We find that while there are marked differences among the responses of the respective author groups to each question, there is a surprising degree of agreement about many essential concepts and questions. We believe that this interdisciplinary and intertheoretical discussion will foster a more comprehensive understanding of tool use than any one of these perspectives (or any one of these author groups) would (or could) on their own.

Causal reductionism and causal structures

Causal reductionism is the widespread assumption that there is no room for additional causes once we have accounted for all elementary mechanisms within a system. Due to its intuitive appeal, causal reductionism is prevalent in neuroscience: once all neurons have been caused to fire or not to fire, it seems that causally there is nothing left to be accounted for. Here, we argue that these reductionist intuitions are based on an implicit, unexamined notion of causation that conflates causation with prediction. By means of a simple model organism, we demonstrate that causal reductionism cannot provide a complete and coherent account of 'what caused what'. To that end, we outline an explicit, operational approach to analyzing causal structures.

Skilled we-intentionality: Situating joint action in the living environment

There is a difference between the activities of two or more individuals that are performed jointly such as playing music in a band or dancing as a couple, and performing these same activities alone. This difference is sometimes captured by appealing to shared or joint intentions that allow individuals to coordinate what they do over space and time. In what follows we will use the terminology of we-intentionality to refer to what individuals do when they engage in group ways of thinking, feeling and acting. Our aim in this paper is to argue that we-intentionality is best understood in relation to a shared living environment in which acting individuals are situated. By the "living environment" we mean to refer to places and everyday situations in which humans act. These places and situations are simultaneously social, cultural, material and natural. We will use the term "affordance" to refer to the possibilities for action the living environment furnishes. Affordances form and are maintained over time through the activities people repeatedly engage in the living environment. We will show how we-intentionality is best understood in relation to the affordances of the living environmentand by taking into account the skills people have to engage with these affordances. For this reason we coin the term 'skilled we-intentionality' to characterize the intentionality characteristic of group ways of acting, feeling and thinking.

A deep joint sparse non-negative matrix factorization framework for identifying the common and subject-specific functional units of tongue motion during speech

Intelligible speech is produced by creating varying internal local muscle groupings-i.e., functional units-that are generated in a systematic and coordinated manner. There are two major challenges in characterizing and analyzing functional units. First, due to the complex and convoluted nature of tongue structure and function, it is of great importance to develop a method that can accurately decode complex muscle coordination patterns during speech. Second, it is challenging to keep identified functional units across subjects comparable due to their substantial variability. In this work, to address these challenges, we develop a new deep learning framework to identify common and subject-specific functional units of tongue motion during speech. Our framework hinges on joint deep graph-regularized sparse non-negative matrix factorization (NMF) using motion quantities derived from displacements by tagged Magnetic Resonance Imaging. More specifically, we transform NMF with sparse and graph regularizations into modular architectures akin to deep neural networks by means of unfolding the Iterative Shrinkage-Thresholding Algorithm to learn interpretable building blocks and associated weighting map. We then apply spectral clustering to common and subject-specific weighting maps from which we jointly determine the common and subject-specific functional units. Experiments carried out with simulated datasets show that the proposed method achieved on par or better clustering performance over the comparison methods.Experiments carried out with in vivo tongue motion data show that the proposed method can determine the common and subject-specific functional units with increased interpretability and decreased size variability.

Metastable Coordination Dynamics of Collaborative Creativity in Educational Settings

Educational systems consider fostering creativity and cooperation as two essential aims to nurture future sustainable citizens. The cooperative learning approach proposes different pedagogical strategies for developing creativity in students. In this paper, we conceptualize collaborative creativity under the framework of coordination dynamics and, specifically, we base it on the formation of spontaneous multiscale synergies emerging in complex living systems when interacting with cooperative/competitive environments. This conception of educational agents (students, teachers, institutions) changes the understanding of the teaching/learning process and the traditional roles assigned to each agent. Under such an understanding, the design and co-design of challenging and meaningful learning environments is a key aspect to promote the spontaneous emergence of multiscale functional synergies and teams (of students, students and teachers, teachers, institutions, etc.). According to coordination dynamics, cooperative and competitive processes (within and between systems and their environments) are seen not as opposites but as complementary pairs, needed to develop collaborative creativity and increase the functional diversity potential of teams. Adequate manipulation of environmental and personal constraints, nested in different level and time scales, and the knowledge of their critical (tipping) points are key aspects for an adequate design of learning environments to develop synergistic creativity.

Interlimb Coordination: A New Order Parameter and a Marker of Fatigue During Quasi-Isometric Exercise?

Although exercise-induced fatigue has been mostly studied from a reductionist and component-dominant approach, some authors have started to test the general predictions of theories of self-organized change during exercises performed until exhaustion. However, little is known about the effects of fatigue on interlimb coordination in quasi-isometric actions. The aim of this study was to investigate the effect of exercise-induced fatigue on upper interlimb coordination during a quasi-isometric exercise performed until exhaustion. In order to do this, we hypothesized an order parameter that governs the interlimb coordination as an interlimb correlation measure. In line with general predictions of theory of phase transitions, we expected that the locally averaged values of the order parameter will increase as the fatigue driven system approaches the point of spontaneous task disengagement. Seven participants performed a quasi-isometric task holding an Olympic bar maintaining an initial elbow flexion of 90 degrees until fatigue induced spontaneous task disengagement. The variability of the elbow angle was recorded through electrogoniometry and the obtained time series were divided into three segments for further analysis. Running correlation function (RCF) and adopted bivariate phase rectified signal averaging (BPRSA) were applied to the corresponding initial (30%) and last (30%) segments of the time series. The results of both analyses showed that the interlimb correlation increased between the initial and the final segments of the performed task. Hence, the hypothesis of the research was supported by evidence. The enhancement of the correlation in the last part means a less flexible coordination among limbs. Our results also show that the high magnitude correlation (%RCF > 0.8) and the %Range (END-BEG) may prove to be useful markers to detect the effects of effort accumulation on interlimb coordination. These results may provide information about the loss of adaptability during exercises performed until exhaustion. Finally, we briefly discuss the hypothesis of the inhibitory percolation process being the general explanation of the spontaneous task disengagement phenomenon.

Adjustments in end-effector trajectory and underlying joint angle synergies after a target switch: Order of adjustment is flexible

Goal-directed reaching adapts to meet changing task requirements after unexpected perturbations such as a sudden switch of target location. Literature on adaptive behavior using a target switch has primarily focused on adjustments of the end-effector trajectory, addressing proposed feedback and feedforward processes in planning adjusted actions. Starting from a dynamical systems approach to motor coordination, the current paper focusses on coordination of joint angles after a target switch, which has received little attention in the literature. We argue that joint angles are coordinated in synergies, temporary task-specific units emerging from interactions amongst task, organism, and environmental constraints. We asked whether after a target switch: i) joint angles were coordinated in synergies, ii) joint angles were coordinated in a different synergy than the synergy used when moving to the original target, and iii) synergies or end-effector trajectory was adjusted first. Participants (N = 12) performed manual reaching movements toward a target on a table (stationary target trials), where in some trials the target could unexpectedly switch to a new location (switch trials). Results showed that the end-effector curved to the switched target. Joint angles were synergistically organized as shown by the large extent of co-variation based on Uncontrolled Manifold analyses. At the end of the target switch movement, joint angle configurations differed from the joint angle configurations used to move to the original stationary target. Hence, we argue, a new synergy emerged after the target switch. The order of adjustment in the synergies and in the end-effector was flexible within participants, though most often synergies were adjusted first. These findings support the two-step framework of Kay (1988) to understand the coordination of abundant degrees of freedom and to explain adaptive actions. The flexibility in the order of adjustments of synergies suggests that the coordination of DOF emerges from self-organization.

Bring the Noise: Reconceptualizing Spontaneous Neural Activity

Definitions of what constitutes the 'signal of interest' in neuroscience can be controversial, due in part to continuously evolving notions regarding the significance of spontaneous neural activity. This review highlights how the challenge of separating brain signal from noise has led to new conceptualizations of brain functional organization at both the micro- and macroscopic level. Recent debates in the functional neuroimaging community surrounding artifact removal processes have revived earlier discussions surrounding how to appropriately isolate and measure neuronal signals against a background of noise from various sources. Insights from electrophysiological studies and computational modeling can inform current theory and data analytic practices in human functional neuroimaging, given that signal and noise may be inextricably linked in the brain.

Metastable neural dynamics underlies cognitive performance across multiple behavioural paradigms

Despite resting state networks being associated with a variety of cognitive abilities, it remains unclear how these local areas act in concert to express particular cognitive operations. Theoretical and empirical accounts indicate that large-scale resting state networks reconcile dual tendencies towards integration and segregation by operating in a metastable regime of their coordination dynamics. Metastability may confer important behavioural qualities by binding distributed local areas into large-scale neurocognitive networks. We tested this hypothesis by analysing fMRI data in a large cohort of healthy individuals (N = 566) and comparing the metastability of the brain's large-scale resting network architecture at rest and during the performance of several tasks. Metastability was estimated using a well-defined collective variable capturing the level of 'phase-locking' between large-scale networks over time. Task-based reasoning was principally characterised by high metastability in cognitive control networks and low metastability in sensory processing areas. Although metastability between resting state networks increased during task performance, cognitive ability was more closely linked to spontaneous activity. High metastability in the intrinsic connectivity of cognitive control networks was linked to novel problem solving or fluid intelligence, but was less important in tasks relying on previous experience or crystallised intelligence. Crucially, subjects with resting architectures similar or 'pre-configured' to a task-general arrangement demonstrated superior cognitive performance. Taken together, our findings support a key linkage between the spontaneous metastability of large-scale networks in the cerebral cortex and cognition.

Coordination Dynamics: A Foundation for Understanding Social Behavior

Humans' interactions with each other or with socially competent machines exhibit lawful coordination patterns at multiple levels of description. According to Coordination Dynamics, such laws specify the flow of coordination states produced by functional synergies of elements (e.g., cells, body parts, brain areas, people…) that are temporarily organized as single, coherent units. These coordinative structures or synergies may be mathematically characterized as informationally coupled self-organizing dynamical systems (Coordination Dynamics). In this paper, we start from a simple foundation, an elemental model system for social interactions, whose behavior has been captured in the Haken-Kelso-Bunz (HKB) model. We follow a tried and tested scientific method that tightly interweaves experimental neurobehavioral studies and mathematical models. We use this method to further develop a body of empirical research that advances the theory toward more generalized forms. In concordance with this interdisciplinary spirit, the present paper is written both as an overview of relevant advances and as an introduction to its mathematical underpinnings. We demonstrate HKB's evolution in the context of social coordination along several directions, with its applicability growing to increasingly complex scenarios. In particular, we show that accommodating for symmetry breaking in intrinsic dynamics and coupling, multiscale generalization and adaptation are principal evolutions. We conclude that a general framework for social coordination dynamics is on the horizon, in which models support experiments with hypothesis generation and mechanistic insights.

Training or Synergizing? Complex Systems Principles Change the Understanding of Sport Processes

There is a need to update scientific assumptions in sport to promote the critical thinking of scientists, coaches, and practitioners and improve their methodological decisions. On the basis of complex systems science and theories of biological evolution, a systematization and update of theoretical and methodological principles to transform the understanding of sports training is provided. The classical focus on learning/acquiring skills and fitness is replaced by the aim of increasing the diversity/unpredictability potential of teams/athletes through the development of synergies. This development is underpinned by the properties of hierarchical organization and circular causality of constraints, that is, the nestedness of constraints acting at different levels and timescales. These properties, that integrate bottom-up and top-down all dimensions and levels of performance (from social to genetic), apply to all types of sport, ages, or levels of expertise and can be transferred to other fields (e.g., education, health, management). The team as the main training unit of intervention, the dynamic concept of task representativeness, and the co-adaptive and synergic role of the agents are some few practical consequences of moving from training to synergizing.

Scale Matters: Temporality in the Perception of Affordances

In this paper I seek to unify enactive and ecological approaches to cognitive science by emphasizing the fact that both approaches view cognitive processes as being inherently temporally extended. My hypothesis is that characterizing the temporal scales in which perception of affordances occur, they can serve different purposes of explanation within the theories. Specifically, the paper brings together, on the one hand, Chemero’s (2009) dynamicist understanding of affordances, which he called affordances 2.0, with, on the other hand, a distinction originally made by Varela (1999), and later taken up by Shaun Gallagher (2011, 2017b), between three different timescales for understanding cognition: the elementary, the integrative, and the narrative. Varela’s three-fold distinction was originally intended as a way of identifying phenomenological events as being causally coupled to specific cellular events happening within the nervous system. The central claim of the present paper is that affordances, likewise, should be understood in terms of these three different timescales. I show that these temporal scales can be a useful toolkit for explaining the perception and learning of affordances and at the same time unifying enactivism and ecological psychology claiming that affordances serve a different explanatory role depending on which time scale you consider them at. If you are interested in explaining the embodied assemblies that form the always changing sensorimotor contingencies, then you see the elementary scale. If you’re interested in explaining perception at the integrative scale, then affordances are solicitations that get actualized and bear an umwelt at that same scale. The perception of affordances as such is constituted by the integration of these first two scales, and the experience of it can be characterized by the husserlian structure of experience with its intrinsic temporality. Finally, if you are interested in explaining change in the animal-environment system over developmental time, that is, learning, then affordances are roughly what Chemero proposed and they operate at the narrative scale. But it is important to say that the three scales are always intertwined because learning and perception are ongoing processes that in many senses are impossible to separate. Finally, I discuss the importance of scales from the macro to micro levels for understanding behavior through affordances, considering them as synergies, where abilities and aspects of the environment are understood as constraints on the potential trajectories of such systems.

Linking Tensegrity to Sports Team Collective Behaviors: Towards the Group-Tensegrity Hypothesis

Collective behaviors in sports teams emerge from the coordination between players formed from their perception of shared affordances. Recent studies based on the theoretical framework of ecological dynamics reported new analytical tools to capture collective behavior variables that describe team synergies. Here, we introduce a novel hypothesis based on the principles of tensegrity to describe collective behavior. Tensegrity principles operate in the human body at different size scales, from molecular to organism levels, in structures connected physically (biotensegrity). Thus, we propose that a group of individuals connected by information can exhibit synergies based on the same principles (group-tensegrity), and we provide an empirical example based on the dynamics of a volleyball team sub-phase of defense.

Synergies reciprocally relate end-effector and joint-angles in rhythmic pointing movements

During rhythmic pointing movements, degrees of freedom (DOF) in the human action system-such as joint-angles in the arm-are assumed to covary to stabilise end-effector movement, e.g. index finger. In this paper, it is suggested that the end-effector movement and the coordination of DOF are reciprocally related in synergies that link DOF so as to produce the end-effector movement. The coordination of DOF in synergies and the relation between end-effector movement and DOF coordination received little attention, though essential to understand the principles of synergy formation. Therefore, the current study assessed how the end-effector movement related to the coordination of joint-angles during rhythmic pointing across target widths and distances. Results demonstrated that joint-angles were linked in different synergies when end-effector movements differed across conditions. Furthermore, in every condition, three joint-angles (shoulder plane of elevation, shoulder inward-outward rotation, elbow flexion-extension) largely drove the end-effector, and all joint-angles contributed to covariation that stabilised the end-effector. Together, results demonstrated synergies that produced the end-effector movement, constrained joint-angles so that they covaried to stabilise the end-effector, and differed when end-effector movement differed. Hence, end-effector and joint-angles were reciprocally related in synergies-indicating that the action system was organised as a complex dynamical system.

Complex Communication Dynamics: Exploring the Structure of an Academic Talk

Communication is a multimodal phenomenon. The cognitive mechanisms supporting it are still understudied. We explored a natural dataset of academic lectures to determine how communication modalities are used and coordinated during the presentation of complex information. Using automated and semi-automated techniques, we extracted and analyzed, from the videos of 30 speakers, measures capturing the dynamics of their body movement, their slide change rate, and various aspects of their speech (speech rate, articulation rate, fundamental frequency, and intensity). There were consistent but statistically subtle patterns in the use of speech rate, articulation rate, intensity, and body motion across the presentation. Principal component analysis also revealed patterns of system-like covariation among modalities. These findings, although tentative, do suggest that the cognitive system is integrating body, slides, and speech in a coordinated manner during natural language use. Further research is needed to clarify the specific coordination patterns that occur between the different modalities.

A Sparse Non-Negative Matrix Factorization Framework for Identifying Functional Units of Tongue Behavior From MRI

Muscle coordination patterns of lingual behaviors are synergies generated by deforming local muscle groups in a variety of ways. Functional units are functional muscle groups of local structural elements within the tongue that compress, expand, and move in a cohesive and consistent manner. Identifying the functional units using tagged-magnetic resonance imaging (MRI) sheds light on the mechanisms of normal and pathological muscle coordination patterns, yielding improvement in surgical planning, treatment, or rehabilitation procedures. In this paper, to mine this information, we propose a matrix factorization and probabilistic graphical model framework to produce building blocks and their associated weighting map using motion quantities extracted from tagged-MRI. Our tagged-MRI imaging and accurate voxel-level tracking provide previously unavailable internal tongue motion patterns, thus revealing the inner workings of the tongue during speech or other lingual behaviors. We then employ spectral clustering on the weighting map to identify the cohesive regions defined by the tongue motion that may involve multiple or undocumented regions. To evaluate our method, we perform a series of experiments. We first use two-dimensional images and synthetic data to demonstrate the accuracy of our method. We then use three-dimensional synthetic and in vivo tongue motion data using protrusion and simple speech tasks to identify subject-specific and data-driven functional units of the tongue in localized regions.

Quantifying synergies in two-versus-one situations in team sports: An example from Rugby Union

Collective behaviors in team sports result in players forming interpersonal synergies that contribute to performance goals. Because of the huge amount of variables that continuously constrain players' behavior during a game, the way that these synergies are formed remain unclear. Our aim was to quantify interpersonal synergies in the team sport of Rugby Union. For that purpose we used the Uncontrolled Manifold Hypothesis (UCM) to identify interpersonal synergies that are formed between ball carrier and support player in two-versus-one situations in Rugby Union. The inter-player angle close to the moment of the pass was used as a performance variable and players running lines velocities as task-relevant elements. Interpersonal synergies (UCM values above 1) were found in 19 out of 55 trials under analysis, which means that on 34% of the trials, the players' running line velocities contribute to stabilizing the inter-player angle close the moment of the pass. The strength of the synergy fluctuates over time indicating the existence of a location effect during attack phases in Rugby Union. UCM analysis shows considerable promise as a performance analysis tool in team sports to discriminate between skilled sub-groups of players.

Deciphering the functional role of spatial and temporal muscle synergies in whole-body movements

Voluntary movement is hypothesized to rely on a limited number of muscle synergies, the recruitment of which translates task goals into effective muscle activity. In this study, we investigated how to analytically characterize the functional role of different types of muscle synergies in task performance. To this end, we recorded a comprehensive dataset of muscle activity during a variety of whole-body pointing movements. We decomposed the electromyographic (EMG) signals using a space-by-time modularity model which encompasses the main types of synergies. We then used a task decoding and information theoretic analysis to probe the role of each synergy by mapping it to specific task features. We found that the temporal and spatial aspects of the movements were encoded by different temporal and spatial muscle synergies, respectively, consistent with the intuition that there should a correspondence between major attributes of movement and major features of synergies. This approach led to the development of a novel computational method for comparing muscle synergies from different participants according to their functional role. This functional similarity analysis yielded a small set of temporal and spatial synergies that describes the main features of whole-body reaching movements.

Changes in Dimensionality and Fractal Scaling Suggest Soft-Assembled Dynamics in Human EEG

Humans are high-dimensional, complex systems consisting of many components that must coordinate in order to perform even the simplest of activities. Many behavioral studies, especially in the movement sciences, have advanced the notion of soft-assembly to describe how systems with many components coordinate to perform specific functions while also exhibiting the potential to re-structure and then perform other functions as task demands change. Consistent with this notion, within cognitive neuroscience it is increasingly accepted that the brain flexibly coordinates the networks needed to cope with changing task demands. However, evaluation of various indices of soft-assembly has so far been absent from neurophysiological research. To begin addressing this gap, we investigated task-related changes in two distinct indices of soft-assembly using the established phenomenon of EEG repetition suppression. In a repetition priming task, we assessed evidence for changes in the correlation dimension and fractal scaling exponents during stimulus-locked event-related potentials, as a function of stimulus onset and familiarity, and relative to spontaneous non-task-related activity. Consistent with predictions derived from soft-assembly, results indicated decreases in dimensionality and increases in fractal scaling exponents from resting to pre-stimulus states and following stimulus onset. However, contrary to predictions, familiarity tended to increase dimensionality estimates. Overall, the findings support the view from soft-assembly that neural dynamics should become increasingly ordered as external task demands increase, and support the broader application of soft-assembly logic in understanding human behavior and electrophysiology.

On the Self-Organizing Origins of Agency

The question of agency and directedness in living systems has puzzled philosophers and scientists for centuries. What principles and mechanisms underlie the emergence of agency? Analysis and dynamical modeling of experiments on human infants suggest that the birth of agency is due to a eureka-like, pattern-forming phase transition in which the infant suddenly realizes it can make things happen in the world. The main mechanism involves positive feedback: when the baby's initially spontaneous movements cause the world to change, their perceived consequences have a sudden and sustained amplifying effect on the baby's further actions. The baby discovers itself as a causal agent. Some implications of this theory are discussed.

Directly data-derived articulatory gesture-like representations retain discriminatory information about phone categories

How the speech production and perception systems evolved in humans still remains a mystery today. Previous research suggests that human auditory systems are able, and have possibly evolved, to preserve maximal information about the speaker's articulatory gestures. This paper attempts an initial step towards answering the complementary question of whether speakers' articulatory mechanisms have also evolved to produce sounds that can be optimally discriminated by the listener's auditory system. To this end we explicitly model, using computational methods, the extent to which derived representations of "primitive movements" of speech articulation can be used to discriminate between broad phone categories. We extract interpretable spatio-temporal primitive movements as recurring patterns in a data matrix of human speech articulation, i.e. representing the trajectories of vocal tract articulators over time. To this end, we propose a weakly-supervised learning method that attempts to find a part-based representation of the data in terms of recurring basis trajectory units (or primitives) and their corresponding activations over time. For each phone interval, we then derive a feature representation that captures the co-occurrences between the activations of the various bases over different time-lags. We show that this feature, derived entirely from activations of these primitive movements, is able to achieve a greater discrimination relative to using conventional features on an interval-based phone classification task. We discuss the implications of these findings in furthering our understanding of speech signal representations and the links between speech production and perception systems.

The Path to Exhaustion: Time-Variability Properties of Coordinative Variables during Continuous Exercise

The aim of this study was to detect qualitative changes in the structure of coordinative variable (elbow angle) fluctuations during a quasi-isometric exercise performed until exhaustion. Seven physical education students performed a quasi-isometric arm-curl exercise holding an Olympic bar (weight: 80% 1RM) with an initial elbow flexion of 90° three times over a period of 4 weeks. They were encouraged to persist, even if the elbow angle was lost, until the fatigue-induced spontaneous termination point (FISTP). Changes in both elbow angles were registered during the task through an electrogoniometer. Detrended Fluctuation Analysis (DFA) was conducted on the initial and final 1024 data points of the series and the associated Hurst exponents were obtained. Multi-way RM ANOVA analyses revealed a significant main effect of the Time on task on the Hurst exponent values but also revealed a significant Trial × Time on task interaction. In the initial (non-fatigue) condition participants tended to produce anti-persistent fBm fluctuations. In the final part before exhaustion a tendency toward persistent fBm was dominant. The trial to trial differences in time-variability structure points to an existence of a long-term variability in control strategies during exercise. The changes in the temporal structure of the elbow angle variability as effort accumulated reflected an increase in low-frequency fluctuations signifying a change in psychobiological mechanisms used to negotiate the task demands. The variability properties of the coordinative variable during exercise may provide information about the dynamic mechanisms that lead to exhaustion.

Can discrete joint action be synergistic? Studying the stabilization of interpersonal hand coordination

The human perceptual-motor system is tightly coupled to the physical and informational dynamics of a task environment. These dynamics operate to constrain the high-dimensional order of the human movement system into low-dimensional, task-specific synergies-functional groupings of structural elements that are temporarily constrained to act as a single coordinated unit. The aim of the current study was to determine whether synergistic processes operate when coacting individuals coordinate to perform a discrete joint-action task. Pairs of participants sat next to each other and each used 1 arm to complete a pointer-to-target task. Using the uncontrolled manifold (UCM) analysis for the first time in a discrete joint action, the structure of joint-angle variance was examined to determine whether there was synergistic organization of the degrees of freedom employed at the interpersonal or intrapersonal levels. The results revealed that the motor actions performed by coactors were synergistically organized at both the interpersonal and intrapersonal levels. More importantly, however, the interpersonal synergy was found to be significantly stronger than the intrapersonal synergies. Accordingly, the results provide clear evidence that coacting individuals can become temporarily organized to form single synergistic 2-person systems during performance of a discrete joint action.

Hidden in plain view: degeneracy in complex systems

Degeneracy is a word with two meanings. The popular usage of the word denotes deviance and decay. In scientific discourse, degeneracy refers to the idea that different pathways can lead to the same output. In the biological sciences, the concept of degeneracy has been ignored for a few key reasons. Firstly, the word "degenerate" in popular culture has negative, emotionally powerful associations that do not inspire scientists to consider its technical meaning. Secondly, the tendency of searching for single causes of natural and social phenomena means that scientists can overlook the multi-stranded relationships between cause and effect. Thirdly, degeneracy and redundancy are often confused with each other. Degeneracy refers to dissimilar structures that are functionally similar while redundancy refers to identical structures. Degeneracy can give rise to novelty in ways that redundancy cannot. From genetic codes to immunology, vaccinology and brain development, degeneracy is a crucial part of how complex systems maintain their functional integrity. This review article discusses how the scientific concept of degeneracy was imported into genetics from physics and was later introduced to immunology and neuroscience. Using examples of degeneracy in immunology, neuroscience and linguistics, we demonstrate that degeneracy is a useful way of understanding how complex systems function. Reviewing the history and theoretical scope of degeneracy allows its usefulness to be better appreciated, its coherency to be further developed, and its application to be more quickly realized.

Aging induced loss of complexity and dedifferentiation: consequences for coordination dynamics within and between brain, muscular and behavioral levels

Growing evidence demonstrates that aging not only leads to structural and functional alterations of individual components of the neuro-musculo-skeletal system (NMSS) but also results in a systemic re-organization of interactions within and between the different levels and functional domains. Understanding the principles that drive the dynamics of these re-organizations is an important challenge for aging research. The present Hypothesis and Theory paper is a contribution in this direction. We propose that age-related declines in brain and behavior that have been characterized in the literature as dedifferentiation and the loss of complexity (LOC) are: (i) synonymous; and (ii) integrated. We argue that a causal link between the aforementioned phenomena exists, evident in the dynamic changes occurring in the aging NMSS. Through models and methods provided by a dynamical systems approach to coordination processes in complex living systems, we: (i) formalize operational hypotheses about the general principles of changes in cross-level and cross-domain interactions during aging; and (ii) develop a theory of the aging NMSS based on the combination of the frameworks of coordination dynamics (CD), dedifferentiation, and LOC. Finally, we provide operational predictions in the study of aging at neural, muscular, and behavioral levels, which lead to testable hypotheses and an experimental agenda to explore the link between CD, LOC and dedifferentiation within and between these different levels.

Tool use ability depends on understanding of functional dynamics and not specific joint contribution profiles

Researchers in cognitive neuroscience have become increasingly interested in how different aspects of tool use are integrated and represented by the brain. Comparatively less attention has been directed toward tool use actions themselves and how effective tool use behaviors are coordinated. In response, we take this opportunity to consider the mechanical principles of tool use actions and their relationship to motor learning. Using kinematic analysis, we examine both functional dynamics and joint contribution profiles of subjects with different levels of experience in a primordial percussive task. Our results show that the ability to successfully produce stone flakes using the Oldowan method did not correspond with any particular joint contribution profile. Rather, expertise in this tool use action was principally associated with the subject's ability to regulate the functional parameters that define the task itself.

Spatio-temporal articulatory movement primitives during speech production: extraction, interpretation, and validation

This paper presents a computational approach to derive interpretable movement primitives from speech articulation data. It puts forth a convolutive Nonnegative Matrix Factorization algorithm with sparseness constraints (cNMFsc) to decompose a given data matrix into a set of spatiotemporal basis sequences and an activation matrix. The algorithm optimizes a cost function that trades off the mismatch between the proposed model and the input data against the number of primitives that are active at any given instant. The method is applied to both measured articulatory data obtained through electromagnetic articulography as well as synthetic data generated using an articulatory synthesizer. The paper then describes how to evaluate the algorithm performance quantitatively and further performs a qualitative assessment of the algorithm's ability to recover compositional structure from data. This is done using pseudo ground-truth primitives generated by the articulatory synthesizer based on an Articulatory Phonology frame-work [Browman and Goldstein (1995). "Dynamics and articulatory phonology," in Mind as motion: Explorations in the dynamics of cognition, edited by R. F. Port and T.van Gelder (MIT Press, Cambridge, MA), pp. 175-194]. The results suggest that the proposed algorithm extracts movement primitives from human speech production data that are linguistically interpretable. Such a framework might aid the understanding of longstanding issues in speech production such as motor control and coarticulation.

Multistability and metastability: understanding dynamic coordination in the brain

Multistable coordination dynamics exists at many levels, from multifunctional neural circuits in vertebrates and invertebrates to large-scale neural circuitry in humans. Moreover, multistability spans (at least) the domains of action and perception, and has been found to place constraints upon, even dictating the nature of, intentional change and the skill-learning process. This paper reviews some of the key evidence for multistability in the aforementioned areas, and illustrates how it has been measured, modelled and theoretically understood. It then suggests how multistability—when combined with essential aspects of coordination dynamics such as instability, transitions and (especially) metastability—provides a platform for understanding coupling and the creative dynamics of complex goal-directed systems, including the brain and the brain–behaviour relation.

Coordination dynamics in a socially situated nervous system

Traditional theories of cognitive science have typically accounted for the organization of human behavior by detailing requisite computational/representational functions and identifying neurological mechanisms that might perform these functions. Put simply, such approaches hold that neural activity causes behavior. This same general framework has been extended to accounts of human social behavior via concepts such as “common-coding” and “co-representation” and much recent neurological research has been devoted to brain structures that might execute these social-cognitive functions. Although these neural processes are unquestionably involved in the organization and control of human social interactions, there is good reason to question whether they should be accorded explanatory primacy. Alternatively, we propose that a full appreciation of the role of neural processes in social interactions requires appropriately situating them in their context of embodied-embedded constraints. To this end, we introduce concepts from dynamical systems theory and review research demonstrating that the organization of human behavior, including social behavior, can be accounted for in terms of self-organizing processes and lawful dynamics of animal-environment systems. Ultimately, we hope that these alternative concepts can complement the recent advances in cognitive neuroscience and thereby provide opportunities to develop a complete and coherent account of human social interaction.

Spatiotemporal re-organization of large-scale neural assemblies underlies bimanual coordination

Bimanual coordination engages a distributed network of brain areas, the spatiotemporal organization of which has given rise to intense debates. Do bimanual movements require information processing in the same set of brain areas that are engaged by movements of the individual components (left and right hands)? Or is it necessary that other brain areas are recruited to help in the act of coordination? These two possibilities are often considered as mutually exclusive, with studies yielding support for one or the other depending on techniques and hypotheses. However, as yet there is no account of how the two views may work together dynamically. Using the method of Mode-Level Cognitive Subtraction (MLCS) on high density EEG recorded during unimanual and bimanual movements, we expose spatiotemporal reorganization of large-scale cortical networks during stable inphase and antiphase coordination and transitions between them. During execution of stable bimanual coordination patterns, neural dynamics were dominated by temporal modulation of unimanual networks. At instability and transition, there was evidence for recruitment of additional areas. Our study provides a framework to quantify large-scale network mechanisms underlying complex cognitive tasks often studied with macroscopic neurophysiological recordings.

Bimanual training in stroke: How do coupling and symmetry-breaking matter?

BACKGROUND

The dramatic consequences of stroke on patient autonomy in daily living activities urged the need for new reliable therapeutic strategies. Recently, bimanual training has emerged as a promising tool to improve the functional recovery of upper-limbs in stroke patients. However, who could benefit from bimanual therapy and how it could be used as a part of a more complete rehabilitation protocol remain largely unknown. A possible reason explaining this situation is that coupling and symmetry-breaking mechanisms, two fundamental principles governing bimanual behaviour, have been largely under-explored in both research and rehabilitation in stroke.

DISCUSSION

Bimanual coordination emerges as an active, task-specific assembling process where the limbs are constrained to act as a single unit by virtue of mutual coupling. Consequently, exploring, assessing, re-establishing and exploiting functional bimanual synergies following stroke, require moving beyond the classical characterization of performance of each limb in separate and isolated fashion, to study coupling signatures at both neural and behavioural levels. Grounded on the conceptual framework of the dynamic system approach to bimanual coordination, we debated on two main assumptions: 1) stroke-induced impairment of bimanual coordination might be anticipated/understood by comparing, in join protocols, changes in coupling strength and asymmetry of bimanual discrete movements observed in healthy people and those observed in stroke; 2) understanding/predicting behavioural manifestations of decrease in bimanual coupling strength and/or increase in interlimb asymmetry might constitute an operational prerequisite to adapt therapy and better target training at the specific needs of each patient. We believe that these statements draw new directions for experimental and clinical studies and contribute in promoting bimanual training as an efficient and adequate tool to facilitate the paretic upper-limb recovery and to restore spontaneous bimanual synergies.

SUMMARY

Since bimanual control deficits have scarcely been systematically investigated, the eventual benefits of bimanual coordination practice in stroke rehabilitation remains poorly understood. In the present paper we argued that a better understanding of coupling and symmetry-breaking mechanisms in both the undamaged and stroke-lesioned neuro-behavioral system should provide a better understanding of stroke-related alterations of bimanual synergies, and help clinicians to adapt therapy in order to maximize rehabilitation benefits.