1
|
Sandini G, Sciutti A, Morasso P. Artificial cognition vs. artificial intelligence for next-generation autonomous robotic agents. Front Comput Neurosci 2024; 18:1349408. [PMID: 38585280 PMCID: PMC10995397 DOI: 10.3389/fncom.2024.1349408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 02/20/2024] [Indexed: 04/09/2024] Open
Abstract
The trend in industrial/service robotics is to develop robots that can cooperate with people, interacting with them in an autonomous, safe and purposive way. These are the fundamental elements characterizing the fourth and the fifth industrial revolutions (4IR, 5IR): the crucial innovation is the adoption of intelligent technologies that can allow the development of cyber-physical systems, similar if not superior to humans. The common wisdom is that intelligence might be provided by AI (Artificial Intelligence), a claim that is supported more by media coverage and commercial interests than by solid scientific evidence. AI is currently conceived in a quite broad sense, encompassing LLMs and a lot of other things, without any unifying principle, but self-motivating for the success in various areas. The current view of AI robotics mostly follows a purely disembodied approach that is consistent with the old-fashioned, Cartesian mind-body dualism, reflected in the software-hardware distinction inherent to the von Neumann computing architecture. The working hypothesis of this position paper is that the road to the next generation of autonomous robotic agents with cognitive capabilities requires a fully brain-inspired, embodied cognitive approach that avoids the trap of mind-body dualism and aims at the full integration of Bodyware and Cogniware. We name this approach Artificial Cognition (ACo) and ground it in Cognitive Neuroscience. It is specifically focused on proactive knowledge acquisition based on bidirectional human-robot interaction: the practical advantage is to enhance generalization and explainability. Moreover, we believe that a brain-inspired network of interactions is necessary for allowing humans to cooperate with artificial cognitive agents, building a growing level of personal trust and reciprocal accountability: this is clearly missing, although actively sought, in current AI. The ACo approach is a work in progress that can take advantage of a number of research threads, some of them antecedent the early attempts to define AI concepts and methods. In the rest of the paper we will consider some of the building blocks that need to be re-visited in a unitary framework: the principles of developmental robotics, the methods of action representation with prospection capabilities, and the crucial role of social interaction.
Collapse
Affiliation(s)
| | | | - Pietro Morasso
- Italian Institute of Technology, Cognitive Architecture for Collaborative Technologies (CONTACT) and Robotics, Brain and Cognitive Sciences (RBCS) Research Units, Genoa, Italy
| |
Collapse
|
2
|
Nakamura A, Miura R, Suzuki Y, Morasso P, Nomura T. Discrete cortical control during quiet stance revealed by desynchronization and rebound of beta oscillations. Neurosci Lett 2023; 814:137443. [PMID: 37591357 DOI: 10.1016/j.neulet.2023.137443] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Revised: 07/07/2023] [Accepted: 08/14/2023] [Indexed: 08/19/2023]
Abstract
Postural sway during quiet stance often exhibits a repetition of micro-fall and the subsequent micro-recovery. The classical view -that the quiet bipedal stance is stabilized by the ankle joint stiffness- has been challenged by paradoxical non-spring-like behaviors of calf muscles: gastrocnemius muscles are shortened and then lengthened, respectively, during the micro-fall and the micro-recovery. Here, we examined EEG based brain activity during quiet stance, and identified desynchronization and synchronization of beta oscillations that were associated, respectively, with the micro-fall and the micro-recovery. Based on a widely accepted scenario for beta-band desynchronization during movement and post-movement rebound in the control of discrete voluntary movement, our results reveal that the beta rebound can be considered as a manifestation of stop command to punctuate the motor control for every fall-recovery cycle. Namely, cortical interventions to the automatic postural control are discrete, rather than continuous modulations. The finding is highly compatible with the intermittent control model, rather than the stiffness control model.
Collapse
Affiliation(s)
- Akihiro Nakamura
- Department of Mechanical Science and Bioengineering, Graduate School of Engineering Science, Osaka University, Osaka, Japan.
| | - Ryota Miura
- Department of Mechanical Science and Bioengineering, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | - Yasuyuki Suzuki
- Department of Mechanical Science and Bioengineering, Graduate School of Engineering Science, Osaka University, Osaka, Japan
| | | | - Taishin Nomura
- Department of Mechanical Science and Bioengineering, Graduate School of Engineering Science, Osaka University, Osaka, Japan.
| |
Collapse
|
3
|
Albanese GA, Marini F, Morasso P, Campus C, Zenzeri J. μ-band desynchronization in the contralateral central and central-parietal areas predicts proprioceptive acuity. Front Hum Neurosci 2023; 17:1000832. [PMID: 37007684 PMCID: PMC10050694 DOI: 10.3389/fnhum.2023.1000832] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Accepted: 02/28/2023] [Indexed: 03/17/2023] Open
Abstract
IntroductionPosition sense, which belongs to the sensory stream called proprioception, is pivotal for proper movement execution. Its comprehensive understanding is needed to fill existing knowledge gaps in human physiology, motor control, neurorehabilitation, and prosthetics. Although numerous studies have focused on different aspects of proprioception in humans, what has not been fully investigated so far are the neural correlates of proprioceptive acuity at the joints.MethodsHere, we implemented a robot-based position sense test to elucidate the correlation between patterns of neural activity and the degree of accuracy and precision exhibited by the subjects. Eighteen healthy participants performed the test, and their electroencephalographic (EEG) activity was analyzed in its μ band (8–12 Hz), as the frequency band related to voluntary movement and somatosensory stimulation.ResultsWe observed a significant positive correlation between the matching error, representing proprioceptive acuity, and the strength of the activation in contralateral hand motor and sensorimotor areas (left central and central-parietal areas). In absence of visual feedback, these same regions of interest (ROIs) presented a higher activation level compared to the association and visual areas. Remarkably, central and central-parietal activation was still observed when visual feedback was added, although a consistent activation in association and visual areas came up.ConclusionSumming up, this study supports the existence of a specific link between the magnitude of activation of motor and sensorimotor areas related to upper limb proprioceptive processing and the proprioceptive acuity at the joints.
Collapse
Affiliation(s)
- Giulia Aurora Albanese
- Department of Robotics, Brain and Cognitive Sciences, Fondazione Istituto Italiano di Tecnologia, Genoa, Italy
- Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genoa, Genoa, Italy
- *Correspondence: Giulia Aurora Albanese,
| | | | - Pietro Morasso
- Department of Robotics, Brain and Cognitive Sciences, Fondazione Istituto Italiano di Tecnologia, Genoa, Italy
| | - Claudio Campus
- U-VIP Unit for Visually Impaired People, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Jacopo Zenzeri
- Department of Robotics, Brain and Cognitive Sciences, Fondazione Istituto Italiano di Tecnologia, Genoa, Italy
- ReWing S.r.l., Milan, Italy
| |
Collapse
|
4
|
Morasso P. Taming the abundance of degrees of freedom: Comment on "Motor invariants in action execution and perception" by Francesco Torricelli et al. Phys Life Rev 2023; 44:166-169. [PMID: 36753907 DOI: 10.1016/j.plrev.2023.01.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2023] [Accepted: 01/29/2023] [Indexed: 02/04/2023]
|
5
|
Morasso P. The Quest for Cognition in Purposive Action: From Cybernetics to Quantum Computing. J Integr Neurosci 2023; 22:39. [PMID: 36992588 DOI: 10.31083/j.jin2202039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2022] [Revised: 11/07/2022] [Accepted: 11/09/2022] [Indexed: 02/19/2023] Open
Abstract
Norbert Wiener and Nikolai Bernstein set the stage for a worldwide multidisciplinary attempt to understand how purposive action is integrated with cognition in a circular, bidirectional manner, both in life sciences and engineering. Such a 'workshop' is still open and far away from a satisfactory level of understanding, despite the current hype surrounding Artificial Intelligence (AI). The problem is that Cognition is frequently confused with Intelligence, overlooking a crucial distinction: the type of cognition that is required of a cognitive agent to meet the challenge of adaptive behavior in a changing environment is Embodied Cognition, which is antithetical to the disembodied and dualistic nature of the current wave of AI. This essay is the perspective formulation of a cybernetic framework for the representation of actions that, following Bernstein, is focused on what has long been considered the fundamental issue underlying action and motor control, namely the degrees of freedom problem. In particular, the paper reviews a solution to this problem based on a model of ideomotor/muscle-less synergy formation, namely the Passive Motion Paradigm (PMP). Moreover, it is shown how this modeling approach can be reformulated in a distributed manner based on a self-organizing neural paradigm consisting of multiple topology-representing networks with attractor dynamics. The computational implication of such an approach is also briefly analyzed looking at possible alternatives of the von Neuman paradigm, namely neuromorphic and quantum computing, aiming in perspective at a hybrid computational framework for integrating digital information, analog information, and quantum information. It is also suggested that such a framework is crucial not only for the neurobiological modeling of motor cognition but also for the design of the cognitive architecture of autonomous robots of industry 4.0 that are supposed to interact and communicate naturally with human partners.
Collapse
Affiliation(s)
- Pietro Morasso
- Istituto Italiano di Tecnologia, Center for Human Technologies, Robotics, Brain, and Cognitive Sciences, 16152 Genoa, Italy
| |
Collapse
|
6
|
Morasso P. Integrating ankle and hip strategies for the stabilization of upright standing: An intermittent control model. Front Comput Neurosci 2022; 16:956932. [PMID: 36465968 PMCID: PMC9713939 DOI: 10.3389/fncom.2022.956932] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2022] [Accepted: 10/25/2022] [Indexed: 08/03/2023] Open
Abstract
Even in unperturbed upright standing of healthy young adults, body sway involves concurrent oscillations of ankle and hip joints, thus suggesting to using biomechanical models with at least two degrees of freedom, namely, a double inverted pendulum (DIP) framework. However, in a previous study, it was demonstrated that the observed coordinated ankle-hip patterns do not necessarily require the independent active control of the two joints but can be explained by a simpler hybrid control system, with a single active component (intermittent, delayed sensory feedback of the ongoing sway) applied to the ankle joint and a passive component (stiffness control) applied to the hip joint. In particular, the proposed active component was based on the internal representation of a virtual inverted pendulum (VIP) that links the ankle to the current position of the global center of mass (CoM). This hybrid control system, which can also be described as an ankle strategy, is consistent with the known kinematics of the DIP and, in particular, with the anti-phase correlation of the acceleration profiles of the two joints. The purpose of this study is to extend the hybrid control model in order to apply to both the ankle and hip strategy, clarifying as well the rationale of mixed strategies. The extension consists of applying the hybrid control scheme to both joints: a passive stiffness component and an active intermittent component, based on the same feedback signals derived from the common VIP but with independent parameter gains for the two joints. Thus, the hip gains are null in the pure ankle strategy, the ankle gains are null in the pure hip strategy, and both ankle and hip gains are specifically tuned in mixed strategies. The simulation of such an extended model shows that it can reproduce both strategies; moreover, the pure ankle strategy is more robust than the hip strategy, because the range of variation (RoV) of the intermittent control gains is larger in the former case than in the latter, and the pure ankle strategy is also more energy efficient. Generally, the simulations suggest that there is no advantage to employ mixed strategies, except in borderline situations in which the control gains are just outside the RoV that provides stable control for either pure strategy: in this case, a stable mixed strategy can emerge from the combination of two marginally unstable pure strategies.
Collapse
|
7
|
Albanese GA, Falzarano V, Holmes MWR, Morasso P, Zenzeri J. A Dynamic Submaximal Fatigue Protocol Alters Wrist Biomechanical Properties and Proprioception. Front Hum Neurosci 2022; 16:887270. [PMID: 35712530 PMCID: PMC9196583 DOI: 10.3389/fnhum.2022.887270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2022] [Accepted: 05/11/2022] [Indexed: 11/13/2022] Open
Abstract
Fatigue is a temporary condition that arises as a result of intense and/or prolonged use of muscles and can affect skilled human performance. Therefore, the quantitative analysis of these effects is a topic of crucial interest in both ergonomics and clinical settings. This study introduced a novel protocol, based on robotic techniques, to quantitatively assess the effects of fatigue on the human wrist joint. A wrist manipulandum was used for two concurrent purposes: (1) implementing the fatigue task and (2) assessing the functional changes both before and at four time points after the end of the fatigue task. Fourteen participants completed the experimental protocol, which included the fatigue task and assessment sessions over 2 days. Specifically, the assessments performed are related to the following indicators: (1) isometric forces, (2) biomechanical properties of the wrist, (3) position sense, and (4) stretch reflexes of the muscles involved. The proposed fatigue task was a short-term, submaximal and dynamic wrist flexion/extension task designed with a torque opposing wrist flexion. A novel task termination criterion was employed and based on a percentage decrease in the mean frequency of muscles measured using surface electromyography. The muscle fatigue analysis demonstrated a change in mean frequency for both the wrist flexors and extensors, however, only the isometric flexion force decreased 4 min after the end of the task. At the same time point, wrist position sense was significantly improved and stiffness was the lowest. Viscosity presented different behaviors depending on the direction evaluated. At the end of the experiment (about 12 min after the end of the fatigue task), wrist position sense recovered to pre-fatigue values, while biomechanical properties did not return to their pre-fatigue values. Due to the wide variety of fatigue tasks proposed in the literature, it has been difficult to define a complete framework that presents the dynamic of fatigue-related changes in different components associated with wrist function. This work enables us to discuss the possible causes and the mutual relationship of the changes detected after the same task.
Collapse
Affiliation(s)
- Giulia A. Albanese
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
- Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genoa, Genoa, Italy
- *Correspondence: Giulia A. Albanese,
| | - Valeria Falzarano
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
- Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genoa, Genoa, Italy
| | - Michael W. R. Holmes
- Faculty of Applied Health Sciences, Brock University, St. Catharines, ON, Canada
| | - Pietro Morasso
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Jacopo Zenzeri
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|
8
|
Abstract
The human “marionette” is extremely complex and multi-articulated: anatomical redundancy (in terms of Degrees of Freedom: DoFs), kinematic redundancy (movements can have different trajectories, velocities, and accelerations and yet achieve the same goal, according to the principle of Motor Equivalence), and neurophysiological redundancy (many more muscles than DoFs and multiple motor units for each muscle). Although it is quite obvious that such abundance is not noxious at all because, in contrast, it is instrumental for motor learning, allowing the nervous system to “explore” the space of feasible actions before settling on an elegant and possibly optimal solution, the crucial question then boils down to figure out how the nervous system “chooses/selects/recruits/modulates” task-dependent subsets of countless assemblies of DoFs as functional motor synergies. Despite this daunting conceptual riddle, human purposive behavior in daily life activities is a proof of concept that solutions can be found easily and quickly by the embodied brain of the human cognitive agent. The point of view suggested in this essay is to frame the question above in the old-fashioned but still seminal observation by Marr and Poggio that cognitive agents should be regarded as Generalized Information Processing Systems (GIPS) and should be investigated according to three nearly independent but complementary levels of analysis: 1) the computational level, 2) the algorithmic level, and 3) the implementation level. In this framework, we attempt to discriminate as well as aggregate the different hypotheses and solutions proposed so far: the optimal control hypothesis, the muscle synergy hypothesis, the equilibrium point hypothesis, or the uncontrolled manifold hypothesis, to mention the most popular ones. The proposed GIPS follows the strategy of factoring out shaping and timing by adopting a force-field based approach (the Passive Motion Paradigm) that is inspired by the Equilibrium Point Hypothesis, extended in such a way to represent covert as well overt actions. In particular, it is shown how this approach can explain spatio-temporal invariances and, at the same time, solve the Degrees of Freedom Problem.
Collapse
|
9
|
Albanese GA, Falzarano V, Holmes MWR, Morasso P, Zenzeri J. Implementing a robust wrist dynamic fatigue task: repeatability and investigation of the features involved. Annu Int Conf IEEE Eng Med Biol Soc 2021; 2021:6487-6490. [PMID: 34892596 DOI: 10.1109/embc46164.2021.9630291] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
In this study, we implemented a protocol for the robotic assessment of the effects of forearm muscle fatigue on wrist dynamics. The potential of robotic devices lies in the possibility to control and measure a wide variety of kinematic and physiological variables, both in repeated sessions over time and during real-time assessments. The implemented fatigue task is tailored to the robotically assessed single-subject maximal force and based on a real-time evaluation of muscle activity. The protocol resulted to be repeatable across sessions evaluated on the same subject and a preliminary step toward a better understanding of which features should be monitored to design a robust and strongly controlled dynamic fatiguing task.
Collapse
|
10
|
Falzarano V, Holmes MWR, Masia L, Morasso P, Zenzeri J. Evaluating Viscoelastic Properties of the Wrist Joint During External Perturbations: Influence of Velocity, Grip, and Handedness. Front Hum Neurosci 2021; 15:726841. [PMID: 34671248 PMCID: PMC8520977 DOI: 10.3389/fnhum.2021.726841] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Accepted: 09/13/2021] [Indexed: 11/30/2022] Open
Abstract
In this study, we designed a robot-based method to compute a mechanical impedance model that could extract the viscoelastic properties of the wrist joint. Thirteen subjects participated in the experiment, testing both dominant and nondominant hands. Specifically, the robotic device delivered position-controlled disturbances in the flexion-extension degree of freedom of the wrist. The external perturbations were characterized by small amplitudes and fast velocities, causing rotation at the wrist joint. The viscoelastic characteristics of the mechanical impedance of the joint were evaluated from the wrist kinematics and corresponding torques. Since the protocol used position inputs to determine changes in mean wrist torque, a detailed analysis of wrist joint dynamics could be made. The scientific question was whether and how these mechanical features changed with various grip demands and perturbation velocities. Nine experimental conditions were tested for each hand, given by the combination of three velocity perturbations (fast, medium, and slow) and three hand grip conditions [self-selected grip, medium and high grip force, as percentage of the maximum voluntary contraction (MVC)]. Throughout the experiments, electromyographic signals of the extensor carpi radialis (ECR) and the flexor carpi radialis (FCR) were recorded. The novelty of this work included a custom-made soft grip sensor, wrapped around the robotic handle, to accurately quantify the grip force exerted by the subjects during experimentation. Damping parameters were in the range of measurements from prior studies and consistent among the different experimental conditions. Stiffness was independent of both direction and velocity of perturbations and increased with increasing grip demand. Both damping and stiffness were not different between the dominant and nondominant hands. These results are crucial to improving our knowledge of the mechanical characteristics of the wrist, and how grip demands influence these properties. This study is the foundation for future work on how mechanical characteristics of the wrist are affected in pathological conditions.
Collapse
Affiliation(s)
- Valeria Falzarano
- Department of Informatics, Bioengineering, Robotics, and Systems Engineering, University of Genova, Genova, Italy.,Robotics, Brain, and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Michael W R Holmes
- Faculty of Applied Health Sciences, Brock University, St. Catharines, ON, Canada
| | - Lorenzo Masia
- Institut für Technische Informatik, Universität Heidelberg, Heidelberg, Germany
| | - Pietro Morasso
- Robotics, Brain, and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Jacopo Zenzeri
- Robotics, Brain, and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|
11
|
Albanese GA, Holmes MWR, Marini F, Morasso P, Zenzeri J. Wrist Position Sense in Two Dimensions: Between-Hand Symmetry and Anisotropic Accuracy Across the Space. Front Hum Neurosci 2021; 15:662768. [PMID: 33967724 PMCID: PMC8100524 DOI: 10.3389/fnhum.2021.662768] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Accepted: 03/29/2021] [Indexed: 02/01/2023] Open
Abstract
A deep investigation of proprioceptive processes is necessary to understand the relationship between sensory afferent inputs and motor outcomes. In this work, we investigate whether and how perception of wrist position is influenced by the direction along which the movement occurs. Most previous studies have tested Joint Position Sense (JPS) through 1 degree of freedom (DoF) wrist movements, such as flexion/extension (FE) or radial/ulnar deviation (RUD). However, the wrist joint has 3-DoF and many activities of daily living produce combined movements, requiring at least 2-DoF wrist coordination. For this reason, in this study, target positions involved movement directions that combined wrist flexion or extension with radial or ulnar deviation. The chosen task was a robot-aided Joint Position Matching (JPM), in which blindfolded participants actively reproduced a previously passively assumed target joint configuration. The JPM performance of 20 healthy participants was quantified through measures of accuracy and precision, in terms of both perceived target direction and distance along each direction of movement. Twelve different directions of movement were selected and both hands tested. The left and right hand led to comparable results, both target extents and directions were differently perceived according to the target direction on the FE/RUD space. Moreover, during 2-DoF combined movements, subjects' perception of directions was impaired when compared to 1-DoF target movements. In summary, our results showed that human perception of wrist position on the FE/RUD space is symmetric between hands but not isotropic among movement directions.
Collapse
Affiliation(s)
- Giulia A Albanese
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy.,Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS), University of Genoa, Genoa, Italy
| | - Michael W R Holmes
- Faculty of Applied Health Sciences, Brock University, St. Catharines, ON, Canada
| | | | - Pietro Morasso
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Jacopo Zenzeri
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| |
Collapse
|
12
|
Tacchino C, Impagliazzo M, Maggi E, Bertamino M, Blanchi I, Campone F, Durand P, Fato M, Giannoni P, Iandolo R, Izzo M, Morasso P, Moretti P, Ramenghi L, Shima K, Shimatani K, Tsuji T, Uccella S, Zanardi N, Casadio M. Spontaneous movements in the newborns: a tool of quantitative video analysis of preterm babies. Comput Methods Programs Biomed 2021; 199:105838. [PMID: 33421664 DOI: 10.1016/j.cmpb.2020.105838] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 11/08/2020] [Indexed: 06/12/2023]
Abstract
BACKGROUND AND OBJECTIVES The number of preterm babies is steadily growing world-wide and these neonates are at risk of neuro-motor-cognitive deficits. The observation of spontaneous movements in the first three months of age is known to predict such risk. However, the analysis by specifically trained physiotherapists is not suited for the clinical routine, motivating the development of simple computerized video analysis systems, integrated with a well-structured Biobank to make available for preterm babies a growing service with diagnostic, prognostic and epidemiological purposes. METHODS MIMAS (Markerless Infant Movement Analysis System) is a simple, low-cost system of video analysis of spontaneous movements of newborns in their natural environment, based on a single standard RGB camera, without markers attached to the body. The original videos are transformed into binarized sequences highlighting the silhouette of the baby, in order to minimize the illumination effects and increase the robustness of the analysis; such sequences are then coded by a large set of parameters (39) related to the spatial and spectral changes of the silhouette. The parameter vectors of each baby were stored in the Biobank together with related clinical information. RESULTS The preliminary test of the system was carried out at the Gaslini Pediatric Hospital in Genoa, where 46 preterm (PT) and 21 full-term (FT) babies (as controls) were recorded at birth (T0) and 8-12 weeks thereafter (T1). A simple statistical analysis of the data showed that the coded parameters are sensitive to the degree of maturation of the newborns (comparing T0 with T1, for both PT and FT babies), and to the conditions at birth (PT vs. FT at T0), whereas this difference tends to vanish at T1. Moreover, the coding method seems also able to detect the few 'abnormal' preterm babies in the PT populations that were analyzed as specific case studies. CONCLUSIONS Preliminary results motivate the adoption of this tool in clinical practice allowing for a systematic accumulation of cases in the Biobank, thus for improving the accuracy of data analysis performed by MIMAS and ultimately allowing the adoption of data mining techniques.
Collapse
Affiliation(s)
- Chiara Tacchino
- Physical Medicine and Rehabilitation, Gaslini Pediatric Hospital, Genoa, Italy
| | | | - Erika Maggi
- DIBRIS dept., University of Genoa, Genoa, Italy
| | - Marta Bertamino
- Physical Medicine and Rehabilitation, Gaslini Pediatric Hospital, Genoa, Italy
| | - Isa Blanchi
- Physical Medicine and Rehabilitation, Gaslini Pediatric Hospital, Genoa, Italy
| | - Francesca Campone
- Physical Medicine and Rehabilitation, Gaslini Pediatric Hospital, Genoa, Italy
| | - Paola Durand
- Physical Medicine and Rehabilitation, Gaslini Pediatric Hospital, Genoa, Italy
| | - Marco Fato
- DIBRIS dept., University of Genoa, Genoa, Italy
| | | | - Riccardo Iandolo
- DIBRIS dept., University of Genoa, Genoa, Italy; RBCS dept., Italian Institute of Technology, Genoa, Italy
| | - Massimiliano Izzo
- DIBRIS dept., University of Genoa, Genoa, Italy; Oxford e-Research Centre, Department of Engineering Science, University of Oxford, Oxford, UK
| | - Pietro Morasso
- DIBRIS dept., University of Genoa, Genoa, Italy; RBCS dept., Italian Institute of Technology, Genoa, Italy
| | - Paolo Moretti
- Physical Medicine and Rehabilitation, Gaslini Pediatric Hospital, Genoa, Italy
| | - Luca Ramenghi
- Intensive Therapy and Neonatal Pathology, Gaslini Pediatric Hospital, Genoa, Italy
| | - Keisuke Shima
- Faculty of Engineering, Yokohama National University, Yokohama, Japan
| | - Koji Shimatani
- Dept. of Physical Therapy, Prefectural University of Hiroshima, Hiroshima, Japan
| | - Toshio Tsuji
- Dept. of System Cybernetics, Graduate School of Engineering, Hiroshima University, Hiroshima, Japan
| | - Sara Uccella
- Physical Medicine and Rehabilitation, Gaslini Pediatric Hospital, Genoa, Italy
| | | | - Maura Casadio
- DIBRIS dept., University of Genoa, Genoa, Italy; RBCS dept., Italian Institute of Technology, Genoa, Italy.
| |
Collapse
|
13
|
Suzuki Y, Nakamura A, Milosevic M, Nomura K, Tanahashi T, Endo T, Sakoda S, Morasso P, Nomura T. Postural instability via a loss of intermittent control in elderly and patients with Parkinson's disease: A model-based and data-driven approach. Chaos 2020; 30:113140. [PMID: 33261318 DOI: 10.1063/5.0022319] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/21/2020] [Accepted: 10/28/2020] [Indexed: 06/12/2023]
Abstract
Postural instability is one of the major symptoms of Parkinson's disease. Here, we assimilated a model of intermittent delay feedback control during quiet standing into postural sway data from healthy young and elderly individuals as well as patients with Parkinson's disease to elucidate the possible mechanisms of instability. Specifically, we estimated the joint probability distribution of a set of parameters in the model using the Bayesian parameter inference such that the model with the inferred parameters can best-fit sway data for each individual. It was expected that the parameter values for three populations would distribute differently in the parameter space depending on their balance capability. Because the intermittent control model is parameterized by a parameter associated with the degree of intermittency in the control, it can represent not only the intermittent model but also the traditional continuous control model with no intermittency. We showed that the inferred parameter values for the three groups of individuals are classified into two major groups in the parameter space: one represents the intermittent control mostly for healthy people and patients with mild postural symptoms and the other the continuous control mostly for some elderly and patients with severe postural symptoms. The results of this study may be interpreted by postulating that increased postural instability in most Parkinson's patients and some elderly persons might be characterized as a dynamical disease.
Collapse
Affiliation(s)
- Yasuyuki Suzuki
- Graduate School of Engineering Science, Osaka University, Osaka 5608531, Japan
| | - Akihiro Nakamura
- Graduate School of Engineering Science, Osaka University, Osaka 5608531, Japan
| | - Matija Milosevic
- Graduate School of Engineering Science, Osaka University, Osaka 5608531, Japan
| | - Kunihiko Nomura
- Department of Information Technology and Social Sciences, Osaka University of Economics, Osaka 5338533, Japan
| | - Takao Tanahashi
- Department of Neurology, Osaka Rosai Hospital, Osaka 5918025, Japan
| | - Takuyuki Endo
- Department of Neurology, Osaka Toneyama Medical Center, Osaka 5608552, Japan
| | - Saburo Sakoda
- Department of Neurology, Osaka Toneyama Medical Center, Osaka 5608552, Japan
| | - Pietro Morasso
- Center for Human Technologies, Istituto Italiano di Tecnologia, Genoa 16163, Italy
| | - Taishin Nomura
- Graduate School of Engineering Science, Osaka University, Osaka 5608531, Japan
| |
Collapse
|
14
|
Morasso P. Centre of pressure versus centre of mass stabilization strategies: the tightrope balancing case. R Soc Open Sci 2020; 7:200111. [PMID: 33047011 PMCID: PMC7540784 DOI: 10.1098/rsos.200111] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/16/2020] [Accepted: 08/14/2020] [Indexed: 06/01/2023]
Abstract
This study proposes a generalization of the ankle and hip postural strategies to be applied to the large class of skills that share the same basic challenge of defeating the destabilizing effect of gravity on the basis of the same neuromotor control organization, adapted and specialized to a variable number of degrees of freedom, different body parts, different muscles and different sensory feedback channels. In all the cases, we can identify two crucial elements (the CoP, centre of pressure and the CoM, centre of mass) and the central point of the paper is that most balancing skills can be framed in the CoP-CoM interplay and can be modelled as a combination/alternation of two basic stabilization strategies: the standard well-investigated COPS (or CoP stabilization strategy, the default option), where the CoM is the controlled variable and the CoP is the control variable, and the less investigated COMS (or CoM stabilization strategy), where CoP and CoM must exchange their role because the range of motion of the CoP is strongly constrained by environmental conditions. The paper focuses on the tightrope balancing skill where sway control in the sagittal plane is modelled in terms of the COPS while the more challenging sway in the coronal plane is modelled in terms of the COMS, with the support of a suitable balance pole. Both stabilization strategies are implemented as state-space intermittent, delayed feedback controllers, independent of each other. Extensive simulations support the degree of plausibility, generality and robustness of the proposed approach.
Collapse
Affiliation(s)
- Pietro Morasso
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Via Enrico Melen 83, 16152 Genoa, Italy
| |
Collapse
|
15
|
Ballardini G, Florio V, Canessa A, Carlini G, Morasso P, Casadio M. Vibrotactile Feedback for Improving Standing Balance. Front Bioeng Biotechnol 2020; 8:94. [PMID: 32154229 PMCID: PMC7046798 DOI: 10.3389/fbioe.2020.00094] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2019] [Accepted: 01/31/2020] [Indexed: 01/01/2023] Open
Abstract
Maintaining balance standing upright is an active process that complements the stabilizing properties of muscle stiffness with feedback control driven by independent sensory channels: proprioceptive, visual, and vestibular. Considering that the contribution of these channels is additive, we investigated to what extent providing an additional channel, based on vibrotactile stimulation, may improve balance control. This study focused only on healthy young participants for evaluating the effects of different encoding methods and the importance of the informational content. We built a device that provides a vibrotactile feedback using two vibration motors placed on the anterior and posterior part of the body, at the L5 level. The vibration was synchronized with an accelerometric measurement encoding a combination of the position and acceleration of the body center of mass in the anterior-posterior direction. The goal was to investigate the efficacy of the information encoded by this feedback in modifying postural patterns, comparing, in particular, two different encoding methods: vibration always on and vibration with a dead zone, i.e., silent in a region around the natural stance posture. We also studied if after the exposure, the participants modified their normal oscillation patterns, i.e., if there were after effects. Finally, we investigated if these effects depended on the informational content of the feedback, introducing trials with vibration unrelated to the actual postural oscillations (sham feedback). Twenty-four participants were asked to stand still with their eyes closed, alternating trials with and without vibrotactile feedback: nine were tested with vibration always on and sham feedback, fifteen with dead zone feedback. The results show that synchronized vibrotactile feedback reduces significantly the sway amplitude while increasing the frequency in anterior-posterior and medial-lateral directions. The two encoding methods had no different effects of reducing the amount of postural sway during exposure to vibration, however only the dead-zone feedback led to short-term after effects. The presence of sham vibration, instead, increased the sway amplitude, highlighting the importance of the encoded information.
Collapse
Affiliation(s)
- Giulia Ballardini
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Genoa, Italy
| | - Valeria Florio
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Genoa, Italy
| | - Andrea Canessa
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Genoa, Italy
| | - Giorgio Carlini
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Genoa, Italy
| | - Pietro Morasso
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Genoa, Italy
- Department of Robotics, Brain and Cognitive Sciences, Italian Institute of Technology, Genoa, Italy
| | - Maura Casadio
- Department of Informatics, Bioengineering, Robotics and Systems Engineering, University of Genoa, Genoa, Italy
| |
Collapse
|
16
|
Fu C, Suzuki Y, Morasso P, Nomura T. Phase resetting and intermittent control at the edge of stability in a simple biped model generates 1/f-like gait cycle variability. Biol Cybern 2020; 114:95-111. [PMID: 31960137 DOI: 10.1007/s00422-020-00816-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/09/2019] [Accepted: 01/04/2020] [Indexed: 06/10/2023]
Abstract
The 1/f-like gait cycle variability, characterized by temporal changes in stride-time intervals during steady-state human walking, is a well-documented gait characteristic. Such gait fractality is apparent in healthy young adults, but tends to disappear in the elderly and patients with neurological diseases. However, mechanisms that give rise to gait fractality have yet to be fully clarified. We aimed to provide novel insights into neuro-mechanical mechanisms of gait fractality, based on a numerical simulation model of biped walking. A previously developed heel-toe footed, seven-rigid-link biped model with human-like body parameters in the sagittal plane was implemented and expanded. It has been shown that the gait model, stabilized rigidly by means of impedance control with large values of proportional (P) and derivative (D) gains for a linear feedback controller, is destabilized only in a low-dimensional eigenspace, as P and D decrease below and even far below critical values. Such low-dimensional linear instability can be compensated by impulsive, phase-dependent actions of nonlinear controllers (phase resetting and intermittent controllers), leading to the flexible walking with joint impedance in the model being as small as that in humans. Here, we added white noise to the model to examine P-value-dependent stochastic dynamics of the model for small D-values. The simulation results demonstrated that introduction of the nonlinear controllers in the model determined the fractal features of gait for a wide range of the P-values, provided that the model operates near the edge of stability. In other words, neither the model stabilized only by pure impedance control even at the edge of linear stability, nor the model stabilized by specific nonlinear controllers, but with P-values far inside the stability region, could induce gait fractality. Although only limited types of controllers were examined, we suggest that the impulsive nonlinear controllers and criticality could be major mechanisms for the genesis of gait fractality.
Collapse
Affiliation(s)
- Chunjiang Fu
- Graduate School of Engineering Science, Osaka University, Osaka, 5608531, Japan
- Honda R&D Innovative Research Excellence, Wako, Japan
| | - Yasuyuki Suzuki
- Graduate School of Engineering Science, Osaka University, Osaka, 5608531, Japan
| | - Pietro Morasso
- Center for Human Technologies, Istituto Italiano di Tecnologia, 16152, Genoa, Italy
| | - Taishin Nomura
- Graduate School of Engineering Science, Osaka University, Osaka, 5608531, Japan.
| |
Collapse
|
17
|
Abstract
Balancing a stick on the fingertip while standing upright is a dual balancing task that requires the integration of two independent control systems. This is a completely novel experimental paradigm for attempting to understand how the brain deals with equilibrium in a general way. Preliminary results are presented and interpreted in the framework of an intermittent control policy extended to include a dual balancing task. In particular the study reveals that the upright standing (the less critical task) is modified in an adaptive way, in order to facilitate the more critical task, i.e. stick balancing.
Collapse
|
18
|
Belgiovine G, Morasso P, Zenzeri J. Strategy preference in complex dynamical tasks: preliminary results .. Annu Int Conf IEEE Eng Med Biol Soc 2020; 2019:5104-5107. [PMID: 31947007 DOI: 10.1109/embc.2019.8856519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Many complex activities of daily living are characterized by instabilities. From a motor control point of view, there are two alternative stabilization mechanisms that require to integrate multi-joint coordination aspects: stiffness and positional stabilization strategies. The aim of this work is to understand how the central nervous system can switch between the two control paradigms, depending on the dynamic properties of the environment. This study reports the performance of healthy participants trained to master both strategies and, in particular, it shows how it is possible to quantitatively assess the individual strategy preference when specific environmental factors are introduced.
Collapse
|
19
|
Avanzino L, Cherif A, Crisafulli O, Carbone F, Zenzeri J, Morasso P, Abbruzzese G, Pelosin E, Konczak J. Tactile and proprioceptive dysfunction differentiates cervical dystonia with and without tremor. Neurology 2020; 94:e639-e650. [DOI: 10.1212/wnl.0000000000008916] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2019] [Accepted: 08/28/2019] [Indexed: 12/13/2022] Open
Abstract
ObjectiveTo determine whether different phenotypes of cervical dystonia (CD) express different types and levels of somatosensory impairment.MethodsWe assessed somatosensory function in patients with CD with and without tremor (n = 12 each) and in healthy age-matched controls (n = 22) by measuring tactile temporal discrimination thresholds of the nondystonic forearm and proprioceptive acuity in both the dystonic (head/neck) and nondystonic body segments (forearm/hand) using a joint position‐matching task. The head or the wrist was passively displaced along different axes to distinct joint positions by the experimenter or through a robotic exoskeleton. Participants actively reproduced the experienced joint position, and the absolute joint position‐matching error between the target and the reproduced positions served as a marker of proprioceptive acuity.ResultsTactile temporal discrimination thresholds were significantly elevated in both CD subgroups compared to controls. Proprioceptive acuity of both the dystonic and nondystonic body segments was elevated in patients with CD and tremor with respect to both healthy controls and patients with CD without tremor. That is, tactile abnormalities were a shared dysfunction of both CD phenotypes, while proprioceptive dysfunction was observed in patients with CD with tremor.ConclusionsOur findings suggest that the pathophysiology in CD can be characterized by 2 abnormal neural processes: a dysfunctional somatosensory gating mechanism involving the basal ganglia that triggers involuntary muscle spasms and abnormal processing of proprioceptive information within a defective corticocerebellar loop, likely affecting the feedback and feedforward control of head positioning. This dysfunction is expressed mainly in CD with tremor.
Collapse
|
20
|
Mohan V, Morasso P, Bhat A. The complementarity of 'Muscleless' motor synergies with motor control strategies in humans and robots: Reply to comments on "Muscleless motor synergies and actions without movements: From motor neuroscience to cognitive robotics". Phys Life Rev 2019; 30:130-133. [PMID: 31757600 DOI: 10.1016/j.plrev.2019.11.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2019] [Accepted: 11/05/2019] [Indexed: 11/19/2022]
Affiliation(s)
- Vishwanathan Mohan
- Dept. of Computer science, University of Essex, Wivenhoe Park, CO34SQ, UK.
| | - Pietro Morasso
- Robotics, Brain and Cognitive Sciences Dept, Via Enrico Melen 83, 16152 Genova, Italy.
| | - Ajaz Bhat
- Dept. of Psychology, University of East Anglia, UK.
| |
Collapse
|
21
|
Ballardini G, Ponassi V, Galofaro E, Carlini G, Marini F, Pellegrino L, Morasso P, Casadio M. Interaction between position sense and force control in bimanual tasks. J Neuroeng Rehabil 2019; 16:137. [PMID: 31703703 PMCID: PMC6839077 DOI: 10.1186/s12984-019-0606-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2019] [Accepted: 10/10/2019] [Indexed: 12/03/2022] Open
Abstract
Background Several daily living activities require people to coordinate the motion and the force produced by both arms, using their position sense and sense of effort. However, to date, the interaction in bimanual tasks has not been extensively investigated. Methods We focused on bimanual tasks where subjects were required:
(Experiment 1) to move their hands until reaching the same position – equal hand position implied identical arm configurations in joint space - under different loading conditions; (Experiment 2) to produce the same amount of isometric force by pushing upward, with their hands placed in symmetric or asymmetric positions.
The arm motions and forces required for accomplishing these tasks were in the vertical direction. We enrolled a healthy population of 20 subjects for Experiment 1 and 25 for Experiment 2. Our primary outcome was the systematic difference between the two hands at the end of each trial in terms of position for Experiment 1 and force for Experiment 2. In both experiments using repeated measure ANOVA we evaluated the effect of each specific condition, namely loading in the former case and hand configuration in the latter. Results In the first experiment, the difference between the hands’ positions was greater when they were concurrently loaded with different weights. Conversely, in the second experiment, when subjects were asked to exert equal forces with both arms, the systematic difference between left and right force was not influenced by symmetric or asymmetric arm configurations, but by the position of the left hand, regardless of the right hand position. The performance was better when the left hand was in the higher position. Conclusions The experiments report the reciprocal interaction between position sense and sense of effort inbimanual tasks performed by healthy subjects. Apart for the intrinsic interest for a better understanding of basic sensorimotor processes, the results are also relevant to clinical applications, for defining functional evaluation and rehabilitative protocols for people with neurological diseases or conditions that impair the ability to sense and control concurrently position and force.
Collapse
Affiliation(s)
- Giulia Ballardini
- Department of Informatics, Bioengineering, Robotics, and Systems Engineering, University of Genoa, Genoa, Italy.
| | - Valentina Ponassi
- Department of Informatics, Bioengineering, Robotics, and Systems Engineering, University of Genoa, Genoa, Italy
| | - Elisa Galofaro
- Department of Informatics, Bioengineering, Robotics, and Systems Engineering, University of Genoa, Genoa, Italy
| | - Giorgio Carlini
- Department of Informatics, Bioengineering, Robotics, and Systems Engineering, University of Genoa, Genoa, Italy
| | | | - Laura Pellegrino
- Department of Informatics, Bioengineering, Robotics, and Systems Engineering, University of Genoa, Genoa, Italy
| | | | - Maura Casadio
- Department of Informatics, Bioengineering, Robotics, and Systems Engineering, University of Genoa, Genoa, Italy
| |
Collapse
|
22
|
Marini F, Zenzeri J, Pippo V, Morasso P, Campus C. Neural correlates of proprioceptive upper limb position matching. Hum Brain Mapp 2019; 40:4813-4826. [PMID: 31348604 PMCID: PMC6865654 DOI: 10.1002/hbm.24739] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2019] [Revised: 07/15/2019] [Accepted: 07/16/2019] [Indexed: 11/06/2022] Open
Abstract
Proprioceptive information allows humans to perform smooth coordinated movements by constantly updating one's mind with knowledge of the position of one's limbs in space. How this information is combined with other sensory modalities and centrally processed to form conscious perceptions of limb position remains relatively unknown. What has proven even more elusive is pinpointing the contribution of proprioception in cortical activity related to motion. This study addresses these gaps by examining electrocortical dynamics while participants performed an upper limb position matching task in two conditions, namely with proprioceptive feedback or with both visual and proprioceptive feedback. Specifically, we evaluated the reduction of the electroencephalographic power (desynchronization) in the μ frequency band (8-12 Hz), which is known to characterize the neural activation associated with motor control and behavior. We observed a stronger desynchronization in the left motor and somatosensory areas, contralateral to the moving limb while, parietal and occipital regions, identifying association and visual areas, respectively, exhibited a similar activation level in the two hemispheres. Pertaining to the influence of the two experimental conditions it affected only movement's offset, and precisely we found that when matching movements are performed relying only on proprioceptive information, a lower cortical activity is entailed. This effect was strongest in the visual and association areas, while there was a minor effect in the hand motor and somatosensory areas.
Collapse
Affiliation(s)
- Francesca Marini
- Department of Robotics, Brain and Cognitive SciencesIstituto Italiano di TecnologiaGenoaItaly
| | - Jacopo Zenzeri
- Department of Robotics, Brain and Cognitive SciencesIstituto Italiano di TecnologiaGenoaItaly
| | - Valentina Pippo
- Department of Robotics, Brain and Cognitive SciencesIstituto Italiano di TecnologiaGenoaItaly
| | - Pietro Morasso
- Department of Robotics, Brain and Cognitive SciencesIstituto Italiano di TecnologiaGenoaItaly
| | - Claudio Campus
- U‐VIP Unit for Visually Impaired PeopleIstituto Italiano di TecnologiaGenoaItaly
| |
Collapse
|
23
|
Mohan V, Bhat A, Morasso P. Muscleless motor synergies and actions without movements: From motor neuroscience to cognitive robotics. Phys Life Rev 2019; 30:89-111. [DOI: 10.1016/j.plrev.2018.04.005] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2017] [Revised: 04/12/2018] [Accepted: 04/16/2018] [Indexed: 10/17/2022]
|
24
|
Marini F, Zenzeri J, Pippo V, Morasso P, Campus C. Movement related activity in the μ band of the human EEG during a robot-based proprioceptive task. IEEE Int Conf Rehabil Robot 2019; 2019:1019-1024. [PMID: 31374763 DOI: 10.1109/icorr.2019.8779552] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Innovative research in the fields of prosthetic, neurorehabilitation, motor control and human physiology has been focusing on the study of proprioception, the sense through which we perceive the position and movement of our body, and great achievements have been obtained regarding its assessment and characterization. However, how proprioceptive signals are combined with other sensory modalities and processed by the central nervous system to form a conscious body image, is still unknown. Such a crucial question was addressed in this study, which involved 23 healthy subjects, by combining a robot-based proprioceptive test with a specific analysis of electroencephalographic activity (EEG) in the $\mu$ frequency band (8-12 Hz). We observed important activation in the motor area contralateral to the moving hand, and besides, a substantial bias in brain activation and proprioceptive acuity when visual feedback was provided in addition to the proprioceptive information during movement execution. In details, brain activation and proprioceptive acuity were both higher in case of movements performed with visual feedback. Remarkably, we also found a correlation between the level of activation in the brain motor area contralateral to the moving hand and the value of proprioceptive acuity.
Collapse
|
25
|
Morasso P, Nomura T, Suzuki Y, Zenzeri J. Stabilization of a Cart Inverted Pendulum: Improving the Intermittent Feedback Strategy to Match the Limits of Human Performance. Front Comput Neurosci 2019; 13:16. [PMID: 31024281 PMCID: PMC6461063 DOI: 10.3389/fncom.2019.00016] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2019] [Accepted: 03/11/2019] [Indexed: 11/13/2022] Open
Abstract
Stabilization of the CIP (Cart Inverted Pendulum) is an analogy to stick balancing on a finger and is an example of unstable tasks that humans face in everyday life. The difficulty of the task grows exponentially with the decrease of the length of the stick and a stick length of 32 cm is considered as a human limit even for well-trained subjects. Moreover, there is a cybernetic limit related to the delay of the multimodal sensory feedback (about 230 ms) that supports a feedback stabilization strategy. We previously demonstrated that an intermittent-feedback control paradigm, originally developed for modeling the stabilization of upright standing, can be applied with success also to the CIP system, but with values of the critical parameters far from the limiting ones (stick length 50 cm and feedback delay 100 ms). The intermittent control paradigm is based on the alternation of on-phases, driven by a proportional/derivative delayed feedback controller, and off-phases, where the feedback is switched off and the motion evolves according to the intrinsic dynamics of the CIP. In its standard formulation, the switching mechanism consists of a simple threshold operator: the feedback control is switched off if the current (delayed) state vector is closer to the stable than to the unstable manifold of the off-phase and is switched on in the opposite case. Although this simple formulation is effective for explaining upright standing as well as CIP balancing, it fails in the most challenging configuration of the CIP. In this work we propose a modification of the standard intermittent control policy that focuses on the explicit selection of switching times and is based on the phase reset of the estimated state vector at each switching time and on the simulation of an approximated internal model of CIP dynamics. We demonstrate, by simulating the modified intermittent control policy, that it can match the limits of human performance, while operating near the edge of instability.
Collapse
Affiliation(s)
- Pietro Morasso
- Robotics, Brain and Cognitive Sciences Department, Center for Human Technologies, Italian Institute of Technology, Genoa, Italy
| | - Taishin Nomura
- Mechanical Science and Bioengineering Department, Graduate School of Engineering Science, Osaka University, Toyonaka, Japan
| | - Yasuyuki Suzuki
- Mechanical Science and Bioengineering Department, Graduate School of Engineering Science, Osaka University, Toyonaka, Japan
| | - Jacopo Zenzeri
- Robotics, Brain and Cognitive Sciences Department, Center for Human Technologies, Italian Institute of Technology, Genoa, Italy
| |
Collapse
|
26
|
Abstract
In the study of balance and postural control the (Single) Inverted Pendulum model (SIP) has been taken for a long time as an acceptable paradigm, with the implicit assumption that only ankle rotations are relevant for describing and explaining sway movements. However, more recent kinematic analysis of quiet standing revealed that hip motion cannot be neglected at all and that ankle-hip oscillatory patterns are characterized by complex in-phase and anti-phase interactions, suggesting that the SIP model should be substituted by a DIP (Double Inverted Pendulum) model. It was also suggested that DIP control could be characterized as a kind of optimal bi-axial active controller whose goal is minimizing the acceleration of the global CoM (Center of Mass). We propose here an alternative where active feedback control is applied in an intermittent manner only to the ankle joint, whereas the hip joint is stabilized by a passive stiffness mechanism. The active control impulses are delivered to the ankle joint as a function of the delayed state vector (tilt rotation angle + tilt rotational speed) of a Virtual Inverted Pendulum (VIP), namely a pendulum that links the ankle to the CoM, embedded in the real DIP. Simulations of such DIP/VIP model, with the hybrid control mechanism, show that it can reproduce the in-phase/anti-phase interaction patterns of the two joints described by several experimental studies. Moreover, the simulations demonstrate that the DIP/VIP model can also reproduce the measured minimization of the CoM acceleration, as an indirect biomechanical consequence of the dynamic interaction between the active control of the ankle joint and the passive control of the hip joint. We suggest that although the SIP model is literally false, because it ignores the ankle-hip coordination, it is functionally correct and practically acceptable for experimental studies that focus on the postural oscillations of the CoM.
Collapse
Affiliation(s)
- Pietro Morasso
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Amel Cherif
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genoa, Italy
- Department of Informatics, Bioengineering, Robotics, and System Engineering, University of Genoa, Genoa, Italy
| | - Jacopo Zenzeri
- Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genoa, Italy
- * E-mail:
| |
Collapse
|
27
|
Abstract
BACKGROUND Several neuromuscular disorders present muscle fatigue as a typical symptom. Therefore, a reliable method of fatigue assessment may be crucial for understanding how specific disease features evolve over time and for developing effective rehabilitation strategies. Unfortunately, despite its importance, a standardized, reliable and objective method for fatigue measurement is lacking in clinical practice and this work investigates a practical solution. METHODS 40 healthy young adults performed a haptic reaching task, while holding a robotic manipulandum. Subjects were required to perform wrist flexion and extension movements in a resistive visco-elastic force field, as many times as possible, until the measured muscles (mainly flexor and extensor carpi radialis) exhibited signs of fatigue. In order to analyze the behavior and the characteristics of the two muscles, subjects were divided into two groups: in the first group, the resistive force was applied by the robot only during flexion movements, whereas, in the second group, the force was applied only during extension movements. Surface electromyographic signals (sEMG) of both flexor and extensor carpi radialis were acquired. A novel indicator to define the Onset of Fatigue (OF) was proposed and evaluated from the Mean Frequency of the sEMG signal. Furthermore, as measure of the subjects' effort throughout the task, the energy consumption was estimated. RESULTS From the beginning to the end of the task, as expected, all the subjects showed a decrement in Mean Frequency of the muscle involved in movements resisting the force. For the OF indicator, subjects were consistent in terms of timing of fatigue; moreover, extensor and flexor muscles presented similar OF times. The metabolic analysis showed a very low level of energy consumption and, from the behavioral point of view, the test was well tolerated by the subjects. CONCLUSION The robot-aided assessment test proposed in this study, proved to be an easy to administer, fast and reliable method for objectively measuring muscular fatigue in a healthy population. This work developed a framework for an evaluation that can be deployed in a clinical practice with patients presenting neuromuscular disorders. Considering the low metabolic demand, the requested effort would likely be well tolerated by clinical populations.
Collapse
Affiliation(s)
- Maddalena Mugnosso
- Motor Learning, Assistive and Rehabilitation Robotics Lab, Robotics, Brain and Cognitive Sciences unit, Istituto Italiano di Tecnologia, Genoa, Italy.
- Department of Informatics, Bioengineering, Robotics and Systems Engineering (DIBRIS),University of Genoa, Genoa, Italy.
| | - Francesca Marini
- Motor Learning, Assistive and Rehabilitation Robotics Lab, Robotics, Brain and Cognitive Sciences unit, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Michael Holmes
- Department of Kinesiology, Brock University, St. Catharines, ON, Canada
| | - Pietro Morasso
- Motor Learning, Assistive and Rehabilitation Robotics Lab, Robotics, Brain and Cognitive Sciences unit, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Jacopo Zenzeri
- Motor Learning, Assistive and Rehabilitation Robotics Lab, Robotics, Brain and Cognitive Sciences unit, Istituto Italiano di Tecnologia, Genoa, Italy
| |
Collapse
|
28
|
Sandini G, Mohan V, Sciutti A, Morasso P. Social Cognition for Human-Robot Symbiosis-Challenges and Building Blocks. Front Neurorobot 2018; 12:34. [PMID: 30050425 PMCID: PMC6051162 DOI: 10.3389/fnbot.2018.00034] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2018] [Accepted: 06/11/2018] [Indexed: 11/22/2022] Open
Abstract
The next generation of robot companions or robot working partners will need to satisfy social requirements somehow similar to the famous laws of robotics envisaged by Isaac Asimov time ago (Asimov, 1942). The necessary technology has almost reached the required level, including sensors and actuators, but the cognitive organization is still in its infancy and is only partially supported by the current understanding of brain cognitive processes. The brain of symbiotic robots will certainly not be a “positronic” replica of the human brain: probably, the greatest part of it will be a set of interacting computational processes running in the cloud. In this article, we review the challenges that must be met in the design of a set of interacting computational processes as building blocks of a cognitive architecture that may give symbiotic capabilities to collaborative robots of the next decades: (1) an animated body-schema; (2) an imitation machinery; (3) a motor intentions machinery; (4) a set of physical interaction mechanisms; and (5) a shared memory system for incremental symbiotic development. We would like to stress that our approach is totally un-hierarchical: the five building blocks of the shared cognitive architecture are fully bi-directionally connected. For example, imitation and intentional processes require the “services” of the animated body schema which, on the other hand, can run its simulations if appropriately prompted by imitation and/or intention, with or without physical interaction. Successful experiences can leave a trace in the shared memory system and chunks of memory fragment may compete to participate to novel cooperative actions. And so on and so forth. At the heart of the system is lifelong training and learning but, different from the conventional learning paradigms in neural networks, where learning is somehow passively imposed by an external agent, in symbiotic robots there is an element of free choice of what is worth learning, driven by the interaction between the robot and the human partner. The proposed set of building blocks is certainly a rough approximation of what is needed by symbiotic robots but we believe it is a useful starting point for building a computational framework.
Collapse
Affiliation(s)
- Giulio Sandini
- Research Unit of Robotics, Brain, and Cognitive Sciences (RBCS), Istituto Italiano di Tecnologia, Genoa, Italy
| | - Vishwanathan Mohan
- School of Computer Science and Electronic Engineering, University of Essex, Colchester, United Kingdom
| | - Alessandra Sciutti
- Research Unit of Robotics, Brain, and Cognitive Sciences (RBCS), Istituto Italiano di Tecnologia, Genoa, Italy
| | - Pietro Morasso
- Research Unit of Robotics, Brain, and Cognitive Sciences (RBCS), Istituto Italiano di Tecnologia, Genoa, Italy
| |
Collapse
|
29
|
De Santis D, Avila Mireles EJ, Squeri V, Morasso P, Zenzeri J. Dealing with instability in bimanual and collaborative tasks. Annu Int Conf IEEE Eng Med Biol Soc 2018; 2015:1417-20. [PMID: 26736535 DOI: 10.1109/embc.2015.7318635] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
In the context of unstable tasks, whenever the dynamics of the interaction are unknown, our ability to control an object depends on the predictability of the sensory feedback generated from the physical coupling at the interface with the object. In the case of physical human-human interaction, the haptic sensory feedback plays a primary role in the construction of a shared motor plan, being the channel for the mutual sharing of intentions. The present work addresses the issue of strategy selection in contexts in which instability is arising both from the environment, i.e. controlling a compliant object subject to nonlinear forces, and from the interaction with a partner, i.e. carrying out a bimanual balancing task in the presence of disturbing force-fields.
Collapse
|
30
|
Abstract
Proprioceptive signals from cutaneous, joint, tendon and muscle receptors create the basis for bodily perception and are known to be essential for motor control. However, which are the mechanisms underlying the proprioceptive signals and which are the variables that affect them is still a matter of debate. In particular, what is worth to investigate is, namely, the codification of proprioceptive information related to pointing movements of the wrist towards kinesthetic targets. In this work we asked 10 healthy adults to perform with their wrist a robot-aided proprioceptive matching task, in which the starting position of the matching movements was shifted forward or backward, in order to ascertain to which extent such shifts cause target over/under estimation and how important is movement's length on task performance. Results indicate that accuracy and precision of performance are highly correlated with the starting position and targets tended to be undershot when the active matching movements were longer. Moreover, further analysis revealed a consistent decrement of movement speed for shorter movements and conversely, faster displacement in case of backward of starting position.
Collapse
|
31
|
Mugnosso M, Marini F, Gillardo M, Morasso P, Zenzeri J. A novel method for muscle fatigue assessment during robot-based tracking tasks. IEEE Int Conf Rehabil Robot 2018; 2017:84-89. [PMID: 28813798 DOI: 10.1109/icorr.2017.8009226] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
In this work we propose a novel method based on sEMG signals, easy and fast to perform, administered with a robotic device to maximize repeatability and objectivity. Muscle fatigue, which is frequently experienced by healthy subjects, can be a highly debilitating symptom in case of neuromuscular disorders. Its assessment provides crucial information on the progression of the disability itself, on patient's muscular function and on the efficacy of the eventual clinical intervention. Hence, a robust and objective protocol for fatigue assessment is fundamental in rehabilitation practice. Therefore, the aim of this work was twofold. Firstly, we aimed to test the proposed method and highlight its strengths and drawbacks for a future optimization and implementation in a clinical context. Secondly, we meant to identify which are the most sensitive and reliable measures of muscles' performance that can quickly and optimally predict subjects' behavior. sEMG signals were collected from right Extensor and Flexor Carpi Radialis of 9 healthy subjects during a flexion-extension robotic task consisting in a haptic tracking in a viscous field. Three indicators of fatigue (Mean Frequency, Dimitrov Index, Root Mean Square) were obtained and we proposed a novel sensitive parameter which determines the Onset of Fatigue.
Collapse
|
32
|
Bhat AA, Mohan V, Sandini G, Morasso P. Humanoid infers Archimedes' principle: understanding physical relations and object affordances through cumulative learning experiences. J R Soc Interface 2017; 13:rsif.2016.0310. [PMID: 27466440 PMCID: PMC4971221 DOI: 10.1098/rsif.2016.0310] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2016] [Accepted: 06/28/2016] [Indexed: 11/12/2022] Open
Abstract
Emerging studies indicate that several species such as corvids, apes and children solve 'The Crow and the Pitcher' task (from Aesop's Fables) in diverse conditions. Hidden beneath this fascinating paradigm is a fundamental question: by cumulatively interacting with different objects, how can an agent abstract the underlying cause-effect relations to predict and creatively exploit potential affordances of novel objects in the context of sought goals? Re-enacting this Aesop's Fable task on a humanoid within an open-ended 'learning-prediction-abstraction' loop, we address this problem and (i) present a brain-guided neural framework that emulates rapid one-shot encoding of ongoing experiences into a long-term memory and (ii) propose four task-agnostic learning rules (elimination, growth, uncertainty and status quo) that correlate predictions from remembered past experiences with the unfolding present situation to gradually abstract the underlying causal relations. Driven by the proposed architecture, the ensuing robot behaviours illustrated causal learning and anticipation similar to natural agents. Results further demonstrate that by cumulatively interacting with few objects, the predictions of the robot in case of novel objects converge close to the physical law, i.e. the Archimedes principle: this being independent of both the objects explored during learning and the order of their cumulative exploration.
Collapse
Affiliation(s)
- Ajaz Ahmad Bhat
- Robotics, Brain and Cognitive Science Department, Istituto Italiano di Tecnologia, Via Morego 30, Genova, Italy
| | - Vishwanathan Mohan
- Robotics, Brain and Cognitive Science Department, Istituto Italiano di Tecnologia, Via Morego 30, Genova, Italy
| | - Giulio Sandini
- Robotics, Brain and Cognitive Science Department, Istituto Italiano di Tecnologia, Via Morego 30, Genova, Italy
| | - Pietro Morasso
- Robotics, Brain and Cognitive Science Department, Istituto Italiano di Tecnologia, Via Morego 30, Genova, Italy
| |
Collapse
|
33
|
Maggi E, Impagliazzo M, Minnella A, Zanardi N, Izzo M, Campone F, Blanchi I, Tacchino C, Shimatani K, Shima K, Tsuji T, Giannoni P, Fato M, Morasso P, Casadio M, Ramenghi L, Moretti P. A new method for early detection of infants at risk of long-term neuromotor disabilities. Gait Posture 2017. [DOI: 10.1016/j.gaitpost.2017.07.079] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/25/2023]
|
34
|
Marini F, Contu S, Antuvan CW, Morasso P, Masia L. The Influence of External Forces on Wrist Proprioception. Front Hum Neurosci 2017; 11:440. [PMID: 28912703 PMCID: PMC5583607 DOI: 10.3389/fnhum.2017.00440] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2017] [Accepted: 08/16/2017] [Indexed: 11/13/2022] Open
Abstract
Proprioception combines information from cutaneous, joint, tendon, and muscle receptors for maintaining a reliable internal body image. However, it is still a matter of debate, in both neurophysiology and psychology, to what extent such body image is modified or distorted by a changing haptic environment. In particular, what is worth investigating is the contribution of external forces on our perception of body and joint configuration. The proprioceptive acuity of fifteen young participants was tested with a Joint Position Matching (JPM) task, performed with the dominant wrist under five different external forces, in order to understand to what extent they affect proprioceptive acuity. Results show that accuracy and precision in target matching do not change in a significant manner as a function of the loading condition, suggesting that the multi-sensory integration process is indeed capable of discriminating different sub-modalities of proprioception, namely the joint position sense and the sense of force. Furthermore, results indicate a preference for target undershooting when movements are performed in a viscous or high resistive force field, rather than passive or null fields in which subjects did not show any predominance for under/over estimation of their position.
Collapse
Affiliation(s)
- Francesca Marini
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di TecnologiaGenova, Italy
| | - Sara Contu
- School of Mechanical and Aerospace Engineering, Nanyang Technological UniversitySingapore, Singapore
| | - Chris W Antuvan
- School of Mechanical and Aerospace Engineering, Nanyang Technological UniversitySingapore, Singapore
| | - Pietro Morasso
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di TecnologiaGenova, Italy
| | - Lorenzo Masia
- School of Mechanical and Aerospace Engineering, Nanyang Technological UniversitySingapore, Singapore
| |
Collapse
|
35
|
Galofaro E, Morasso P, Zenzeri J. Improving motor skill transfer during dyadic robot training through the modulation of the expert role. IEEE Int Conf Rehabil Robot 2017; 2017:78-83. [PMID: 28813797 DOI: 10.1109/icorr.2017.8009225] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
In daily life it is necessary to learn skills that can be applied in different tasks and different contexts. Usually these skills are acquired by observation or by direct physical training with another expert person. The critical point is to know which is the best possible way to achieve this knowledge acquisition. In this work we have proposed a collaborative environment where subjects with different levels of expertise have to interact through the use of a robotic platform. A motor skill learning algorithm has been designed in order to allow the less skilled subjects-naïves-to explore the virtual environment and to exploit the advantages of working with a skilled partner. Results show that the correct trade - off between exploration and exploitation, provided by the implemented algorithm applied during the dyadic training, allows a group of naive subjects to learn the task and generalize better the acquired skills respect to subjects trained without the proposed algorithm.
Collapse
|
36
|
Shima K, Shimatani K, Sato G, Sakata M, Giannoni P, Morasso P. A fundamental study on how holding a helium-filled balloon affects stability in human standing. IEEE Int Conf Rehabil Robot 2017; 2017:1061-1066. [PMID: 28813962 DOI: 10.1109/icorr.2017.8009390] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Various studies have been conducted in the field of the development/deterioration of standing and walking ability. In standing and walking control strategy, the relationship linking visual/somatosensory/vestibular-system information and physical movement is important. Researchers have previously sought to evaluate attitude control based on human sensory information. The authors have also reported that the body sway of a walking infant is mitigated when the subject holds a helium-filled balloon, with results suggesting that this approach can be applied to extend walking distance. This study was conducted to clarify how holding a balloon influences standing control strategy. A novel system was developed to quantitatively monitor and evaluate the standing state of subjects holding such a balloon. The results of the experiments conducted indicate that attitude control strategy changes in response to somatosensory information provided by the physical connection with the balloon.
Collapse
|
37
|
Abstract
This study examined wrist proprioception in a cross-sectional sample of 44 children aged between 8-to 14-years and a control group of 10 neurologically and physically healthy adults. Using a 3-degrees of freedom robotic device, participants performed an ipsilateral joint position matching task in which target amplitude (40% or 80% functional range of motion [fRoM]) and degrees-of-freedom (Flexion/Extension [FE], Radial/Ulnar deviation [RUD], Pronation/Supination [PS]) were manipulated. Results indicated that proprioceptive function became more accurate and consistent over the developmental spectrum, but that the ability to utilize proprioceptive feedback did not reach adult levels till the age of 10-11 years. Furthermore, proprioceptive acuity was influenced by target amplitude, such that movements were more accurate for the 80% fROM compared to the 40% fROM target for both the RUD and PS DoFs, independently of age. The present results provide critical information about the typical development of wrist proprioception that will enable clinicians to chart the course of development and dysfunction in neurological disorders in children, and help establish protocols for the robotic diagnosis and assessment of neurodevelopmental disorders.
Collapse
|
38
|
Morasso P, Nomura T, Suzuki Y, Zenzeri J. The brain can mix different control strategies in a task-oriented and multi-referential manner: a simulation study. Annu Int Conf IEEE Eng Med Biol Soc 2017; 2016:9-12. [PMID: 28268268 DOI: 10.1109/embc.2016.7590627] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
In everyday life the brain must adapt to variable situations that may require a mixture of approaches including anticipatory synergy formation, through an internal body schema, and different control strategies. Unstable tasks are particularly challenging because deteriorate the predictive power of internal models and further enhance the instability potential of delayed sensory feedback. We explore this issue by means of three simulation studies: A) The hybrid control of a double inverted pendulum model, B) The bimanual stabilization of a saddle-like instability, C) Whole-body focal-postural dynamics. The simulation results support the idea that the brain can mix different control strategies in a task-oriented and multi-referential manner.
Collapse
|
39
|
Avila Mireles EJ, Zenzeri J, Squeri V, Morasso P, De Santis D. Skill Learning and Skill Transfer Mediated by Cooperative Haptic Interaction. IEEE Trans Neural Syst Rehabil Eng 2017; 25:832-843. [PMID: 28500006 DOI: 10.1109/tnsre.2017.2700839] [Citation(s) in RCA: 30] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
It is known that physical coupling between two subjects may be advantageous in joint tasks. However, little is known about how two people mutually exchange information to exploit the coupling. Therefore, we adopted a reversed, novel perspective to the standard one that focuses on the ability of physically coupled subjects to adapt to cooperative contexts that require negotiating a common plan: we investigated how training in pairs on a novel task affects the development of motor skills of each of the interacting partners. The task involved reaching movements in an unstable dynamic environment using a bilateral non-linear elastic tool that could be used bimanually or dyadically. The main result is that training with an expert leads to the greatest performance in the joint task. However, the performance in the individual test is strongly affected by the initial skill level of the partner. Moreover, practicing with a peer rather than an expert appears to be more advantageous for a naive; and motor skills can be transferred to a bimanual context, after training with an expert, only if the non-expert subject had prior experience of the dynamics of the novel task.
Collapse
|
40
|
Bhat AA, Akkaladevi SC, Mohan V, Eitzinger C, Morasso P. Towards a learnt neural body schema for dexterous coordination of action in humanoid and industrial robots. Auton Robots 2017. [DOI: 10.1007/s10514-016-9563-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
41
|
Mireles EJA, De Santis D, Morasso P, Zenzeri J. Transferring knowledge during dyadic interaction: The role of the expert in the learning process. Annu Int Conf IEEE Eng Med Biol Soc 2017; 2016:2149-2152. [PMID: 28268757 DOI: 10.1109/embc.2016.7591154] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Physical interaction between man and machines is increasing the interest of the research as well as the industrial community. It is known that physical coupling between active persons can be beneficial and increase the performance of the dyad compared to an individual. However, the factors that may result in performance benefits are still poorly understood. The aim of this work is to investigate how the different initial skill levels of the interacting partners influence the learning of a stabilization task. Twelve subjects, divided in two groups, trained in couples in a joint stabilization task. In the first group the couples were composed of two naive, while in the second a naive was trained together with an expert. Results show that training with an expert results in the greatest performance in the joint task. However, this benefit is not transferred to the individual when performing the same task bimanually.
Collapse
|
42
|
Marini F, Squeri V, Morasso P, Campus C, Konczak J, Masia L. Robot-aided developmental assessment of wrist proprioception in children. J Neuroeng Rehabil 2017; 14:3. [PMID: 28069028 PMCID: PMC5223571 DOI: 10.1186/s12984-016-0215-9] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2016] [Accepted: 12/23/2016] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Several neurodevelopmental disorders and brain injuries in children have been associated with proprioceptive dysfunction that will negatively affect their movement. Unfortunately, there is lack of reliable and objective clinical examination protocols and our current knowledge of how proprioception evolves in typically developing children is still sparse. METHODS Using a robotic exoskeleton, we investigated proprioceptive acuity of the wrist in a group of 49 typically developing healthy children (8-15 years), and a group of 40 young adults. Without vision participants performed an ipsilateral wrist joint position matching task that required them to reproduce (match) a previously experienced target position. All three joint degrees-of-freedom of the wrist/hand complex were assessed. Accuracy and precision were evaluated as a measure of proprioceptive acuity. The cross-sectional data indicating the time course of development of acuity were then fitted by four models in order to determine which function best describes developmental changes in proprioception across age. RESULTS First, the robot-aided assessment proved to be an easy to administer method for objectively measuring proprioceptive acuity in both children and adult populations. Second, proprioceptive acuity continued to develop throughout middle childhood and early adolescence, improving by more than 50% with respect to the youngest group. Adult levels of performance were reached approximately by the age of 12 years. An inverse-root function best described the development of proprioceptive acuity across the age groups. Third, wrist/forearm proprioception is anisotropic across the three DoFs with the Abduction/Adduction exhibiting a higher level of acuity than those of Flexion/extension and Pronation/Supination. This anisotropy did not change across development. CONCLUSIONS Proprioceptive development for the wrist continues well into early adolescence. Our normative data obtained trough this novel robot-aided assessment method provide a basis against which proprioceptive function of pediatric population can be compared. This may aid the design of more effective sensorimotor intervention programs.
Collapse
Affiliation(s)
- Francesca Marini
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Via Morego 30, Genova, 16163, Italy
| | - Valentina Squeri
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Via Morego 30, Genova, 16163, Italy
| | - Pietro Morasso
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Via Morego 30, Genova, 16163, Italy
| | - Claudio Campus
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Via Morego 30, Genova, 16163, Italy
| | - Jürgen Konczak
- Human Sensorimotor Control Laboratory, School of Kinesiology and Center for Clinical Movement Science, University of Minnesota, USA, 1900 University Ave S E, Minneapolis, 24105, USA
| | - Lorenzo Masia
- School of Mechanical & Aerospace Engineering, Nanyang Technological University, Singapore, Singapore, 639798.
| |
Collapse
|
43
|
Abstract
This work examines physiological mechanisms underlying the position sense of the wrist, namely, the codification of proprioceptive information related to pointing movements of the wrist toward kinesthetic targets. Twenty-four healthy subjects participated to a robot-aided assessment of their wrist proprioceptive acuity to investigate if the sensorimotor transformation involved in matching targets located by proprioceptive receptors relies on amplitude or positional cues. A joint position matching test was performed in order to explore such dichotomy. In this test, the wrist of a blindfolded participant is passively moved by a robotic device to a preset target position and, after a removal movement from this position, the participant has to actively replicate and match it as accurately as possible. The test involved two separate conditions: in the first, the matching movements started from the same initial location; in the second one, the initial location was randomly assigned. Target matching accuracy, precision, and bias in the two conditions were then compared. Overall results showed a consistent higher performance in the former condition than in the latter, thus supporting the hypothesis that the joint position sense is based on vectorial or amplitude coding rather than positional.
Collapse
Affiliation(s)
- Francesca Marini
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia , Genova , Italy
| | - Valentina Squeri
- Rehab Technologies, Istituto Italiano di Tecnologia , Genova , Italy
| | - Pietro Morasso
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia , Genova , Italy
| | - Lorenzo Masia
- School of Mechanical and Aerospace Engineering, Nanyang Technological University , Singapore
| |
Collapse
|
44
|
Marini F, Squeri V, Morasso P, Konczak J, Masia L. Robot-Aided Mapping of Wrist Proprioceptive Acuity across a 3D Workspace. PLoS One 2016; 11:e0161155. [PMID: 27536882 PMCID: PMC4990409 DOI: 10.1371/journal.pone.0161155] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2016] [Accepted: 08/01/2016] [Indexed: 11/19/2022] Open
Abstract
Proprioceptive signals from peripheral mechanoreceptors form the basis for bodily perception and are known to be essential for motor control. However we still have an incomplete understanding of how proprioception differs between joints, whether it differs among the various degrees-of-freedom (DoFs) within a particular joint, and how such differences affect motor control and learning. We here introduce a robot-aided method to objectively measure proprioceptive function: specifically, we systematically mapped wrist proprioceptive acuity across the three DoFs of the wrist/hand complex with the aim to characterize the wrist position sense. Thirty healthy young adults performed an ipsilateral active joint position matching task with their dominant wrist using a haptic robotic exoskeleton. Our results indicate that the active wrist position sense acuity is anisotropic across the joint, with the abduction/adduction DoF having the highest acuity (the error of acuity for flexion/extension is 4.64 ± 0.24°; abduction/adduction: 3.68 ± 0.32°; supination/pronation: 5.15 ± 0.37°) and they also revealed that proprioceptive acuity decreases for smaller joint displacements. We believe this knowledge is imperative in a clinical scenario when assessing proprioceptive deficits and for understanding how such sensory deficits relate to observable motor impairments.
Collapse
Affiliation(s)
- Francesca Marini
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Valentina Squeri
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Pietro Morasso
- Motor Learning and Robotic Rehabilitation Laboratory, Department of Robotics, Brain and Cognitive Sciences, Istituto Italiano di Tecnologia, Genova, Italy
| | - Jürgen Konczak
- Human Sensorimotor Control Laboratory, School of Kinesiology and Center for Clinical Movement Science, University of Minnesota, Minneapolis, Minnesota, United States of America
| | - Lorenzo Masia
- School of Mechanical & Aerospace Engineering, Nanyang Technological University, Singapore, Singapore
- * E-mail:
| |
Collapse
|
45
|
Michimoto K, Suzuki Y, Kiyono K, Kobayashi Y, Morasso P, Nomura T. Reinforcement learning for stabilizing an inverted pendulum naturally leads to intermittent feedback control as in human quiet standing. Annu Int Conf IEEE Eng Med Biol Soc 2016; 2016:37-40. [PMID: 28268275 DOI: 10.1109/embc.2016.7590634] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Intermittent feedback control for stabilizing human upright stance is a promising strategy, alternative to the standard time-continuous stiffness control. Here we show that such an intermittent controller can be established naturally through reinforcement learning. To this end, we used a single inverted pendulum model of the upright posture and a very simple reward function that gives a certain amount of punishments when the inverted pendulum falls or changes its position in the state space. We found that the acquired feedback controller exhibits hallmarks of the intermittent feedback control strategy, namely the action of the feedback controller is switched-off intermittently when the state of the pendulum is located near the stable manifold of the unstable saddle-type upright equilibrium of the inverted pendulum with no active control: this action provides an opportunity to exploit transiently converging dynamics toward the unstable upright position with no help of the active feedback control. We then speculate about a possible physiological mechanism of such reinforcement learning, and suggest that it may be related to the neural activity in the pedunculopontine tegmental nucleus (PPN) of the brainstem. This hypothesis is supported by recent evidence indicating that PPN might play critical roles for generation and regulation of postural tonus, reward prediction, as well as postural instability in patients with Parkinson's disease.
Collapse
|
46
|
Iandolo R, Squeri V, De Santis D, Giannoni P, Morasso P, Casadio M. Testing proprioception in intrinsic and extrinsic coordinate systems: is there a difference? Annu Int Conf IEEE Eng Med Biol Soc 2015; 2014:6961-4. [PMID: 25571597 DOI: 10.1109/embc.2014.6945229] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
An intact position sense is considered important for neuromotor recovery, but the available methods and protocols for its assessment are still limited. In the clinical practice it is generally tested trough a bimanual position matching test, that consists of replicating with one arm the angular positions of the other arm in space (intrinsic coordinates matching). However, the same test could be carried out by matching the hand location in space (extrinsic coordinates matching). Is there any difference between the procedures that may be relevant to the evaluation of position sense deficits? In this study we compared the performance of eight right handed subjects and two stroke survivors with left hemiparesis performing the test in the two conditions. A robotic manipulandum passively moved the left arm of the participants in twenty-four positions in the workspace. Subjects had to match the left arm position with their right arm either in intrinsic or extrinsic coordinates. The results show that all the subjects (impaired and controls) performed better when using the extrinsic paradigm.
Collapse
|
47
|
Fu C, Suzuki Y, Kiyono K, Morasso P, Nomura T. An intermittent control model of flexible human gait using a stable manifold of saddle-type unstable limit cycle dynamics. J R Soc Interface 2015; 11:20140958. [PMID: 25339687 PMCID: PMC4223921 DOI: 10.1098/rsif.2014.0958] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
Stability of human gait is the ability to maintain upright posture during walking against external perturbations. It is a complex process determined by a number of cross-related factors, including gait trajectory, joint impedance and neural control strategies. Here, we consider a control strategy that can achieve stable steady-state periodic gait while maintaining joint flexibility with the lowest possible joint impedance. To this end, we carried out a simulation study of a heel-toe footed biped model with hip, knee and ankle joints and a heavy head-arms-trunk element, working in the sagittal plane. For simplicity, the model assumes a periodic desired joint angle trajectory and joint torques generated by a set of feed-forward and proportional-derivative feedback controllers, whereby the joint impedance is parametrized by the feedback gains. We could show that a desired steady-state gait accompanied by the desired joint angle trajectory can be established as a stable limit cycle (LC) for the feedback controller with an appropriate set of large feedback gains. Moreover, as the feedback gains are decreased for lowering the joint stiffness, stability of the LC is lost only in a few dimensions, while leaving the remaining large number of dimensions quite stable: this means that the LC becomes saddle-type, with a low-dimensional unstable manifold and a high-dimensional stable manifold. Remarkably, the unstable manifold remains of low dimensionality even when the feedback gains are decreased far below the instability point. We then developed an intermittent neural feedback controller that is activated only for short periods of time at an optimal phase of each gait stride. We characterized the robustness of this design by showing that it can better stabilize the unstable LC with small feedback gains, leading to a flexible gait, and in particular we demonstrated that such an intermittent controller performs better if it drives the state point to the stable manifold, rather than directly to the LC. The proposed intermittent control strategy might have a high affinity for the inverted pendulum analogy of biped gait, providing a dynamic view of how the step-to-step transition from one pendular stance to the next can be achieved stably in a robust manner by a well-timed neural intervention that exploits the stable modes embedded in the unstable dynamics.
Collapse
Affiliation(s)
- Chunjiang Fu
- Graduate School of Engineering Science, Osaka University, Toyonaka, Osaka, Japan
| | - Yasuyuki Suzuki
- Graduate School of Engineering Science, Osaka University, Toyonaka, Osaka, Japan
| | - Ken Kiyono
- Graduate School of Engineering Science, Osaka University, Toyonaka, Osaka, Japan
| | | | - Taishin Nomura
- Graduate School of Engineering Science, Osaka University, Toyonaka, Osaka, Japan
| |
Collapse
|
48
|
Mireles EJA, De Santis D, Squeri V, Morasso P, Zenzeri J. Motor control strategies in the bimanual stabilization of an unstable virtual tool. Annu Int Conf IEEE Eng Med Biol Soc 2015; 2015:3472-3475. [PMID: 26737040 DOI: 10.1109/embc.2015.7319140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Previous works have shown that, when dealing with instabilities in a bimanual manipulation paradigm, humans modulate the stiffness of the arms according to feedforward or feedback mechanisms as a function of the dynamics of the task. The aim of this work is to complement these results getting insights on how the CNS controls the muscles to achieve the stabilization goal in the two aforementioned control strategies. Surface EMG was recorded from 13 muscles of each arm and trunk while three expert subjects performed bimanual balancing of a virtual underactuated tool immersed in an unstable force-field. Results suggest the existence of an intermittent muscle ensemble recruitment that follows two distinct activation patterns, namely synchronous co-contractions and independent activations. The observed EMG patterns were independent of the motor control strategy applied in the task. These findings therefore suggest the existence of separate control strategies for the tool stabilization and the control of hand movements at the muscular level during a bimanual postural task.
Collapse
|
49
|
Suzuki Y, Morimoto H, Kiyono K, Morasso P, Nomura T. Non-actively controlled double-inverted-pendulum-like dynamics can minimize center of mass acceleration during human quiet standing. Annu Int Conf IEEE Eng Med Biol Soc 2015; 2015:1432-1435. [PMID: 26736538 DOI: 10.1109/embc.2015.7318638] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Multiple joint movements during human quiet standing exhibit characteristic inter-joint coordination, shortly referred to as reciprocal relationship, in which angular acceleration of the hip joint is linearly and negatively correlated with that of the ankle joint (antiphase coordination) and, moreover, acceleration of the center of mass (CoM) of the double-inverted-pendulum (DIP) model of the human body is close to zero constantly. A question considered in this study is whether the reciprocal relationship is established by active neural control of the posture, or rather it is a biomechanical consequence of non-actively controlled body dynamics. To answer this question, we consider a DIP model of quiet standing, and show that the reciprocal relationship always holds by Newton's second law applied to the DIP model with human anthropometric dimensions, regardless of passive and active joint torque patterns acting on the ankle and hip joints. We then show that characteristic frequencies included in experimental sway trajectories with the reciprocal relationship match with harmonics of the eigenfrequency of the stable antiphase eigenmode of the non-actively controlled DIP-like unstable body dynamics. The results suggest that non-actively controlled DIP-like mechanical dynamics is a major cause of the minimization of the CoM acceleration during quiet standing, which is consistent with a type of control strategy that allows switching off active neural control intermittently for suitable periods of time during quiet standing.
Collapse
|
50
|
|