1
|
Borzelli D, Vieira TMM, Botter A, Gazzoni M, Lacquaniti F, d'Avella A. Synaptic inputs to motor neurons underlying muscle coactivation for functionally different tasks have different spectral characteristics. J Neurophysiol 2024; 131:1126-1142. [PMID: 38629162 DOI: 10.1152/jn.00199.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 04/11/2024] [Accepted: 04/11/2024] [Indexed: 06/01/2024] Open
Abstract
The central nervous system (CNS) may produce the same endpoint trajectory or torque profile with different muscle activation patterns. What differentiates these patterns is the presence of cocontraction, which does not contribute to effective torque generation but allows to modulate joints' mechanical stiffness. Although it has been suggested that the generation of force and the modulation of stiffness rely on separate pathways, a characterization of the differences between the synaptic inputs to motor neurons (MNs) underlying these tasks is still missing. In this study, participants coactivated the same pair of upper-limb muscles, i.e., the biceps brachii and the triceps brachii, to perform two functionally different tasks: limb stiffness modulation or endpoint force generation. Spike trains of MNs were identified through decomposition of high-density electromyograms (EMGs) collected from the two muscles. Cross-correlogram showed a higher synchronization between MNs recruited to modulate stiffness, whereas cross-muscle coherence analysis revealed peaks in the β-band, which is commonly ascribed to a cortical origin. These peaks did not appear during the coactivation for force generation, thus suggesting separate cortical inputs for stiffness modulation. Moreover, a within-muscle coherence analysis identified two subsets of MNs that were selectively recruited to generate force or regulate stiffness. This study is the first to highlight different characteristics, and probable different neural origins, of the synaptic inputs driving a pair of muscles under different functional conditions. We suggest that stiffness modulation is driven by cortical inputs that project to a separate set of MNs, supporting the existence of a separate pathway underlying the control of stiffness.NEW & NOTEWORTHY The characterization of the pathways underlying force generation or stiffness modulation are still unknown. In this study, we demonstrated that the common input to motor neurons of antagonist muscles shows a high-frequency component when muscles are coactivated to modulate stiffness but not to generate force. Our results provide novel insights on the neural strategies for the recruitment of multiple muscles by identifying specific spectral characteristics of the synaptic inputs underlying functionally different tasks.
Collapse
Affiliation(s)
- Daniele Borzelli
- Department of Biomedical, Dental, Morphological and Functional Imaging Sciences, University of Messina, Messina, Italy
- Laboratory of Neuromotor Physiology, IRCCS Santa Lucia Foundation, Rome, Italy
| | - Taian M M Vieira
- Laboratory for Engineering of the Neuromuscular System, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
- PoliToBIOMed Lab, Politecnico di Torino, Turin, Italy
| | - Alberto Botter
- Laboratory for Engineering of the Neuromuscular System, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
- PoliToBIOMed Lab, Politecnico di Torino, Turin, Italy
| | - Marco Gazzoni
- Laboratory for Engineering of the Neuromuscular System, Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy
- PoliToBIOMed Lab, Politecnico di Torino, Turin, Italy
| | - Francesco Lacquaniti
- Laboratory of Neuromotor Physiology, IRCCS Santa Lucia Foundation, Rome, Italy
- Department of Systems Medicine and Center of Space BioMedicine, University of Rome Tor Vergata, Rome, Italy
| | - Andrea d'Avella
- Department of Biomedical, Dental, Morphological and Functional Imaging Sciences, University of Messina, Messina, Italy
- Laboratory of Neuromotor Physiology, IRCCS Santa Lucia Foundation, Rome, Italy
| |
Collapse
|
2
|
Clode D, Dowdall L, da Silva E, Selén K, Cowie D, Dominijanni G, Makin TR. Evaluating initial usability of a hand augmentation device across a large and diverse sample. Sci Robot 2024; 9:eadk5183. [PMID: 38809995 PMCID: PMC7616312 DOI: 10.1126/scirobotics.adk5183] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Accepted: 04/26/2024] [Indexed: 05/31/2024]
Abstract
The advancement of motor augmentation and the broader domain of human-machine interaction rely on a seamless integration with users' physical and cognitive capabilities. These considerations may markedly fluctuate among individuals on the basis of their age, form, and abilities. There is a need to develop a standard for considering these diversity needs and preferences to guide technological development, and large-scale testing can provide us with evidence for such considerations. Public engagement events provide an important opportunity to build a bidirectional discourse with potential users for the codevelopment of inclusive and accessible technologies. We exhibited the Third Thumb, a hand augmentation device, at a public engagement event and tested participants from the general public, who are often not involved in such early technological development of wearable robotic technology. We focused on wearability (fit and control), ability to successfully operate the device, and ability levels across diversity factors relevant for physical technologies (gender, handedness, and age). Our inclusive design was successful in 99.3% of our diverse sample of 596 individuals tested (age range from 3 to 96 years). Ninety-eight percent of participants were further able to successfully manipulate objects using the extra thumb during the first minute of use, with no significant influences of gender, handedness, or affinity for hobbies involving the hands. Performance was generally poorer among younger children (aged ≤11 years). Although older and younger adults performed the task comparably, we identified age costs with the older adults. Our findings offer tangible demonstration of the initial usability of the Third Thumb for a broad demographic.
Collapse
Affiliation(s)
- Dani Clode
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
- Institute of Cognitive Neuroscience, University College London, London, UK
- Dani Clode Design, Cambridge, UK
| | - Lucy Dowdall
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
- Institute of Cognitive Neuroscience, University College London, London, UK
| | - Edmund da Silva
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
- Institute of Cognitive Neuroscience, University College London, London, UK
| | - Klara Selén
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Dorothy Cowie
- Department of Psychology, Durham University, Durham, UK
| | - Giulia Dominijanni
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
- Neuro-X Institute, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Tamar R Makin
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
- Institute of Cognitive Neuroscience, University College London, London, UK
| |
Collapse
|
3
|
Micera S. Toward more naturalistic tactile sensors. Science 2024; 384:624-625. [PMID: 38723096 DOI: 10.1126/science.adp2623] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/31/2024]
Abstract
An artificial tactile system mimicking human touch enables effective object recognition.
Collapse
Affiliation(s)
- Silvestro Micera
- The BioRobotics Institute and Department of AI and Robotics, Scuola Superiore Sant'Anna, Pisa, Italy
- Translational Neural Engineering Laboratory, Neuro-X Institute, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
| |
Collapse
|
4
|
Yang YJ, Vadivelu AKN, Hepworth J, Zeng Y, Pilgrim CHC, Kulic D, Abdi E. Experimental evaluation of accuracy and efficiency of two control strategies for a novel foot commanded robotic laparoscope holders with surgeons. Sci Rep 2024; 14:9264. [PMID: 38649705 PMCID: PMC11035708 DOI: 10.1038/s41598-024-59338-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Accepted: 04/09/2024] [Indexed: 04/25/2024] Open
Abstract
The implementation of a laparoscope-holding robot in minimally invasive surgery enhances the efficiency and safety of the operation. However, the extra robot control task can increase the cognitive load on surgeons. A suitable interface may simplify the control task and reduce the surgeon load. Foot interfaces are commonly used for commanding laparoscope-holding robots, with two control strategies available: decoupled control permits only one Cartesian axis actuation, known as decoupled commands; hybrid control allows for both decoupled commands and multiple axes actuation, known as coupled commands. This paper aims to determine the optimal control strategy for foot interfaces by investigating two common assumptions in the literature: (1) Decoupled control is believed to result in better predictability of the final laparoscopic view orientation, and (2) Hybrid control has the efficiency advantage in laparoscope control. Our user study with 11 experienced and trainee surgeons shows that decoupled control has better predictability than hybrid control, while both approaches are equally efficient. In addition, using two surgery-like tasks in a simulator, users' choice of decoupled and coupled commands is analysed based on their level of surgical experience and the nature of the movement. Results show that trainee surgeons tend to issue more commands than the more experienced participants. Single decoupled commands were frequently used in small view adjustments, while a mixture of coupled and decoupled commands was preferred in larger view adjustments. A guideline for foot interface control strategy selection is provided.
Collapse
Affiliation(s)
- Yan-Jun Yang
- Department of Mechanical and Aerospace Engineering, Monash University, Clayton, VIC, 3800, Australia.
| | - Arvind Kumar N Vadivelu
- The Department of Mechanical Engineering, The University of Melbourne, Parkville, VIC, 3010, Australia
| | - Jessica Hepworth
- Department of Mechanical and Aerospace Engineering, Monash University, Clayton, VIC, 3800, Australia
| | - Yongpeng Zeng
- Department of Mechanical and Aerospace Engineering, Monash University, Clayton, VIC, 3800, Australia
| | - Charles H C Pilgrim
- Suite 29, Cabrini Medical Centre, Malvern, 3144, VIC, Australia
- The Alfred Hospital, Malvern, VIC, 3144, Australia
- Faculty of Medicine, Monash University, Clayton, VIC, 3800, Australia
| | - Dana Kulic
- Department of Mechanical and Aerospace Engineering, Monash University, Clayton, VIC, 3800, Australia
| | - Elahe Abdi
- Department of Mechanical and Aerospace Engineering, Monash University, Clayton, VIC, 3800, Australia
| |
Collapse
|
5
|
O'Reilly D, Delis I. Dissecting muscle synergies in the task space. eLife 2024; 12:RP87651. [PMID: 38407224 PMCID: PMC10942626 DOI: 10.7554/elife.87651] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/27/2024] Open
Abstract
The muscle synergy is a guiding concept in motor control research that relies on the general notion of muscles 'working together' towards task performance. However, although the synergy concept has provided valuable insights into motor coordination, muscle interactions have not been fully characterised with respect to task performance. Here, we address this research gap by proposing a novel perspective to the muscle synergy that assigns specific functional roles to muscle couplings by characterising their task-relevance. Our novel perspective provides nuance to the muscle synergy concept, demonstrating how muscular interactions can 'work together' in different ways: (1) irrespective of the task at hand but also (2) redundantly or (3) complementarily towards common task-goals. To establish this perspective, we leverage information- and network-theory and dimensionality reduction methods to include discrete and continuous task parameters directly during muscle synergy extraction. Specifically, we introduce co-information as a measure of the task-relevance of muscle interactions and use it to categorise such interactions as task-irrelevant (present across tasks), redundant (shared task information), or synergistic (different task information). To demonstrate these types of interactions in real data, we firstly apply the framework in a simple way, revealing its added functional and physiological relevance with respect to current approaches. We then apply the framework to large-scale datasets and extract generalizable and scale-invariant representations consisting of subnetworks of synchronised muscle couplings and distinct temporal patterns. The representations effectively capture the functional interplay between task end-goals and biomechanical affordances and the concurrent processing of functionally similar and complementary task information. The proposed framework unifies the capabilities of current approaches in capturing distinct motor features while providing novel insights and research opportunities through a nuanced perspective to the muscle synergy.
Collapse
Affiliation(s)
- David O'Reilly
- School of Biomedical Sciences, University of LeedsLeedsUnited Kingdom
| | - Ioannis Delis
- School of Biomedical Sciences, University of LeedsLeedsUnited Kingdom
| |
Collapse
|
6
|
Taghlabi KM, Cruz-Garza JG, Hassan T, Potnis O, Bhenderu LS, Guerrero JR, Whitehead RE, Wu Y, Luan L, Xie C, Robinson JT, Faraji AH. Clinical outcomes of peripheral nerve interfaces for rehabilitation in paralysis and amputation: a literature review. J Neural Eng 2024; 21:011001. [PMID: 38237175 DOI: 10.1088/1741-2552/ad200f] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Accepted: 01/18/2024] [Indexed: 02/02/2024]
Abstract
Peripheral nerve interfaces (PNIs) are electrical systems designed to integrate with peripheral nerves in patients, such as following central nervous system (CNS) injuries to augment or replace CNS control and restore function. We review the literature for clinical trials and studies containing clinical outcome measures to explore the utility of human applications of PNIs. We discuss the various types of electrodes currently used for PNI systems and their functionalities and limitations. We discuss important design characteristics of PNI systems, including biocompatibility, resolution and specificity, efficacy, and longevity, to highlight their importance in the current and future development of PNIs. The clinical outcomes of PNI systems are also discussed. Finally, we review relevant PNI clinical trials that were conducted, up to the present date, to restore the sensory and motor function of upper or lower limbs in amputees, spinal cord injury patients, or intact individuals and describe their significant findings. This review highlights the current progress in the field of PNIs and serves as a foundation for future development and application of PNI systems.
Collapse
Affiliation(s)
- Khaled M Taghlabi
- Department of Neurological Surgery, Houston Methodist Hospital, Houston, TX 77030, United States of America
- Center for Neural Systems Restoration, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- Clinical Innovations Laboratory, Houston Methodist Research Institute, Houston, TX 77030, United States of America
| | - Jesus G Cruz-Garza
- Department of Neurological Surgery, Houston Methodist Hospital, Houston, TX 77030, United States of America
- Center for Neural Systems Restoration, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- Clinical Innovations Laboratory, Houston Methodist Research Institute, Houston, TX 77030, United States of America
| | - Taimur Hassan
- Department of Neurological Surgery, Houston Methodist Hospital, Houston, TX 77030, United States of America
- Center for Neural Systems Restoration, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- Clinical Innovations Laboratory, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- School of Medicine, Texas A&M University, Bryan, TX 77807, United States of America
| | - Ojas Potnis
- Department of Neurological Surgery, Houston Methodist Hospital, Houston, TX 77030, United States of America
- Center for Neural Systems Restoration, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- Clinical Innovations Laboratory, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- School of Engineering Medicine, Texas A&M University, Houston, TX 77030, United States of America
| | - Lokeshwar S Bhenderu
- Department of Neurological Surgery, Houston Methodist Hospital, Houston, TX 77030, United States of America
- Center for Neural Systems Restoration, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- Clinical Innovations Laboratory, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- School of Medicine, Texas A&M University, Bryan, TX 77807, United States of America
| | - Jaime R Guerrero
- Department of Neurological Surgery, Houston Methodist Hospital, Houston, TX 77030, United States of America
- Center for Neural Systems Restoration, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- Clinical Innovations Laboratory, Houston Methodist Research Institute, Houston, TX 77030, United States of America
| | - Rachael E Whitehead
- Department of Academic Affairs, Houston Methodist Academic Institute, Houston, TX 77030, United States of America
| | - Yu Wu
- Rice Neuroengineering Initiative, Rice University, Houston, TX 77005, United States of America
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, United States of America
| | - Lan Luan
- Rice Neuroengineering Initiative, Rice University, Houston, TX 77005, United States of America
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, United States of America
| | - Chong Xie
- Rice Neuroengineering Initiative, Rice University, Houston, TX 77005, United States of America
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, United States of America
| | - Jacob T Robinson
- Rice Neuroengineering Initiative, Rice University, Houston, TX 77005, United States of America
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, United States of America
| | - Amir H Faraji
- Department of Neurological Surgery, Houston Methodist Hospital, Houston, TX 77030, United States of America
- Center for Neural Systems Restoration, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- Clinical Innovations Laboratory, Houston Methodist Research Institute, Houston, TX 77030, United States of America
- Rice Neuroengineering Initiative, Rice University, Houston, TX 77005, United States of America
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, United States of America
| |
Collapse
|
7
|
Tucciarelli R, Ejaz N, Wesselink DB, Kolli V, Hodgetts CJ, Diedrichsen J, Makin TR. Does Ipsilateral Remapping Following Hand Loss Impact Motor Control of the Intact Hand? J Neurosci 2024; 44:e0948232023. [PMID: 38050100 PMCID: PMC10860625 DOI: 10.1523/jneurosci.0948-23.2023] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 10/31/2023] [Accepted: 11/21/2023] [Indexed: 12/06/2023] Open
Abstract
What happens once a cortical territory becomes functionally redundant? We studied changes in brain function and behavior for the remaining hand in humans (male and female) with either a missing hand from birth (one-handers) or due to amputation. Previous studies reported that amputees, but not one-handers, show increased ipsilateral activity in the somatosensory territory of the missing hand (i.e., remapping). We used a complex finger task to explore whether this observed remapping in amputees involves recruiting more neural resources to support the intact hand to meet greater motor control demands. Using basic fMRI analysis, we found that only amputees had more ipsilateral activity when motor demand increased; however, this did not match any noticeable improvement in their behavioral task performance. More advanced multivariate fMRI analyses showed that amputees had stronger and more typical representation-relative to controls' contralateral hand representation-compared with one-handers. This suggests that in amputees, both hand areas work together more collaboratively, potentially reflecting the intact hand's efference copy. One-handers struggled to learn difficult finger configurations, but this did not translate to differences in univariate or multivariate activity relative to controls. Additional white matter analysis provided conclusive evidence that the structural connectivity between the two hand areas did not vary across groups. Together, our results suggest that enhanced activity in the missing hand territory may not reflect intact hand function. Instead, we suggest that plasticity is more restricted than generally assumed and may depend on the availability of homologous pathways acquired early in life.
Collapse
Affiliation(s)
- Raffaele Tucciarelli
- MRC Cognition & Brain Sciences Unit, University of Cambridge, Cambridge CB2 7EF, United Kingdom
- Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, United Kingdom
| | - Naveed Ejaz
- Departments of Statistical and Actuarial Sciences and Computer Science, Western University, London, Ontario N6A 5B7, Canada
| | - Daan B Wesselink
- WIN Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford OX3 9DU, United Kingdom
- Department of Neurobiology, Harvard Medical School, Boston, Massachusetts 02115
| | - Vijay Kolli
- Queen Mary's Hospital, London SW15 5PN, United Kingdom
| | - Carl J Hodgetts
- CUBRIC, School of Psychology, Cardiff University, Cardiff CF24 4HQ, United Kingdom
- Royal Holloway, University of London, Egham TW20 0EX, United Kingdom
| | - Jörn Diedrichsen
- Departments of Statistical and Actuarial Sciences and Computer Science, Western University, London, Ontario N6A 5B7, Canada
- Brain and Mind Institute, Western University, London, Ontario N6A 3K7, Canada
| | - Tamar R Makin
- MRC Cognition & Brain Sciences Unit, University of Cambridge, Cambridge CB2 7EF, United Kingdom
- Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, United Kingdom
- WIN Centre, Nuffield Department of Clinical Neuroscience, University of Oxford, Oxford OX3 9DU, United Kingdom
| |
Collapse
|
8
|
Dominijanni G, Pinheiro DL, Pollina L, Orset B, Gini M, Anselmino E, Pierella C, Olivier J, Shokur S, Micera S. Human motor augmentation with an extra robotic arm without functional interference. Sci Robot 2023; 8:eadh1438. [PMID: 38091424 DOI: 10.1126/scirobotics.adh1438] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Accepted: 11/15/2023] [Indexed: 12/18/2023]
Abstract
Extra robotic arms (XRAs) are gaining interest in neuroscience and robotics, offering potential tools for daily activities. However, this compelling opportunity poses new challenges for sensorimotor control strategies and human-machine interfaces (HMIs). A key unsolved challenge is allowing users to proficiently control XRAs without hindering their existing functions. To address this, we propose a pipeline to identify suitable HMIs given a defined task to accomplish with the XRA. Following such a scheme, we assessed a multimodal motor HMI based on gaze detection and diaphragmatic respiration in a purposely designed modular neurorobotic platform integrating virtual reality and a bilateral upper limb exoskeleton. Our results show that the proposed HMI does not interfere with speaking or visual exploration and that it can be used to control an extra virtual arm independently from the biological ones or in coordination with them. Participants showed significant improvements in performance with daily training and retention of learning, with no further improvements when artificial haptic feedback was provided. As a final proof of concept, naïve and experienced participants used a simplified version of the HMI to control a wearable XRA. Our analysis indicates how the presented HMI can be effectively used to control XRAs. The observation that experienced users achieved a success rate 22.2% higher than that of naïve users, combined with the result that naïve users showed average success rates of 74% when they first engaged with the system, endorses the viability of both the virtual reality-based testing and training and the proposed pipeline.
Collapse
Affiliation(s)
- Giulia Dominijanni
- Neuro-X Institute, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Daniel Leal Pinheiro
- Neuro-X Institute, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
- Neuroengineering and Neurocognition Laboratory, Escola Paulista de Medicina, Department of Neurology and Neurosurgery, Division of Neuroscience, Universidade Federal de São Paulo, São Paulo, Brazil
| | - Leonardo Pollina
- Neuro-X Institute, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Bastien Orset
- Neuro-X Institute, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Martina Gini
- BioRobotics Institute, Health Interdisciplinary Center, and Department of Excellence in AI and Robotics, Scuola Superiore Sant'Anna, Pisa, Italy
- Neuroelectronic Interfaces, Faculty of Electrical Engineering and IT, Rheinisch-Westfälische Technische Hochschule (RWTH) Aachen, Aachen 52074, Germany
| | - Eugenio Anselmino
- BioRobotics Institute, Health Interdisciplinary Center, and Department of Excellence in AI and Robotics, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Camilla Pierella
- Department of Neurosciences, Rehabilitation, Ophthalmology, Genetics, and Maternal and Children's Sciences (DINOGMI), University of Genoa, Genoa, Italy
| | - Jérémy Olivier
- Institute for Industrial Sciences and Technologies, Haute Ecole du Paysage, d'Ingénierie et d'Architecture (HEPIA), HES-SO University of Applied Sciences and Arts Western Switzerland, Geneva, Switzerland
| | - Solaiman Shokur
- Neuro-X Institute, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
- BioRobotics Institute, Health Interdisciplinary Center, and Department of Excellence in AI and Robotics, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Silvestro Micera
- Neuro-X Institute, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
- BioRobotics Institute, Health Interdisciplinary Center, and Department of Excellence in AI and Robotics, Scuola Superiore Sant'Anna, Pisa, Italy
| |
Collapse
|
9
|
Abstract
Neurological insults, such as congenital blindness, deafness, amputation, and stroke, often result in surprising and impressive behavioural changes. Cortical reorganisation, which refers to preserved brain tissue taking on a new functional role, is often invoked to account for these behavioural changes. Here, we revisit many of the classical animal and patient cortical remapping studies that spawned this notion of reorganisation. We highlight empirical, methodological, and conceptual problems that call this notion into doubt. We argue that appeal to the idea of reorganisation is attributable in part to the way that cortical maps are empirically derived. Specifically, cortical maps are often defined based on oversimplified assumptions of 'winner-takes-all', which in turn leads to an erroneous interpretation of what it means when these maps appear to change. Conceptually, remapping is interpreted as a circuit receiving novel input and processing it in a way unrelated to its original function. This implies that neurons are either pluripotent enough to change what they are tuned to or that a circuit can change what it computes. Instead of reorganisation, we argue that remapping is more likely to occur due to potentiation of pre-existing architecture that already has the requisite representational and computational capacity pre-injury. This architecture can be facilitated via Hebbian and homeostatic plasticity mechanisms. Crucially, our revised framework proposes that opportunities for functional change are constrained throughout the lifespan by the underlying structural 'blueprint'. At no period, including early in development, does the cortex offer structural opportunities for functional pluripotency. We conclude that reorganisation as a distinct form of cortical plasticity, ubiquitously evoked with words such as 'take-over'' and 'rewiring', does not exist.
Collapse
Affiliation(s)
- Tamar R Makin
- MRC Cognition and Brain Sciences Unit, University of CambridgeCambridgeUnited Kingdom
| | - John W Krakauer
- Department of Neuroscience, Johns Hopkins University School of MedicineBaltimoreUnited States
- Department of Neurology, Johns Hopkins University School of MedicineBaltimoreUnited States
- The Santa Fe InstituteSanta FeUnited States
| |
Collapse
|
10
|
Selvam A, Aggarwal T, Mukherjee M, Verma YK. Humans and robots: Friends of the future? A bird's eye view of biomanufacturing industry 5.0. Biotechnol Adv 2023; 68:108237. [PMID: 37604228 DOI: 10.1016/j.biotechadv.2023.108237] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Revised: 07/15/2023] [Accepted: 08/18/2023] [Indexed: 08/23/2023]
Abstract
The evolution of industries have introduced versatile technologies, motivating limitless possibilities of tackling pivotal global predicaments in the arenas of medicine, environment, defence, and national security. In this direction, ardently emerges the new era of Industry 5.0 through the eyes of biomanufacturing, which integrates the most advanced systems 21st century has to offer by means of integrating artificial systems to mimic and nativize the natural milieu to substitute the deficits of nature, thence leading to a new meta world. Albeit, it questions the natural order of the living world, which necessitates certain paramount stipulations to be addressed for a successful expansion of biomanufacturing Industry 5.0. Can humans live in synergism with artificial beings? How can humans establish dominance of hierarchy with artificial counterparts? This perspective provides a bird's eye view on the plausible direction of a new meta world inquisitively. For this purpose, we propose the influence of internet of things (IoT) via new generation interfacial systems, such as, human-machine interface (HMI) and brain-computer interface (BCI) in the domain of tissue engineering and regenerative medicine, which can be extended to target modern warfare and smart healthcare.
Collapse
Affiliation(s)
- Abhyavartin Selvam
- Amity Institute of Nanotechnology, Amity University Noida, Uttar Pradesh 201303, India
| | - Tanishka Aggarwal
- Department of Biotechnology, School of Chemical and Life Sciences (SCLS) Jamia Hamdard, New Delhi 110062, India
| | - Monalisa Mukherjee
- Amity Institute of Click Chemistry Research and Studies, Amity University Noida, Uttar Pradesh 201303, India
| | - Yogesh Kumar Verma
- Stem Cell & Tissue Engineering Research Group, Institute of Nuclear Medicine and Allied Sciences, Defence Research and Development Organisation, New Delhi 110054, India.
| |
Collapse
|
11
|
Maselli A, Gordon J, Eluchans M, Lancia GL, Thiery T, Moretti R, Cisek P, Pezzulo G. Beyond simple laboratory studies: Developing sophisticated models to study rich behavior. Phys Life Rev 2023; 46:220-244. [PMID: 37499620 DOI: 10.1016/j.plrev.2023.07.006] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Accepted: 07/06/2023] [Indexed: 07/29/2023]
Abstract
Psychology and neuroscience are concerned with the study of behavior, of internal cognitive processes, and their neural foundations. However, most laboratory studies use constrained experimental settings that greatly limit the range of behaviors that can be expressed. While focusing on restricted settings ensures methodological control, it risks impoverishing the object of study: by restricting behavior, we might miss key aspects of cognitive and neural functions. In this article, we argue that psychology and neuroscience should increasingly adopt innovative experimental designs, measurement methods, analysis techniques and sophisticated computational models to probe rich, ecologically valid forms of behavior, including social behavior. We discuss the challenges of studying rich forms of behavior as well as the novel opportunities offered by state-of-the-art methodologies and new sensing technologies, and we highlight the importance of developing sophisticated formal models. We exemplify our arguments by reviewing some recent streams of research in psychology, neuroscience and other fields (e.g., sports analytics, ethology and robotics) that have addressed rich forms of behavior in a model-based manner. We hope that these "success cases" will encourage psychologists and neuroscientists to extend their toolbox of techniques with sophisticated behavioral models - and to use them to study rich forms of behavior as well as the cognitive and neural processes that they engage.
Collapse
Affiliation(s)
- Antonella Maselli
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Jeremy Gordon
- University of California, Berkeley, Berkeley, CA, 94704, United States
| | - Mattia Eluchans
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy; University of Rome "La Sapienza", Rome, Italy
| | - Gian Luca Lancia
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy; University of Rome "La Sapienza", Rome, Italy
| | - Thomas Thiery
- Department of Psychology, University of Montréal, Montréal, Québec, Canada
| | - Riccardo Moretti
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy; University of Rome "La Sapienza", Rome, Italy
| | - Paul Cisek
- Department of Neuroscience, University of Montréal, Montréal, Québec, Canada
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy.
| |
Collapse
|
12
|
Pinardi M, Di Stefano N, Di Pino G, Spence C. Exploring crossmodal correspondences for future research in human movement augmentation. Front Psychol 2023; 14:1190103. [PMID: 37397340 PMCID: PMC10308310 DOI: 10.3389/fpsyg.2023.1190103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Accepted: 05/30/2023] [Indexed: 07/04/2023] Open
Abstract
"Crossmodal correspondences" are the consistent mappings between perceptual dimensions or stimuli from different sensory domains, which have been widely observed in the general population and investigated by experimental psychologists in recent years. At the same time, the emerging field of human movement augmentation (i.e., the enhancement of an individual's motor abilities by means of artificial devices) has been struggling with the question of how to relay supplementary information concerning the state of the artificial device and its interaction with the environment to the user, which may help the latter to control the device more effectively. To date, this challenge has not been explicitly addressed by capitalizing on our emerging knowledge concerning crossmodal correspondences, despite these being tightly related to multisensory integration. In this perspective paper, we introduce some of the latest research findings on the crossmodal correspondences and their potential role in human augmentation. We then consider three ways in which the former might impact the latter, and the feasibility of this process. First, crossmodal correspondences, given the documented effect on attentional processing, might facilitate the integration of device status information (e.g., concerning position) coming from different sensory modalities (e.g., haptic and visual), thus increasing their usefulness for motor control and embodiment. Second, by capitalizing on their widespread and seemingly spontaneous nature, crossmodal correspondences might be exploited to reduce the cognitive burden caused by additional sensory inputs and the time required for the human brain to adapt the representation of the body to the presence of the artificial device. Third, to accomplish the first two points, the benefits of crossmodal correspondences should be maintained even after sensory substitution, a strategy commonly used when implementing supplementary feedback.
Collapse
Affiliation(s)
- Mattia Pinardi
- NeXT Lab, Neurophysiology and Neuroengineering of Human-Technology Interaction Research Unit, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Nicola Di Stefano
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Giovanni Di Pino
- NeXT Lab, Neurophysiology and Neuroengineering of Human-Technology Interaction Research Unit, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Charles Spence
- Crossmodal Research Laboratory, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
13
|
Pinheiro DJLL, Faber J, Micera S, Shokur S. Human-machine interface for two-dimensional steering control with the auricular muscles. Front Neurorobot 2023; 17:1154427. [PMID: 37342389 PMCID: PMC10277645 DOI: 10.3389/fnbot.2023.1154427] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Accepted: 05/16/2023] [Indexed: 06/22/2023] Open
Abstract
Human-machine interfaces (HMIs) can be used to decode a user's motor intention to control an external device. People that suffer from motor disabilities, such as spinal cord injury, can benefit from the uses of these interfaces. While many solutions can be found in this direction, there is still room for improvement both from a decoding, hardware, and subject-motor learning perspective. Here we show, in a series of experiments with non-disabled participants, a novel decoding and training paradigm allowing naïve participants to use their auricular muscles (AM) to control two degrees of freedom with a virtual cursor. AMs are particularly interesting because they are vestigial muscles and are often preserved after neurological diseases. Our method relies on the use of surface electromyographic records and the use of contraction levels of both AMs to modulate the velocity and direction of a cursor in a two-dimensional paradigm. We used a locking mechanism to fix the current position of each axis separately to enable the user to stop the cursor at a certain location. A five-session training procedure (20-30 min per session) with a 2D center-out task was performed by five volunteers. All participants increased their success rate (Initial: 52.78 ± 5.56%; Final: 72.22 ± 6.67%; median ± median absolute deviation) and their trajectory performances throughout the training. We implemented a dual task with visual distractors to assess the mental challenge of controlling while executing another task; our results suggest that the participants could perform the task in cognitively demanding conditions (success rate of 66.67 ± 5.56%). Finally, using the Nasa Task Load Index questionnaire, we found that participants reported lower mental demand and effort in the last two sessions. To summarize, all subjects could learn to control the movement of a cursor with two degrees of freedom using their AM, with a low impact on the cognitive load. Our study is a first step in developing AM-based decoders for HMIs for people with motor disabilities, such as spinal cord injury.
Collapse
Affiliation(s)
- Daniel J. L. L. Pinheiro
- Division of Neuroscience, Department of Neurology and Neurosurgery, Neuroengineering and Neurocognition Laboratory, Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, Brazil
- Translational Neural Engineering Lab, Institute Neuro X, École Polytechnique Fédérale de Lausanne, Geneva, Switzerland
| | - Jean Faber
- Division of Neuroscience, Department of Neurology and Neurosurgery, Neuroengineering and Neurocognition Laboratory, Escola Paulista de Medicina, Universidade Federal de São Paulo, São Paulo, Brazil
- Neuroengineering Laboratory, Division of Biomedical Engineering, Instituto de Ciência e Tecnologia, Universidade Federal de São Paulo, São José dos Campos, Brazil
| | - Silvestro Micera
- Translational Neural Engineering Lab, Institute Neuro X, École Polytechnique Fédérale de Lausanne, Geneva, Switzerland
- Department of Excellence in Robotics and AI, Institute of BioRobotics Interdisciplinary Health Center, Scuola Superiore Sant'Anna, Pisa, Italy
| | - Solaiman Shokur
- Translational Neural Engineering Lab, Institute Neuro X, École Polytechnique Fédérale de Lausanne, Geneva, Switzerland
| |
Collapse
|
14
|
Grinschgl S, Berdnik AL, Stehling E, Hofer G, Neubauer AC. Who Wants to Enhance Their Cognitive Abilities? Potential Predictors of the Acceptance of Cognitive Enhancement. J Intell 2023; 11:109. [PMID: 37367511 DOI: 10.3390/jintelligence11060109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 04/25/2023] [Accepted: 05/25/2023] [Indexed: 06/28/2023] Open
Abstract
With advances in new technologies, the topic of cognitive enhancement has been at the center of public debate in recent years. Various enhancement methods (e.g., brain stimulation, smart drugs, or working memory training) promise improvements in one's cognitive abilities such as intelligence and memory. Although these methods have been rather ineffective so far, they are largely available to the general public and can be applied individually. As applying enhancement might be accompanied by certain risks, it is important to understand which individuals seek to enhance themselves. For instance, individuals' intelligence, personality, and interests might predict their willingness to get enhanced. Thus, in a preregistered study, we asked 257 participants about their acceptance of various enhancement methods and tested predictors thereof, such as participants' psychometrically measured and self-estimated intelligence. While both measured and self-estimated intelligence as well as participants' implicit beliefs about intelligence, did not predict participants' acceptance of enhancement; a younger age, higher interest in science-fiction, and (partially) higher openness as well as lower conscientiousness did. Thus, certain interests and personality traits might contribute to the willingness to enhance one's cognition. Finally, we discuss the need for replication and argue for testing other potential predictors of the acceptance of cognitive enhancement.
Collapse
Affiliation(s)
| | | | | | - Gabriela Hofer
- Institute of Psychology, University of Graz, 8010 Graz, Austria
| | | |
Collapse
|
15
|
Di Stefano N, Jarrassé N, Valera L. The Ethics of Supernumerary Robotic Limbs. An Enactivist Approach. SCIENCE AND ENGINEERING ETHICS 2022; 28:57. [PMID: 36376778 PMCID: PMC9663385 DOI: 10.1007/s11948-022-00405-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Accepted: 09/12/2022] [Indexed: 06/16/2023]
Abstract
Supernumerary robotic limbs are innovative devices in the field of wearable robotics which can provide humans with unprecedented sensorimotor abilities. However, scholars have raised awareness of the ethical issues that would arise from the large adoption of technologies for human augmentation in society. Most negative attitudes towards such technologies seem to rely on an allegedly clear distinction between therapy and enhancement in the use of technological devices. Based on such distinction, people tend to accept technologies when used for therapeutic purposes (e.g., prostheses), but tend to raise issues when similar devices are used for upgrading a physical or cognitive ability (e.g., supernumerary robotics limbs). However, as many scholars have pointed out, the distinction between therapy and enhancement might be theoretically flawed. In this paper, we present an alternative approach to the ethics of supernumerary limbs which is based on two related claims. First, we propose to conceive supernumerary limbs as tools that necessarily modify our psychological and bodily identity. At the same time, we stress that such a modification is not ethically bad in itself; on the contrary, it drives human interaction with the environment. Second, by comparing our view with the extended mind thesis, we claim that the mediation through tools is crucial for the formation of novel meanings and skills that constitute human interaction with the world. We will relate the latter claim to enactivism as a helpful theoretical perspective to frame issues related to artificial limbs and, more in general, to technologies for augmentation. Based on this approach, we finally sketch some suggestions for future directions in the ethics of supernumerary limbs.
Collapse
Affiliation(s)
- Nicola Di Stefano
- Institute of Cognitive Sciences and Technologies (ISTC), National Research Council of Italy (CNR), Via S. Martino Della Battaglia 44, 00185, Rome, Italy.
| | - Nathanaël Jarrassé
- Centre National de la Recherche Scientifique (CNRS) UMR 7222, Institut des Systèmes Intelligentes et de Robotique (ISIR) /INSERM U1150 Agathe‑ISIR, Sorbonne Université, 75005, Paris, France
| | - Luca Valera
- Center for Bioethics, Pontifical Universidad Catolica de Chile, Av. Libertador Bernardo O'Higgins 340, Santiago, Chile
- Facultad de Filosofia y Letras, Universidad de Valladolid, Plaza Campus Universitario, s/n. 47011, Valladolid, Spain
| |
Collapse
|
16
|
Makin TR, Micera S, Miller LE. Neurocognitive and motor-control challenges for the realization of bionic augmentation. Nat Biomed Eng 2022; 7:344-348. [PMID: 36050524 PMCID: PMC9975114 DOI: 10.1038/s41551-022-00930-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Robotic fingers and arms that augment the motor abilities of non-disabled individuals are increasingly feasible yet face neurocognitive barriers and hurdles in efferent motor control.
Collapse
Affiliation(s)
- Tamar R Makin
- Institute of Cognitive Neuroscience, University College London, London, UK. .,MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK.
| | - Silvestro Micera
- Bertarelli Foundation Chair in Translational Neural Engineering, Center for Neuroprosthetics and Institute of Bioengineering, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland. .,The BioRobotics Institute and Department of Excellence in Robotics and AI, Scuola Superiore Sant'Anna, Pisa, Italy.
| | - Lee E Miller
- Department of Physiology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA. .,Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA. .,Department of Biomedical Engineering, McCormick School of Engineering, Northwestern University, Evanston, IL, USA. .,Shirley Ryan AbilityLab, Chicago, IL, USA.
| |
Collapse
|
17
|
Bräcklein M, Barsakcioglu DY, Ibáñez J, Eden J, Burdet E, Mehring C, Farina D. The control and training of single motor units in isometric tasks are constrained by a common input signal. eLife 2022; 11:72871. [PMID: 35670561 PMCID: PMC9208758 DOI: 10.7554/elife.72871] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Accepted: 06/06/2022] [Indexed: 11/15/2022] Open
Abstract
Recent developments in neural interfaces enable the real-time and non-invasive tracking of motor neuron spiking activity. Such novel interfaces could provide a promising basis for human motor augmentation by extracting potentially high-dimensional control signals directly from the human nervous system. However, it is unclear how flexibly humans can control the activity of individual motor neurons to effectively increase the number of degrees of freedom available to coordinate multiple effectors simultaneously. Here, we provided human subjects (N = 7) with real-time feedback on the discharge patterns of pairs of motor units (MUs) innervating a single muscle (tibialis anterior) and encouraged them to independently control the MUs by tracking targets in a 2D space. Subjects learned control strategies to achieve the target-tracking task for various combinations of MUs. These strategies rarely corresponded to a volitional control of independent input signals to individual MUs during the onset of neural activity. Conversely, MU activation was consistent with a common input to the MU pair, while individual activation of the MUs in the pair was predominantly achieved by alterations in de-recruitment order that could be explained by history-dependent changes in motor neuron excitability. These results suggest that flexible MU recruitment based on independent synaptic inputs to single MUs is unlikely, although de-recruitment might reflect varying inputs or modulations in the neuron’s intrinsic excitability.
Collapse
Affiliation(s)
| | | | - Jaime Ibáñez
- Department of Bioengineering, Imperial College London
| | - Jonathan Eden
- Department of Bioengineering, Imperial College London
| | | | | | - Dario Farina
- Department of Bioengineering, Imperial College London
| |
Collapse
|
18
|
Sra M, Danry V, Maes P, Johnsen K, Billinghurst M. Situated VR: Toward a Congruent Hybrid Reality Without Experiential Artifacts. IEEE COMPUTER GRAPHICS AND APPLICATIONS 2022; 42:7-18. [PMID: 35671280 DOI: 10.1109/mcg.2022.3154358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The vision of extended reality (XR) systems is living in a world where real and virtual elements seamlessly and contextually augment experiences of ourselves and the worlds we inhabit. While this integration promises exciting opportunities for the future of XR, it comes with the risk of experiential distortions and feelings of dissociation, especially related to virtual reality (VR). When transitioning from a virtual world to the real world, users report of experiential structures that linger on, as sort of after images, causing disruptions in their daily life. In this work, we define these atypical experiences as experiential artifacts (EAs) and present preliminary results from an informal survey conducted online with 76 VR users to highlight different types of artifacts and their durations. To avoid disruptions caused by these artifacts and simultaneously increase the user's sense of presence, we propose the idea of situated VR, which blends the real and virtual in novel ways that can reduce incongruencies between the two worlds. We discuss the implications of EAs, and through examples from our own work in building hybrid experiences, we demonstrate the potential and relevance of situated VR in the design of a future, more immersive, artifact-free hybrid reality.
Collapse
|
19
|
Bräcklein M, Barsakcioglu DY, Del Vecchio A, Ibáñez J, Farina D. Reading and Modulating Cortical β Bursts from Motor Unit Spiking Activity. J Neurosci 2022; 42:3611-3621. [PMID: 35351832 PMCID: PMC9053843 DOI: 10.1523/jneurosci.1885-21.2022] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Revised: 02/01/2022] [Accepted: 02/27/2022] [Indexed: 11/21/2022] Open
Abstract
β Oscillations (13-30 Hz) are ubiquitous in the human motor nervous system. Yet, their origins and roles are unknown. Traditionally, β activity has been treated as a stationary signal. However, recent studies observed that cortical β occurs in "bursting events," which are transmitted to muscles. This short-lived nature of β events makes it possible to study the main mechanism of β activity found in the muscles in relation to cortical β. Here, we assessed whether muscle β activity mainly results from cortical projections. We ran two experiments in healthy humans of both sexes (N = 15 and N = 13, respectively) to characterize β activity at the cortical and motor unit (MU) levels during isometric contractions of the tibialis anterior muscle. We found that β rhythms observed at the cortical and MU levels are indeed in bursts. These bursts appeared to be time-locked and had comparable average durations (40-80 ms) and rates (approximately three to four bursts per second). To further confirm that cortical and MU β have the same source, we used a novel operant conditioning framework to allow subjects to volitionally modulate MU β. We showed that volitional modulation of β activity at the MU level was possible with minimal subject learning and was paralleled by similar changes in cortical β activity. These results support the hypothesis that MU β mainly results from cortical projections. Moreover, they demonstrate the possibility to decode cortical β activity from MU recordings, with a potential translation to future neural interfaces that use peripheral information to identify and modulate activity in the central nervous system.SIGNIFICANCE STATEMENT We show for the first time that β activity in motor unit (MU) populations occurs in bursting events. These bursts observed in the output of the spinal cord appear to be time-locked and share similar characteristics of β activity at the cortical level, such as the duration and rate at which they occur. Moreover, when subjects were exposed to a novel operant conditioning paradigm and modulated MU β activity, cortical β activity changed in a similar way as peripheral β. These results provide evidence for a strong correspondence between cortical and peripheral β activity, demonstrating the cortical origin of peripheral β and opening the pathway for a new generation of neural interfaces.
Collapse
Affiliation(s)
- Mario Bräcklein
- Neuromechanics and Rehabilitation Technology Group, Department of Bioengineering, Faculty of Engineering, Imperial College London, London W12 0BZ, United Kingdom
| | - Deren Y Barsakcioglu
- Neuromechanics and Rehabilitation Technology Group, Department of Bioengineering, Faculty of Engineering, Imperial College London, London W12 0BZ, United Kingdom
| | - Alessandro Del Vecchio
- Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander University Erlangen-Nuremberg, Erlangen 91052, Germany
| | - Jaime Ibáñez
- Neuromechanics and Rehabilitation Technology Group, Department of Bioengineering, Faculty of Engineering, Imperial College London, London W12 0BZ, United Kingdom
- Biomedical Signal Interpretation and Computational Simulation (BSICoS), Instituto de Investigación Sanitaria Aragón, Universidad de Zaragoza, Zaragoza 50018, Spain
- Department of Clinical and Movement Disorders, Institute of Neurology, University College London, London WC1N 3BG, United Kingdom
| | - Dario Farina
- Neuromechanics and Rehabilitation Technology Group, Department of Bioengineering, Faculty of Engineering, Imperial College London, London W12 0BZ, United Kingdom
| |
Collapse
|
20
|
Eden J, Bräcklein M, Ibáñez J, Barsakcioglu DY, Di Pino G, Farina D, Burdet E, Mehring C. Principles of human movement augmentation and the challenges in making it a reality. Nat Commun 2022; 13:1345. [PMID: 35292665 PMCID: PMC8924218 DOI: 10.1038/s41467-022-28725-7] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Accepted: 02/04/2022] [Indexed: 12/23/2022] Open
Abstract
Augmenting the body with artificial limbs controlled concurrently to one's natural limbs has long appeared in science fiction, but recent technological and neuroscientific advances have begun to make this possible. By allowing individuals to achieve otherwise impossible actions, movement augmentation could revolutionize medical and industrial applications and profoundly change the way humans interact with the environment. Here, we construct a movement augmentation taxonomy through what is augmented and how it is achieved. With this framework, we analyze augmentation that extends the number of degrees-of-freedom, discuss critical features of effective augmentation such as physiological control signals, sensory feedback and learning as well as application scenarios, and propose a vision for the field.
Collapse
Affiliation(s)
- Jonathan Eden
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Mario Bräcklein
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Jaime Ibáñez
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK.,BSICoS, IIS Aragón, Universidad de Zaragoza, Zaragoza, Spain.,Department of Clinical and Movement Neurosciences, Institute of Neurology, University College London, London, UK
| | | | - Giovanni Di Pino
- NEXT: Neurophysiology and Neuroengineering of Human-Technology Interaction Research Unit, Università Campus Bio-Medico di Roma, Rome, Italy
| | - Dario Farina
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK
| | - Etienne Burdet
- Department of Bioengineering, Imperial College of Science, Technology and Medicine, London, UK.
| | - Carsten Mehring
- Bernstein Center Freiburg, University of Freiburg, Freiburg im Breisgau, 79104, Germany.,Faculty of Biology, University of Freiburg, Freiburg im Breisgau, 79104, Germany
| |
Collapse
|
21
|
Gurgone S, Borzelli D, De Pasquale P, Berger DJ, Lisini Baldi T, D'Aurizio N, Prattichizzo D, d'Avella A. Simultaneous control of natural and extra degrees of freedom by isometric force and electromyographic activity in the muscle-to-force null space. J Neural Eng 2022; 19. [PMID: 34983036 DOI: 10.1088/1741-2552/ac47db] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Accepted: 01/04/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Muscle activation patterns in the muscle-to-force null space, i.e., patterns that do not generate task-relevant forces, may provide an opportunity for motor augmentation by allowing to control additional end-effectors simultaneously to natural limbs. Here we tested the feasibility of muscular null space control for augmentation by assessing simultaneous control of natural and extra degrees of freedom. APPROACH We instructed eight participants to control translation and rotation of a virtual 3D end-effector by simultaneous generation of isometric force at the hand and null space activity extracted in real-time from the electromyographic signals recorded from 15 shoulder and arm muscles. First, we identified the null space components that each participant could control more naturally by voluntary co-contraction. Then, participants performed several blocks of a reaching and holding task. They displaced an ellipsoidal cursor to reach one of nine targets by generating force, and simultaneously rotated the cursor to match the target orientation by activating null space components. We developed an information-theoretic metric, an index of difficulty defined as the sum of a spatial and a temporal term, to assess individual null space control ability for both reaching and holding. MAIN RESULTS On average, participants could reach the targets in most trials already in the first block (72%) and they improved with practice (maximum 93%) but holding performance remained lower (maximum 43%). As there was a high inter-individual variability in performance, we performed a simulation with different spatial and temporal task conditions to estimate those for which each individual participants would have performed best. SIGNIFICANCE Muscular null space control is feasible and may be used to control additional virtual or robotics end-effectors. However, decoding of motor commands must be optimized according to individual null space control ability.
Collapse
Affiliation(s)
- Sergio Gurgone
- University of Messina, Viale Ferdinando Stagno D'Alcontres 31, Messina, 98166, ITALY
| | - Daniele Borzelli
- University of Messina, Via Consolare Valeria, Messina, Messina, 98122, ITALY
| | - Paolo De Pasquale
- Scienze Biomediche, Odontoiatriche e delle Immagini Morfologiche e Funzionali, Università degli Studi di Messina, Via Consolare Valeria, 1, Messina, Messina, ME, 98124, ITALY
| | - Denise J Berger
- Laboratorio di Fisiologia Neuromotoria, Fondazione Santa Lucia, Via Ardeatina 306, Via Ardeatina 306, Roma, 00179, ITALY
| | | | - Nicole D'Aurizio
- Università degli Studi di Siena, Via Roma 56, Siena, 53100, ITALY
| | | | - Andrea d'Avella
- Scienze Biomediche, Odontoiatriche e delle Immagini Morfologiche e Funzionali, Università degli Studi di Messina, Via Consolare Valeria, 1, Messina, Messina, ME, 98124, ITALY
| |
Collapse
|