1
|
Iwane F, Billard A, Millán JDR. Inferring individual evaluation criteria for reaching trajectories with obstacle avoidance from EEG signals. Sci Rep 2023; 13:20163. [PMID: 37978205 PMCID: PMC10656489 DOI: 10.1038/s41598-023-47136-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 11/09/2023] [Indexed: 11/19/2023] Open
Abstract
During reaching actions, the human central nerve system (CNS) generates the trajectories that optimize effort and time. When there is an obstacle in the path, we make sure that our arm passes the obstacle with a sufficient margin. This comfort margin varies between individuals. When passing a fragile object, risk-averse individuals may adopt a larger margin by following the longer path than risk-prone people do. However, it is not known whether this variation is associated with a personalized cost function used for the individual optimal control policies and how it is represented in our brain activity. This study investigates whether such individual variations in evaluation criteria during reaching results from differentiated weighting given to energy minimization versus comfort, and monitors brain error-related potentials (ErrPs) evoked when subjects observe a robot moving dangerously close to a fragile object. Seventeen healthy participants monitored a robot performing safe, daring and unsafe trajectories around a wine glass. Each participant displayed distinct evaluation criteria on the energy efficiency and comfort of robot trajectories. The ErrP-BCI outputs successfully inferred such individual variation. This study suggests that ErrPs could be used in conjunction with an optimal control approach to identify the personalized cost used by CNS. It further opens new avenues for the use of brain-evoked potential to train assistive robotic devices through the use of neuroprosthetic interfaces.
Collapse
Affiliation(s)
- Fumiaki Iwane
- Learning Algorithms and Systems Laboratory (LASA), École Polytechnique Fédérale de Lausanne (EPFL), 1015, Lausanne, Switzerland.
- Chandra Family Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX, 78712, USA.
- Department of Neurology, The University of Texas at Austin, Austin, TX, 78712, USA.
| | - Aude Billard
- Learning Algorithms and Systems Laboratory (LASA), École Polytechnique Fédérale de Lausanne (EPFL), 1015, Lausanne, Switzerland
| | - José Del R Millán
- Chandra Family Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX, 78712, USA
- Department of Neurology, The University of Texas at Austin, Austin, TX, 78712, USA
- Department of Biomedical Engineering, The University of Texas at Austin, Austin, TX, 78712, USA
- Mulva Clinic for the Neurosciences, The University of Texas at Austin, Austin, TX, 78712, USA
| |
Collapse
|
2
|
Murakami H, Yamada N. Human Information Processing of the Speed of Various Movements Estimated Based on Trajectory Change. ENTROPY (BASEL, SWITZERLAND) 2023; 25:e25040695. [PMID: 37190483 PMCID: PMC10138091 DOI: 10.3390/e25040695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 04/04/2023] [Accepted: 04/18/2023] [Indexed: 05/17/2023]
Abstract
Fitts' approach, which examines the information processing of the human motor system, has the problem that the movement speed is controlled by the difficulty index of the task, which the participant uniquely sets, but it is an arbitrary speed. This study rigorously aims to examine the relationship between movement speed and information processing using Woodworth's method to control movement speed. Furthermore, we examined movement information processing using an approach that calculates probability-based information entropy and mutual information quantity between points from trajectory analysis. Overall, 17 experimental conditions were applied, 16 being externally controlled and one being self-paced with maximum speed. Considering that information processing occurs when irregularities decrease, the point at which information processing occurs switches at a movement frequency of approximately 3.0-3.25 Hz. Previous findings have suggested that motor control switches with increasing movement speed; thus, our approach helps explore human information processing in detail. Note that the characteristics of information processing in movement speed changes that were identified in this study were derived from one participant, but they are important characteristics of human motor control.
Collapse
Affiliation(s)
- Hiroki Murakami
- Graduate School of Health and Sport Sciences, Chukyo University, 101 Tokodachi, Kaizu-cho, Toyota, Aichi 470-0393, Japan
| | - Norimasa Yamada
- Graduate School of Health and Sport Sciences, Chukyo University, 101 Tokodachi, Kaizu-cho, Toyota, Aichi 470-0393, Japan
| |
Collapse
|
3
|
Murakami H, Yamada N. Estimating Information Processing of Human Fast Continuous Tapping from Trajectories. ENTROPY 2022; 24:e24060788. [PMID: 35741509 PMCID: PMC9223281 DOI: 10.3390/e24060788] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 05/30/2022] [Accepted: 06/02/2022] [Indexed: 02/01/2023]
Abstract
Fitts studied the problem of information capacity and transfer in the speed–accuracy motor paradigm using a theoretical approach developed from Shannon and Weaver’s information theory. The information processing (bit/s) estimated in Fitts’ study is calculated from the movement time required to achieve the required task index of difficulty but is essentially different from Shannon’s information entropy. Thus, we estimated the information entropy of multiple human movement trajectories and the mutual information among trajectories for the continuous aiming task in Fitts’ paradigm. Further, we estimated the information processing moment by moment. Two methods were considered: (1) encoded values encompassing the coordinates of the three dimensions and (2) coordinate values associated with each direction in the three dimensions. Information entropy indicates the magnitude of variation at each time point, and the structure of this variation varies with the index of difficulty. The ratio of entropy to mutual information was examined, and it was found that information was processed from the first half of the trajectory in difficult tasks. In addition, since these values calculated from the encoded method were higher than those from the conventional method, this method may be able to estimate these values successfully.
Collapse
Affiliation(s)
- Hiroki Murakami
- Graduate School of Health and Sport Sciences, Chukyo University, 101 Tokodachi, Kaizu-cho, Toyota, Aichi 470-0393, Japan
- Correspondence:
| | - Norimasa Yamada
- School of Health and Sport Sciences, Chukyo University, 101 Tokodachi, Kaizu-cho, Toyota, Aichi 470-0393, Japan;
| |
Collapse
|
4
|
Tang L, Zeng P, Qing Shi J, Kim WS. Model-based joint curve registration and classification. J Appl Stat 2022; 50:1178-1198. [PMID: 37009594 PMCID: PMC10062228 DOI: 10.1080/02664763.2021.2023118] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
In this paper, we consider the problem of classification of misaligned multivariate functional data. We propose to use a model-based approach for the joint registration and classification of such data. The observed functional inputs are modeled as a functional nonlinear mixed effects model containing a nonlinear functional fixed effect constructed upon warping functions to account for curve alignment, and a nonlinear functional random effects component to address the variability among subjects. The warping functions are also modeled to accommodate common effect within groups and the variability between subjects. Then, a functional logistic regression model defined upon the representation of the aligned curves and scalar inputs is used to account for curve classification. EM-based algorithms are developed to perform maximum likelihood inference of the proposed models. The identifiability of the registration model and the asymptotical properties of the proposed method are established. The performance of the proposed procedure is illustrated via simulation studies and an analysis of a hyoid bone movement data application. The statistical developments proposed in this paper were motivated by the hyoid bone movement study, the methodology is designed and presented generality and can be applied to numerous areas of scientific research.
Collapse
Affiliation(s)
- Lin Tang
- Yunnan Key Laboratory of Statistical Modeling and Data Analysis, Yunnan University, Kunming, Yunnan, People's Republic of China
| | - Pengcheng Zeng
- Institute of Mathematical Sciences, ShanghaiTech University, Shanghai, People's Republic of China
| | - Jian Qing Shi
- Department of Statistics and Data Science, Southern University of Science and Technology, Shenzhen, People's Republic of China
- National Center for Applied Mathematics, Shenzhen, People's Republic of China
| | - Won-Seok Kim
- Department of Rehabilitation Medicine, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, South Korea
| |
Collapse
|
5
|
Zeng P, Qing Shi J, Kim WS. Simultaneous Registration and Clustering for Multidimensional Functional Data. J Comput Graph Stat 2019. [DOI: 10.1080/10618600.2019.1607744] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
- Pengcheng Zeng
- School of Mathematics, Statistics and Physics, Newcastle University, Newcastle upon Tyne, UK
| | - Jian Qing Shi
- School of Mathematics, Statistics and Physics, Newcastle University, Newcastle upon Tyne, UK
| | - Won-Seok Kim
- Department of Rehabilitation Medicine, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, South Korea
| |
Collapse
|
6
|
Statistical modelling of conidial discharge of entomophthoralean fungi using a newly discovered Pandora species. PLoS One 2019; 14:e0215914. [PMID: 31116738 PMCID: PMC6530823 DOI: 10.1371/journal.pone.0215914] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2018] [Accepted: 04/10/2019] [Indexed: 11/24/2022] Open
Abstract
Entomophthoralean fungi are insect pathogenic fungi and are characterized by their active discharge of infective conidia that infect insects. Our aim was to study the effects of temperature on the discharge and to characterize the variation in the associated temporal pattern of a newly discovered Pandora species with focus on peak location and shape of the discharge. Mycelia were incubated at various temperatures in darkness, and conidial discharge was measured over time. We used a novel modification of a statistical model (pavpop), that simultaneously estimates phase and amplitude effects, into a setting of generalized linear models. This model is used to test hypotheses of peak location and discharge of conidia. The statistical analysis showed that high temperature leads to an early and fast decreasing peak, whereas there were no significant differences in total number of discharged conidia. Using the proposed model we also quantified the biological variation in the timing of the peak location at a fixed temperature.
Collapse
|
7
|
Proprioceptive loss and the perception, control and learning of arm movements in humans: evidence from sensory neuronopathy. Exp Brain Res 2018; 236:2137-2155. [PMID: 29779050 PMCID: PMC6061502 DOI: 10.1007/s00221-018-5289-0] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Accepted: 05/09/2018] [Indexed: 12/12/2022]
Abstract
It is uncertain how vision and proprioception contribute to adaptation of voluntary arm movements. In normal participants, adaptation to imposed forces is possible with or without vision, suggesting that proprioception is sufficient; in participants with proprioceptive loss (PL), adaptation is possible with visual feedback, suggesting that proprioception is unnecessary. In experiment 1 adaptation to, and retention of, perturbing forces were evaluated in three chronically deafferented participants. They made rapid reaching movements to move a cursor toward a visual target, and a planar robot arm applied orthogonal velocity-dependent forces. Trial-by-trial error correction was observed in all participants. Such adaptation has been characterized with a dual-rate model: a fast process that learns quickly, but retains poorly and a slow process that learns slowly and retains well. Experiment 2 showed that the PL participants had large individual differences in learning and retention rates compared to normal controls. Experiment 3 tested participants’ perception of applied forces. With visual feedback, the PL participants could report the perturbation’s direction as well as controls; without visual feedback, thresholds were elevated. Experiment 4 showed, in healthy participants, that force direction could be estimated from head motion, at levels close to the no-vision threshold for the PL participants. Our results show that proprioceptive loss influences perception, motor control and adaptation but that proprioception from the moving limb is not essential for adaptation to, or detection of, force fields. The differences in learning and retention seen between the three deafferented participants suggest that they achieve these tasks in idiosyncratic ways after proprioceptive loss, possibly integrating visual and vestibular information with individual cognitive strategies.
Collapse
|
8
|
|
9
|
Olsen NL, Markussen B, Raket LL. Simultaneous inference for misaligned multivariate functional data. J R Stat Soc Ser C Appl Stat 2018. [DOI: 10.1111/rssc.12276] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|