1
|
Salim FA, Postma DBW, Haider F, Luz S, van Beijnum BJF, Reidsma D. Enhancing volleyball training: empowering athletes and coaches through advanced sensing and analysis. Front Sports Act Living 2024; 6:1326807. [PMID: 38689871 PMCID: PMC11058639 DOI: 10.3389/fspor.2024.1326807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2023] [Accepted: 03/27/2024] [Indexed: 05/02/2024] Open
Abstract
Modern sensing technologies and data analysis methods usher in a new era for sports training and practice. Hidden insights can be uncovered and interactive training environments can be created by means of data analysis. We present a system to support volleyball training which makes use of Inertial Measurement Units, a pressure sensitive display floor, and machine learning techniques to automatically detect relevant behaviours and provides the user with the appropriate information. While working with trainers and amateur athletes, we also explore potential applications that are driven by automatic action recognition, that contribute various requirements to the platform. The first application is an automatic video-tagging protocol that marks key events (captured on video) based on the automatic recognition of volleyball-specific actions with an unweighted average recall of 78.71% in the 10-fold cross-validation setting with convolution neural network and 73.84% in leave-one-subject-out cross-validation setting with active data representation method using wearable sensors, as an exemplification of how dashboard and retrieval systems would work with the platform. In the context of action recognition, we have evaluated statistical functions and their transformation using active data representation besides raw signal of IMUs sensor. The second application is the "bump-set-spike" trainer, which uses automatic action recognition to provide real-time feedback about performance to steer player behaviour in volleyball, as an example of rich learning environments enabled by live action detection. In addition to describing these applications, we detail the system components and architecture and discuss the implications that our system might have for sports in general and for volleyball in particular.
Collapse
Affiliation(s)
- Fahim A. Salim
- Digitalization Group, Irish Manufacturing Research, Mullingar, Ireland
| | - Dees B. W. Postma
- Human Media Interaction, University of Twente, Enschede, Netherlands
| | - Fasih Haider
- School of Engineering, The University of Edinburgh, Edinburgh, United Kingdom
| | - Saturnino Luz
- Usher Institute, The University of Edinburgh, Edinburgh, United Kingdom
| | | | - Dennis Reidsma
- Human Media Interaction, University of Twente, Enschede, Netherlands
| |
Collapse
|
2
|
Nasri M, Tsou YT, Koutamanis A, Baratchi M, Giest S, Reidsma D, Rieffe C. Correction: Nasri et al. A Novel Data-Driven Approach to Examine Children's Movements and Social Behaviour in Schoolyard Environments. Children 2022, 9, 1177. Children (Basel) 2022; 9:children9121882. [PMID: 36553443 PMCID: PMC9721453 DOI: 10.3390/children9121882] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Accepted: 10/21/2022] [Indexed: 12/04/2022]
Abstract
The authors request the following corrections because the changes made according to the second round of the review process were not included in the original publication [...].
Collapse
Affiliation(s)
- Maedeh Nasri
- Unit of Developmental and Educational Psychology, Institute of Psychology, Leiden University, 2300 RB Leiden, The Netherlands
- Leiden-Delft-Erasmus Centre for BOLD Cities, Leiden University, 2300 RA Leiden, The Netherlands
- Correspondence:
| | - Yung-Ting Tsou
- Unit of Developmental and Educational Psychology, Institute of Psychology, Leiden University, 2300 RB Leiden, The Netherlands
- Department of Computer Science, Faculty of Science, Vrije Universiteit Amsterdam, 1081 HV Amsterdam, The Netherlands
| | - Alexander Koutamanis
- Faculty of Architecture & the Built Environment, Delft University of Technology, 2628 BL Delft, The Netherlands
| | - Mitra Baratchi
- Leiden Institute of Advanced Computer Science, Leiden University, 2300 RA Leiden, The Netherlands
| | - Sarah Giest
- Institute of Public Administration, Faculty of Governance and Global Affairs, Leiden University, 2511 DC The Hague, The Netherlands
| | - Dennis Reidsma
- Human Media Interaction Research Group, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, 7522 NB Enschede, The Netherlands
| | - Carolien Rieffe
- Unit of Developmental and Educational Psychology, Institute of Psychology, Leiden University, 2300 RB Leiden, The Netherlands
- Human Media Interaction Research Group, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, 7522 NB Enschede, The Netherlands
- Department of Psychology and Human Development, Institute of Education, University College London, London WC1H 0AA, UK
| |
Collapse
|
3
|
Abstract
Unpredictability in robot behaviour can cause difficulties in interacting with robots. However, for social interactions with robots, a degree of unpredictability in robot behaviour may be desirable for facilitating engagement and increasing the attribution of mental states to the robot. To generate a better conceptual understanding of predictability, we looked at two facets of predictability, namely, the ability to predict robot actions and the association of predictability as an attribute of the robot. We carried out a video human-robot interaction study where we manipulated whether participants could either see the cause of a robot’s responsive action or could not see this, because there was no cause, or because we obstructed the visual cues. Our results indicate that when the cause of the robot’s responsive actions was not visible, participants rated the robot as more unpredictable and less competent, compared to when it was visible. The relationship between seeing the cause of the responsive actions and the attribution of competence was partially mediated by the attribution of unpredictability to the robot. We argue that the effects of unpredictability may be mitigated when the robot identifies when a person may not be aware of what the robot wants to respond to and uses additional actions to make its response predictable.
Collapse
Affiliation(s)
| | | | | | - Vanessa Evers
- University of Twente, the Netherlands and Nanyang Technological University,Singapore
| |
Collapse
|
4
|
Schadenberg BR, Reidsma D, Heylen DKJ, Evers V. Differences in Spontaneous Interactions of Autistic Children in an Interaction With an Adult and Humanoid Robot. Front Robot AI 2020; 7:28. [PMID: 33501197 PMCID: PMC7805683 DOI: 10.3389/frobt.2020.00028] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Accepted: 02/19/2020] [Indexed: 11/13/2022] Open
Abstract
Robots are promising tools for promoting engagement of autistic children in interventions and thereby increasing the amount of learning opportunities. However, designing deliberate robot behavior aimed at engaging autistic children remains challenging. Our current understanding of what interactions with a robot, or facilitated by a robot, are particularly motivating to autistic children is limited to qualitative reports with small sample sizes. Translating insights from these reports to design is difficult due to the large individual differences among autistic children in their needs, interests, and abilities. To address these issues, we conducted a descriptive study and report on an analysis of how 31 autistic children spontaneously interacted with a humanoid robot and an adult within the context of a robot-assisted intervention, as well as which individual characteristics were associated with the observed interactions. For this analysis, we used video recordings of autistic children engaged in a robot-assisted intervention that were recorded as part of the DE-ENIGMA database. The results showed that the autistic children frequently engaged in exploratory and functional interactions with the robot spontaneously, as well as in interactions with the adult that were elicited by the robot. In particular, we observed autistic children frequently initiating interactions aimed at making the robot do a certain action. Autistic children with stronger language ability, social functioning, and fewer autism spectrum-related symptoms, initiated more functional interactions with the robot and more robot-elicited interactions with the adult. We conclude that the children's individual characteristics, in particular the child's language ability, can be indicative of which types of interaction they are more likely to find interesting. Taking these into account for the design of deliberate robot behavior, coupled with providing more autonomy over the robot's behavior to the autistic children, appears promising for promoting engagement and facilitating more learning opportunities.
Collapse
Affiliation(s)
- Bob R Schadenberg
- Human Media Interaction, University of Twente, Enschede, Netherlands
| | - Dennis Reidsma
- Human Media Interaction, University of Twente, Enschede, Netherlands
| | - Dirk K J Heylen
- Human Media Interaction, University of Twente, Enschede, Netherlands
| | - Vanessa Evers
- Human Media Interaction, University of Twente, Enschede, Netherlands.,Institute of Science and Technology for Humanity, Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
5
|
Wijnen FM, Davison DP, Reidsma D, Meij JVD, Charisi V, Evers V. Now We’re Talking. J Hum -Robot Interact 2020. [DOI: 10.1145/3345508] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
This article presents a study in which we explored the effect of a social robot on the explanatory behavior of children (aged 6--10) while working on an inquiry learning task. In a comparative experiment, we offered children either a baseline Computer Aided Learning (CAL) system or the same CAL system that was supplemented with a social robot to verbally explain their thoughts to. Results indicate that when children made observations in an inquiry learning context, the robot was better able to trigger elaborate explanatory behavior. First, this is shown by a longer duration of explanatory utterances by children who worked with the robot compared to the baseline CAL system. Second, a content analysis of the explanations indicated that children who worked with the robot included more relevant utterances about the task in their explanation. Third, the content analysis shows that children made more logical associations between relevant facets in their explanations when they explained to a robot compared to a baseline CAL system. These results show that social robots that are used as extensions to CAL systems may be beneficial for triggering explanatory behavior in children, which is associated with deeper learning.
Collapse
|
6
|
Jung MM, Poel M, Reidsma D, Heylen DKJ. A First Step toward the Automatic Understanding of Social Touch for Naturalistic Human–Robot Interaction. ACTA ACUST UNITED AC 2017. [DOI: 10.3389/fict.2017.00003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
|
7
|
Mader A, Dertien E, Kolkmeier J, Reidsma D. Single value devices. IJART 2015. [DOI: 10.1504/ijart.2015.071209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
8
|
van Welbergen H, Reidsma D, Kopp S. An Incremental Multimodal Realizer for Behavior Co-Articulation and Coordination. Intelligent Virtual Agents 2012. [DOI: 10.1007/978-3-642-33197-8_18] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
|
9
|
Nijholt A, Reidsma D, van Welbergen H, op den Akker R, Ruttkay Z. Mutually Coordinated Anticipatory Multimodal Interaction. Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction 2008. [DOI: 10.1007/978-3-540-70872-8_6] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
|
10
|
Carletta J, Ashby S, Bourban S, Flynn M, Guillemot M, Hain T, Kadlec J, Karaiskos V, Kraaij W, Kronenthal M, Lathoud G, Lincoln M, Lisowska A, McCowan I, Post W, Reidsma D, Wellner P. The AMI Meeting Corpus: A Pre-announcement. Machine Learning for Multimodal Interaction 2006. [DOI: 10.1007/11677482_3] [Citation(s) in RCA: 191] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|