1
|
Nalepka P, Patil G, Kallen RW, Richardson MJ. Human-inspired strategies for controlling swarm systems. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2025; 383:20240147. [PMID: 39880027 PMCID: PMC11779539 DOI: 10.1098/rsta.2024.0147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Revised: 09/13/2024] [Accepted: 10/22/2024] [Indexed: 01/31/2025]
Abstract
The control of swarms has emerged as a paradigmatic example of human-autonomy teaming. This review focuses on understanding human coordination behaviours, while controlling evasive autonomous agents, to inform the design of human-compatible teammates. We summarize the solutions employed by human dyads, as well as the verbal communication and division of labour strategies observed in four-person teams using virtual simulations. Additionally, we provide an overview of the design of artificial agents that replicate human-like dynamics using task-dynamical models, and which can be integrated into human-autonomy teams. Finally, we conclude with open questions regarding the preservation of situation awareness and trust within human-autonomous swarming teams.This article is part of the theme issue 'The road forward with swarm systems'.
Collapse
Affiliation(s)
- Patrick Nalepka
- Performance and Expertise Research Centre, Macquarie University, SydneyNSW 2109, Australia
- School of Psychological Sciences, Macquarie University, SydneyNSW 2109, Australia
| | - Gaurav Patil
- Performance and Expertise Research Centre, Macquarie University, SydneyNSW 2109, Australia
- School of Psychological Sciences, Macquarie University, SydneyNSW 2109, Australia
| | - Rachel W. Kallen
- Performance and Expertise Research Centre, Macquarie University, SydneyNSW 2109, Australia
- School of Psychological Sciences, Macquarie University, SydneyNSW 2109, Australia
| | - Michael J. Richardson
- Performance and Expertise Research Centre, Macquarie University, SydneyNSW 2109, Australia
- School of Psychological Sciences, Macquarie University, SydneyNSW 2109, Australia
| |
Collapse
|
2
|
bin Kamruddin A, Sandison H, Patil G, Musolesi M, di Bernardo M, Richardson MJ. Modelling human navigation and decision dynamics in a first-person herding task. ROYAL SOCIETY OPEN SCIENCE 2024; 11:231919. [PMID: 39479245 PMCID: PMC11522880 DOI: 10.1098/rsos.231919] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/18/2024] [Revised: 07/15/2024] [Accepted: 08/27/2024] [Indexed: 11/02/2024]
Abstract
This study investigated whether dynamical perceptual-motor primitives (DPMPs) could also be used to capture human navigation in a first-person herding task. To achieve this aim, human participants played a first-person herding game, in which they were required to corral virtual cows, called targets, into a specified containment zone. In addition to recording and modelling participants' movement trajectories during gameplay, participants' target-selection decisions (i.e. the order in which participants corralled targets) were recorded and modelled. The results revealed that a simple DPMP navigation model could effectively reproduce the movement trajectories of participants and that almost 80% of the participants' target-selection decisions could be captured by a simple heuristic policy. Importantly, when this policy was coupled to the DPMP navigation model, the resulting system could successfully simulate and predict the behavioural dynamics (movement trajectories and target-selection decisions) of participants in novel multi-target contexts. Implications of the findings for understanding complex human perceptual-motor behaviour and the development of artificial agents for robust human-machine interaction are discussed.
Collapse
Affiliation(s)
- Ayman bin Kamruddin
- Modeling and Engineering Risk and Complexity, Scuola Superiore Meridionale, Naples, Italy
- Department of Electrical Engineering and ICT, University of Naples Federico II, Naples, Italy
| | - Hannah Sandison
- School of Psychological Sciences and Performance and Expertise Research Center, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
| | - Gaurav Patil
- School of Psychological Sciences and Performance and Expertise Research Center, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
| | - Mirco Musolesi
- Department of Computer Science, University College London, London, UK
- Department of Computer Science and Engineering, University of Bologna, Bologna, Italy
| | - Mario di Bernardo
- Modeling and Engineering Risk and Complexity, Scuola Superiore Meridionale, Naples, Italy
- Department of Electrical Engineering and ICT, University of Naples Federico II, Naples, Italy
| | - Michael J. Richardson
- School of Psychological Sciences and Performance and Expertise Research Center, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney, Australia
| |
Collapse
|
3
|
Patil G, Nalepka P, Novak A, Auletta F, Pepping GJ, Fransen J, Kallen RW, Richardson MJ. Dynamical biomarkers in teams and other multiagent systems. J Sci Med Sport 2023:S1440-2440(23)00074-9. [PMID: 37150726 DOI: 10.1016/j.jsams.2023.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Revised: 02/26/2023] [Accepted: 04/17/2023] [Indexed: 05/09/2023]
Abstract
Effective team behavior in high-performance environments such as in sport and the military requires individual team members to efficiently perceive the unfolding task events, predict the actions and action intents of the other team members, and plan and execute their own actions to simultaneously accomplish individual and collective goals. To enhance team performance through effective cooperation, it is crucial to measure the situation awareness and dynamics of each team member and how they collectively impact the team's functioning. Further, to be practically useful for real-life settings, such measures must be easily obtainable from existing sensors. This paper presents several methodologies that can be used on positional and movement acceleration data of team members to quantify and/or predict team performance, assess situation awareness, and to help identify task-relevant information to support individual decision-making. Given the limited reporting of these methods within military cohorts, these methodologies are described using examples from team sports and teams training in virtual environments, with discussion as to how they can be applied to real-world military teams.
Collapse
Affiliation(s)
- Gaurav Patil
- School of Psychological Sciences, Faculty of Medicine, Health and Human Sciences, Macquarie University, Australia; Center for Elite Performance, Expertise and Training, Faculty of Medicine, Health and Human Sciences, Macquarie University, Australia.
| | - Patrick Nalepka
- School of Psychological Sciences, Faculty of Medicine, Health and Human Sciences, Macquarie University, Australia; Center for Elite Performance, Expertise and Training, Faculty of Medicine, Health and Human Sciences, Macquarie University, Australia.
| | - Andrew Novak
- Human Performance Research Centre, Sport and Exercise Science, Faculty of Health, University of Technology Sydney, Australia; High Performance Department, Rugby Australia, Australia
| | - Fabrizia Auletta
- School of Psychological Sciences, Faculty of Medicine, Health and Human Sciences, Macquarie University, Australia; Department of Engineering Mathematics, University of Bristol, UK
| | - Gert-Jan Pepping
- School of Behavioural and Health Sciences, Australian Catholic University, Australia
| | - Job Fransen
- Department of Human Movement Sciences, University of Groningen, Netherlands
| | - Rachel W Kallen
- School of Psychological Sciences, Faculty of Medicine, Health and Human Sciences, Macquarie University, Australia; Center for Elite Performance, Expertise and Training, Faculty of Medicine, Health and Human Sciences, Macquarie University, Australia
| | - Michael J Richardson
- School of Psychological Sciences, Faculty of Medicine, Health and Human Sciences, Macquarie University, Australia; Center for Elite Performance, Expertise and Training, Faculty of Medicine, Health and Human Sciences, Macquarie University, Australia
| |
Collapse
|
4
|
Simpson J, Nalepka P, Kallen RW, Dras M, Reichle ED, Hosking SG, Best C, Richards D, Richardson MJ. Conversation dynamics in a multiplayer video game with knowledge asymmetry. Front Psychol 2022; 13:1039431. [PMID: 36405156 PMCID: PMC9669907 DOI: 10.3389/fpsyg.2022.1039431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Accepted: 10/18/2022] [Indexed: 09/08/2024] Open
Abstract
Despite the challenges associated with virtually mediated communication, remote collaboration is a defining characteristic of online multiplayer gaming communities. Inspired by the teamwork exhibited by players in first-person shooter games, this study investigated the verbal and behavioral coordination of four-player teams playing a cooperative online video game. The game, Desert Herding, involved teams consisting of three ground players and one drone operator tasked to locate, corral, and contain evasive robot agents scattered across a large desert environment. Ground players could move throughout the environment, while the drone operator's role was akin to that of a "spectator" with a bird's-eye view, with access to veridical information of the locations of teammates and the to-be-corralled agents. Categorical recurrence quantification analysis (catRQA) was used to measure the communication dynamics of teams as they completed the task. Demands on coordination were manipulated by varying the ground players' ability to observe the environment with the use of game "fog." Results show that catRQA was sensitive to changes to task visibility, with reductions in task visibility reorganizing how participants conversed during the game to maintain team situation awareness. The results are discussed in the context of future work that can address how team coordination can be augmented with the inclusion of artificial agents, as synthetic teammates.
Collapse
Affiliation(s)
- James Simpson
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
| | - Patrick Nalepka
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW, Australia
| | - Rachel W. Kallen
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW, Australia
| | - Mark Dras
- School of Computing, Macquarie University, Sydney, NSW, Australia
| | - Erik D. Reichle
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW, Australia
| | - Simon G. Hosking
- Human and Decision Sciences Division, Defence Science and Technology Group, Melbourne, VIC, Australia
| | - Christopher Best
- Human and Decision Sciences Division, Defence Science and Technology Group, Melbourne, VIC, Australia
| | - Deborah Richards
- School of Computing, Macquarie University, Sydney, NSW, Australia
| | - Michael J. Richardson
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|