1
|
Nalepka P, Silva PL, Kallen RW, Shockley K, Chemero A, Saltzman E, Richardson MJ. Task dynamics define the contextual emergence of human corralling behaviors. PLoS One 2021; 16:e0260046. [PMID: 34780559 PMCID: PMC8592491 DOI: 10.1371/journal.pone.0260046] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2021] [Accepted: 10/29/2021] [Indexed: 11/24/2022] Open
Abstract
Social animals have the remarkable ability to organize into collectives to achieve goals unobtainable to individual members. Equally striking is the observation that despite differences in perceptual-motor capabilities, different animals often exhibit qualitatively similar collective states of organization and coordination. Such qualitative similarities can be seen in corralling behaviors involving the encirclement of prey that are observed, for example, during collaborative hunting amongst several apex predator species living in disparate environments. Similar encirclement behaviors are also displayed by human participants in a collaborative problem-solving task involving the herding and containment of evasive artificial agents. Inspired by the functional similarities in this behavior across humans and non-human systems, this paper investigated whether the containment strategies displayed by humans emerge as a function of the task's underlying dynamics, which shape patterns of goal-directed corralling more generally. This hypothesis was tested by comparing the strategies naïve human dyads adopt during the containment of a set of evasive artificial agents across two disparate task contexts. Despite the different movement types (manual manipulation or locomotion) required in the different task contexts, the behaviors that humans display can be predicted as emergent properties of the same underlying task-dynamic model.
Collapse
Affiliation(s)
- Patrick Nalepka
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW, Australia
| | - Paula L. Silva
- Department of Psychology, Center for Cognition, Action & Perception, University of Cincinnati, Cincinnati, OH, United States of America
| | - Rachel W. Kallen
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW, Australia
| | - Kevin Shockley
- Department of Psychology, Center for Cognition, Action & Perception, University of Cincinnati, Cincinnati, OH, United States of America
| | - Anthony Chemero
- Department of Psychology, Center for Cognition, Action & Perception, University of Cincinnati, Cincinnati, OH, United States of America
| | - Elliot Saltzman
- Department of Physical Therapy & Athletic Training, College of Health & Rehabilitation Sciences, Sargent College, Boston University, Boston, MA, United States of America
- Haskins Laboratories, New Haven, CT, United States of America
| | - Michael J. Richardson
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|
2
|
Rigoli LM, Patil G, Stening HF, Kallen RW, Richardson MJ. Navigational Behavior of Humans and Deep Reinforcement Learning Agents. Front Psychol 2021; 12:725932. [PMID: 34630238 PMCID: PMC8493935 DOI: 10.3389/fpsyg.2021.725932] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Accepted: 08/24/2021] [Indexed: 11/27/2022] Open
Abstract
Rapid advances in the field of Deep Reinforcement Learning (DRL) over the past several years have led to artificial agents (AAs) capable of producing behavior that meets or exceeds human-level performance in a wide variety of tasks. However, research on DRL frequently lacks adequate discussion of the low-level dynamics of the behavior itself and instead focuses on meta-level or global-level performance metrics. In doing so, the current literature lacks perspective on the qualitative nature of AA behavior, leaving questions regarding the spatiotemporal patterning of their behavior largely unanswered. The current study explored the degree to which the navigation and route selection trajectories of DRL agents (i.e., AAs trained using DRL) through simple obstacle ridden virtual environments were equivalent (and/or different) from those produced by human agents. The second and related aim was to determine whether a task-dynamical model of human route navigation could not only be used to capture both human and DRL navigational behavior, but also to help identify whether any observed differences in the navigational trajectories of humans and DRL agents were a function of differences in the dynamical environmental couplings.
Collapse
Affiliation(s)
- Lillian M Rigoli
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
| | - Gaurav Patil
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia.,Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW, Australia
| | - Hamish F Stening
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
| | - Rachel W Kallen
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia.,Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW, Australia
| | - Michael J Richardson
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia.,Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW, Australia
| |
Collapse
|
3
|
Cini F, Banfi T, Ciuti G, Craighero L, Controzzi M. The relevance of signal timing in human-robot collaborative manipulation. Sci Robot 2021; 6:eabg1308. [PMID: 34550718 DOI: 10.1126/scirobotics.abg1308] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
To achieve a seamless human-robot collaboration, it is crucial that robots express their intentions without perturbating or interrupting the task that a human partner is performing at that moment. Although it has not received much attention so far, this issue is important when robots assist humans in physical and manipulation tasks. The main question addressed here is whether there is a more appropriate time to inform a human partner that a robot is requesting to pass them an object. This question is posed in a reference scenario where human individuals are involved in a continuous pick-and-place task that cannot be interrupted. Our findings showed that providing a cue at the beginning of a reach-to-grasp movement could severely interfere with the ongoing human action, increasing the number of errors made by humans, slowing down and degrading the smoothness of their arm movement, and deflecting their gaze. These disruptive interferences strongly decreased, until they disappeared, when the robot provided the cue to the human partners shortly after the participants picked up an object, identifying this as the best signaling timing. The results of this work showed how the signaling timing may have a decisive influence on the performances of the human-robot teamwork and contribute to understanding the mechanisms underpinning the phenomenon of cognitive-motor interference in humans.
Collapse
Affiliation(s)
- F Cini
- BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy.,Scuola Superiore Sant'Anna, Department of Excellence in Robotics & AI, Pisa, Italy
| | - T Banfi
- BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy.,Scuola Superiore Sant'Anna, Department of Excellence in Robotics & AI, Pisa, Italy
| | - G Ciuti
- BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy.,Scuola Superiore Sant'Anna, Department of Excellence in Robotics & AI, Pisa, Italy
| | - L Craighero
- University of Ferrara, Department of Neuroscience and Rehabilitation, Ferrara, Italy
| | - M Controzzi
- BioRobotics Institute, Scuola Superiore Sant'Anna, Pisa, Italy.,Scuola Superiore Sant'Anna, Department of Excellence in Robotics & AI, Pisa, Italy
| |
Collapse
|
4
|
Salters D, Rios PC, Ramsay E, Scharoun Benson SM. Preferential Reaching and End-State Comfort: How Task Demands Influence Motor Planning. J Mot Behav 2020; 53:737-749. [PMID: 33331241 DOI: 10.1080/00222895.2020.1858746] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
Various factors (e.g., hand preference, object properties) constrain reach-to-grasp in hemispace. With object use, end-state comfort (ESC) has been shown to supersede the preferential use of one hand at the midline. To assess how location, size, and orientation of objects (dowel, mallet, cup) influence preferred-hand use and ESC (N = 50; Mage = 20.83), three preferential reaching tasks were implemented. Object location influenced hand selection in all tasks, along with size (cups) and orientation (mallets). Object location and orientation influenced ESC, but only with dowels and mallets. When oriented away from the preferred hand in hemispace, there was a higher occurrence of non-preferred hand use to facilitate ESC. Overall, findings add to understanding of ESC and preferential reaching with varying task demands.
Collapse
Affiliation(s)
- Danielle Salters
- Department of Kinesiology, University of Windsor, Windsor, Ontario, Canada
| | - P Camila Rios
- Department of Kinesiology, University of Windsor, Windsor, Ontario, Canada
| | - Eliza Ramsay
- Department of Kinesiology, University of Windsor, Windsor, Ontario, Canada
| | | |
Collapse
|
5
|
Patil G, Nalepka P, Kallen RW, Richardson MJ. Hopf Bifurcations in Complex Multiagent Activity: The Signature of Discrete to Rhythmic Behavioral Transitions. Brain Sci 2020; 10:brainsci10080536. [PMID: 32784867 PMCID: PMC7465533 DOI: 10.3390/brainsci10080536] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Revised: 07/31/2020] [Accepted: 08/06/2020] [Indexed: 11/16/2022] Open
Abstract
Most human actions are composed of two fundamental movement types, discrete and rhythmic movements. These movement types, or primitives, are analogous to the two elemental behaviors of nonlinear dynamical systems, namely, fixed-point and limit cycle behavior, respectively. Furthermore, there is now a growing body of research demonstrating how various human actions and behaviors can be effectively modeled and understood using a small set of low-dimensional, fixed-point and limit cycle dynamical systems (differential equations). Here, we provide an overview of these dynamical motorprimitives and detail recent research demonstrating how these dynamical primitives can be used to model the task dynamics of complex multiagent behavior. More specifically, we review how a task-dynamic model of multiagent shepherding behavior, composed of rudimentary fixed-point and limit cycle dynamical primitives, can not only effectively model the behavior of cooperating human co-actors, but also reveals how the discovery and intentional use of optimal behavioral coordination during task learning is marked by a spontaneous, self-organized transition between fixed-point and limit cycle dynamics (i.e., via a Hopf bifurcation).
Collapse
|
6
|
Scharoun Benson SM, Bryden PJ, Roy EA. Age-group differences in beginning-state comfort reveal an increase in motor planning capabilities. INTERNATIONAL JOURNAL OF BEHAVIORAL DEVELOPMENT 2019. [DOI: 10.1177/0165025419865620] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Objects can be grasped in different ways to ensure a movement plan is aligned with the intended action. The current study assessed grasp posture in joint action object manipulation in children (ages 6–11, n = 68), young adults ( n = 21), and older adults ( n = 23). Participants performed two actions (pickup and pass; pickup and pass for use) within two movement contexts (using a dowel as if it were the actual object; actual object use), using two objects (glass and hammer) that differed in use-dependent experience. Beginning-state comfort (prioritizing a comfortable initial hand posture for an object recipient) was assessed. Taken together, findings support the notion that the ability to anticipate the intended action, and thus consider an action partner in one’s action plan, increases with age. With age and use-dependent experience, it can be argued that there is a shift from stimulus-driven, familiar responses, to considering affordances and task demands. Together, findings add to our understanding of changes in motor planning capabilities across the life span.
Collapse
|
7
|
Nalepka P, Lamb M, Kallen RW, Shockley K, Chemero A, Saltzman E, Richardson MJ. Human social motor solutions for human-machine interaction in dynamical task contexts. Proc Natl Acad Sci U S A 2019; 116:1437-1446. [PMID: 30617064 PMCID: PMC6347696 DOI: 10.1073/pnas.1813164116] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Multiagent activity is commonplace in everyday life and can improve the behavioral efficiency of task performance and learning. Thus, augmenting social contexts with the use of interactive virtual and robotic agents is of great interest across health, sport, and industry domains. However, the effectiveness of human-machine interaction (HMI) to effectively train humans for future social encounters depends on the ability of artificial agents to respond to human coactors in a natural, human-like manner. One way to achieve effective HMI is by developing dynamical models utilizing dynamical motor primitives (DMPs) of human multiagent coordination that not only capture the behavioral dynamics of successful human performance but also, provide a tractable control architecture for computerized agents. Previous research has demonstrated how DMPs can successfully capture human-like dynamics of simple nonsocial, single-actor movements. However, it is unclear whether DMPs can be used to model more complex multiagent task scenarios. This study tested this human-centered approach to HMI using a complex dyadic shepherding task, in which pairs of coacting agents had to work together to corral and contain small herds of virtual sheep. Human-human and human-artificial agent dyads were tested across two different task contexts. The results revealed (i) that the performance of human-human dyads was equivalent to those composed of a human and the artificial agent and (ii) that, using a "Turing-like" methodology, most participants in the HMI condition were unaware that they were working alongside an artificial agent, further validating the isomorphism of human and artificial agent behavior.
Collapse
Affiliation(s)
- Patrick Nalepka
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW 2109, Australia;
- Department of Psychology, Macquarie University, Sydney, NSW 2109, Australia
| | - Maurice Lamb
- Center for Cognition, Action & Perception, Department of Psychology, University of Cincinnati, Cincinnati, OH 45220
| | - Rachel W Kallen
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW 2109, Australia
- Department of Psychology, Macquarie University, Sydney, NSW 2109, Australia
| | - Kevin Shockley
- Center for Cognition, Action & Perception, Department of Psychology, University of Cincinnati, Cincinnati, OH 45220
| | - Anthony Chemero
- Center for Cognition, Action & Perception, Department of Psychology, University of Cincinnati, Cincinnati, OH 45220
| | - Elliot Saltzman
- Department of Physical Therapy & Athletic Training, Sargent College of Health & Rehabilitation Sciences, Boston University, Boston, MA 02215
- Haskins Laboratories, New Haven, CT 06511
| | - Michael J Richardson
- Centre for Elite Performance, Expertise and Training, Macquarie University, Sydney, NSW 2109, Australia;
- Department of Psychology, Macquarie University, Sydney, NSW 2109, Australia
| |
Collapse
|
8
|
A cluster phase analysis for collective behavior in team sports. Hum Mov Sci 2018; 59:96-111. [DOI: 10.1016/j.humov.2018.03.013] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2017] [Revised: 03/15/2018] [Accepted: 03/22/2018] [Indexed: 11/24/2022]
|