1
|
Brunyé TT, Goring SA, Cantelon JA, Eddy MD, Elkin-Frankston S, Elmore WR, Giles GE, Hancock CL, Masud SB, McIntyre J, McKenzie KL, Mitchell KB, O’Donovan MP, Racicot K, Ramsay JW. Trait-level predictors of human performance outcomes in personnel engaged in stressful laboratory and field tasks. Front Psychol 2024; 15:1449200. [PMID: 39315045 PMCID: PMC11418282 DOI: 10.3389/fpsyg.2024.1449200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2024] [Accepted: 08/20/2024] [Indexed: 09/25/2024] Open
Abstract
Introduction Personnel performance under stress hinges on various factors, including individual traits, training, context, mental and physiological states, and task demands. This study explored the link between the traits of military personnel and their performance outcomes in five domains: move, shoot, communicate, navigate, and sustain. Methods A total of 387 U.S. Army soldiers participated in this study, undergoing trait assessments covering physical, cognitive, social-emotional, demographic/lifestyle, and health domains. Performance was measured through lab and field events assessing a broad range of individual and team-level skills under conditions demanding resilience to acute cognitive and physical stress exposure. Analysis used feature selection and elastic net regression. Results Analyses revealed complex associations between traits and performance, with physical, cognitive, health-related, social-emotional, and lifestyle traits playing roles in guiding and constraining performance. Measures of resilience, emotion regulation, grit, and mindfulness were identified as relevant predictors of several performance-related outcomes. Discussion Results carry implications for the selection, training, and operational effectiveness of personnel in high-stakes occupations including military and first response. Further research is necessary to explore the mechanisms underlying these associations and inform targeted interventions to boost personnel effectiveness.
Collapse
Affiliation(s)
- Tad T. Brunyé
- U.S. Army DEVCOM Soldier Center, Natick, MA, United States
- Center for Applied Brain and Cognitive Sciences, Tufts University, Medford, MA, United States
| | - Sara Anne Goring
- Center for Applied Brain and Cognitive Sciences, Tufts University, Medford, MA, United States
| | - Julie A. Cantelon
- U.S. Army DEVCOM Soldier Center, Natick, MA, United States
- Center for Applied Brain and Cognitive Sciences, Tufts University, Medford, MA, United States
| | - Marianna D. Eddy
- U.S. Army DEVCOM Soldier Center, Natick, MA, United States
- Center for Applied Brain and Cognitive Sciences, Tufts University, Medford, MA, United States
| | - Seth Elkin-Frankston
- U.S. Army DEVCOM Soldier Center, Natick, MA, United States
- Center for Applied Brain and Cognitive Sciences, Tufts University, Medford, MA, United States
| | - Wade R. Elmore
- U.S. Army DEVCOM Soldier Center, Natick, MA, United States
| | - Grace E. Giles
- U.S. Army DEVCOM Soldier Center, Natick, MA, United States
- Center for Applied Brain and Cognitive Sciences, Tufts University, Medford, MA, United States
| | | | - Shoaib Bin Masud
- Center for Applied Brain and Cognitive Sciences, Tufts University, Medford, MA, United States
- Department of Electrical and Computer Engineering, Tufts University, Medford, MA, United States
| | - James McIntyre
- Center for Applied Brain and Cognitive Sciences, Tufts University, Medford, MA, United States
| | | | | | | | | | - John W. Ramsay
- U.S. Army DEVCOM Soldier Center, Natick, MA, United States
| |
Collapse
|
2
|
Baker AL, Keebler JR, Anania EC, Schuster D, Plummer JP. Team Combat Identification: Effects of Gender, Spatial Visualization, and Disagreement. HUMAN FACTORS 2021; 63:684-695. [PMID: 32017611 DOI: 10.1177/0018720820902286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
OBJECTIVE The combat identification (CID) abilities of same-gender and mixed-gender dyads were experimentally assessed, along with measures of spatial skills and team communication. BACKGROUND CID is a high-stakes decision-making task involving discrimination between friendly and enemy forces. Literature on CID is primarily focused on the individual, but the extensive use of teams in the military means that more team-based research is needed in this area. METHOD After a set of training sessions, 39 dyads were tasked with identifying 10 armored vehicles in a series of pictures and videos. Team communication was recorded, transcribed, and coded for instances of disagreements. RESULTS Analyses indicated that males scored higher on a spatial visualization measure than did females. M-M teams performed significantly better than M-F teams on the CID task, but when spatial ability and team disagreements were added as predictors, the effect of team gender composition became nonsignificant. Spatial ability and team disagreement were significant predictors of team CID performance. CONCLUSION Results suggest that spatial skills and team disagreement behaviors are more important for team CID performance than a team's gender composition. To our knowledge, this is the first lab study of team CID. APPLICATION This research highlights the importance of understanding both individual differences (e.g., spatial skills) and team processes (e.g., communication) within CID training environments in the military context.
Collapse
Affiliation(s)
- Anthony L Baker
- 2830 Embry-Riddle Aeronautical University, Daytona Beach, FL, USA
| | - Joseph R Keebler
- 2830 Embry-Riddle Aeronautical University, Daytona Beach, FL, USA
| | - Emily C Anania
- 2830 Embry-Riddle Aeronautical University, Daytona Beach, FL, USA
| | | | | |
Collapse
|
3
|
Abstract
OBJECTIVE To assess the evidence of general transfer from training on abstract computer-based exercises and video games to driving and flight control. BACKGROUND Many believe that training on abstract computer-based exercises and video games enhances cognitive capacities to the benefit of performance in operational contexts. The basic research in this area is controversial. METHOD We summarize reviews of the basic research data on transfer from training on abstract computer-based exercises and video games and undertake a detailed methodological review of flight and driving transfer studies. RESULTS Reviews of basic transfer research fail to reveal evidence of general transfer, although a few applied studies are said to show general transfer to driving or flight control. Our review of these applied studies identifies issues with research methods and data interpretation that compromise the credibility of their results to an extent that they do not provide robust evidence of general transfer from abstract computer-based exercises or video games. CONCLUSION The state of cognitive training and video game training in relation to transfer has failed to meet early expectations. Much of the research in this area suffers from inadequate experimental control and flawed interpretation of results. We call for adherence to robust experimental design, critical evaluation of data patterns, and replication of keystone results. We also call for a theoretically grounded research effort, and we outline relevant theoretical conceptions of transfer. APPLICATION A robust theory of transfer and better understanding of transfer effects can guide development of principles for design and use of training simulators.
Collapse
Affiliation(s)
- Gavan Lintern
- 2541 Monash University, Melbourne, Victoria, Australia
| | | |
Collapse
|
5
|
Männiste T, Pedaste M, Schimanski R. Review of instruments measuring decision making performance in military tactical level battle situation context. MILITARY PSYCHOLOGY 2019. [DOI: 10.1080/08995605.2019.1645538] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Tõnis Männiste
- Institute of Education, University of Tartu, Tartu, Estonia
- Department of Applied Research, Estonian Military Academy, Estonian National Defence College, Tartu, Estonia
| | - Margus Pedaste
- Institute of Education, University of Tartu, Tartu, Estonia
| | | |
Collapse
|
6
|
McGinn C, Sena A, Kelly K. Controlling robots in the home: Factors that affect the performance of novice robot operators. APPLIED ERGONOMICS 2017; 65:23-32. [PMID: 28802443 DOI: 10.1016/j.apergo.2017.05.005] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/11/2016] [Revised: 04/21/2017] [Accepted: 05/12/2017] [Indexed: 06/07/2023]
Abstract
For robots to successfully integrate into everyday life, it is important that they can be effectively controlled by laypeople. However, the task of manually controlling mobile robots can be challenging due to demanding cognitive and sensorimotor requirements. This research explores the effect that the built environment has on the manual control of domestic service robots. In this study, a virtual reality simulation of a domestic robot control scenario was developed. The performance of fifty novice users was evaluated, and their subjective experiences recorded through questionnaires. Through quantitative and qualitative analysis, it was found that untrained operators frequently perform poorly at navigation-based robot control tasks. The study found that passing through doorways accounted for the largest number of collisions, and was consistently identified as a very difficult operation to perform. These findings suggest that homes and other human-orientated settings present significant challenges to robot control.
Collapse
Affiliation(s)
- Conor McGinn
- Dept. of Mechanical and Manufacturing Engineering, Trinity College Dublin, Ireland.
| | - Aran Sena
- Dept. of Mechanical and Manufacturing Engineering, Trinity College Dublin, Ireland
| | - Kevin Kelly
- Dept. of Mechanical and Manufacturing Engineering, Trinity College Dublin, Ireland
| |
Collapse
|
7
|
Plummer JP, Schuster D, Keebler JR. The effects of gender, flow and video game experience on combat identification training. ERGONOMICS 2017; 60:1101-1111. [PMID: 28112587 DOI: 10.1080/00140139.2017.1280187] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2016] [Accepted: 12/28/2016] [Indexed: 06/06/2023]
Abstract
The present study examined the effects of gender, video game experience (VGE), and flow state on multiple indices of combat identification (CID) performance. Individuals were trained on six combat vehicles in a simulation, presented through either a stereoscopic or non-stereoscopic display. Participants then reported flow state, VGE and were tested on their ability to discriminate friend vs. foe and identify both pictures and videos of the trained vehicles. The effect of stereoscopy was not significant. There was an effect of gender across three dependent measures. For the two picture-based measures, the effect of gender was mediated by VGE. Additionally, the effect of gender was moderated by flow state on the identification measures. Overall, the study suggests that gender differences may be overcome by VGE and by achieving flow state. Selection based on these individual differences may be useful for future military simulation. Practitioner Summary: This work investigates the effect of gender, VGE and flow state on CID performance. For three measures of performance, there was a main effect of gender. Gender was mediated by previous VGE on two measures, and gender was moderated by flow state on two measures.
Collapse
Affiliation(s)
- John Paul Plummer
- a Department of Psychology , Wichita State University , Wichita , KS , USA
| | - David Schuster
- b Department of Psychology , San José State University , San José , CA , USA
| | - Joseph R Keebler
- c Department of Human Factors , Embry-Riddle Aeronautical University , Daytona Beach , FL , USA
| |
Collapse
|
8
|
Keebler JR, Smith DC, Patzer B, Plummer JP, Jentsch F, Palmer E. Review of Combat Identification Training. ACTA ACUST UNITED AC 2016. [DOI: 10.1177/1541931215591392] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Combat identification (CID) has been studied throughout the 20th and into the 21st century, with a renewed interest in the topic in the past few decades. CID research has demonstrated that an emerging set of technologies could potentially mitigate some of the negative battlefield outcomes of failures in CID, including high rates of fratricide due to friendly fire. This paper discusses major CID research and provides an update on previous CID research by the authors. We review training technologies, effective measurement tools in this research, and important individual differences to consider for others researching training outcomes in relation to learning to differentiate between highly similar combat vehicles.
Collapse
|
11
|
Bohil CJ, Higgins NA, Keebler JR. Predicting and interpreting identification errors in military vehicle training using multidimensional scaling. ERGONOMICS 2014; 57:844-855. [PMID: 24697208 DOI: 10.1080/00140139.2014.899631] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
UNLABELLED We compared methods for predicting and understanding the source of confusion errors during military vehicle identification training. Participants completed training to identify main battle tanks. They also completed card-sorting and similarity-rating tasks to express their mental representation of resemblance across the set of training items. We expected participants to selectively attend to a subset of vehicle features during these tasks, and we hypothesised that we could predict identification confusion errors based on the outcomes of the card-sort and similarity-rating tasks. Based on card-sorting results, we were able to predict about 45% of observed identification confusions. Based on multidimensional scaling of the similarity-rating data, we could predict more than 80% of identification confusions. These methods also enabled us to infer the dimensions receiving significant attention from each participant. This understanding of mental representation may be crucial in creating personalised training that directs attention to features that are critical for accurate identification. PRACTITIONER SUMMARY Participants completed military vehicle identification training and testing, along with card-sorting and similarity-rating tasks. The data enabled us to predict up to 84% of identification confusion errors and to understand the mental representation underlying these errors. These methods have potential to improve training and reduce identification errors leading to fratricide.
Collapse
Affiliation(s)
- Corey J Bohil
- a Department of Psychology , University of Central Florida , Orlando , FL , USA
| | | | | |
Collapse
|