3
|
Albertella L, Kirkham R, Adler AB, Crampton J, Drummond SPA, Fogarty GJ, Gross JJ, Zaichkowsky L, Andersen JP, Bartone PT, Boga D, Bond JW, Brunyé TT, Campbell MJ, Ciobanu LG, Clark SR, Crane MF, Dietrich A, Doty TJ, Driskell JE, Fahsing I, Fiore SM, Flin R, Funke J, Gatt JM, Hancock PA, Harper C, Heathcote A, Heatown KJ, Helsen WF, Hussey EK, Jackson RC, Khemlani S, Killgore WDS, Kleitman S, Lane AM, Loft S, MacMahon C, Marcora SM, McKenna FP, Meijen C, Moulton V, Moyle GM, Nalivaiko E, O'Connor D, O’Conor D, Patton D, Piccolo MD, Ruiz C, Schücker L, Smith RA, Smith SJR, Sobrino C, Stetz M, Stewart D, Taylor P, Tucker AJ, van Stralen H, Vickers JN, Visser TAW, Walker R, Wiggins MW, Williams AM, Wong L, Aidman E, Yücel M. Building a transdisciplinary expert consensus on the cognitive drivers of performance under pressure: An international multi-panel Delphi study. Front Psychol 2023; 13:1017675. [PMID: 36755983 PMCID: PMC9901503 DOI: 10.3389/fpsyg.2022.1017675] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Accepted: 11/02/2022] [Indexed: 01/19/2023] Open
Abstract
Introduction The ability to perform optimally under pressure is critical across many occupations, including the military, first responders, and competitive sport. Despite recognition that such performance depends on a range of cognitive factors, how common these factors are across performance domains remains unclear. The current study sought to integrate existing knowledge in the performance field in the form of a transdisciplinary expert consensus on the cognitive mechanisms that underlie performance under pressure. Methods International experts were recruited from four performance domains [(i) Defense; (ii) Competitive Sport; (iii) Civilian High-stakes; and (iv) Performance Neuroscience]. Experts rated constructs from the Research Domain Criteria (RDoC) framework (and several expert-suggested constructs) across successive rounds, until all constructs reached consensus for inclusion or were eliminated. Finally, included constructs were ranked for their relative importance. Results Sixty-eight experts completed the first Delphi round, with 94% of experts retained by the end of the Delphi process. The following 10 constructs reached consensus across all four panels (in order of overall ranking): (1) Attention; (2) Cognitive Control-Performance Monitoring; (3) Arousal and Regulatory Systems-Arousal; (4) Cognitive Control-Goal Selection, Updating, Representation, and Maintenance; (5) Cognitive Control-Response Selection and Inhibition/Suppression; (6) Working memory-Flexible Updating; (7) Working memory-Active Maintenance; (8) Perception and Understanding of Self-Self-knowledge; (9) Working memory-Interference Control, and (10) Expert-suggested-Shifting. Discussion Our results identify a set of transdisciplinary neuroscience-informed constructs, validated through expert consensus. This expert consensus is critical to standardizing cognitive assessment and informing mechanism-targeted interventions in the broader field of human performance optimization.
Collapse
Affiliation(s)
- Lucy Albertella
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, VIC, Australia,*Correspondence: Lucy Albertella,
| | - Rebecca Kirkham
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, VIC, Australia
| | - Amy B. Adler
- Walter Reed Army Institute of Research, Silver Spring, MD, United States
| | - John Crampton
- APS College of Sport and Exercise Psychologists, Melbourne, VIC, Australia
| | - Sean P. A. Drummond
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, VIC, Australia
| | - Gerard J. Fogarty
- School of Psychology and Wellbeing, University of Southern Queensland, Toowoomba, QLD, Australia
| | | | - Leonard Zaichkowsky
- Wheelock College of Education and Human Development, Boston University, Boston, MA, United States
| | | | | | - Danny Boga
- Australian Army Psychology Corps, Canberra, ACT, Australia
| | - Jeffrey W. Bond
- APS College of Sport and Exercise Psychologists, Melbourne, VIC, Australia
| | - Tad T. Brunyé
- U.S. Army DEVCOM Analysis Center, Natick, MA, United States
| | - Mark J. Campbell
- Physical Education & Sport Sciences Department, University of Limerick, Limerick, Ireland
| | - Liliana G. Ciobanu
- Adelaide Medical School, University of Adelaide, Adelaide, SA, Australia
| | - Scott R. Clark
- Adelaide Medical School, University of Adelaide, Adelaide, SA, Australia
| | - Monique F. Crane
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
| | - Arne Dietrich
- Department of Psychology, American University of Beirut, Beirut, Lebanon
| | - Tracy J. Doty
- Walter Reed Army Institute of Research, Silver Spring, MD, United States
| | | | - Ivar Fahsing
- Norwegian Police University College, Oslo, Norway
| | - Stephen M. Fiore
- Department of Psychology, and Institute of Simulation and Training, University of Central Florida, Orlando, FL, United States
| | - Rhona Flin
- Aberdeen Business School, Robert Gordon University, Aberdeen, United Kingdom
| | - Joachim Funke
- Department of Psychology, Heidelberg University, Heidelberg, Germany
| | - Justine M. Gatt
- School of Psychology, University of New South Wales, Kensington, NSW, Australia,Neuroscience Research Australia, Sydney, NSW, Australia
| | - P. A. Hancock
- Department of Psychology, and Institute of Simulation and Training, University of Central Florida, Orlando, FL, United States
| | - Craig Harper
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, VIC, Australia
| | - Andrew Heathcote
- The University of Newcastle, Callaghan, NSW, Australia,School of Biomedical Sciences and Pharmacy, The University of Newcastle, Callaghan, NSW, Australia
| | - Kristin J. Heatown
- US Army Research Institute of Environmental Medicine (USARIEM), Natick, MA, United States
| | | | | | - Robin C. Jackson
- School of Sport, Exercise and Health Sciences, Loughborough University, Loughborough, United Kingdom
| | - Sangeet Khemlani
- United States Naval Research Laboratory, Washington, DC, United States
| | | | - Sabina Kleitman
- School of Psychology, The University of Sydney, Darlington, NSW, Australia
| | - Andrew M. Lane
- Sport, Physical Activity Research Centre (SPARC), School of Sport, University of Wolverhampton, Wolverhampton, United Kingdom
| | - Shayne Loft
- School of Psychological Science, University of Western Australia, Perth, WA, Australia
| | - Clare MacMahon
- School of Allied Health, Human Services, and Sport, La Trobe University, Melbourne, VIC, Australia
| | - Samuele M. Marcora
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Frank P. McKenna
- Department of Psychology, University of Reading, Reading, United Kingdom
| | - Carla Meijen
- Faculty of Sport, Allied Health and Performance Science, St Mary's University, Twickenham, United Kingdom
| | | | - Gene M. Moyle
- Faculty of Creative Industries, Education and Social Justice, Queensland University of Technology, Brisbane, QLD, Australia
| | - Eugene Nalivaiko
- The University of Newcastle, Callaghan, NSW, Australia,School of Biomedical Sciences and Pharmacy, The University of Newcastle, Callaghan, NSW, Australia
| | - Donna O'Connor
- Sydney School of Education and Social Work, The University of Sydney, Darlington, NSW, Australia
| | | | - Debra Patton
- United States Department of Defense, Washington DC, United States
| | | | - Coleman Ruiz
- Mission Critical Team Institute, Annapolis, MD, United States
| | - Linda Schücker
- Department of Sport Psychology, Institute of Sport and Exercise Sciences, University of Münster, Münster, Germany
| | | | - Sarah J. R. Smith
- Defense Science and Technology Laboratory, Salisbury, United Kingdom
| | - Chava Sobrino
- NSW Institute of Sport and Diving, Sydney, NSW, Australia
| | - Melba Stetz
- Independent Practitioner, Grand Ledge, MI, United States
| | | | - Paul Taylor
- The University of Newcastle, Callaghan, NSW, Australia,School of Biomedical Sciences and Pharmacy, The University of Newcastle, Callaghan, NSW, Australia
| | - Andrew J. Tucker
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, VIC, Australia
| | | | - Joan N. Vickers
- Faculty of Kinesiology, University of Calgary, Calgary, AB, Canada
| | - Troy A. W Visser
- School of Psychological Science, University of Western Australia, Perth, WA, Australia
| | - Rohan Walker
- The University of Newcastle, Callaghan, NSW, Australia,School of Biomedical Sciences and Pharmacy, The University of Newcastle, Callaghan, NSW, Australia
| | - Mark W. Wiggins
- School of Psychological Sciences, Macquarie University, Sydney, NSW, Australia
| | | | - Leonard Wong
- United States Army War College, Carlisle, PA, United States
| | - Eugene Aidman
- The University of Newcastle, Callaghan, NSW, Australia,Decision Sciences Division, Defense Science and Technology Group, Adelaide, SA, Australia
| | - Murat Yücel
- Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Melbourne, VIC, Australia
| |
Collapse
|
5
|
Blaha LM, Abrams M, Bibyk SA, Bonial C, Hartzler BM, Hsu CD, Khemlani S, King J, St. Amant R, Trafton JG, Wong R. Understanding Is a Process. Front Syst Neurosci 2022; 16:800280. [PMID: 35431820 PMCID: PMC9008134 DOI: 10.3389/fnsys.2022.800280] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Accepted: 01/17/2022] [Indexed: 12/04/2022] Open
Abstract
How do we gauge understanding? Tests of understanding, such as Turing's imitation game, are numerous; yet, attempts to achieve a state of understanding are not satisfactory assessments. Intelligent agents designed to pass one test of understanding often fall short of others. Rather than approaching understanding as a system state, in this paper, we argue that understanding is a process that changes over time and experience. The only window into the process is through the lens of natural language. Usefully, failures of understanding reveal breakdowns in the process. We propose a set of natural language-based probes that can be used to map the degree of understanding a human or intelligent system has achieved through combinations of successes and failures.
Collapse
Affiliation(s)
- Leslie M. Blaha
- 711 Human Performance Wing, U.S. Air Force Research Laboratory, Wright-Patterson Air Force Base, OH, United States
- *Correspondence: Leslie M. Blaha
| | | | - Sarah A. Bibyk
- 711 Human Performance Wing, U.S. Air Force Research Laboratory, Wright-Patterson Air Force Base, OH, United States
| | - Claire Bonial
- U.S. Army Combat Capabilities Development Command, Army Research Laboratory, Adelphi, MD, United States
| | - Beth M. Hartzler
- Link Training & Simulation, CAE USA, Arlington, TX, United States
| | - Christopher D. Hsu
- U.S. Army Combat Capabilities Development Command, Army Research Laboratory, Adelphi, MD, United States
| | - Sangeet Khemlani
- Navy Center for Applied Research in AI, U.S. Naval Research Laboratory, Washington, DC, United States
| | - Jayde King
- 711 Human Performance Wing, U.S. Air Force Research Laboratory, Wright-Patterson Air Force Base, OH, United States
| | - Robert St. Amant
- U.S. Army Combat Capabilities Development Command, Army Research Laboratory, Adelphi, MD, United States
| | - J. Gregory Trafton
- Navy Center for Applied Research in AI, U.S. Naval Research Laboratory, Washington, DC, United States
| | - Rachel Wong
- Link Training & Simulation, CAE USA, Arlington, TX, United States
| |
Collapse
|