Modeling Automation With Cognitive Work Analysis to Support Human-Automation Coordination

Designing human-AI systems for complex settings: ideas from distributed, joint, and self-organising perspectives of sociotechnical systems and cognitive work analysis

Real-world events like the COVID-19 pandemic and wildfires in Australia, Europe, and America remind us that the demands of complex operational settings are met by multiple, distributed teams interwoven with a large array of artefacts and networked technologies, including automation. Yet, current models of human-automation interaction, including those intended for human-machine teaming or collaboration, tend to be dyadic in nature, assuming individual humans interacting with individual machines. Given the opportunities and challenges of emerging artificial intelligence (AI) technologies, and the growing interest of many organisations in utilising these technologies in complex operations, we suggest turning to contemporary perspectives of sociotechnical systems for a way forward. We show how ideas of distributed cognition, joint cognitive systems, and self-organisation lead to specific concepts for designing human-AI systems, and propose that design frameworks informed by contemporary views of complex work performance are needed. We discuss cognitive work analysis as an example.

Combining cognitive work analysis and empirical evaluations to understand map use by operators of small carry-on unmanned aerial systems

Operating a small carry-on unmanned aerial system (UAS) alone is challenging. Research on facilitating single-operator work has focused mainly on payload operation and health monitoring. Little focus has been given to mission-related aspects and how the command and control (C2) map display contributes to mission accomplishment. This study uses cognitive work analysis (CWA) to describe the operational work of the mission operator of a Skylark miniature UAS system. Three CWA phases were conducted - work domain analysis, control task analysis and strategy analysis - providing a rich framework of operational mission phases, task components, processes and the physical interface-objects in use. These representations highlight the operators' extensive use of the C2 map during all mission phases, for all object-related processes. To further enhance the outcomes of the CWA, and prior to outlining specific design requirements, an empirical investigation was conducted in which the eye movements of five experienced operators were obtained during a simulated mission. The empirical results confirm and further specify the work patterns that operators adopt. Quantitative analysis shows operators' extensive focus on the map, especially during mission-critical phases. These analyses led to the conclusion that a significant change in the way operators interact with the C2 map, or alternative designs to enhance map-based information utilization, should be applied. Insights drawn from this analysis can be applied to other aerial surveillance work domains, and adding empirical evaluations is helpful to further refine and reinforce the CWA outcomes.