Beyond human error taxonomies in assessment of risk in sociotechnical systems: a new paradigm with the EAST 'broken-links' approach

When tomorrow comes: A prospective risk assessment of a future artificial general intelligence-based uncrewed combat aerial vehicle system

There are concerns that Artificial General Intelligence (AGI) could pose an existential threat to humanity; however, as AGI does not yet exist it is difficult to prospectively identify risks and develop requisite controls. We applied the Work Domain Analysis Broken Nodes (WDA-BN) and Event Analysis of Systemic Teamwork-Broken Links (EAST-BL) methods to identify potential risks in a future 'envisioned world' AGI-based uncrewed combat aerial vehicle system. The findings suggest five main categories of risk in this context: sub-optimal performance risks, goal alignment risks, super-intelligence risks, over-control risks, and enfeeblement risks. Two of these categories, goal alignment risks and super-intelligence risks, have not previously been encountered or dealt with in conventional safety management systems. Whereas most of the identified sub-optimal performance risks can be managed through existing defence design lifecycle processes, we propose that work is required to develop controls to manage the other risks identified. These include controls on AGI developers, controls within the AGI itself, and broader sociotechnical system controls.

Managing the risks associated with technological disruption in the road transport system: a control structure modelling approach

Road transport is experiencing disruptive change from new first-of-a-kind technologies. While such technologies offer safety and operational benefits, they also pose new risks. It is critical to proactively identify risks during the design, development and testing of new technologies. The Systems Theoretic Accident Model and Processes (STAMP) method analyses the dynamic structure in place to manage safety risks. This study applied STAMP to develop a control structure model for emerging technologies in the Australian road transport system and identified control gaps. The control structure shows the actors responsible for managing risks associated with first-of-a-kind technologies and the existing control and feedback mechanisms. Gaps identified related to controls (e.g. legislation) and feedback mechanisms (e.g. monitoring for behavioural adaptation). The study provides an example of how STAMP can be used to identify control structure gaps requiring attention to support the safe introduction of new technologies.

Shaping the development and use of Artificial Intelligence: how human factors and ergonomics expertise can become more pertinent

New developments in Artificial Intelligence (AI) are extensively discussed in public media and scholarly publications. While in many academic disciplines debates on the challenges and opportunities of Artificial Intelligence (AI) and how to best address them have been launched, the human factors and ergonomics (HFE) community has been strangely quiet. I discuss three main areas in which HFE could and should significantly contribute to the socially and economically viable development and use of AI: decisions on automation versus augmentation of human work; alignment of control and accountability for AI outcomes; counteracting power imbalances among AI stakeholders. I then outline actions that the HFE community could undertake to improve their involvement in AI development and use, foremost translating ethical into design principles, strengthening the macro-turn in HFE, broadening the HFE design mindset, and taking advantage of new interdisciplinary research opportunities.Practitioner summary: HFE expertise could and should significantly contribute to the socially and economically viable development and use of AI. Translating ethical into design principles, opening up to broader multi-stakeholder perspectives, and engaging in interdisciplinary collaboration within a design science framework are discussed as measures to achieve that.

Forecasting emergent risks in advanced AI systems: an analysis of a future road transport management system

Artificial Intelligence (AI) is being increasingly implemented within road transport systems worldwide. Next generation of AI, Artificial General Intelligence (AGI) is imminent, and is anticipated to be more powerful than current AI. AGI systems will have a broad range of abilities and be able to perform multiple cognitive tasks akin to humans that will likely produce many expected benefits, but also potential risks. This study applied the EAST Broken Links approach to forecast the functioning of an AGI system tasked with managing a road transport system and identify potential risks. In total, 363 risks were identified that could have adverse impacts on the stated goals of safety, efficiency, environmental sustainability, and economic performance of the road system. Further, risks beyond the stated goals were identified; removal from human control, mismanaging public relations, and self-preservation. A diverse set of systemic controls will be required when designing, implementing, and operating future advanced technologies.Practitioner summary: This study demonstrated the utility of HFE methods for formally considering risks associated with the design, implementation, and operation of future technologies. This study has implications for AGI research, design, and development to ensure safe and ethical AGI implementation.

Understanding complexity in a safety critical setting: A systems approach to medication administration

'Medication errors' are a significant concern and are associated with a higher incidence of adverse events and unintentional patient harm than any other aspect of healthcare. While much research has focused on adverse medication errors, limited studies have specifically examined 'normal' medication delivery performance and the interactions between tasks, agents, and information within the medication administration system. This article describes a study that applied the Event Analysis of Systemic Teamwork (EAST) model to study the hospital medication administration system to identify opportunities to optimise performance and patient safety. Key findings of this study demonstrate that this is a highly complex system, comprising many social agents and a relatively closely linked series of tasks and information. However, most of the workload relies on a small proportion of healthcare professionals. Significantly, the patient has a minimal role in the medication administration system during their hospital stay. The research has shown that this approach enables mapping networks and their interdependencies to optimise the system as a whole rather than its parts in isolation.

Using systems thinking-based risk assessment methods to assess hazardous manual tasks: a comparison of Net-HARMS, EAST-BL, FRAM and STPA

Formal risk assessment is a component of safety management relating to hazardous manual tasks (HMT). Systems thinking approaches are currently gaining interest for supporting safety management. Existing HMT risk assessment methods have been found to be limited in their ability to identify risks across the whole work system; however, systems thinking-based risk assessment (STBRA) methods were not designed for the HMT context and have not been tested in this area. The aim of this study was to compare the performance of four state-of-the-art STBRA methods: Net-HARMS, EAST-BL, FRAM and STPA to determine which would be most useful for identifying HMT risks. Each method was independently applied by one of four analysts to assess the risks associated with a hypothetical HMT system. The outcomes were assessed for alignment with a benchmark analysis. Using signal detection theory (SDT), overall STPA was found to be the best performing method having the highest hit rate, second lowest false alarm rate and highest Matthews Correlation Coefficient of the four methods.Practitioner summary: A comparison of four systems thinking risk assessment methods found that STPA had the highest level of agreement with the benchmark analysis and is the most suitable for practitioners to use to identify the risks associated with HMT systems.

Analysing dynamic work systems using DynEAST: a demonstration of concept

The capability of current Ergonomics methods to capture dynamism is limited, stifling our understanding of work-as-done, distributed situational awareness and organisational drift. This paper provides a demonstration of concept of DynEAST; an extension of the EAST framework underpinned by principles from Dynamic Network Analysis, to capture elements of dynamism within work systems. The DynEAST concept is applied to a railway maintenance case study. Case study findings demonstrate how DynEAST outputs can be used to advance our understanding of the aforementioned phenomena and better equip practitioners for current and future Ergonomics challenges.Practitioner summary: This paper introduces the DynEAST method. DynEAST enables HF/E practitioners to model and analyse dynamic features of complex work systems. The development of DynEAST is timely due to the concurrent proliferation of increasingly complex sociotechnical systems and stagnation of HF/E methods development; particularly those able to model systemic dynamism. Abbreviations: DynEAST: dynamic event analysis of systemic teamwork; EAST: dynamic event analysis of systemic teamwork; HF/E: human factors and ergonomics; HF: human factors; DNA: dynamic network analysis; HTA: hierarchal task analysis; CWA: cognitive work analysis; CAST: causal analysis based on system theory; STAMP: system theoretic accident model and processes; FRAM: functional resonance analysis method; SNA: social network analysis; DSA: distributed situational awareness; PPO: possession protection officer; PO: protection officer; RTS: railway track signals; LPA: local possession authority; SMEs: subject matter experts.

The quest for the ring: a case study of a new submarine control room configuration

Submarine control room layouts have remained similar across decades of operation, despite the introduction of new technologies that allow for the co-location of the sound and control room. Operation of an inwards, rather than outwards, facing ring control room configuration was examined in three scenarios: Return to Periscope Depth, Inshore Operations, and Dived Tracking. A case study design employed a serving team of qualified submariners participated in all three scenarios with high and low demand. Communications and activities in the control room were recorded and analysed using the Event Analysis of Systemic Teamwork (EAST) method. EAST models collaborative teamwork through social, information, and task networks. The results from the ring configuration were compared to an outward facing baseline of the contemporary control room layout with a separate sound and control room. The ring control room configuration increased communications between operators, leading to a more information exchanged, and more tasks completed. Practitioner summary: Control room design on submarines, and other domains, has traditionally been outward facing with supervisory staff looking over the shoulders of their subordinates. In this paper, and inward looking control room design was explored, with subordinate staff facing their supervisors. This design resulted in more information exchange and productive work.

Development of Rasmussen's risk management framework for analysing multi-level sociotechnical influences in the design of envisioned work systems

Besides radically altering work, advances in automation and intelligent technologies have the potential to bring significant societal transformation. These transitional periods require an approach to analysis and design that goes beyond human-machine interaction in the workplace to consider the wider sociotechnical needs of envisioned work systems. The Sociotechnical Influences Space, an analytical tool motivated by Rasmussen's risk management model, promotes a holistic approach to the design of future systems, attending to societal needs and challenges, while still recognising the bottom-up push from emerging technologies. A study explores the concept and practical potential of the tool when applied to the analysis of a large-scale, 'real-world' problem, specifically the societal, governmental, regulatory, organisational, human, and technological factors of significance in mixed human-artificial agent workforces. Further research is needed to establish the feasibility of the tool in a range of application domains, the details of the method, and the value of the tool in design. Practitioner summary: Emerging automation and intelligent technologies are not only transforming workplaces, but may be harbingers of major societal change. A new analytical tool, the Sociotechnical Influences Space, is proposed to support organisations in taking a holistic approach to the incorporation of advanced technologies into workplaces and function allocation in mixed human-artificial agent teams.

Testing the reliability and validity of risk assessment methods in Human Factors and Ergonomics

There is growing interest in the use of systems-based risk assessment methods in Human Factors and Ergonomics (HFE). The purpose of this study was to test the intra-rater reliability and criterion-referenced concurrent validity of three systems-based risk assessment approaches: (i) the Systems-Theoretic Process Analysis (STPA) method; (ii) the Event Analysis of Systemic Teamwork Broken Links (EAST-BL) method; and, (iii) the Network Hazard Analysis and Risk Management System (Net-HARMS) method. Reliability and validity measures were obtained using the Signal Detection Theory (SDT) paradigm. Whilst STPA identified the highest number of risks, the findings indicate a weak to moderate level of reliability and validity for STPA, EAST-BL and Net-HARMS. There were no statistically significant differences between the methods across analyses. The results suggest that there is merit to the continued use of systems-based risk assessment methods following a series of methodological extensions that aim to enhance the reliability and validity of future applications. Practitioner summary The three risk assessment methods produced weak to moderate levels of stability and accuracy regarding their capability to predict risks. There is a pressing need to further test the reliability and validity of safety methods in Human Factors and Ergonomics.

Distributed situation awareness: From awareness in individuals and teams to the awareness of technologies, sociotechnical systems, and societies

A large component of Neville Stanton's work has focused on situation awareness in domains such as defence, transport, and process control. A significant contribution has been to initiate a shift from considering individual human operator situation awareness to considering the situation awareness of human and non-human teams, organisations, and even sociotechnical systems. Though controversial when introduced, the distributed situation awareness model has become increasingly relevant for modern day systems and problems. In this article we reflect on Stanton's contribution and point to a pressing need to consider a. The situation awareness of advanced technologies, and b. situation awareness at a sociotechnical system, societal and even global level. This is demonstrated via discussion on two contemporaneous issues: automated vehicles and the COVID-19 pandemic. It is concluded that, given advances such as artificial intelligence, the increased connectedness of society, emerging issues such as disinformation, and an increasing set of global threats, Stanton's distributed situation awareness model and associated analysis framework provide a useful toolkit for future Human Factors and Ergonomics applications.

The Binary-Based Model (BBM) for Improved Human Factors Method Selection

OBJECTIVE

This paper presents the Binary-Based Model (BBM), a new approach to Human Factors (HF) method selection. The BBM helps practitioners select the most appropriate HF methodology in relation to the complexity within the target system.

BACKGROUND

There are over 200 HF methods available to the practitioner and little guidance to help choose between them.

METHOD

The BBM defines a HF "problem space" comprising three complexity attributes. HF problems can be rated against these attributes and located in the "problem space." In addition, a similar HF "approach space" in which 66 predictive methods are rated according to their ability to confront those attributes is defined. These spaces are combined into a "utility space" in which problems and methods coexist. In the utility space, the match between HF problems and methods can be formally assessed.

RESULTS

The method space is split into octants to establish broad groupings of methods distributed throughout the space. About 77% of the methods reside in Octant 1 which corresponds to problems with low levels of complexity. This demonstrates that most HF methods are suited to problems in low-complexity systems.

CONCLUSION

The location of 77% of the rated methods in Octant 1 indicates that HF practitioners are underserved with methods for analysis of HF problems exhibiting high complexity.

APPLICATION

The BBM can be used by multidisciplinary teams to select the most appropriate HF methodology for the problem under analysis. All the materials and analysis are placed in the public domain for modification and consensus building by the wider HF community.

It's a circular argument: Examining how a novel configuration impacts information flow in submarine control rooms

The continuing advancement of technology means that sociotechnical systems are primed for revolutionary changes to ways of working that can increase capability. It is critical to consider the unintended impact technology can have on human operators particularly regarding information flow and interactions within teams. Previous research revealed that the co-location of operator's dependent on each other for task relevant information can optimise information flow previously constrained by engineering considerations. The current work compared a novel circular configuration to that of a contemporary submarine control room. In the circular configuration, consoles faced inwards, permitting eye contact between operators, and three large screen displays were introduced to provide all operators with the same information. Ten teams participated in low and high demand dived tracking scenarios in a simulated submarine control room. All communications between operators were recorded in order to generate social, information, and task networks. These were statistically compared to networks generated from a baseline study of contemporary operation. Overall, the volume of verbal communications significantly reduced, information exchange was more structured, and the volume of tasks completed by operators significantly increased when operating in an inward facing circle configuration. The current work provides support for a data driven evidence-based approach to design that is information centric but endorsed by the end user to optimise performance and increase productivity. Implications of the work and future research ideas are discussed.

Causal System Scenario Tool for Near Miss Accident Analysis

Sociotechnical systems (STS) approach to the design of complex systems has been researched extensively. It stresses the fact that system design is never complete; it is an open-ended iterative process wherein designing never stops. With increasing technological advancement and diverse social issues emerging, the new dynamics, system approach has to be followed ingenuously. This Causal System Scenario Tool is applied in this study to a near-miss accident analysis for Indian railways. In particular, we look at the incidence of signal passing at danger (SPAD) by the train pilot due to various sociotechnical and organizational factors. We modify the system scenarios tool by proposing an additional causal system scenario tool. The contribution of this paper is threefold. Firstly, the STS analysis of SPAD is a novel approach. Secondly, STS has been applied in the context of developed economies but we use the Indian scenario, that is, in emerging economies. Thirdly, it contributes to the methodology by supplementing STS analysis with the causal system scenario tool, making it more robust. The first step maps the ‘as is situation’ and utilizes affinity diagram for plotting the issues on the framework. This is followed by replicating the process for the ‘to be situation’ and causal modelling for balancing the system is used, validating this tool. This approach can provide insights to the practitioners and policy makers in designing appropriate interventions to enhance safety of train travel.

The impact of power on health care team performance and patient safety: a review of the literature

Communication failure within health care teams is a major cause of patient harm across health care settings. Factors which contribute to communication failure include actual or perceived 'power'. Whilst a great deal of ergonomics research has focussed on teamwork in health care, the role of power in relation to measurable patient safety and performance outcomes remains relatively unknown. This article presents the findings from a review of the literature on power within multidisciplinary health care team settings. Following a systematic literature search, nineteen studies were evaluated in terms of research design, methods and analyses across the included studies. The main impacts resulting from power imbalances include negative effects on team collaboration, decision-making, communication and overall performance. Wider patient safety research, and more specifically the ergonomics discipline, is encouraged to address the complex interplay between power and teamwork in the health care sector.Practitioner Statement: We conducted a review of studies focussed on the influence of power on teamwork in health care. The findings show that power can have negative impacts on collaboration, decision-making, communication, and team performance. We conclude that power represents an important area for ergonomics, both in health care and other settings.Abbreviations: CRM: crew resource management; TEM: threat and error management; SNA: social network analysis; EAST: event analysis of systemic teamwork.

Complexity theory in accident causation: using AcciMap to identify the systems thinking tenets in 11 catastrophes

The quest to explain and understand the cause of accidents is both ever-present and ongoing amongst the safety science community. In an attempt to advance the theory and science of accident causation, researchers have recently formalised a set of '15 systems thinking tenets' that cover the conditions and characteristics of work systems that are believed to contribute to the cause of accidents. The purpose of this study was to attempt to identify the systems thinking tenets across a range of different systems and accidents using the Accident Mapping (AcciMap) method. The findings suggest that the tenets can be attributed to play a role in accident causation, however as a result of this process, the capability of AcciMap has been brought into question. Implications and directions for future research are described. Practitioner Summary: This study is an extension of previous work that suggested there was a need to test for the 'systems thinking tenets of accident causation' in a multi-incident dataset. We used AcciMap to evaluate whether it has the capability to support ongoing accident analysis activities in ergonomics research.

Human Factors and Ergonomics and the management of existential threats: A work domain analysis of a COVID-19 return from lockdown restrictions system

Following strict "lockdown" restrictions designed to control the spread of the COVID-19 virus, many jurisdictions are now engaged in a process of easing restrictions in an attempt to stimulate economic and social activity while continuing to suppress virus transmission. This is challenging and complex, and in several regions, new outbreaks have emerged. We argue that systems Human Factors and Ergonomics methods can assist in understanding and optimizing the return from lockdown. To demonstrate, we used work domain analysis to develop an abstraction hierarchy model of a generic "return from lockdown restrictions" system. The model was assessed to identify (a) issues preventing a successful return from lockdown; and (b) leverage points that could be exploited to optimize future processes. The findings show that the aim of continuing to suppress virus transmission conflicts with the aims of returning to pre-virus economic and social activity levels. As a result, many functions act against each other, ensuring that the system cannot optimally achieve all three of its primary aims. Potential leverage points include modifying the goals and rules of the system and enhancing communications and feedback. Specifically, it is argued that moderating economic aims and modifying how social and community activities are undertaken will result in longer term suppression of the virus.

Systems thinking-based risk assessment methods applied to sports performance: A comparison of STPA, EAST-BL, and Net-HARMS in the context of elite women's road cycling

There is increasing interest in applying systems Human Factors and Ergonomics (HFE) methods in sport. Risk assessment (RA) methods can be used identify risks which may impact the performance of individual athletes, teams, and overall sports systems; however, they have not yet been tested in sport. This study sets out to apply and compare three systems thinking-based RA methods in the context of elite sports performance and report on the frequency and types of the risks identified. The Systems-Theoretic Process Analysis (STPA) method, the Event Analysis of Systemic Teamwork Broken Links (EAST-BL) method, and the Networked Hazard Analysis and Risk Management System (Net-HARMS) method were applied to elite women's road cycling to identify all the credible risks that could degrade optimal team performance. The findings demonstrate that all three methods appear to provide useful results in a context other than safety, and that multiple risks threatening the performance of the cycling team were identified. Whilst the frequency and types of risks differed across the methods applied, there are additional theoretical, methodological, and practical implications to be considered prior to the selection and use of systems thinking-based RA approaches. Recommendations and directions for future HFE and sports science research are discussed.

Attributions of accidents to "human error" in news stories: Effects on perceived culpability, perceived preventability, and perceived need for punishment

Attributions of the causes of accidents to human error are problematically reductive, yet such attributions persist in media coverage. Few experiments have examined how human error attributions affect people's perceptions. An experiment compared attributions of accidents to "human error" versus other causes ("mechanical failure," "technical error," or "computer error"). Participants (N = 971) from an online sample read one of 50 real news excerpts describing accidents from a broad array of domains (e.g., aviation, automobiles, manufacturing, and infrastructure, among others). Stories kept the same or similar details, with only the causal attribution altered to compare human error to other causes. With human error attributions, participants were in greater agreement with the statement that an individual deserved to be punished for the accident and in less agreement that an organization or company was responsible for the accident. People also perceived past human error accidents to have been more preventable, although ratings of prospective preventability were not significantly different for human error versus other attributions. The idiosyncratic details of particular accidents contributed more variance to perceptions than the causal attribution. The same pattern of results was replicated in a second experiment (N = 1195), and new analyses found no evidence that the relationship between causal attributions and perceptions was moderated by the personal relevance of the news story. Our findings suggested that, when an accident is attributed to human error in media, the public may be less likely to expect examination or mitigation of systemic shortcomings (e.g., in design, organizational practices, etc.) that precipitate accidents.

Distributed situation awareness: a health-system approach to assessing and designing patient flow management

Patient flow management is a system-wide process but many healthcare providers do not integrate multiple departments into the process to minimise the time between treatments or medical services for maximum patient throughput. This paper presents a case study of applying Distributed Situation Awareness (DSA) to characterise system-wide patient flow management and identify opportunities for improvements in a healthcare system. This case study employed a three-part method of data elicitation, extraction, and representation to investigate DSA. Social, task, and knowledge networks were developed and then combined to characterise patient flow management and identify deficiencies of the command and control centre of a healthcare facility. Social network analysis provided centrality metrics to further characterise patient flow management. The DSA model helped identify design principles and deficiencies in managing patient flow. These findings indicate that DSA is promising for analysing patient flow management from a system-wide perspective. Practitioner summary: This article examines Distribution Situation Awareness (DSA) as an analysis framework to study system-wide patient flow management. The DSA yields social, task, and knowledge networks that can be combined to characterise patient flow and identify deficiencies in the system. DSA appears promising for analysing communication and coordination of complex systems. Abbreviations: CDM: critical decision method; CTaC: carilion transfer and communications center; EAST: event analysis systematic teamwork; ED: emergency department; DES: discrete event simulation; DSA: distributed situation awareness; SA: situation awareness; SNA: social network analysis.

The effects of team co-location and reduced crewing on team communication characteristics

The manner in which control rooms are configured can impact the flow of information between command teams. Previous research revealed bottlenecks of communications between the Sonar Controller (SOC) and the Operations Officer (OPSO) in submarine control rooms. One way to relieve such bottlenecks is to co-locate operators reliant on one another for task relevant information. The aim of the current studies was to use multiple command teams to empirically examine a novel submarine control room configuration and a reduced crew size in comparison to a baseline of contemporary operations to see if such bottlenecks could be removed. Ten teams performed high and low demand Dived Tracking (DT) scenarios in a simulated submarine control room. Activities and communications of the teams were recorded and quantified using the Event Analysis of Systemic Teamwork (EAST) method affording statistical comparisons with a baseline condition of contemporary operations. The findings showed that the co-location of operators relieved the bottleneck of communications between the SOC and the OPSO. Although overall communications increased, this was more balanced across the team and was more adaptive to scenario demand. This was coupled with a significant increase in task completion, even with a reduced crew size, suggesting greater efficiency and productivity. Future research should seek to validate the changes observed with objective measures of task performance.

Who is responsible for automated driving? A macro-level insight into automated driving in the United Kingdom using the Risk Management Framework and Social Network Analysis

To date, vehicle manufacturers have largely been left to their own initiatives when it comes to the design, development and implementation of automated driving features. Whilst this has enabled developments within the field to accelerate at a rapid pace, we are also now beginning to see the negative aspects of automated design (e.g., driver complacency, automation misuse and ethical dilemmas). It is therefore becoming increasingly important to identify systemic aspects that can address some of these Human Factors challenges. This paper applies the principles of the Risk Management Framework to explore the wider systemic issues associated with automated driving in the United Kingdom through the novel application of network metrics. The authors propose a number of recommendations targeted at each level of the Risk Management Framework that seek to shift the power of influence away from vehicle manufacturers and back into the hands of governing bodies.

Using the Event Analysis of Systemic Teamwork (EAST) broken-links approach to understand vulnerabilities to disruption in a darknet market

Darknet markets provide an anonymous, online platform for users to trade illicit drugs, fraudulent identity data, and other commodities. Although law enforcement agencies have been successful in seising many markets, the Darknet is an agile and dynamic environment and market activities often persist and emerge in a new form. Given this constantly changing environment, new ways of disrupting darknet markets are required. This study used Event Analysis of Systemic Teamwork (EAST) to analyse market activity and understand vulnerabilities to disruption. This involved using the EAST broken-links approach to assess the effects of compromising the transmission of information between tasks and between agents. The analysis identified critical vulnerabilities in the system, which included information involved in registering, depositing funds, communicating listing details to buyers, and communicating dispute resolution messages. This study indicates that systems ergonomics methods-in particular, EAST-can provide insight into system vulnerabilities that might be targeted for disruption. Practitioner summary This study provides a conceptualisation of the processes, people, structures, and information involved in the buying and selling of goods on a darknet market. Law enforcement agencies may use broken-links analyses to systematically consider the effects of their interventions.

Evaluating sociotechnical dynamics in a simulated remotely-piloted aircraft system: a layered dynamics approach

As coordination mechanisms change and technology failures occur, a sociotechnical system must reorganise itself across human and technological layers to maintain effectiveness. We present a study examining reorganisation across communication, controls and vehicle layers of a remotely-piloted aircraft system (RPAS) using a layered dynamics approach. Team members (pilot; navigator; photographer) performed 5 simulated RPAS missions using different operator configurations, including all-human and human-autonomy teams. Reorganization (operationally defined using entropy) time series measured the changing system reorganisation profiles under different operator configurations and following autonomy failures. Correlations between these reorganisation profiles and team effectiveness scores describe the manner in which the system had to be coordinated to maintain effectiveness under these changing conditions. Four unplanned autonomy failures were analysed to visualise system reorganisation following a technology failure. With its objective and real-time modelling and measurement capabilities, layered dynamics complements existing systems thinking tools for understanding sociotechnical complexity and enhancing system effectiveness. Practitioner summary: A layered dynamics approach for understanding how a sociotechnical system dynamically reorganises itself is presented. The layered dynamics of RPAS were analysed under different operator configurations and following autonomy failures. Layered dynamics complements existing system-thinking tools for modelling sociotechnical system complexity and effectiveness. Abbreviation: RPAS: remotely-piloted aircraft system; HIS: human-systems integration; EAST: event analysis of systemic teamwork; H1: hypothesis 1; H2: hypothesis 2; H3: hypothesis 3; CERTT-STE: cognitive engineering research on team tasks--synthetic task environment; AVO: air vehicle operator; PLO: payload operator; DEMPC: data exploitation, mission planning, and communications; ACT-R: adaptive control of thought-rational; sec: seconds; ANOVA: analysis of variance.

Walking the talk: Comparing pedestrian 'activity as imagined' with 'activity as done'

The safety of vulnerable road users, including pedestrians, is an important issue worldwide. In line with the shift towards systems thinking in transport safety, the aim of this study was to compare the normal performance of pedestrians as they navigate the road system with that imagined by road system managers to gain insights into how safety management can be improved for this vulnerable road user group. The Event Analysis of Systemic Teamwork framework was used to compare pedestrian activity 'as imagined' and 'as done' at signalised road intersections and railway level crossings. Data regarding 'activity as imagined' was derived from documentation review, and data on 'activity as done' was derived from a semi-naturalistic study of ten participants. It is concluded that in both environments pedestrians exhibited more diversity and variability than anticipated by system managers. Insights for improving the design of the road environment for pedestrians are provided. Further, it is argued that wider changes to the processes used in the design and management of road systems are needed.

Distributed Cognition on the road: Using EAST to explore future road transportation systems

Connected and Autonomous Vehicles (CAV) are set to revolutionise the way in which we use our transportation system. However, we do not fully understand how the integration of wireless and autonomous technology into the road transportation network affects overall network dynamism. This paper uses the theoretical principles underlying Distributed Cognition to explore the dependencies and interdependencies that exist between system agents located within the road environment, traffic management centres and other external agencies in both non-connected and connected transportation systems. This represents a significant step forward in modelling complex sociotechnical systems as it shows that the principles underlying Distributed Cognition can be applied to macro-level systems using the visual representations afforded by the Event Analysis of Systemic Teamwork (EAST) method.

Land Ahoy! Understanding Submarine Command and Control During the Completion of Inshore Operations

OBJECTIVE

The aim of this study was to use multiple command teams to provide empirical evidence for understanding communication flow, information pertinence, and tasks undertaken in a submarine control room when completing higher- and lower-demand inshore operation (INSO) scenarios.

BACKGROUND

The focus of submarine operations has changed, and submarines are increasingly required to operate in costal littoral zones. However, submarine command team performance during INSO is not well understood, particularly from a sociotechnical systems perspective.

METHOD

A submarine control-room simulator was built. The creation of networked workstations allowed a team of nine operators to perform tasks completed by submarine command teams during INSO. The Event Analysis of Systematic Teamwork method was used to model the social, task, and information networks and to describe command team performance. Ten teams were recruited for the study, affording statistical comparisons of how command-team roles and level of demand affected performance.

RESULTS

Results indicated that the submarine command-team members are required to rapidly integrate sonar and visual data as the periscope is used, periodically, in a "duck-and-run" fashion, to maintain covertness. The fusion of such information is primarily completed by the operations officer (OPSO), with this operator experiencing significantly greater demand than any other operator.

CONCLUSION

The OPSO was a bottleneck in the command team when completing INSO, experiencing similar load in both scenarios, suggesting that the command team may benefit from data synthesis tasks being more evenly distributed within the command team.

APPLICATION

The work can inform future control-room design and command-team ways of working by identifying bottlenecks in terms of information and task flow between operators.