Neural Efficiency of Human-Robotic Feedback Modalities Under Stress Differs With Gender

A Window Into the Tired Brain: Neurophysiological Dynamics of Visuospatial Working Memory Under Fatigue

OBJECTIVE

We examine the spatiotemporal dynamics of neural activity and its correlates in heart rate and its variability (HR/HRV) during a fatiguing visuospatial working memory task.

BACKGROUND

The neural and physiological drivers of fatigue are complex, coupled, and poorly understood. Investigations that combine the fidelity of neural indices and the field-readiness of physiological measures can facilitate measurements of fatigue states in operational settings.

METHOD

Sixteen healthy adults, balanced by sex, completed a 60-minute fatiguing visuospatial working memory task. Changes in task performance, subjective measures of effort and fatigue, cerebral hemodynamics, and HR/HRV were analyzed. Peak brain activation, functional and effective connections within relevant brain networks were contrasted against spectral and temporal features of HR/HRV.

RESULTS

Task performance elicited increased neural activation in regions responsible for maintaining working memory capacity. With the onset of time-on-task effects, resource utilization was seen to increase beyond task-relevant networks. Over time, functional connections in the prefrontal cortex were seen to weaken, with changes in the causal relationships between key regions known to drive working memory. HR/HRV indices were seen to closely follow activity in the prefrontal cortex.

CONCLUSION

This investigation provided a window into the neurophysiological underpinnings of working memory under the time-on-task effect. HR/HRV was largely shown to mirror changes in cortical networks responsible for working memory, therefore supporting the possibility of unobtrusive state recognition under ecologically valid conditions.

APPLICATIONS

Findings here can inform the development of a fieldable index for cognitive fatigue.

Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot

Robot design to simulate interpersonal social interaction is an active area of research with applications in therapy and companionship. Neural responses to eye-to-eye contact in humans have recently been employed to determine the neural systems that are active during social interactions. Whether eye-contact with a social robot engages the same neural system remains to be seen. Here, we employ a similar approach to compare human-human and human-robot social interactions. We assume that if human-human and human-robot eye-contact elicit similar neural activity in the human, then the perceptual and cognitive processing is also the same for human and robot. That is, the robot is processed similar to the human. However, if neural effects are different, then perceptual and cognitive processing is assumed to be different. In this study neural activity was compared for human-to-human and human-to-robot conditions using near infrared spectroscopy for neural imaging, and a robot (Maki) with eyes that blink and move right and left. Eye-contact was confirmed by eye-tracking for both conditions. Increased neural activity was observed in human social systems including the right temporal parietal junction and the dorsolateral prefrontal cortex during human-human eye contact but not human-robot eye-contact. This suggests that the type of human-robot eye-contact used here is not sufficient to engage the right temporoparietal junction in the human. This study establishes a foundation for future research into human-robot eye-contact to determine how elements of robot design and behavior impact human social processing within this type of interaction and may offer a method for capturing difficult to quantify components of human-robot interaction, such as social engagement.

Disaster Ergonomics: Human Factors in COVID-19 Pandemic Emergency Management

OBJECTIVE

We aimed to identify opportunities for application of human factors knowledge base to mitigate disaster management (DM) challenges associated with the unique characteristics of the COVID-19 pandemic.

BACKGROUND

The role of DM is to minimize and prevent further spread of the contagion over an extended period of time. This requires addressing large-scale logistics, coordination, and specialized training needs. However, DM-related challenges during the pandemic response and recovery are significantly different than with other kinds of disasters.

METHOD

An expert review was conducted to document issues relevant to human factors and ergonomics (HFE) in DM.

RESULTS

The response to the COVID-19 crisis has presented complex and unique challenges to DM and public health practitioners. Compared to other disasters and previous pandemics, the COVID-19 outbreak has had an unprecedented scale, magnitude, and propagation rate. The high technical complexity of response and DM coupled with lack of mental model and expertise to respond to such a unique disaster has seriously challenged the response work systems. Recent research has investigated the role of HFE in modeling DM systems' characteristics to improve resilience, accelerating emergency management expertise, developing agile training methods to facilitate dynamically changing response, improving communication and coordination among system elements, mitigating occupational hazards including guidelines for the design of personal protective equipment, and improving procedures to enhance efficiency and effectiveness of response efforts.

CONCLUSION

This short review highlights the potential for the field's contribution to proactive and resilient DM for the ongoing and future pandemics.

Evaluating effectiveness of information visualizations using cognitive fit theory: A neuroergonomics approach

Information visualizations may be evaluated from the perspective of how they match tasks that must be performed with them, a cognitive fit perspective. However, there is a gap between the high-level references made to cognitive fit and the low-level ability to identify and measure it during human interaction with visualizations. We bridge this gap by using an electroencephalography metric derived from frontal midline theta power and parietal alpha power, known as the task load index, to determine if cognitive effort measured at the level of cortical activity is less when cognitive fit is present compared to when cognitive fit is not. We found that when there is cognitive fit between the type of problem to be solved and the information displayed by a system, the task load index is lower compared to when cognitive fit is not present. We support this finding with subjective (NASA task load index) and performance (response time and accuracy) measures. Our approach, using electroencephalography, provides supplemental information to self-report and performance measures. Findings from this study are important because they (1) provide more validity to the cognitive fit theory using a neurophysiological measure, and (2) use the electroencephalography task load index metric as a means to assess cognitive workload and effort in general.

Evaluating advanced driver-assistance system trainings using driver performance, attention allocation, and neural efficiency measures

There are about 44 million licensed older drivers in the U.S. Older adults have higher crash rates and fatalities as compared to middle-aged and young drivers, which might be associated with degradations in sensory, cognitive, and physical capabilities. Advanced driver-assistance systems (ADAS) have the potential to substantially improve safety by removing some of driver vehicle control responsibilities. However, a critical aspect of providing ADAS is educating drivers on their operational characteristics and continued use. Twenty older adults participated in a driving simulation study assessing the effectiveness of video-based and demonstration-based training protocols in learning ADAS considering gender differences. The findings revealed video-based training to be more effective than demonstration-based training in improving driver performance and reducing off-road visual attention allocation and mental workload. In addition, female drivers required lower investment of mental effort (higher neural efficiency) to maintain the performance relative to males and they were less distracted by ADAS. However, male drivers were faster in activating ADAS as compared to females since they were monitoring the status of ADAS features more frequently while driving. The findings of this study provided an empirical support for using video-based approach for learning ADAS in older adults to improve driver safety and supported previous findings on older adults' learning that as age increases there is a tendency to prefer more passive and observational learning methods.