Benefits of Instructed Responding in Manual Assembly Tasks: An ERP Approach

Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design

OBJECTIVE

We demonstrate and discuss the use of mobile electroencephalogram (EEG) for neuroergonomics. Both technical state of the art as well as measures and cognitive concepts are systematically addressed.

BACKGROUND

Modern work is increasingly characterized by information processing. Therefore, the examination of mental states, mental load, or cognitive processing during work is becoming increasingly important for ergonomics.

RESULTS

Mobile EEG allows to measure mental states and processes under real live conditions. It can be used for various research questions in cognitive neuroergonomics. Besides measures in the frequency domain that have a long tradition in the investigation of mental fatigue, task load, and task engagement, new approaches-like blink-evoked potentials-render event-related analyses of the EEG possible also during unrestricted behavior.

CONCLUSION

Mobile EEG has become a valuable tool for evaluating mental states and mental processes on a highly objective level during work. The main advantage of this technique is that working environments don't have to be changed while systematically measuring brain functions at work. Moreover, the workflow is unaffected by such neuroergonomic approaches.

Visual Demands of Walking Are Reflected in Eye-Blink-Evoked EEG-Activity

Blinking is a natural user-induced response which paces visual information processing. This study investigates whether blinks are viable for segmenting continuous electroencephalography (EEG) activity, for inferring cognitive demands in ecologically valid work environments. We report the blink-related EEG measures of participants who performed auditory tasks either standing, walking on grass, or whilst completing an obstacle course. Blink-related EEG activity discriminated between different levels of cognitive demand during walking. Both behavioral parameters (e.g., blink duration or head motion) and blink-related EEG activity varied with walking conditions. Larger occipital N1 was observed during walking, relative to standing and traversing an obstacle course, which reflects differences in bottom-up visual perception. In contrast, the amplitudes of top-down components (N2, P3) significantly decreased with increasing walking demands, which reflected narrowing attention. This is consistent with blink-related EEG, specifically in Theta and Alpha power that, respectively, increased and decreased with increasing demands of the walking task. This work presents a novel and robust analytical approach to evaluate the cognitive demands experienced in natural work settings, which precludes the use of artificial task manipulations for data segmentation.

Development of Modular and Adaptive Laboratory Set-Up for Neuroergonomic and Human-Robot Interaction Research

The industry increasingly insists on academic cooperation to solve the identified problems such as workers' performance, wellbeing, job satisfaction, and injuries. It causes an unsafe and unpleasant working environment that directly impacts the quality of the product, workers' productivity, and effectiveness. This study aimed to give a specialized solution for tests and explore possible solutions to the given problem in neuroergonomics and human–robot interaction. The designed modular and adaptive laboratory model of the industrial assembly workstation represents the laboratory infrastructure for conducting advanced research in the field of ergonomics, neuroergonomics, and human–robot interaction. It meets the operator's anatomical, anthropometric, physiological, and biomechanical characteristics. Comparing standard, ergonomic, guided, and collaborative work will be possible based on workstation construction and integrated elements. These possibilities allow the industry to try, analyze, and get answers for an identified problem, the condition, habits, and behavior of operators in the workplace. The set-up includes a workstation with an industry work chair, a Poka–Yoke system, adequate lighting, an audio 5.0 system, containers with parts and tools, EEG devices (a cap and smartfones), an EMG device, touchscreen PC screen, and collaborative robot. The first phase of the neuroergonomic study was performed according to the most common industry tasks defined as manual, monotonous, and repetitive activities. Participants have a task to assemble the developed prototype model of an industrial product using prepared parts and elements, and instructed by the installed touchscreen PC. In the beginning, the participant gets all the necessary information about the experiment and gets 15 min of practice. After the introductory part, the EEG device is mounted and prepared for recording. The experiment starts with relaxing music for 5 min. The whole experiment lasts two sessions per 60 min each, with a 15 min break between the sessions. Based on the first experiments, it is possible to develop, construct, and conduct complex experiments for industrial purposes to improve the physical, cognitive, and organizational aspects and increase workers' productivity, efficiency, and effectiveness. It has highlighted the possibility of applying modular and adaptive ergonomic research laboratory experimental set-up to transform standard workplaces into the workplaces of the future.

Neuroergonomic Stress Assessment with Two Different Methodologies, in a Manual Repetitive Task-Product Assembly

Emotions are a fundamental part of mental health and human behavior. In the workplace, optimal performance of employees is necessary for productivity enhancements and its relation to the quality of a manufacturing product, therefore leading a company to advantages and competitiveness. This means that the workplace staff must remain in a neutral or a calm emotional state, for an adequate job performance. When an operation is not pleasant or the same task is carried out for a long period of time (repetitive), it can cause negative emotions such as stress, and this will have repercussions in poor work performance. The purpose of this research is, by means of an electroencephalogram (EEG), to identify the stress in the repetitive assembly of a manufacturing product. To measure brain waves, the Emotiv Epoc equipment was used and a manufacturing line was designed, divided into three workstations, where the assembly of product comprising a LEGO car was carried out within a manual repetitive approach. The appearance of stress was determined by employing two different methodologies, the prefrontal relative gamma marker (RG) and the valence, arousal, and dominance (VAD) emotional categories. The results obtained from the first methodology, corresponding to the RG marker, displayed a significant more change between the relaxation state and the product assembly carried out at 70% of the standard time (ST). A less significant change was observed between the relaxation state and the product assembly carried out at 100% ST, thus signaling the presence of stress. Additionally, the results from the VAD methodology resulted in moderate and low levels of stress, when the product assembly was carried out at 70% and 100% standard time, respectively.

Mobile Brain/Body Imaging (MoBI) of Physical Interaction with Dynamically Moving Objects

The non-invasive recording and analysis of human brain activity during active movements in natural working conditions is a central challenge in Neuroergonomics research. Existing brain imaging approaches do not allow for an investigation of brain dynamics during active behavior because their sensors cannot follow the movement of the signal source. However, movements that require the operator to react fast and to adapt to a dynamically changing environment occur frequently in working environments like assembly-line work, construction trade, health care, but also outside the working environment like in team sports. Overcoming the restrictions of existing imaging methods would allow for deeper insights into neurocognitive processes at workplaces that require physical interactions and thus could help to adapt work settings to the user. To investigate the brain dynamics accompanying rapid volatile movements we used a visual oddball paradigm where participants had to react to color changes either with a simple button press or by physically pointing towards a moving target. Using a mobile brain/body imaging approach (MoBI) including independent component analysis (ICA) with subsequent backprojection of cluster activity allowed for systematically describing the contribution of brain and non-brain sources to the sensor signal. The results demonstrate that visual event-related potentials (ERPs) can be analyzed for simple button presses and physical pointing responses and that it is possible to quantify the contribution of brain processes, muscle activity and eye movements to the signal recorded at the sensor level even for fast volatile arm movements with strong jerks. Using MoBI in naturalistic working environments can thus help to analyze brain dynamics in natural working conditions and help improving unhealthy or inefficient work settings.