On the use of electrooculogram for efficient human computer interfaces

Electrospun Rubber Nanofiber Web-Based Dry Electrodes for Biopotential Monitoring

This study aims to find base materials for dry electrode fabrication with high accuracy and without reducing electrode performance for long-term bioelectric potential monitoring after electroless silver plating. Most applications of dry electrodes that have been developed in the past few decades are restricted by low accuracy compared to commercial Ag/AgCl gel electrodes, as in our previous study of PVDF-based dry electrodes. In a recent study, however, nanoweb-based chlorinated polyisoprene (CPI) and poly(styrene-b-butadiene-b-styrene) (SBS) rubber were selected as promising candidates due to their excellent elastic properties, as well as their nanofibril nature, which may improve electrode durability and skin contact. The electroless silver plating technique was employed to coat the nanofiber web with silver, and silver nanoweb(AgNW)-based dry electrodes were fabricated. The key electrode properties (contact impedance, step response, and noise characteristics) for AgNW dry electrodes were investigated thoroughly using agar phantoms. The dry electrodes were subsequently tested on human subjects to establish their realistic performance in terms of ECG, EMG monitoring, and electrical impedance tomography (EIT) measurements. The experimental results demonstrated that the AgNW dry electrodes, particularly the SBS-AgNW dry electrodes, performed similarly to commercial Ag/AgCl gel electrodes and were outperformed in terms of long-term stability.

Human-Centric Digital Twins in Industry: A Comprehensive Review of Enabling Technologies and Implementation Strategies

The last decade saw the emergence of highly autonomous, flexible, re-configurable Cyber-Physical Systems. Research in this domain has been enhanced by the use of high-fidelity simulations, including Digital Twins, which are virtual representations connected to real assets. Digital Twins have been used for process supervision, prediction, or interaction with physical assets. Interaction with Digital Twins is enhanced by Virtual Reality and Augmented Reality, and Industry 5.0-focused research is evolving with the involvement of the human aspect in Digital Twins. This paper aims to review recent research on Human-Centric Digital Twins (HCDTs) and their enabling technologies. A systematic literature review is performed using the VOSviewer keyword mapping technique. Current technologies such as motion sensors, biological sensors, computational intelligence, simulation, and visualization tools are studied for the development of HCDTs in promising application areas. Domain-specific frameworks and guidelines are formed for different HCDT applications that highlight the workflow and desired outcomes, such as the training of AI models, the optimization of ergonomics, the security policy, task allocation, etc. A guideline and comparative analysis for the effective development of HCDTs are created based on the criteria of Machine Learning requirements, sensors, interfaces, and Human Digital Twin inputs.

EEG-EMG coupling as a hybrid method for steering detection in car driving settings

Understanding mental processes in complex human behavior is a key issue in driving, representing a milestone for developing user-centered assistive driving devices. Here, we propose a hybrid method based on electroencephalographic (EEG) and electromyographic (EMG) signatures to distinguish left and right steering in driving scenarios. Twenty-four participants took part in the experiment consisting of recordings of 128-channel EEG and EMG activity from deltoids and forearm extensors in non-ecological and ecological steering tasks. Specifically, we identified the EEG mu rhythm modulation correlates with motor preparation of self-paced steering actions in the non-ecological task, while the concurrent EMG activity of the left (right) deltoids correlates with right (left) steering. Consequently, we exploited the mu rhythm de-synchronization resulting from the non-ecological task to detect the steering side using cross-correlation analysis with the ecological EMG signals. Results returned significant cross-correlation values showing the coupling between the non-ecological EEG feature and the muscular activity collected in ecological driving conditions. Moreover, such cross-correlation patterns discriminate the steering side earlier relative to the single EMG signal. This hybrid system overcomes the limitation of the EEG signals collected in ecological settings such as low reliability, accuracy, and adaptability, thus adding to the EMG the characteristic predictive power of the cerebral data. These results prove how it is possible to complement different physiological signals to control the level of assistance needed by the driver.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-021-09776-w.

Biodegradable Polymer Composites for Electrophysiological Signal Sensing

Electrophysiological signals are collected to characterize human health and applied in various fields, such as medicine, engineering, and pharmaceuticals. Studies of electrophysiological signals have focused on accurate signal acquisition, real-time monitoring, and signal interpretation. Furthermore, the development of electronic devices consisting of biodegradable and biocompatible materials has been attracting attention over the last decade. In this regard, this review presents a timely overview of electrophysiological signals collected with biodegradable polymer electrodes. Candidate polymers that can constitute biodegradable polymer electrodes are systemically classified by their essential properties for collecting electrophysiological signals. Moreover, electrophysiological signals, such as electrocardiograms, electromyograms, and electroencephalograms subdivided with human organs, are discussed. In addition, the evaluation of the biodegradability of various electrodes with an electrophysiology signal collection purpose is comprehensively revisited.

EOG-Based Human-Computer Interface: 2000-2020 Review

Electro-oculography (EOG)-based brain-computer interface (BCI) is a relevant technology influencing physical medicine, daily life, gaming and even the aeronautics field. EOG-based BCI systems record activity related to users' intention, perception and motor decisions. It converts the bio-physiological signals into commands for external hardware, and it executes the operation expected by the user through the output device. EOG signal is used for identifying and classifying eye movements through active or passive interaction. Both types of interaction have the potential for controlling the output device by performing the user's communication with the environment. In the aeronautical field, investigations of EOG-BCI systems are being explored as a relevant tool to replace the manual command and as a communicative tool dedicated to accelerating the user's intention. This paper reviews the last two decades of EOG-based BCI studies and provides a structured design space with a large set of representative papers. Our purpose is to introduce the existing BCI systems based on EOG signals and to inspire the design of new ones. First, we highlight the basic components of EOG-based BCI studies, including EOG signal acquisition, EOG device particularity, extracted features, translation algorithms, and interaction commands. Second, we provide an overview of EOG-based BCI applications in the real and virtual environment along with the aeronautical application. We conclude with a discussion of the actual limits of EOG devices regarding existing systems. Finally, we provide suggestions to gain insight for future design inquiries.

Soft Bioelectronics Based on Nanomaterials

Recent advances in nanostructured materials and unconventional device designs have transformed the bioelectronics from a rigid and bulky form into a soft and ultrathin form and brought enormous advantages to the bioelectronics. For example, mechanical deformability of the soft bioelectronics and thus its conformal contact onto soft curved organs such as brain, heart, and skin have allowed researchers to measure high-quality biosignals, deliver real-time feedback treatments, and lower long-term side-effects in vivo. Here, we review various materials, fabrication methods, and device strategies for flexible and stretchable electronics, especially focusing on soft biointegrated electronics using nanomaterials and their composites. First, we summarize top-down material processing and bottom-up synthesis methods of various nanomaterials. Next, we discuss state-of-the-art technologies for intrinsically stretchable nanocomposites composed of nanostructured materials incorporated in elastomers or hydrogels. We also briefly discuss unconventional device design strategies for soft bioelectronics. Then individual device components for soft bioelectronics, such as biosensing, data storage, display, therapeutic stimulation, and power supply devices, are introduced. Afterward, representative application examples of the soft bioelectronics are described. A brief summary with a discussion on remaining challenges concludes the review.

Validation of a Novel Wearable Multistream Data Acquisition and Analysis System for Ergonomic Studies

Nowadays, the growing interest in gathering physiological data and human behavior in everyday life scenarios is paralleled by an increase in wireless devices recording brain and body signals. However, the technical issues that characterize these solutions often limit the full brain-related assessments in real-life scenarios. Here we introduce the Biohub platform, a hardware/software (HW/SW) integrated wearable system for multistream synchronized acquisitions. This system consists of off-the-shelf hardware and state-of-art open-source software components, which are highly integrated into a high-tech low-cost solution, complete, yet easy to use outside conventional labs. It flexibly cooperates with several devices, regardless of the manufacturer, and overcomes the possibly limited resources of recording devices. The Biohub was validated through the characterization of the quality of (i) multistream synchronization, (ii) in-lab electroencephalographic (EEG) recordings compared with a medical-grade high-density device, and (iii) a Brain-Computer-Interface (BCI) in a real driving condition. Results show that this system can reliably acquire multiple data streams with high time accuracy and record standard quality EEG signals, becoming a valid device to be used for advanced ergonomics studies such as driving, telerehabilitation, and occupational safety.

Hybrid Systems to Boost EEG-Based Real-Time Action Decoding in Car Driving Scenarios

The complexity of concurrent cerebral processes underlying driving makes such human behavior one of the most studied real-world activities in neuroergonomics. Several attempts have been made to decode, both offline and online, cerebral activity during car driving with the ultimate goal to develop brain-based systems for assistive devices. Electroencephalography (EEG) is the cornerstone of these studies providing the highest temporal resolution to track those cerebral processes underlying overt behavior. Particularly when investigating real-world scenarios as driving, EEG is constrained by factors such as robustness, comfortability, and high data variability affecting the decoding performance. Hence, additional peripheral signals can be combined with EEG for increasing replicability and the overall performance of the brain-based action decoder. In this regard, hybrid systems have been proposed for the detection of braking and steering actions in driving scenarios to improve the predictive power of the single neurophysiological measurement. These recent results represent a proof of concept of the level of technological maturity. They may pave the way for increasing the predictive power of peripheral signals, such as electroculogram (EOG) and electromyography (EMG), collected in real-world scenarios when informed by EEG measurements, even if collected only offline in standard laboratory settings. The promising usability of such hybrid systems should be further investigated in other domains of neuroergonomics.

MXene-infused bioelectronic interfaces for multiscale electrophysiology and stimulation

Soft bioelectronic interfaces for mapping and modulating excitable networks at high resolution and at large scale can enable paradigm-shifting diagnostics, monitoring, and treatment strategies. Yet, current technologies largely rely on materials and fabrication schemes that are expensive, do not scale, and critically limit the maximum attainable resolution and coverage. Solution processing is a cost-effective manufacturing alternative, but biocompatible conductive inks matching the performance of conventional metals are lacking. Here, we introduce MXtrodes, a class of soft, high-resolution, large-scale bioelectronic interfaces enabled by Ti3C2 MXene (a two-dimensional transition metal carbide nanomaterial) and scalable solution processing. We show that the electrochemical properties of MXtrodes exceed those of conventional materials and do not require conductive gels when used in epidermal electronics. Furthermore, we validate MXtrodes in applications ranging from mapping large-scale neuromuscular networks in humans to cortical neural recording and microstimulation in swine and rodent models. Last, we demonstrate that MXtrodes are compatible with standard clinical neuroimaging modalities.

Multipurpose and Reusable Ultrathin Electronic Tattoos Based on PtSe2 and PtTe2

Wearable bioelectronics with emphasis on the research and development of advanced person-oriented biomedical devices have attracted immense interest in the past decade. Scientists and clinicians find it essential to utilize skin-worn smart tattoos for on-demand and ambulatory monitoring of an individual's vital signs. Here, we report on the development of ultrathin platinum-based two-dimensional dichalcogenide (Pt-TMDs)-based electronic tattoos as advanced building blocks of future wearable bioelectronics. We made these ultrathin electronic tattoos out of large-scale synthesized platinum diselenide (PtSe₂) and platinum ditelluride (PtTe₂) layered materials and used them for monitoring human physiological vital signs, such as the electrical activity of the heart and the brain, muscle contractions, eye movements, and temperature. We show that both materials can be used for these applications; yet, PtTe₂ was found to be the most suitable choice due to its metallic structure. In terms of sheet resistance, skin contact, and electrochemical impedance, PtTe₂ outperforms state-of-the-art gold and graphene electronic tattoos and performs on par with medical-grade Ag/AgCl gel electrodes. The PtTe₂ tattoos show 4 times lower impedance and almost 100 times lower sheet resistance compared to monolayer graphene tattoos. One of the possible prompt implications of this work is perhaps in the development of advanced human-machine interfaces. To display the application, we built a multi-tattoo system that can easily distinguish eye movement and identify the direction of an individual's sight.

Electro-Encephalography and Electro-Oculography in Aeronautics: A Review Over the Last Decade (2010-2020)

Electro-encephalography (EEG) and electro-oculography (EOG) are methods of electrophysiological monitoring that have potentially fruitful applications in neuroscience, clinical exploration, the aeronautical industry, and other sectors. These methods are often the most straightforward way of evaluating brain oscillations and eye movements, as they use standard laboratory or mobile techniques. This review describes the potential of EEG and EOG systems and the application of these methods in aeronautics. For example, EEG and EOG signals can be used to design brain-computer interfaces (BCI) and to interpret brain activity, such as monitoring the mental state of a pilot in determining their workload. The main objectives of this review are to, (i) offer an in-depth review of literature on the basics of EEG and EOG and their application in aeronautics; (ii) to explore the methodology and trends of research in combined EEG-EOG studies over the last decade; and (iii) to provide methodological guidelines for beginners and experts when applying these methods in environments outside the laboratory, with a particular focus on human factors and aeronautics. The study used databases from scientific, clinical, and neural engineering fields. The review first introduces the characteristics and the application of both EEG and EOG in aeronautics, undertaking a large review of relevant literature, from early to more recent studies. We then built a novel taxonomy model that includes 150 combined EEG-EOG papers published in peer-reviewed scientific journals and conferences from January 2010 to March 2020. Several data elements were reviewed for each study (e.g., pre-processing, extracted features and performance metrics), which were then examined to uncover trends in aeronautics and summarize interesting methods from this important body of literature. Finally, the review considers the advantages and limitations of these methods as well as future challenges.

DESIGN AND DEVELOPMENT OF HUMAN COMPUTER INTERFACE USING ELECTROOCULOGRAM WITH DEEP LEARNING

Today's life assistive devices were playing significant role in our life to communicate with others. In that modality Human Computer Interface (HCI) based Electrooculogram (EOG) playing vital part. By using this method we can able to overcome the conventional methods in terms of performance and accuracy. To overcome such problem we analyze the EOG signal from twenty subjects to design nine states EOG based HCI using five electrodes system to measure the horizontal and vertical eye movements. Signals were preprocessed to remove the artifacts and extract the valuable information from collected data by using band power and Hilbert Huang Transform (HHT) and trained with Pattern Recognition Neural Network (PRNN) to classify the tasks. The classification results of 92.17% and 91.85% were shown for band power and HHT features using PRNN architecture. Recognition accuracy was analyzed in offline to identify the possibilities of designing HCI. We compare the two feature extraction techniques with PRNN to analyze the best method for classifying the tasks and recognizing single trail tasks to design the HCI. Our experimental result confirms that for classifying as well as recognizing accuracy of the collected signals using band power with PRNN shows better accuracy compared to other network used in this study. We compared the male subjects performance with female subjects to identify the performance. Finally we compared the male as well as female subjects in age group wise to identify the performance of the system. From that we concluded that male performance was appreciable compared with female subjects as well as age group between 26 to 32 performance and recognizing accuracy were high compared with other age groups used in this study.

Signal identification system for developing rehabilitative device using deep learning algorithms

Paralyzed patients were increasing day by day. Some of the neurodegenerative diseases like amyotrophic lateral sclerosis, Brainstem Leison, Stupor and Muscular dystrophy affect the muscle movements in the body. The affected persons were unable to migrate. To overcome from their problem they need some assistive technology with the help of bio signals. Electrooculogram (EOG) based Human Computer Interaction (HCI) is one of the technique used in recent days to overcome such problem. In this paper we clearly check the possibilities of creating nine states HCI by our proposed method. Signals were captured through five electrodes placed on the subjects face around the eyes. These signals were amplified with ADT26 bio amplifier, filtered with notch filter, and processed with reference power and band power techniques to extract features to detect the eye movements and mapped with Time Delay Neural Network to classify the eye movements to generate control signal to control external hardware devices. Our experimental study reports that maximum average classification of 91.09% for reference power feature and 91.55%-for band power feature respectively. The obtained result confirms that band power features with TDNN network models shows better performance than reference features for all subjects. From this outcome we conclude that band power features with TDNN network models was more suitable for classifying the eleven difference eye movements for individual subjects. To validate the result obtained from this method we categorize the subjects in age wise to check the accuracy of the system. Single trail analysis was conducted in offline to identify the recognizing accuracy of the proposed system. The result summarize that band power features with TDNN network models exceed the reference power with TDNN network model used in this study. Through the outcome we conclude that that band power features with TDNN network was more suitable for designing EOG based HCI in offline mode.

A New PC-Based Text Entry System Based on EOG Coding

Some disadvantages of optical eye tracking systems have increased the interest to EOG (Electrooculography) based Human Computer Interaction (HCI). However, text entry attempts using EOG have been slower than expected because the eyes should move several times for entering a character. In order to improve the writing speed and accuracy of EOG based text entry, a new method based on the coding of eye movements has been suggested in this study. In addition, a real time EOG based HCI system has developed to implement the method. In our method all characters have been encoded by single saccades in 8 directions and different dwell time. In order to standardize dwell times and facilitate the coding process, computer assisted voice guidance was used. A number of experiments have been conducted to examine the effectiveness of the proposed method and system. At the end of the fifth trials, an experienced user was able to write at average 13.2 wpm (5 letters = 1 word) with 100% accuracy using the developed system. The results of our experiments have shown that text entry with the eye can be done quickly and efficiently with the proposed method and system.

Development of an electrooculogram-based human-computer interface using involuntary eye movement by spatially rotating sound for communication of locked-in patients

Individuals who have lost normal pathways for communication need augmentative and alternative communication (AAC) devices. In this study, we propose a new electrooculogram (EOG)-based human-computer interface (HCI) paradigm for AAC that does not require a user’s voluntary eye movement for binary yes/no communication by patients in locked-in state (LIS). The proposed HCI uses a horizontal EOG elicited by involuntary auditory oculogyric reflex, in response to a rotating sound source. In the proposed HCI paradigm, a user was asked to selectively attend to one of two sound sources rotating in directions opposite to each other, based on the user’s intention. The user’s intentions could then be recognised by quantifying EOGs. To validate its performance, a series of experiments was conducted with ten healthy subjects, and two patients with amyotrophic lateral sclerosis (ALS). The online experimental results exhibited high-classification accuracies of 94% in both healthy subjects and ALS patients in cases where decisions were made every six seconds. The ALS patients also participated in a practical yes/no communication experiment with 26 or 30 questions with known answers. The accuracy of the experiments with questionnaires was 94%, demonstrating that our paradigm could constitute an auxiliary AAC system for some LIS patients.

Gaze Estimation Method Using Analysis of Electrooculogram Signals and Kinect Sensor

A gaze estimation system is one of the communication methods for severely disabled people who cannot perform gestures and speech. We previously developed an eye tracking method using a compact and light electrooculogram (EOG) signal, but its accuracy is not very high. In the present study, we conducted experiments to investigate the EOG component strongly correlated with the change of eye movements. The experiments in this study are of two types: experiments to see objects only by eye movements and experiments to see objects by face and eye movements. The experimental results show the possibility of an eye tracking method using EOG signals and a Kinect sensor.

Development of a Computer Writing System Based on EOG

The development of a novel computer writing system based on eye movements is introduced herein. A system of these characteristics requires the consideration of three subsystems: (1) A hardware device for the acquisition and transmission of the signals generated by eye movement to the computer; (2) A software application that allows, among other functions, data processing in order to minimize noise and classify signals; and (3) A graphical interface that allows the user to write text easily on the computer screen using eye movements only. This work analyzes these three subsystems and proposes innovative and low cost solutions for each one of them. This computer writing system was tested with 20 users and its efficiency was compared to a traditional virtual keyboard. The results have shown an important reduction in the time spent on writing, which can be very useful, especially for people with severe motor disorders.

A Novel Wearable Forehead EOG Measurement System for Human Computer Interfaces

Amyotrophic lateral sclerosis (ALS) patients whose voluntary muscles are paralyzed commonly communicate with the outside world using eye movement. There have been many efforts to support this method of communication by tracking or detecting eye movement. An electrooculogram (EOG), an electro-physiological signal, is generated by eye movements and can be measured with electrodes placed around the eye. In this study, we proposed a new practical electrode position on the forehead to measure EOG signals, and we developed a wearable forehead EOG measurement system for use in Human Computer/Machine interfaces (HCIs/HMIs). Four electrodes, including the ground electrode, were placed on the forehead. The two channels were arranged vertically and horizontally, sharing a positive electrode. Additionally, a real-time eye movement classification algorithm was developed based on the characteristics of the forehead EOG. Three applications were employed to evaluate the proposed system: a virtual keyboard using a modified Bremen BCI speller and an automatic sequential row-column scanner, and a drivable power wheelchair. The mean typing speeds of the modified Bremen brain–computer interface (BCI) speller and automatic row-column scanner were 10.81 and 7.74 letters per minute, and the mean classification accuracies were 91.25% and 95.12%, respectively. In the power wheelchair demonstration, the user drove the wheelchair through an 8-shape course without collision with obstacles.

Volitional and Real-Time Control Cursor Based on Eye Movement Decoding Using a Linear Decoding Model

The aim of this study is to build a linear decoding model that reveals the relationship between the movement information and the EOG (electrooculogram) data to online control a cursor continuously with blinks and eye pursuit movements. First of all, a blink detection method is proposed to reject a voluntary single eye blink or double-blink information from EOG. Then, a linear decoding model of time series is developed to predict the position of gaze, and the model parameters are calibrated by the RLS (Recursive Least Square) algorithm; besides, the assessment of decoding accuracy is assessed through cross-validation procedure. Additionally, the subsection processing, increment control, and online calibration are presented to realize the online control. Finally, the technology is applied to the volitional and online control of a cursor to hit the multiple predefined targets. Experimental results show that the blink detection algorithm performs well with the voluntary blink detection rate over 95%. Through combining the merits of blinks and smooth pursuit movements, the movement information of eyes can be decoded in good conformity with the average Pearson correlation coefficient which is up to 0.9592, and all signal-to-noise ratios are greater than 0. The novel system allows people to successfully and economically control a cursor online with a hit rate of 98%.

Biomimetic rehabilitation engineering: the importance of somatosensory feedback for brain-machine interfaces

OBJECTIVE

Brain-machine interfaces (BMIs) re-establish communication channels between the nervous system and an external device. The use of BMI technology has generated significant developments in rehabilitative medicine, promising new ways to restore lost sensory-motor functions. However and despite high-caliber basic research, only a few prototypes have successfully left the laboratory and are currently home-deployed.

APPROACH

The failure of this laboratory-to-user transfer likely relates to the absence of BMI solutions for providing naturalistic feedback about the consequences of the BMI's actions. To overcome this limitation, nowadays cutting-edge BMI advances are guided by the principle of biomimicry; i.e. the artificial reproduction of normal neural mechanisms.

MAIN RESULTS

Here, we focus on the importance of somatosensory feedback in BMIs devoted to reproducing movements with the goal of serving as a reference framework for future research on innovative rehabilitation procedures. First, we address the correspondence between users' needs and BMI solutions. Then, we describe the main features of invasive and non-invasive BMIs, including their degree of biomimicry and respective advantages and drawbacks. Furthermore, we explore the prevalent approaches for providing quasi-natural sensory feedback in BMI settings. Finally, we cover special situations that can promote biomimicry and we present the future directions in basic research and clinical applications.

SIGNIFICANCE

The continued incorporation of biomimetic features into the design of BMIs will surely serve to further ameliorate the realism of BMIs, as well as tremendously improve their actuation, acceptance, and use.

HMM based automated wheelchair navigation using EOG traces in EEG

This paper presents a wheelchair navigation system based on a hidden Markov model (HMM), which we developed to assist those with restricted mobility. The semi-autonomous system is equipped with obstacle/collision avoidance sensors and it takes the electrooculography (EOG) signal traces from the user as commands to maneuver the wheelchair. The EOG traces originate from eyeball and eyelid movements and they are embedded in EEG signals collected from the scalp of the user at three different locations. Features extracted from the EOG traces are used to determine whether the eyes are open or closed, and whether the eyes are gazing to the right, center, or left. These features are utilized as inputs to a few support vector machine (SVM) classifiers, whose outputs are regarded as observations to an HMM. The HMM determines the state of the system and generates commands for navigating the wheelchair accordingly. The use of simple features and the implementation of a sliding window that captures important signatures in the EOG traces result in a fast execution time and high classification rates. The wheelchair is equipped with a proximity sensor and it can move forward and backward in three directions. The asynchronous system achieved an average classification rate of 98% when tested with online data while its average execution time was less than 1 s. It was also tested in a navigation experiment where all of the participants managed to complete the tasks successfully without collisions.

Different perception of musical stimuli in patients with monolateral and bilateral cochlear implants

The aim of the present study is to measure the perceived pleasantness during the observation of a musical video clip in a group of cochlear implanted adult patients when compared to a group of normal hearing subjects. This comparison was performed by using the imbalance of the EEG power spectra in alpha band over frontal areas as a metric for the perceived pleasantness. Subjects were asked to watch a musical video clip in three different experimental conditions: with the original audio included (Norm), with a distorted version of the audio (Dist), and without the audio (Mute). The frontal EEG imbalance between the estimated power spectra for the left and right prefrontal areas has been calculated to investigate the differences among the two populations. Results suggested that the perceived pleasantness of the musical video clip in the normal hearing population and in the bilateral cochlear implanted populations has similar range of variation across the different stimulations (Norm, Dist, and Mute), when compared to the range of variation of video clip's pleasantness for the monolateral cochlear implanted population. A similarity exists in the trends of the perceived pleasantness across the different experimental conditions in the mono- and bilaterally cochlear implanted patients.

Neuroelectrical correlates of trustworthiness and dominance judgments related to the observation of political candidates

The present research investigates the neurophysiological activity elicited by fast observations of faces of real candidates during simulated political elections. We used simultaneous recording of electroencephalographic (EEG) signals as well as galvanic skin response (GSR) and heart rate (HR) as measurements of central and autonomic nervous systems. Twenty healthy subjects were asked to give judgments on dominance, trustworthiness, and a preference of vote related to the politicians' faces. We used high-resolution EEG techniques to map statistical differences of power spectral density (PSD) cortical activity onto a realistic head model as well as partial directed coherence (PDC) and graph theory metrics to estimate the functional connectivity networks and investigate the role of cortical regions of interest (ROIs). Behavioral results revealed that judgment of dominance trait is the most predictive of the outcome of the simulated elections. Statistical comparisons related to PSD and PDC values highlighted an asymmetry in the activation of frontal cortical areas associated with the valence of the judged trait as well as to the probability to cast the vote. Overall, our results highlight the existence of cortical EEG features which are correlated with the prediction of vote and with the judgment of trustworthy and dominant faces.

Neurophysiological tools to investigate consumer's gender differences during the observation of TV commercials

Neuromarketing is a multidisciplinary field of research whose aim is to investigate the consumers' reaction to advertisements from a neuroscientific perspective. In particular, the neuroscience field is thought to be able to reveal information about consumer preferences which are unobtainable through conventional methods, including submitting questionnaires to large samples of consumers or performing psychological personal or group interviews. In this scenario, we performed an experiment in order to investigate cognitive and emotional changes of cerebral activity evaluated by neurophysiologic indices during the observation of TV commercials. In particular, we recorded the electroencephalographic (EEG), galvanic skin response (GSR), and heart rate (HR) in a group of 28 healthy subjects during the observation of a series of TV advertisements that have been grouped by commercial categories. Comparisons of cerebral indices have been performed to highlight gender differences between commercial categories and scenes of interest of two specific commercials. Findings show how EEG methodologies, along with the measurements of autonomic variables, could be used to obtain hidden information to marketers not obtainable otherwise. Most importantly, it was suggested how these tools could help to analyse the perception of TV advertisements and differentiate their production according to the consumer's gender.

An asynchronous wheelchair control by hybrid EEG-EOG brain-computer interface

Wheelchair control requires multiple degrees of freedom and fast intention detection, which makes electroencephalography (EEG)-based wheelchair control a big challenge. In our previous study, we have achieved direction (turning left and right) and speed (acceleration and deceleration) control of a wheelchair using a hybrid brain-computer interface (BCI) combining motor imagery and P300 potentials. In this paper, we proposed hybrid EEG-EOG BCI, which combines motor imagery, P300 potentials, and eye blinking to implement forward, backward, and stop control of a wheelchair. By performing relevant activities, users (e.g., those with amyotrophic lateral sclerosis and locked-in syndrome) can navigate the wheelchair with seven steering behaviors. Experimental results on four healthy subjects not only demonstrate the efficiency and robustness of our brain-controlled wheelchair system but also indicate that all the four subjects could control the wheelchair spontaneously and efficiently without any other assistance (e.g., an automatic navigation system).

Technology-aided programs for assisting communication and leisure engagement of persons with amyotrophic lateral sclerosis: two single-case studies

Technology-aided programs for assisting communication and leisure engagement were assessed in single-case studies involving two men with amyotrophic lateral sclerosis (ALS). Study I involved a 51-year-old man with a virtually total loss of his motor repertoire and assessed a technology-aided program aimed at enabling him to (a) write and send out text messages and have incoming messages read to him and (b) establish videophone connections with his children (i.e., establish video contact and communicate with them). Study II involved a 66-year-old man with virtually no motor behavior and apparent depression and assessed a technology-aided program aimed at enabling him to (a) engage in leisure activities and make requests for basic needs and (b) use a low-demand messaging system. The results of both studies were highly encouraging. The participant of Study I could use the technology-aided program for effective communication and social interaction with multiple partners as well as for family interaction. The participant of Study II could use the technology-aided program for leisure engagement, requests, and basic family contacts/communication. The implications of technology for helping persons with severe ALS levels maintain an active and constructive role are discussed.

Alternative communication systems for people with severe motor disabilities: a survey

We have now sufficient evidence that using electrical biosignals in the field of Alternative and Augmented Communication is feasible. Additionally, they are particularly suitable in the case of people with severe motor impairment, e.g. people with high-level spinal cord injury or with locked-up syndrome. Developing solutions for them implies that we find ways to use sensors that fit the user's needs and limitations, which in turn impacts the specifications of the system translating the user's intentions into commands. After devising solutions for a given user or profile, the system should be evaluated with an appropriate method, allowing a comparison with other solutions. This paper submits a review of the way three bioelectrical signals--electromyographic, electrooculographic and electroencephalographic--have been utilised in alternative communication with patients suffering severe motor restrictions. It also offers a comparative study of the various methods applied to measure the performance of AAC systems.

Sensory system for implementing a human-computer interface based on electrooculography

This paper describes a sensory system for implementing a human–computer interface based on electrooculography. An acquisition system captures electrooculograms and transmits them via the ZigBee protocol. The data acquired are analysed in real time using a microcontroller-based platform running the Linux operating system. The continuous wavelet transform and neural network are used to process and analyse the signals to obtain highly reliable results in real time. To enhance system usability, the graphical interface is projected onto special eyewear, which is also used to position the signal-capturing electrodes.