Effects of posed smiling on memory for happy and sad facial expressions

The use of happy faces as visual stimuli improves the performance of the hybrid SSVEP+P300 brain computer interface

BACKGROUND

This study illustrates a hybrid brain-computer interface (BCI) in which steady-state visual evoked potentials (SSVEP) and event-related potentials (P300) are evoked simultaneously. The goal of this study was to improve the performance of the current hybrid SSVEP+P300 BCI systems by incorporating a happy face into visual stimuli.

NEW METHOD

In this study, happy and sad faces were added to a visual stimulus to induce stronger cortical signals in a hybrid SSVEP+P300 BCI. Additionally, we developed a paradigm in which SSVEP responses were triggered by non-face stimuli, whereas P300 responses were triggered by face stimuli. We tested four paradigms: happy face paradigm (HF), sad face paradigm (SF), happy face and flicker paradigm (HFF), and sad face and flicker paradigm (SFF).

RESULTS AND CONCLUSIONS

The results demonstrated that the HFF paradigm elicited more robust cortical responses, which resulted in enhanced system accuracy and information transfer rate (ITR). The HFF paradigm has a system communication rate of 25.9 bits per second and an average accuracy of 96.1%. Compared with other paradigms, the HFF paradigm is the best choice for BCI applications because it has the highest ITR and maximum level of comfort.

Facial mimicry interference reduces working memory accuracy for facial emotion expressions

Facial mimicry, the tendency to imitate facial expressions of other individuals, has been shown to play a critical role in the processing of emotion expressions. At the same time, there is evidence suggesting that its role might change when the cognitive demands of the situation increase. In such situations, understanding another person is dependent on working memory. However, whether facial mimicry influences working memory representations for facial emotion expressions is not fully understood. In the present study, we experimentally interfered with facial mimicry by using established behavioral procedures, and investigated how this interference influenced working memory recall for facial emotion expressions. Healthy, young adults (N = 36) performed an emotion expression n-back paradigm with two levels of working memory load, low (1-back) and high (2-back), and three levels of mimicry interference: high, low, and no interference. Results showed that, after controlling for block order and individual differences in the perceived valence and arousal of the stimuli, the high level of mimicry interference impaired accuracy when working memory load was low (1-back) but, unexpectedly, not when load was high (2-back). Working memory load had a detrimental effect on performance in all three mimicry conditions. We conclude that facial mimicry might support working memory for emotion expressions when task load is low, but that the supporting effect possibly is reduced when the task becomes more cognitively challenging.

Zygomaticus activation through facial neuromuscular electrical stimulation (fNMES) induces happiness perception in ambiguous facial expressions and affects neural correlates of face processing

The role of facial feedback in facial emotion recognition remains controversial, partly due to limitations of the existing methods to manipulate the activation of facial muscles, such as voluntary posing of facial expressions or holding a pen in the mouth. These procedures are indeed limited in their control over which muscles are (de)activated when and to what degree. To overcome these limitations and investigate in a more controlled way if facial emotion recognition is modulated by one's facial muscle activity, we used computer-controlled facial neuromuscular electrical stimulation (fNMES). In a pre-registered EEG experiment, ambiguous facial expressions were categorised as happy or sad by 47 participants. In half of the trials, weak smiling was induced through fNMES delivered to the bilateral Zygomaticus Major muscle for 500 ms. The likelihood of categorising ambiguous facial expressions as happy was significantly increased with fNMES, as shown with frequentist and Bayesian linear mixed models. Further, fNMES resulted in a reduction of P1, N170 and LPP amplitudes. These findings suggest that fNMES-induced facial feedback can bias facial emotion recognition and modulate the neural correlates of face processing. We conclude that fNMES has potential as a tool for studying the effects of facial feedback.

A Utilização da Imitação Facial em Tarefas de Reconhecimento de Expressões Emocionais

Resumo A imitação facial é um comportamento involuntário capaz de facilitar a transmissão de informações não verbais relevantes em diferentes contextos sociais. Este estudo teve por objetivo analisar a capacidade de reconhecimento de expressões emocionais enquanto o observador tensiona a própria face ou imita a face-alvo. A hipótese utilizada foi a de que indivíduos que tensionam a própria face terão menor probabilidade de acertos na execução das tarefas de reconhecimento de expressões emocionais e aqueles que imitam a expressão terão uma maior probabilidade de acertos na execução das mesmas tarefas. A amostra foi composta por 30 participantes, divididos em dois grupos experimentais: o Grupo Imitação (GI) e o Grupo Ruído (GR), ambos com 18 participantes do sexo feminino e 12 do sexo masculino. O experimento consistiu em apresentar fotos de atores expressando facialmente uma emoção básica por 10 segundos. Neste período, os participantes deveriam, então, observar ou intervir facialmente, imitando ou tensionando a própria face (de acordo com o grupo alocado, Imitação ou Ruído). Após os 10 segundos executando a instrução (observar, imitar ou interferir), o participante deveria responder - entre as opções alegria, tristeza, nojo, raiva, surpresa e medo - a emoção correspondente à imagem. Os resultados apresentaram diferenças significativas quando comparadas as tarefas de tensionar ou imitar a face-alvo, sugerindo que a alteração da própria face do observador pode influenciar durante o desempenho de uma tarefa de reconhecimento de emoções em faces.