Comparison Between the Facial Flow Lines of Androids and Humans

Facial Expression Realization of Humanoid Robot Head and Strain-Based Anthropomorphic Evaluation of Robot Facial Expressions

The facial expressions of humanoid robots play a crucial role in human-computer information interactions. However, there is a lack of quantitative evaluation methods for the anthropomorphism of robot facial expressions. In this study, we designed and manufactured a humanoid robot head that was capable of successfully realizing six basic facial expressions. The driving force behind the mechanism was efficiently transmitted to the silicone skin through a rigid linkage drive and snap button connection, which improves both the driving efficiency and the lifespan of the silicone skin. We used human facial expressions as a basis for simulating and acquiring the movement parameters. Subsequently, we designed a control system for the humanoid robot head in order to achieve these facial expressions. Moreover, we used a flexible vertical graphene sensor to measure strain on both the human face and the silicone skin of the humanoid robot head. We then proposed a method to evaluate the anthropomorphic degree of the robot's facial expressions by using the difference rate of strain. The feasibility of this method was confirmed through experiments in facial expression recognition. The evaluation results indicated a high degree of anthropomorphism for the six basic facial expressions which were achieved by the humanoid robot head. Moreover, this study also investigates factors affecting the reproduction of expressions. Finally, the impulse was calculated based on the strain curves of the energy consumption of the humanoid robot head to complete different facial expressions. This offers a reference for fellow researchers when designing humanoid robot heads, based on energy consumption ratios. To conclude, this paper offers data references for optimizing the mechanisms and selecting the drive components of the humanoid robot head. This was realized by considering the anthropomorphic degree and energy consumption of each part. Additionally, a new method for evaluating robot facial expressions is proposed.

Facing the FACS-Using AI to Evaluate and Control Facial Action Units in Humanoid Robot Face Development

This paper presents a new approach for evaluating and controlling expressive humanoid robotic faces using open-source computer vision and machine learning methods. Existing research in Human-Robot Interaction lacks flexible and simple tools that are scalable for evaluating and controlling various robotic faces; thus, our goal is to demonstrate the use of readily available AI-based solutions to support the process. We use a newly developed humanoid robot prototype intended for medical training applications as a case example. The approach automatically captures the robot’s facial action units through a webcam during random motion, which are components traditionally used to describe facial muscle movements in humans. Instead of manipulating the actuators individually or training the robot to express specific emotions, we propose using action units as a means for controlling the robotic face, which enables a multitude of ways to generate dynamic motion, expressions, and behavior. The range of action units achieved by the robot is thus analyzed to discover its expressive capabilities and limitations and to develop a control model by correlating action units to actuation parameters. Because the approach is not dependent on specific facial attributes or actuation capabilities, it can be used for different designs and continuously inform the development process. In healthcare training applications, our goal is to establish a prerequisite of expressive capabilities of humanoid robots bounded by industrial and medical design constraints. Furthermore, to mediate human interpretation and thus enable decision-making based on observed cognitive, emotional, and expressive cues, our approach aims to find the minimum viable expressive capabilities of the robot without having to optimize for realism. The results from our case example demonstrate the flexibility and efficiency of the presented AI-based solutions to support the development of humanoid facial robots.

An Android for Emotional Interaction: Spatiotemporal Validation of Its Facial Expressions

Android robots capable of emotional interactions with humans have considerable potential for application to research. While several studies developed androids that can exhibit human-like emotional facial expressions, few have empirically validated androids' facial expressions. To investigate this issue, we developed an android head called Nikola based on human psychology and conducted three studies to test the validity of its facial expressions. In Study 1, Nikola produced single facial actions, which were evaluated in accordance with the Facial Action Coding System. The results showed that 17 action units were appropriately produced. In Study 2, Nikola produced the prototypical facial expressions for six basic emotions (anger, disgust, fear, happiness, sadness, and surprise), and naïve participants labeled photographs of the expressions. The recognition accuracy of all emotions was higher than chance level. In Study 3, Nikola produced dynamic facial expressions for six basic emotions at four different speeds, and naïve participants evaluated the naturalness of the speed of each expression. The effect of speed differed across emotions, as in previous studies of human expressions. These data validate the spatial and temporal patterns of Nikola's emotional facial expressions, and suggest that it may be useful for future psychological studies and real-life applications.

Assessing Automated Facial Action Unit Detection Systems for Analyzing Cross-Domain Facial Expression Databases

In the field of affective computing, achieving accurate automatic detection of facial movements is an important issue, and great progress has already been made. However, a systematic evaluation of systems that now have access to the dynamic facial database remains an unmet need. This study compared the performance of three systems (FaceReader, OpenFace, AFARtoolbox) that detect each facial movement corresponding to an action unit (AU) derived from the Facial Action Coding System. All machines could detect the presence of AUs from the dynamic facial database at a level above chance. Moreover, OpenFace and AFAR provided higher area under the receiver operating characteristic curve values compared to FaceReader. In addition, several confusion biases of facial components (e.g., AU12 and AU14) were observed to be related to each automated AU detection system and the static mode was superior to dynamic mode for analyzing the posed facial database. These findings demonstrate the features of prediction patterns for each system and provide guidance for research on facial expressions.