Optimal Human-Robot Interaction Facial Expression Design Based on Derivation of Expression Emotional Intensity Factors of an Autonomous Quarantine Robot

Abstract

Background To develop a robot that shares emotions with humans, it is necessary to study how robots can express appropriate emotions in various situations. As interest in sterilization to prevent infectious diseases increases worldwide, the development of autonomous quarantine robots that are capable of not only quarantine tasks but also emotional exchanges with humans is of interest. Therefore, this study describes the optimization of a human-robot interaction (HRI) design that facilitates the interaction between humans and autonomous quarantine robots by designing and developing the facial expressions of robots so that they can express emotions. Methods We created a user-robot integration scenario to derive emotional information according to the situation of the robot. Then, we selected the facial expression of the robot preferred by the user through a survey and designed the robot's basic expression based on the Action Units (AU) combination. We derived elements to modulate the intensity of robot emotions based on previous research and human facial expression verification experiments. Finally, we applied the optimal emotional intensity factors derived from the analysis of videos showing the facial expressions of a human actor to the facial expressions of the robot. Results We derived the optimal emotional intensity factors for producing the seven emotions of the autonomous quarantine robot and presented them in a graph. As a result, we found the values that can express the optimal intensity of the seven emotions. In addition, we verified that speed, duration, eye blinking, and color were appropriate for producing the desired emotional intensity by the robot. In addition, we developed a facial expression design that can express the optimal emotion of the robot through the appropriate emotional intensity. Conclusions In this study, we add the situations of the user and the robot to the standardized emotional expression of the robot and derive elements to express the intensity of the emotion. Through this, the robot can effectively express its emotions and intentions in various environments and can interact smoothly with humans. In addition, we provide suggestions for developing optimized robots using basic data so that robot manufacturers and robot experts can implement an emotional system that adds flexibility to robot behavior.