Aerial Robots have the potential to play a crucial role in assisting humans in complex and dangerous tasks with the goal to decrease users’ cognitive and physical workload. In addition, many applications will require aerial robots to be ubiquitous and share the same environment with human operators. Therefore, this calls for novel solutions to enable seamless, transparent, and efficient human-drone collaboration and co-working in the same workspace. In this paper, we present a novel tele-immersive approach that promotes cognitive and physical collaboration between humans and robots through Mixed Reality (MR). We develop a bi-directional spatial awareness module and a new virtual-physical interaction approach integrated on a head-mounted display with MR. Furthermore, we design two alternative methods for spatial and physical interaction. Both solutions use a 2D monitor for spatial representation, with one method involving a mouse and keyboard, and the other using a haptic interface with the new VAC solution for physical interaction. This setup allows us to study how to analyze how different physical embodiments might compensate for reduced spatial representation during interaction tasks. Finally, to validate our approach and our comparative study, we propose a comprehensive user case study where 12 subjects with different expertise and background are tasked to complete a target reaching task in an indoor cluttered environment. We consider as part of the evaluation both subjective metrics, such as the System Usability Scale and the NASA Task Load Index, as well as objective measures, including completion time, distance traveled to reach the goal, and smoothness of movements. The results demonstrate enhanced user interaction and control capabilities during the task when using our novel novel tele-immersive approach with MR compared to the two alternative solutions. Additionally, the experiments show the opportunity to employ the proposed system as a new innovative collaboration approach between a non-expert human and an aerial robot for exploration and inspection tasks in unknown environments. Video: https://youtu.be/q8Dq-cNxcig
扫码关注我们
求助内容:
应助结果提醒方式:
