Enhancing Immersive User Experience Quality of StudoBot Telepresence Robots with Reinforcement Learning

Abstract

The pandemic situation (Covid 19) brought new challenges in the education sector while simultaneously presenting unique opportunities for technology enabled services. The use of Mobile Robotic Telepresence systems in educational sector is promising as it provides means to significantly enhance the involvement and benefits to stakeholders involved in such interactions. An immersive user interaction with such a system depends on many aspects which are both static and dynamic. We approach the dynamic aspect of such interactions recognizing that the video and audio aspects of such a system will require fine tuning and adaptation. Closely related is the aspect of maintaining the necessary quality of network connection. Considering each of these aspects a reinforcement learning mechanism is incorporated to improve the overall user experience with such a system. A working system is built and experiments performed to demonstrate the effectiveness of the approach. Reward generation matrix, a crucial piece of data gathering from the environment, takes about 45 minutes, offline training time is less than a second, while the robot is able to cover the workspace in slightly less than a minute. The system is not limited to educational sector alone and provides a foundational framework to extend the concepts and principles to adjacent markets.