COMPUTER VISION AIDED HOTSPOT CREATION IN VIRTUAL ENVIRONMENTS

Abstract Hotspot creation is one of the most important modules within virtual environments which helps show the navigators of these environments some information about semantic elements within it and facilitate the navigation between the virtual spaces. In this paper, a system for automatic hotspot proposals and creation in virtual environments is proposed. The system uses computer vision modules to automatically propose hotspot locations in addition to identifying and creating these hotspots with candidate labels. Two main modules used in the system are object detection and scene segmentation. The scene segmentation helps give candidate hotspot areas and provides an overall understanding of the semantics of the virtual environment. The object detection module also uses pretrained deep networks for automatic hotspot creation over these objects. The system helps speed up the hotspot creation process and offers a tool for virtual environment users and creators.