SMART environment control in virtual and mixed reality based on cognitive user abilities

Abstract

This paper focuses on the description of the interface design of a backend server and the design implementation of a user interface suitable for the visualization of virtual and real objects/appliances controlled in a SMART environment, for example in the home, with regard to the cognitive abilities of the user. Client applications will be able to use the REST API and communicate through this API using requests, use implemented logic, and store objects and their states in the database. The server is deployed in the cloud to be accessible outside the local network. The solution is universal and offers a generic standard to support different types of appliances using a generic form. Task scheduling is also an important function. In virtual reality, it is possible to quickly test the cognitive abilities of the user and thus adapt the user interface to his needs.