Vlasios Kasapakis, Elena Dzardanova, D. Gavalas, Stella Sylaiou
Mixed-Reality (MR) worlds are created by fusing together real and virtual elements. This paper presents SEaMlESS, a multiuser, long-distance room-scale MR world. SEaMlESS utilizes widespread 3D modelling techniques and object tracking technologies to enable free user movement by providing full-body motion control, accurate real object representation within the virtual world, as well as interaction with real and virtual objects.
{"title":"Remote Synchronous Interaction in Mixed Reality Gaming Worlds","authors":"Vlasios Kasapakis, Elena Dzardanova, D. Gavalas, Stella Sylaiou","doi":"10.1145/3210438.3210441","DOIUrl":"https://doi.org/10.1145/3210438.3210441","url":null,"abstract":"Mixed-Reality (MR) worlds are created by fusing together real and virtual elements. This paper presents SEaMlESS, a multiuser, long-distance room-scale MR world. SEaMlESS utilizes widespread 3D modelling techniques and object tracking technologies to enable free user movement by providing full-body motion control, accurate real object representation within the virtual world, as well as interaction with real and virtual objects.","PeriodicalId":264837,"journal":{"name":"Proceedings of the 10th International Workshop on Immersive Mixed and Virtual Environment Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114528403","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Natalie Hube, Mathias Müller, Jan Wojdziak, Franziska Hannß, Rainer Groh
Augmented reality (AR) has gained exceptional importance in supporting task performance. Particularly, in quality assurance (QA) processes in the automotive sector AR offers a diversity of use cases. In this paper we propose an interface design which projects information as a digital canvas on the surface of vehicle components. Based on a requirement analysis, we discuss design aspects and describe our application in applying the quality assurance process of a luxury automaker. The application includes a personal view on spatial information embedded in a guided interaction process as a design solution that can be applied to enhance QA processes.
{"title":"Towards Augmented Reality in Quality Assurance Processes","authors":"Natalie Hube, Mathias Müller, Jan Wojdziak, Franziska Hannß, Rainer Groh","doi":"10.1145/3210438.3210442","DOIUrl":"https://doi.org/10.1145/3210438.3210442","url":null,"abstract":"Augmented reality (AR) has gained exceptional importance in supporting task performance. Particularly, in quality assurance (QA) processes in the automotive sector AR offers a diversity of use cases. In this paper we propose an interface design which projects information as a digital canvas on the surface of vehicle components. Based on a requirement analysis, we discuss design aspects and describe our application in applying the quality assurance process of a luxury automaker. The application includes a personal view on spatial information embedded in a guided interaction process as a design solution that can be applied to enhance QA processes.","PeriodicalId":264837,"journal":{"name":"Proceedings of the 10th International Workshop on Immersive Mixed and Virtual Environment Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131024156","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
For scalability, reliability and cost reduction, virtual environment has been evolved from the client-server model, peer-to-peer model, to the virtual node-based hybrid model. When objects are hosted by unreliable nodes, replication is applied for reliability. An important problem is to maintain replica consistency in interaction, while to minimize interaction latency in play. We propose a fast state machine replication model to address this issue. Besides correctness, our simulation shows the achievable high responsiveness. The work can also be applied in augmented and mixed reality systems, where hundreds of users interact with virtual elements on a common platform.
{"title":"Uninterruptible Play in Virtual Node-based Virtual Worlds","authors":"Bingqing Shen, J. Guo","doi":"10.1145/3210438.3210439","DOIUrl":"https://doi.org/10.1145/3210438.3210439","url":null,"abstract":"For scalability, reliability and cost reduction, virtual environment has been evolved from the client-server model, peer-to-peer model, to the virtual node-based hybrid model. When objects are hosted by unreliable nodes, replication is applied for reliability. An important problem is to maintain replica consistency in interaction, while to minimize interaction latency in play. We propose a fast state machine replication model to address this issue. Besides correctness, our simulation shows the achievable high responsiveness. The work can also be applied in augmented and mixed reality systems, where hundreds of users interact with virtual elements on a common platform.","PeriodicalId":264837,"journal":{"name":"Proceedings of the 10th International Workshop on Immersive Mixed and Virtual Environment Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127323433","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this paper1, we introduce the concept of Virtual Transcendence Experience (VTE) as a response to the interactions of several users sharing several immersive experiences through different media channels. For that, we review the current body of knowledge that has led to the development of a VTE system. This is followed by a discussion of current technical and design challenges that could support the implementation of this concept. This discussion has informed the VTE framework (VTEf), which integrates different layers of experiences, including the role of each user and the technical challenges involved. We conclude this paper with suggestions for two scenarios and recommendations for the implementation of a system that could support VTEs.
{"title":"Virtual Transcendence Experiences: Exploring Technical and Design Challenges in Multi-Sensory Environments","authors":"V. Wanick, Guilherme Xavier, E. Ekmekcioglu","doi":"10.1145/3210438.3210444","DOIUrl":"https://doi.org/10.1145/3210438.3210444","url":null,"abstract":"In this paper1, we introduce the concept of Virtual Transcendence Experience (VTE) as a response to the interactions of several users sharing several immersive experiences through different media channels. For that, we review the current body of knowledge that has led to the development of a VTE system. This is followed by a discussion of current technical and design challenges that could support the implementation of this concept. This discussion has informed the VTE framework (VTEf), which integrates different layers of experiences, including the role of each user and the technical challenges involved. We conclude this paper with suggestions for two scenarios and recommendations for the implementation of a system that could support VTEs.","PeriodicalId":264837,"journal":{"name":"Proceedings of the 10th International Workshop on Immersive Mixed and Virtual Environment Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132483047","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Proceedings of the 10th International Workshop on Immersive Mixed and Virtual Environment Systems","authors":"","doi":"10.1145/3210438","DOIUrl":"https://doi.org/10.1145/3210438","url":null,"abstract":"","PeriodicalId":264837,"journal":{"name":"Proceedings of the 10th International Workshop on Immersive Mixed and Virtual Environment Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114647917","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ting Bi, A. Pichon, Longhao Zou, Shengyang Chen, G. Ghinea, Gabriel-Miro Muntean
The Dynamic Adaptive Streaming over HTTP (DASH) is a standard designed for adaptive multimedia delivery. This paper describes an adaptive multimedia and mulsemedia delivery system which employs an extension of DASH to support multiple sensorial media. Testing using a real-life test-bed shows how user satisfaction increases when employing the proposed solution which exposes users to multi-sensorial content. The motivation behind this work is the creation the first solution for remote adaptive multi-sensory media (mulsemedia) content delivery in order to enhance user satisfaction and increase their quality of experience. A DASH-based mulsemedia delivery system (DASH-MS) was built and tested. This work focuses on a fundamental issue for remote multi-sensory media systems: synchronization and shows how the proposed DASH-MS addresses it. Results of real life subjective testing indicate that the average levels of user satisfaction when exposed to content with the mulsemedia effects are better or at least equal to those when no such effects were included. Additionally, the highest value of the level of satisfaction corresponds to the case when these effects were correctly synchronized. Finally, users seem to have preferred effects in advance than late effects.
动态自适应HTTP流(Dynamic Adaptive Streaming over HTTP, DASH)是一种为自适应多媒体传输而设计的标准。本文介绍了一种自适应多媒体和多媒体传输系统,该系统采用DASH扩展来支持多种感知媒体。使用现实生活测试平台的测试表明,当采用将用户暴露于多感官内容的建议解决方案时,用户满意度如何提高。这项工作背后的动机是创造远程自适应多感官媒体(多媒体)内容交付的第一个解决方案,以提高用户满意度并提高他们的体验质量。建立并测试了基于dash的多媒体传输系统(DASH-MS)。这项工作的重点是远程多感官媒体系统的一个基本问题:同步,并展示了拟议的DASH-MS如何解决这个问题。现实生活主观测试的结果表明,当用户接触到具有多媒体效果的内容时,用户满意度的平均水平更好,或者至少等于那些没有包含此类效果的内容。此外,满意度的最高值与这些效果正确同步的情况相对应。最后,用户似乎更喜欢提前效果而不是后期效果。
{"title":"A DASH-based Mulsemedia Adaptive Delivery Solution","authors":"Ting Bi, A. Pichon, Longhao Zou, Shengyang Chen, G. Ghinea, Gabriel-Miro Muntean","doi":"10.1145/3210438.3210443","DOIUrl":"https://doi.org/10.1145/3210438.3210443","url":null,"abstract":"The Dynamic Adaptive Streaming over HTTP (DASH) is a standard designed for adaptive multimedia delivery. This paper describes an adaptive multimedia and mulsemedia delivery system which employs an extension of DASH to support multiple sensorial media. Testing using a real-life test-bed shows how user satisfaction increases when employing the proposed solution which exposes users to multi-sensorial content. The motivation behind this work is the creation the first solution for remote adaptive multi-sensory media (mulsemedia) content delivery in order to enhance user satisfaction and increase their quality of experience. A DASH-based mulsemedia delivery system (DASH-MS) was built and tested. This work focuses on a fundamental issue for remote multi-sensory media systems: synchronization and shows how the proposed DASH-MS addresses it. Results of real life subjective testing indicate that the average levels of user satisfaction when exposed to content with the mulsemedia effects are better or at least equal to those when no such effects were included. Additionally, the highest value of the level of satisfaction corresponds to the case when these effects were correctly synchronized. Finally, users seem to have preferred effects in advance than late effects.","PeriodicalId":264837,"journal":{"name":"Proceedings of the 10th International Workshop on Immersive Mixed and Virtual Environment Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121694531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Applying cloud technology to 3D interactive multimedia applications is a promising way to provide flexible and cost efficient online high bandwidth immersive services to a large population of end users. One main reason cloud systems are popular among users is the fact that it relaxes the hardware requirements for high-end interactive visual applications. As most of the computational tasks are done on cloud servers, users no longer need to upgrade their hardware frequently to keep up with the ever increasing high end computing requirements of the latest applications. Moreover, cloud systems make it easier for a user to enjoy applications on different platforms, including mobile devices that are usually not powerful enough to run high-end, memory intensive services. In short, applying cloud technology to high end immersive applications has advantages in cost efficiency and flexibility both for the end users and the service providers. In previous work, we proposed a flexible framework that addresses the bandwidth utilization and latency issues by using a combination of collaborative rendering, progressive meshes, and 3D image warping techniques. In this paper, we analyze the performance of our framework for unreliable network environments where packets can be lost during network transmission. The experimental results show that compared to pure video streaming approaches, the proposed system is less sensitive to network conditions as part of the content is generated locally on the client.
{"title":"Improving the Quality of 3D Immersive Interactive Cloud Based Services Over Unreliable Network","authors":"De-Yu Chen, M. Zarki","doi":"10.1145/3210438.3210440","DOIUrl":"https://doi.org/10.1145/3210438.3210440","url":null,"abstract":"Applying cloud technology to 3D interactive multimedia applications is a promising way to provide flexible and cost efficient online high bandwidth immersive services to a large population of end users. One main reason cloud systems are popular among users is the fact that it relaxes the hardware requirements for high-end interactive visual applications. As most of the computational tasks are done on cloud servers, users no longer need to upgrade their hardware frequently to keep up with the ever increasing high end computing requirements of the latest applications. Moreover, cloud systems make it easier for a user to enjoy applications on different platforms, including mobile devices that are usually not powerful enough to run high-end, memory intensive services. In short, applying cloud technology to high end immersive applications has advantages in cost efficiency and flexibility both for the end users and the service providers. In previous work, we proposed a flexible framework that addresses the bandwidth utilization and latency issues by using a combination of collaborative rendering, progressive meshes, and 3D image warping techniques. In this paper, we analyze the performance of our framework for unreliable network environments where packets can be lost during network transmission. The experimental results show that compared to pure video streaming approaches, the proposed system is less sensitive to network conditions as part of the content is generated locally on the client.","PeriodicalId":264837,"journal":{"name":"Proceedings of the 10th International Workshop on Immersive Mixed and Virtual Environment Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2018-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130192624","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}