Mark B. Simpson, J. O. Wallgrün, A. Klippel, Liping Yang, G. Garner, K. Keller, D. Oprean, S. Bansal
We are creating an immersive analytics tool for exploring the output of a Dynamic Integrated Climate-Economy (DICE) model, and present early work on the prototype system. DICE models and other Integrated Assessment Models (IAMs) are critical for informing environmental decision making and policy analysis. They often produce complex and multi-layered output, but need to be understood by decision makers who are not experts. We discuss our current and targeted feature set in order to help address this challenge. Additionally, we look ahead to the potential for rigorous evaluation of the system to uncover whether or not it is an improvement over current visualization methods.
{"title":"Immersive Analytics for Multi-objective Dynamic Integrated Climate-Economy (DICE) Models","authors":"Mark B. Simpson, J. O. Wallgrün, A. Klippel, Liping Yang, G. Garner, K. Keller, D. Oprean, S. Bansal","doi":"10.1145/3009939.3009955","DOIUrl":"https://doi.org/10.1145/3009939.3009955","url":null,"abstract":"We are creating an immersive analytics tool for exploring the output of a Dynamic Integrated Climate-Economy (DICE) model, and present early work on the prototype system. DICE models and other Integrated Assessment Models (IAMs) are critical for informing environmental decision making and policy analysis. They often produce complex and multi-layered output, but need to be understood by decision makers who are not experts. We discuss our current and targeted feature set in order to help address this challenge. Additionally, we look ahead to the potential for rigorous evaluation of the system to uncover whether or not it is an improvement over current visualization methods.","PeriodicalId":422627,"journal":{"name":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","volume":"36 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121903713","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wolfgang Büschel, Patrick Reipschläger, Raimund Dachselt
3D data visualizations, while offering a lot of potential, have also well-known issues regarding occlusion and readability. Immersive technologies might help overcoming these issues by addressing the perceptional problems and increasing the tangibility of the data. In this work, we explore the potential of spatial interaction with mobile devices. Building on the related work and our own experiences, we report on visualizations that are fixed in space or fixed on the device, as well as combining them with head-coupled perspective. A number of prototypes we developed, helped us to gain practical insights in the possibilities and limitations of these techniques.
{"title":"Improving 3D Visualizations: Exploring Spatial Interaction with Mobile Devices","authors":"Wolfgang Büschel, Patrick Reipschläger, Raimund Dachselt","doi":"10.1145/3009939.3009949","DOIUrl":"https://doi.org/10.1145/3009939.3009949","url":null,"abstract":"3D data visualizations, while offering a lot of potential, have also well-known issues regarding occlusion and readability. Immersive technologies might help overcoming these issues by addressing the perceptional problems and increasing the tangibility of the data. In this work, we explore the potential of spatial interaction with mobile devices. Building on the related work and our own experiences, we report on visualizations that are fixed in space or fixed on the device, as well as combining them with head-coupled perspective. A number of prototypes we developed, helped us to gain practical insights in the possibilities and limitations of these techniques.","PeriodicalId":422627,"journal":{"name":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115841781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mark S. Hancock, Nicolai Marquardt, Johannes Schöning, Melanie Tory
It is our pleasure to welcome you to the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS 2016). ISS is the premier venue for research addressing the design, development and use of new and emerging digital surfaces and multi-surface technologies. Located right at the border between Canada and the US, the scenic view of the magnificent Niagara Falls and its vibrant city life will be the ideal host for this 11th annual event in the conference series, and the first year with our new conference name. Over the years ISS has been a venue for research and applications of interactive surfaces as well as spaces, which has been acknowledged by the incorporation of 'Spaces' into our conference name for this year. Interactive Surfaces and Spaces increasingly pervade our everyday life, appearing in various sizes, shapes, and application contexts, offering a rich variety of ways to interact. Our conference is the venue to discuss all those innovations in many different areas including design, software, hardware, understanding of use, and applications or deployments of interactive surfaces and spaces. Sponsored by ACM SIGCHI and generously supported by Microsoft, ISS brings together researchers and practitioners from a variety of backgrounds and interest areas. Thanks to all authors submitting novel and innovative research, and the hard work of our program committee, we again have an engaging and high quality conference program. As in previous years, we kept the single track conference structure, split over four days. We had 119 submissions for the main paper track and selected 33 of them. In addition, the program covered a doctoral colloquium, workshops, tutorials, studios and posters and demos. To recognize influential research published at our previous conferences we award the 10-Year Impact Award at ISS for the second time. This year the award goes to Meredith Ringel Morris, AJ Bernheim Brush, and Brian R. Meyers for their submission "Reading revisited: Evaluating the usability of digital display surfaces for active reading tasks". Their contribution to TABLETOP'07 10 years ago addressed the much considered, but still contested, challenge of understanding the differences between reading and annotating text on paper, and reading and annotating text within digital media. The paper revisited the issue from the perspective of workplace tasks, and through a range of qualitative and quantitative studies considered a number of configurations of single and dual displays in horizontal and vertical configurations. Inevitably the conclusions were nuanced, including a set of considerations for the suitability of different set-ups for annotation, navigation, spatial management, composition, and ergonomic comfort. Ten years on and the impact of the paper is clearly seen in the many citations made to the paper by other researchers. These have come in waves of secondary studies as new reading technologies have emerged; and with the emergence
{"title":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","authors":"Mark S. Hancock, Nicolai Marquardt, Johannes Schöning, Melanie Tory","doi":"10.1145/3009939","DOIUrl":"https://doi.org/10.1145/3009939","url":null,"abstract":"It is our pleasure to welcome you to the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS 2016). ISS is the premier venue for research addressing the design, development and use of new and emerging digital surfaces and multi-surface technologies. Located right at the border between Canada and the US, the scenic view of the magnificent Niagara Falls and its vibrant city life will be the ideal host for this 11th annual event in the conference series, and the first year with our new conference name. Over the years ISS has been a venue for research and applications of interactive surfaces as well as spaces, which has been acknowledged by the incorporation of 'Spaces' into our conference name for this year. Interactive Surfaces and Spaces increasingly pervade our everyday life, appearing in various sizes, shapes, and application contexts, offering a rich variety of ways to interact. Our conference is the venue to discuss all those innovations in many different areas including design, software, hardware, understanding of use, and applications or deployments of interactive surfaces and spaces. \u0000 \u0000Sponsored by ACM SIGCHI and generously supported by Microsoft, ISS brings together researchers and practitioners from a variety of backgrounds and interest areas. Thanks to all authors submitting novel and innovative research, and the hard work of our program committee, we again have an engaging and high quality conference program. As in previous years, we kept the single track conference structure, split over four days. We had 119 submissions for the main paper track and selected 33 of them. In addition, the program covered a doctoral colloquium, workshops, tutorials, studios and posters and demos. \u0000 \u0000To recognize influential research published at our previous conferences we award the 10-Year Impact Award at ISS for the second time. This year the award goes to Meredith Ringel Morris, AJ Bernheim Brush, and Brian R. Meyers for their submission \"Reading revisited: Evaluating the usability of digital display surfaces for active reading tasks\". Their contribution to TABLETOP'07 10 years ago addressed the much considered, but still contested, challenge of understanding the differences between reading and annotating text on paper, and reading and annotating text within digital media. The paper revisited the issue from the perspective of workplace tasks, and through a range of qualitative and quantitative studies considered a number of configurations of single and dual displays in horizontal and vertical configurations. Inevitably the conclusions were nuanced, including a set of considerations for the suitability of different set-ups for annotation, navigation, spatial management, composition, and ergonomic comfort. Ten years on and the impact of the paper is clearly seen in the many citations made to the paper by other researchers. These have come in waves of secondary studies as new reading technologies have emerged; and with the emergence ","PeriodicalId":422627,"journal":{"name":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125416676","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sebastian Lay, Jo Vermeulen, Charles Perin, E. Donovan, Raimund Dachselt, M. Carpendale
The Aurora Borealis or Northern Lights is a phenomenon that has fascinated people throughout history. The AuroraMAX outreach initiative provides a collection of time-lapse videos of the night sky captured by a camera at Yellowknife in Canada. We present an interactive visualization of this AuroraMAX image data on a large touch display. Our visualization slices each time-lapse video to represent an entire night as a single image or keogram, provides different views on the keograms, and allows people to explore and compare nights to discover interesting patterns. To entice people to interact, we use proxemic interaction and animate the visualization in response to people's movements in front of the display. We deployed the visualization in a public space at an art-science festival. Initial findings suggest that the proxemic interaction aspect helps to draw people in and that the visualization generates interest from passersby, providing opportunities for science outreach.
{"title":"Slicing the Aurora: An Immersive Proxemics-Aware Visualization","authors":"Sebastian Lay, Jo Vermeulen, Charles Perin, E. Donovan, Raimund Dachselt, M. Carpendale","doi":"10.1145/3009939.3009954","DOIUrl":"https://doi.org/10.1145/3009939.3009954","url":null,"abstract":"The Aurora Borealis or Northern Lights is a phenomenon that has fascinated people throughout history. The AuroraMAX outreach initiative provides a collection of time-lapse videos of the night sky captured by a camera at Yellowknife in Canada. We present an interactive visualization of this AuroraMAX image data on a large touch display. Our visualization slices each time-lapse video to represent an entire night as a single image or keogram, provides different views on the keograms, and allows people to explore and compare nights to discover interesting patterns. To entice people to interact, we use proxemic interaction and animate the visualization in response to people's movements in front of the display. We deployed the visualization in a public space at an art-science festival. Initial findings suggest that the proxemic interaction aspect helps to draw people in and that the visualization generates interest from passersby, providing opportunities for science outreach.","PeriodicalId":422627,"journal":{"name":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126708960","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Beyond other domains, the field of immersive analytics makes use of Augmented Reality techniques to successfully support users in analyzing data. When displaying ubiquitous data integrated into the everyday life, spatial immersion issues like depth perception, data localization and object relations become relevant. Although there is a variety of techniques to deal with those, they are difficult to apply if the examined data or the reference space are large and abstract. In this work, we discuss observed problems in such immersive analytics systems and the applicability of current countermeasures to identify needs for action.
{"title":"On Spatial Perception Issues In Augmented Reality Based Immersive Analytics","authors":"M. Luboschik, P. Berger, O. Staadt","doi":"10.1145/3009939.3009947","DOIUrl":"https://doi.org/10.1145/3009939.3009947","url":null,"abstract":"Beyond other domains, the field of immersive analytics makes use of Augmented Reality techniques to successfully support users in analyzing data. When displaying ubiquitous data integrated into the everyday life, spatial immersion issues like depth perception, data localization and object relations become relevant. Although there is a variety of techniques to deal with those, they are difficult to apply if the examined data or the reference space are large and abstract. In this work, we discuss observed problems in such immersive analytics systems and the applicability of current countermeasures to identify needs for action.","PeriodicalId":422627,"journal":{"name":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134320638","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Immersive computing modalities such as AR, VR, and speech-based input are regaining prominence as research threads in the visualization field due to the advancement in technology and availability of cheap consumer hardware. This renewed interest is similar to what we observed a decade ago when multitouch technology was gaining mainstream adoption. In this work, we reflect on lessons learned from designing for multitouch, with the goal of highlighting problems that may also emerge in AR/VR research. Specifically, we emphasize the need for the field to rearticulate what is expected from research efforts in the area of visualization on immersive technologies.
{"title":"Redefining a Contribution for Immersive Visualization Research","authors":"Ramik Sadana, V. Setlur, J. Stasko","doi":"10.1145/3009939.3009946","DOIUrl":"https://doi.org/10.1145/3009939.3009946","url":null,"abstract":"Immersive computing modalities such as AR, VR, and speech-based input are regaining prominence as research threads in the visualization field due to the advancement in technology and availability of cheap consumer hardware. This renewed interest is similar to what we observed a decade ago when multitouch technology was gaining mainstream adoption. In this work, we reflect on lessons learned from designing for multitouch, with the goal of highlighting problems that may also emerge in AR/VR research. Specifically, we emphasize the need for the field to rearticulate what is expected from research efforts in the area of visualization on immersive technologies.","PeriodicalId":422627,"journal":{"name":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126146587","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Seth Johnson, Bret Jackson, Bethany Tourek, Marcos Molina, A. Erdman, Daniel F. Keefe
We explore the role that immersive technologies, specifically virtual reality (VR) and hybrid 2D/3D sketch-based interfaces and visualizations, can play in analytical reasoning for medicine. Two case studies are described: (1) immersive explanations of medical procedures, and (2) immersive design of medical devices. Both tightly integrate 2D imagery and data with 3D interfaces, models, and visualizations. This is an approach we argue is likely to be particularly useful in medicine, where analytical tasks often involve relating 2D data (e.g., medical imaging) to 3D contexts (e.g., a patient's body). User feedback and observations from our interdisciplinary team indicate the utility of the approach for the current case studies as well as some shortcomings and areas for future research. This work contributes to a broader discussion of how hybrid 2D/3D interfaces may form an essential ingredient of future immersive analytics systems across a variety of domains.
{"title":"Immersive Analytics for Medicine: Hybrid 2D/3D Sketch-Based Interfaces for Annotating Medical Data and Designing Medical Devices","authors":"Seth Johnson, Bret Jackson, Bethany Tourek, Marcos Molina, A. Erdman, Daniel F. Keefe","doi":"10.1145/3009939.3009956","DOIUrl":"https://doi.org/10.1145/3009939.3009956","url":null,"abstract":"We explore the role that immersive technologies, specifically virtual reality (VR) and hybrid 2D/3D sketch-based interfaces and visualizations, can play in analytical reasoning for medicine. Two case studies are described: (1) immersive explanations of medical procedures, and (2) immersive design of medical devices. Both tightly integrate 2D imagery and data with 3D interfaces, models, and visualizations. This is an approach we argue is likely to be particularly useful in medicine, where analytical tasks often involve relating 2D data (e.g., medical imaging) to 3D contexts (e.g., a patient's body). User feedback and observations from our interdisciplinary team indicate the utility of the approach for the current case studies as well as some shortcomings and areas for future research. This work contributes to a broader discussion of how hybrid 2D/3D interfaces may form an essential ingredient of future immersive analytics systems across a variety of domains.","PeriodicalId":422627,"journal":{"name":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127519526","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Computer Aided Design (CAD) tools provide little direct support for working with multiple parallel designs. This lack of version-control has lead designers to adopt ad-hoc techniques, such as opening two files side-by-side; layering designs for comparison; copy-pasting partial solutions to merge; saving versions manually, etc. These techniques for one are rudimentary, and have limited benefits for designers when it comes to common operations on multiple designs. On one hand, design literature motivates designers to explore multiple designs in parallel for better comparison and decision-making; on the other hand, existing computational support limits such activities. Furthermore, the implications for a system capable of working with multiple parallel designs have yet to be explored. In this dissertation, I aim to identify, propose and develop parallel exploration interfaces to answer how designers can work with multiple design variations in parallel? A series of experimental studies are proposed with cyclic prototype-evaluate-feedback phases. Each phase informs the prototype development for the next phase, along with a new set of research questions.
{"title":"ParaXplore Interfaces: Parametric Interfaces for Parallel Exploration in Design","authors":"Naghmi I. Shireen","doi":"10.1145/3009939.3009941","DOIUrl":"https://doi.org/10.1145/3009939.3009941","url":null,"abstract":"Computer Aided Design (CAD) tools provide little direct support for working with multiple parallel designs. This lack of version-control has lead designers to adopt ad-hoc techniques, such as opening two files side-by-side; layering designs for comparison; copy-pasting partial solutions to merge; saving versions manually, etc. These techniques for one are rudimentary, and have limited benefits for designers when it comes to common operations on multiple designs. On one hand, design literature motivates designers to explore multiple designs in parallel for better comparison and decision-making; on the other hand, existing computational support limits such activities. Furthermore, the implications for a system capable of working with multiple parallel designs have yet to be explored. In this dissertation, I aim to identify, propose and develop parallel exploration interfaces to answer how designers can work with multiple design variations in parallel? A series of experimental studies are proposed with cyclic prototype-evaluate-feedback phases. Each phase informs the prototype development for the next phase, along with a new set of research questions.","PeriodicalId":422627,"journal":{"name":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121840600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The goal of my research is to design and develop new interactive technologies to facilitate in-clinic clinician-patient communication. While there have been a few successful communication technologies designed for specific purposes, supporting things such as planning knee surgery, communicating with deaf patients, and supporting play therapy, in general this challenge is still open. My intention is to work closely with both clinicians and patients to develop a better understanding of both their perspectives. I will leverage this understanding to developing more supportive in-clinic communication technologies. This research may help us gain a better understanding of how to characterize in-clinic communication and how to design communication technology for this setting. Therefore through this research, first, I will increase our understanding of clinician-patient communication challenges. Next, by applying this understanding, I will design, develop and study potential interactive technology prototypes to support in-clinic clinician-patient communication.
{"title":"Designing and Developing Technologies to Facilitate Clinician-Patient Communication","authors":"F. Rajabiyazdi","doi":"10.1145/3009939.3009943","DOIUrl":"https://doi.org/10.1145/3009939.3009943","url":null,"abstract":"The goal of my research is to design and develop new interactive technologies to facilitate in-clinic clinician-patient communication. While there have been a few successful communication technologies designed for specific purposes, supporting things such as planning knee surgery, communicating with deaf patients, and supporting play therapy, in general this challenge is still open. My intention is to work closely with both clinicians and patients to develop a better understanding of both their perspectives. I will leverage this understanding to developing more supportive in-clinic communication technologies. This research may help us gain a better understanding of how to characterize in-clinic communication and how to design communication technology for this setting. Therefore through this research, first, I will increase our understanding of clinician-patient communication challenges. Next, by applying this understanding, I will design, develop and study potential interactive technology prototypes to support in-clinic clinician-patient communication.","PeriodicalId":422627,"journal":{"name":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129518856","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The latest advances in head-mounted displays (HMDs) for augmented reality (AR) and mixed reality (MR) have produced commercialized devices that are gradually accepted by the public. These HMDs are generally equipped with head tracking, which provides an excellent input to explore immersive visualization and interaction techniques for various AR/MR applications. This paper explores the head tracking function on the latest Microsoft HoloLens -- where gaze is defined as the ray starting at the head location and points forward. We present a gaze-directed visualization approach to study ensembles of 2D oil spill simulations in mixed reality. Our approach allows users to place an ensemble as an image stack in a real environment and explore the ensemble with gaze tracking. The prototype system demonstrates the challenges and promising effects of gaze-based interaction in the state-of-the-art mixed reality.
{"title":"Gaze-directed Immersive Visualization of Scientific Ensembles","authors":"E. Mahfoud, Aidong Lu","doi":"10.1145/3009939.3009952","DOIUrl":"https://doi.org/10.1145/3009939.3009952","url":null,"abstract":"The latest advances in head-mounted displays (HMDs) for augmented reality (AR) and mixed reality (MR) have produced commercialized devices that are gradually accepted by the public. These HMDs are generally equipped with head tracking, which provides an excellent input to explore immersive visualization and interaction techniques for various AR/MR applications. This paper explores the head tracking function on the latest Microsoft HoloLens -- where gaze is defined as the ray starting at the head location and points forward. We present a gaze-directed visualization approach to study ensembles of 2D oil spill simulations in mixed reality. Our approach allows users to place an ensemble as an image stack in a real environment and explore the ensemble with gaze tracking. The prototype system demonstrates the challenges and promising effects of gaze-based interaction in the state-of-the-art mixed reality.","PeriodicalId":422627,"journal":{"name":"Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-11-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134153627","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}