With the increased use of smart speakers, silent speech interaction (SSI) is attracting attention. Unfortunately, traditional silent speech interaction methods require the addition of obtrusive sensors and devices around the user's face, making wearability and portability a challenge. Considering that most uses for smart speakers do not require many words, we suggest a more casual approach, TieLent, which can easily be worn between the neck and the chest. TieLent's RGB camera is set away from the user's face, presenting less interference with the user. Although TieLent's camera is not able to capture the whole mouth, when combined with our image-to-speech neural network model, it is able to generate the recognizable speech of 15 commands with an average accuracy of 94%.
{"title":"TieLent","authors":"N. Kimura, Kentaro Hayashi, J. Rekimoto","doi":"10.1145/3399715.3399852","DOIUrl":"https://doi.org/10.1145/3399715.3399852","url":null,"abstract":"With the increased use of smart speakers, silent speech interaction (SSI) is attracting attention. Unfortunately, traditional silent speech interaction methods require the addition of obtrusive sensors and devices around the user's face, making wearability and portability a challenge. Considering that most uses for smart speakers do not require many words, we suggest a more casual approach, TieLent, which can easily be worn between the neck and the chest. TieLent's RGB camera is set away from the user's face, presenting less interference with the user. Although TieLent's camera is not able to capture the whole mouth, when combined with our image-to-speech neural network model, it is able to generate the recognizable speech of 15 commands with an average accuracy of 94%.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114736375","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Carole Plasson, Dominique Cunin, Yann Laurillau, L. Nigay
This paper contributes a first comparative study of three techniques for selecting 3D objects anchored to the table in tabletop Augmented Reality (AR). The impetus for this study is that touch interaction makes more sense when the targeted objects are anchored to the table. We experimentally compare touch and a mixed (touch+mid-air) techniques with the common direct mid-air technique. The touch and mixed techniques involve a decomposition of the 3D task into a 2D task by touch on the table followed by a 1D task by touch or mid-air interaction. Results show that: (1) The touch and mixed techniques present completion times similar to the mid-air technique and are more accurate than the mid-air technique; (2) The mixed technique defines a good compromise between accuracy of touch interaction and speed of mid-air interaction.
{"title":"3D Tabletop AR: A Comparison of Mid-Air, Touch and Touch+Mid-Air Interaction","authors":"Carole Plasson, Dominique Cunin, Yann Laurillau, L. Nigay","doi":"10.1145/3399715.3399836","DOIUrl":"https://doi.org/10.1145/3399715.3399836","url":null,"abstract":"This paper contributes a first comparative study of three techniques for selecting 3D objects anchored to the table in tabletop Augmented Reality (AR). The impetus for this study is that touch interaction makes more sense when the targeted objects are anchored to the table. We experimentally compare touch and a mixed (touch+mid-air) techniques with the common direct mid-air technique. The touch and mixed techniques involve a decomposition of the 3D task into a 2D task by touch on the table followed by a 1D task by touch or mid-air interaction. Results show that: (1) The touch and mixed techniques present completion times similar to the mid-air technique and are more accurate than the mid-air technique; (2) The mixed technique defines a good compromise between accuracy of touch interaction and speed of mid-air interaction.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124735617","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This work is focused on the design of a VR application for helping actors during the training phase of a play. The project starts from the analysis of a previous work and from additional research, involving real actors, for evaluating the parameters of interest in an actor's training. These results have been used as the starting point for the design of an immersive VR application, where different interaction techniques have been designed and experimented for supporting the actors. These techniques have been applied to a case study, a play written by the well-known Italian playwright Carlo Goldoni, and tested with a group of high-school students, considering for the evaluation a set of variables which are meaningful for VR experiences and for learning.
{"title":"Design and evaluation of an educational virtual reality application for learning how to perform on a stage","authors":"Fabio Pittarello, Veronica Pagini, Leonardo Zuffellato","doi":"10.1145/3399715.3399919","DOIUrl":"https://doi.org/10.1145/3399715.3399919","url":null,"abstract":"This work is focused on the design of a VR application for helping actors during the training phase of a play. The project starts from the analysis of a previous work and from additional research, involving real actors, for evaluating the parameters of interest in an actor's training. These results have been used as the starting point for the design of an immersive VR application, where different interaction techniques have been designed and experimented for supporting the actors. These techniques have been applied to a case study, a play written by the well-known Italian playwright Carlo Goldoni, and tested with a group of high-school students, considering for the evaluation a set of variables which are meaningful for VR experiences and for learning.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126062499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Melonio, Mehdi Rizvi, Eftychia Roumelioti, A. D. Angeli, R. Gennari, M. Matera
Children's role in the design of new technology has been widely investigated. Recently, the research focus has shifted, from the technology they help create, towards what children gain by participating in design workshops. This paper intercepts this line of research. It reports on a design workshop with 27 children, aged from 11 to 14 years old, ideating, programming and prototyping smart objects for their town park. Data were gathered in relation to children's beliefs, before and after the workshop, and in relation to their understanding of design, after the workshop. The analysis of the gathered data suggests that the workshop positively affected children's beliefs and understanding of design, giving indications for future work concerning design as means of empowerment.
{"title":"Children's Beliefs and Understanding of Smart Objects: An Exploratory Study","authors":"A. Melonio, Mehdi Rizvi, Eftychia Roumelioti, A. D. Angeli, R. Gennari, M. Matera","doi":"10.1145/3399715.3399828","DOIUrl":"https://doi.org/10.1145/3399715.3399828","url":null,"abstract":"Children's role in the design of new technology has been widely investigated. Recently, the research focus has shifted, from the technology they help create, towards what children gain by participating in design workshops. This paper intercepts this line of research. It reports on a design workshop with 27 children, aged from 11 to 14 years old, ideating, programming and prototyping smart objects for their town park. Data were gathered in relation to children's beliefs, before and after the workshop, and in relation to their understanding of design, after the workshop. The analysis of the gathered data suggests that the workshop positively affected children's beliefs and understanding of design, giving indications for future work concerning design as means of empowerment.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126525975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hoorieh Afkari, V. Maquil, Béatrice Arend, Svenja Heuser, Patrick Sunnen
The design space of tangible and multi-touch tabletop interfaces is complex, and little is known about how the different characteristics of tangible and multi-touch interactive features affect collaboration strategies. With this work, we report on five different features designed for an interactive tabletop application to support collaborative problem-solving. We present the design details and describe preliminary results obtained from a user study with 15 participants.
{"title":"Designing different features of an interactive tabletop application to support collaborative problem-solving","authors":"Hoorieh Afkari, V. Maquil, Béatrice Arend, Svenja Heuser, Patrick Sunnen","doi":"10.1145/3399715.3399953","DOIUrl":"https://doi.org/10.1145/3399715.3399953","url":null,"abstract":"The design space of tangible and multi-touch tabletop interfaces is complex, and little is known about how the different characteristics of tangible and multi-touch interactive features affect collaboration strategies. With this work, we report on five different features designed for an interactive tabletop application to support collaborative problem-solving. We present the design details and describe preliminary results obtained from a user study with 15 participants.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121736537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The overall scope and goal of the workshop is to bring together researchers active in the areas of Artificial Intelligence (AI), Big Data Analysis, and Visualization to achieve a road map, which can support the acceleration in research and data science activities by means of transforming, enriching, and deploying AI models and algorithms as well as intelligent advanced visual user interfaces supporting creation, configuration, management, and usage of distributed Big Data Analysis. Big Data Analysis and AI mutually support each other: AI-powered algorithms empower data scientists to analyze Big Data and thereby exploit its full potential whereas Big Data enables AI experts to comfortably design, validate, and deploy AI models. One of the workshop's objectives is the examination of the importance and necessity of a third, a more straightforward relationship of Big Data and AI: AI supporting all user stereotypes and organizations involved in Big Data Analysis on their exploration journey from raw input data to insight and effectuation.
{"title":"Big Data Analysis, AI, and Visualization Workshop: Road Mapping Infrastructures for Artificial Intelligence Supporting Advanced Visual Big Data Analysis","authors":"Thoralf Reis, M. X. Bornschlegl, M. Hemmje","doi":"10.1145/3399715.3400860","DOIUrl":"https://doi.org/10.1145/3399715.3400860","url":null,"abstract":"The overall scope and goal of the workshop is to bring together researchers active in the areas of Artificial Intelligence (AI), Big Data Analysis, and Visualization to achieve a road map, which can support the acceleration in research and data science activities by means of transforming, enriching, and deploying AI models and algorithms as well as intelligent advanced visual user interfaces supporting creation, configuration, management, and usage of distributed Big Data Analysis. Big Data Analysis and AI mutually support each other: AI-powered algorithms empower data scientists to analyze Big Data and thereby exploit its full potential whereas Big Data enables AI experts to comfortably design, validate, and deploy AI models. One of the workshop's objectives is the examination of the importance and necessity of a third, a more straightforward relationship of Big Data and AI: AI supporting all user stereotypes and organizations involved in Big Data Analysis on their exploration journey from raw input data to insight and effectuation.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123283933","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mandy Keck, D. Kammer, Alfredo Ferreira, Andrea Giachetti, Rainer Groh
Currently, both understanding and developing interactive visual interfaces become ever more challenging, since different visual solutions exist that involve large interdisciplinary teams and deal with massive amounts of data, a wide range of interaction techniques, and domain-specific aspects. At the same time, traditional design methods become obsolete with more and more resources and knowledge that needs to be acquired. The proposed workshop provides a forum for discussing experimental and theoretical techniques, frameworks, and prototyping methods to design visual interfaces in different domains such as data visualization, tangible and embedded interaction, extended and mixed reality, multi-modal interfaces, and others.
{"title":"VIDEM 2020: Workshop on Visual Interface Design Methods","authors":"Mandy Keck, D. Kammer, Alfredo Ferreira, Andrea Giachetti, Rainer Groh","doi":"10.1145/3399715.3400863","DOIUrl":"https://doi.org/10.1145/3399715.3400863","url":null,"abstract":"Currently, both understanding and developing interactive visual interfaces become ever more challenging, since different visual solutions exist that involve large interdisciplinary teams and deal with massive amounts of data, a wide range of interaction techniques, and domain-specific aspects. At the same time, traditional design methods become obsolete with more and more resources and knowledge that needs to be acquired. The proposed workshop provides a forum for discussing experimental and theoretical techniques, frameworks, and prototyping methods to design visual interfaces in different domains such as data visualization, tangible and embedded interaction, extended and mixed reality, multi-modal interfaces, and others.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123552767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Target expansion techniques facilitate pointing by enlarging the effective sizes of targets. As opposed to the numerous studies on target expansion solely focusing on optimizing pointing, we study the compound task of pointing at a Point of Interest (POI) and then interacting with the POI menu in handheld Augmented Reality (AR). A POI menu in AR has a fixed position because it contains relevant information about its location in the real world. We present two techniques that make the cursor jump to the closest opened POI menu after pointing at a POI. Our experimental results show that 1) for selecting a POI the expansion techniques are 31 % faster than the baseline screen-centered crosshair pointing technique, 2) the expansion techniques with/without a jumping cursor to the closest opened POI menu offer similar performances and 3) Touch relative pointing is preferred by participants because it minimizes physical movements.
{"title":"Target Expansion in Context: the Case of Menu in Handheld Augmented Reality","authors":"P. Perea, D. Morand, L. Nigay","doi":"10.1145/3399715.3399851","DOIUrl":"https://doi.org/10.1145/3399715.3399851","url":null,"abstract":"Target expansion techniques facilitate pointing by enlarging the effective sizes of targets. As opposed to the numerous studies on target expansion solely focusing on optimizing pointing, we study the compound task of pointing at a Point of Interest (POI) and then interacting with the POI menu in handheld Augmented Reality (AR). A POI menu in AR has a fixed position because it contains relevant information about its location in the real world. We present two techniques that make the cursor jump to the closest opened POI menu after pointing at a POI. Our experimental results show that 1) for selecting a POI the expansion techniques are 31 % faster than the baseline screen-centered crosshair pointing technique, 2) the expansion techniques with/without a jumping cursor to the closest opened POI menu offer similar performances and 3) Touch relative pointing is preferred by participants because it minimizes physical movements.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130643146","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Within the Industry 4.0 context, a great number of machineries has been equipped with multiple sensors collecting vast amounts of heterogeneous data, including multimedia ones. In the context of high-precision industrial manufacturing, the output of these sensors can be exploited to leverage on human intelligence for monitoring the quality of the production. Nevertheless, in complex scenarios, the amount of sensed data could lead to a visual and acoustic overload for the Decision Maker. In this poster we propose a multi-modal user interface (UI) we devised to support the Decision Maker in monitoring the outcome of high-precision manufacturing machineries. In particular, to mitigate the acoustic and visual overloads, we propose the use of the haptic channel, both to control the playback of the collected data stream, and to get feedbacks about anomalous situations.
{"title":"An Haptic Interface for Industrial High-Precision Manufacturing Tasks","authors":"S. Martino, Vincenzo Norman Vitale","doi":"10.1145/3399715.3399952","DOIUrl":"https://doi.org/10.1145/3399715.3399952","url":null,"abstract":"Within the Industry 4.0 context, a great number of machineries has been equipped with multiple sensors collecting vast amounts of heterogeneous data, including multimedia ones. In the context of high-precision industrial manufacturing, the output of these sensors can be exploited to leverage on human intelligence for monitoring the quality of the production. Nevertheless, in complex scenarios, the amount of sensed data could lead to a visual and acoustic overload for the Decision Maker. In this poster we propose a multi-modal user interface (UI) we devised to support the Decision Maker in monitoring the outcome of high-precision manufacturing machineries. In particular, to mitigate the acoustic and visual overloads, we propose the use of the haptic channel, both to control the playback of the collected data stream, and to get feedbacks about anomalous situations.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134488661","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Reona Nagafuchi, Yasushi Matoba, Kaori Ikematsu, Ayaka Ishii, Y. Kawahara, I. Siio
We propose a method for controlling a device that draws letters and illustrations on large, flat surfaces. Similarly to conventional inkjet printers, the device ejects a volume of water from its nozzle, with the water droplets then forming dots on surfaces such as soil, concrete, and sand. Both the direction of the nozzle and the water pressure can be controlled to enable the device to draw arbitrary two-dimensional patterns within a semicircular region with a radius of six meters. The device can draw letters and illustrations. We have investigated the pressure, the shape of the nozzle, and droplet size in order to avoid further division of the droplets into even smaller droplets while traversing the air. In this paper, we introduce the mechanism of this device and demonstrate how a user can take advantage of this new drawing tool.
{"title":"Polka: A Water-jet Printer for Painting on the Grounds","authors":"Reona Nagafuchi, Yasushi Matoba, Kaori Ikematsu, Ayaka Ishii, Y. Kawahara, I. Siio","doi":"10.1145/3399715.3399817","DOIUrl":"https://doi.org/10.1145/3399715.3399817","url":null,"abstract":"We propose a method for controlling a device that draws letters and illustrations on large, flat surfaces. Similarly to conventional inkjet printers, the device ejects a volume of water from its nozzle, with the water droplets then forming dots on surfaces such as soil, concrete, and sand. Both the direction of the nozzle and the water pressure can be controlled to enable the device to draw arbitrary two-dimensional patterns within a semicircular region with a radius of six meters. The device can draw letters and illustrations. We have investigated the pressure, the shape of the nozzle, and droplet size in order to avoid further division of the droplets into even smaller droplets while traversing the air. In this paper, we introduce the mechanism of this device and demonstrate how a user can take advantage of this new drawing tool.","PeriodicalId":149902,"journal":{"name":"Proceedings of the International Conference on Advanced Visual Interfaces","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2020-09-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134509748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：