首页 > 最新文献

Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference最新文献

英文 中文
Activity Segmentation and Identification based on Eye Gaze Features 基于眼球注视特征的活动分割和识别
S. Amrouche, Benedikt Gollan, A. Ferscha, Josef Heftberger
In coherence with the ongoing digitalization of production processes, Human Computer Interaction (HCI) technologies have evolved rapidly in industrial applications, providing abundant numbers of the versatile tracking and monitoring devices suitable to address complex challenges. This paper focuses on Activity Segmentation and Activity Identification as one of the most crucial challenges in pervasive computing, applying only visual attention features captured through mobile eye-tracking sensors. We propose a novel, application-independent approach towards segmentation of task executions in semi-manual industrial assembly setup via exploiting the expressive properties of the distribution-based gaze feature Nearest Neighbor Index (NNI) to build a dynamic activity segmentation algorithm. The proposed approach is enriched with a machine learning validation model acting as a feedback loop to classify segments qualities. The approach is evaluated in an alpine ski assembly scenario with real-world data reaching an overall of 91% detection accuracy.
随着生产流程的不断数字化,人机交互(HCI)技术在工业应用领域发展迅速,提供了大量适用于应对复杂挑战的多功能跟踪和监控设备。作为普适计算领域最关键的挑战之一,本文重点关注活动分割和活动识别,仅应用通过移动眼动跟踪传感器捕获的视觉注意力特征。我们提出了一种新颖的、与应用无关的方法,通过利用基于分布的注视特征近邻索引(NNI)的表达特性来构建动态活动分割算法,从而对半手工工业装配设置中的任务执行进行分割。所提出的方法通过一个机器学习验证模型作为反馈回路,对片段质量进行分类。该方法在高山滑雪装配场景中使用真实世界的数据进行了评估,总体检测准确率达到 91%。
{"title":"Activity Segmentation and Identification based on Eye Gaze Features","authors":"S. Amrouche, Benedikt Gollan, A. Ferscha, Josef Heftberger","doi":"10.1145/3197768.3197775","DOIUrl":"https://doi.org/10.1145/3197768.3197775","url":null,"abstract":"In coherence with the ongoing digitalization of production processes, Human Computer Interaction (HCI) technologies have evolved rapidly in industrial applications, providing abundant numbers of the versatile tracking and monitoring devices suitable to address complex challenges. This paper focuses on Activity Segmentation and Activity Identification as one of the most crucial challenges in pervasive computing, applying only visual attention features captured through mobile eye-tracking sensors. We propose a novel, application-independent approach towards segmentation of task executions in semi-manual industrial assembly setup via exploiting the expressive properties of the distribution-based gaze feature Nearest Neighbor Index (NNI) to build a dynamic activity segmentation algorithm. The proposed approach is enriched with a machine learning validation model acting as a feedback loop to classify segments qualities. The approach is evaluated in an alpine ski assembly scenario with real-world data reaching an overall of 91% detection accuracy.","PeriodicalId":130190,"journal":{"name":"Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference","volume":"207 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126143178","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Touchless heart rate Recognition by Robots to support natural Human-Robot Communication 机器人的非接触式心率识别,支持自然的人机交流
G. Bieber, Niklas Antony, Marian Haescher
With the proliferation of robotic assistants, such as robot vacuum cleaners, telepresence robots, or shopping assistance robots, human-robot interaction becomes increasingly more natural. The capabilities of robots are expanding, which leads to an increasing need for a natural human-robot communication and interaction. Therefore, the modalities of text- or speech-based communication have to be extended by body language and a direct feedback such as emotion or non-verbal communication. In this paper, we present a camera-based, non-body contact optical heart rate recognition method that can be used in robots in order to identify humans' reactions during a robot-human communication or interaction. For the purpose of heart rate and heart rate variability detection, we used standard cameras (webcams) that are located inside the robot's eye. Although camera-based vital sign identification has been discussed in previous research, we noticed that certain limitations with regard to real-world applications do still exist. We identified artificial light sources as one of the main influencing factors. Therefore, we propose strategies with the aim Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from of improving natural communication between social robots and humans.
随着机器人助手的激增,如机器人吸尘器、远程呈现机器人或购物辅助机器人,人机交互变得越来越自然。机器人的功能正在不断扩展,这导致对自然的人机交流和交互的需求日益增加。因此,以文本或语音为基础的交流方式必须通过肢体语言和直接反馈(如情感或非语言交流)来扩展。在本文中,我们提出了一种基于相机的非身体接触光学心率识别方法,该方法可用于机器人,以识别人类在机器人与人类交流或互动期间的反应。为了检测心率和心率变异性,我们使用了位于机器人眼睛内部的标准摄像头(网络摄像头)。尽管基于摄像头的生命体征识别已经在之前的研究中进行了讨论,但我们注意到,在实际应用中仍然存在某些局限性。我们确定人工光源是主要的影响因素之一。因此,我们提出的策略是这样的:允许免费制作本作品的全部或部分数字或硬拷贝供个人或课堂使用,前提是副本不是为了盈利或商业利益而制作或分发的,并且副本在第一页上带有本通知和完整的引用。本作品的版权由作者以外的人所有,必须得到尊重。允许有信用的摘要。以其他方式复制或重新发布,在服务器上发布或重新分发到列表,需要事先获得特定许可和/或付费。请求许可,以改善社交机器人与人类之间的自然交流。
{"title":"Touchless heart rate Recognition by Robots to support natural Human-Robot Communication","authors":"G. Bieber, Niklas Antony, Marian Haescher","doi":"10.1145/3197768.3203181","DOIUrl":"https://doi.org/10.1145/3197768.3203181","url":null,"abstract":"With the proliferation of robotic assistants, such as robot vacuum cleaners, telepresence robots, or shopping assistance robots, human-robot interaction becomes increasingly more natural. The capabilities of robots are expanding, which leads to an increasing need for a natural human-robot communication and interaction. Therefore, the modalities of text- or speech-based communication have to be extended by body language and a direct feedback such as emotion or non-verbal communication. In this paper, we present a camera-based, non-body contact optical heart rate recognition method that can be used in robots in order to identify humans' reactions during a robot-human communication or interaction. For the purpose of heart rate and heart rate variability detection, we used standard cameras (webcams) that are located inside the robot's eye. Although camera-based vital sign identification has been discussed in previous research, we noticed that certain limitations with regard to real-world applications do still exist. We identified artificial light sources as one of the main influencing factors. Therefore, we propose strategies with the aim Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from of improving natural communication between social robots and humans.","PeriodicalId":130190,"journal":{"name":"Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference","volume":"230 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123159869","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Two examples of online eHealth platforms for supporting people living with cognitive impairments and their caregivers 支持认知障碍患者及其照护者的在线电子保健平台的两个例子
V. Solachidis, I. Paliokas, N. Vretos, K. Votis, U. Cortés, D. Tzovaras
This paper compares two methodological approaches derived from the EU Horizon 2020 funded projects CAREGIVERSPROMMD (C-MMD)1 and ICT4LIFE2. Both approaches were initiated in 2016 with the ambition to provide new integrated care services to people living with cognitive impairments, including Dementia, Alzheimer and Parkinson disease, as well as to their home caregivers towards a long-term increase in quality of life and autonomy at home. An outline of the disparities and similarities related to non-pharmacological interventions introduced by the two projects to foster treatment adherence was made. Both approaches have developed software solutions, including social platforms, notifications, Serious Games, user monitoring and support services aimed at developing the concepts of self-care, active patients and integrated care. Besides their differences, both projects can be benefited by knowledge and technology exchange, pilot results sharing and possible user's exchange if possible in the near future.
本文比较了来自欧盟地平线2020资助项目CAREGIVERSPROMMD (C-MMD)1和ICT4LIFE2的两种方法。这两种方法都于2016年启动,旨在为患有认知障碍的人(包括痴呆症、阿尔茨海默病和帕金森病)以及他们的家庭护理人员提供新的综合护理服务,以长期提高生活质量和家庭自主权。概述了两个项目为促进治疗依从性而引入的非药物干预措施的差异和相似之处。这两种方法都开发了软件解决方案,包括社交平台、通知、严肃游戏、用户监控和支持服务,旨在发展自我护理、积极患者和综合护理的概念。除了它们之间的差异,在不久的将来,如果可能的话,两个项目都可以通过知识和技术交流、试点成果分享和可能的用户交流而受益。
{"title":"Two examples of online eHealth platforms for supporting people living with cognitive impairments and their caregivers","authors":"V. Solachidis, I. Paliokas, N. Vretos, K. Votis, U. Cortés, D. Tzovaras","doi":"10.1145/3197768.3201556","DOIUrl":"https://doi.org/10.1145/3197768.3201556","url":null,"abstract":"This paper compares two methodological approaches derived from the EU Horizon 2020 funded projects CAREGIVERSPROMMD (C-MMD)1 and ICT4LIFE2. Both approaches were initiated in 2016 with the ambition to provide new integrated care services to people living with cognitive impairments, including Dementia, Alzheimer and Parkinson disease, as well as to their home caregivers towards a long-term increase in quality of life and autonomy at home. An outline of the disparities and similarities related to non-pharmacological interventions introduced by the two projects to foster treatment adherence was made. Both approaches have developed software solutions, including social platforms, notifications, Serious Games, user monitoring and support services aimed at developing the concepts of self-care, active patients and integrated care. Besides their differences, both projects can be benefited by knowledge and technology exchange, pilot results sharing and possible user's exchange if possible in the near future.","PeriodicalId":130190,"journal":{"name":"Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference","volume":"14 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131525665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Insights into the Introduction of Digital Interventions at the shop floor 在车间引入数字干预的见解
Marlene Schafler, F. J. Lacueva-Pérez, L. Hannola, Stelios Damalas, Jan Nierhoff, Thomas Herrmann
It is well-known that the introduction of innovative digital tools in manufacturing due to Industry 4.0 has far-reaching effects on an organizational and on an individual level. The H2020 funded project FACTS4WORKERS - Worker-Centric Workplaces in Smart Factories - aims to develop user-centered assistance systems in order to demonstrate their impact and applicability at the shop floor. To do so it is important to understand how to develop such tools and how to assess if advantages can be derived from the created ICT system. This study introduces the technology of a workplace solution that is linked to a specific industrial challenge. Subsequently, a 2-stepped approach to evaluate the presented system is discussed. Heuristics, which are an output of project "Heuristics for Industry 4.0" are used to test if the developed solution covers critical aspects of socio-technical system design. Insights into the design, development and holistic evaluation of digital tools at the shop floor should be shown.
众所周知,由于工业4.0在制造业中引入了创新的数字工具,对组织和个人层面都产生了深远的影响。H2020资助的项目FACTS4WORKERS——智能工厂中以工人为中心的工作场所——旨在开发以用户为中心的辅助系统,以展示其在车间的影响和适用性。要做到这一点,重要的是要了解如何开发这些工具,以及如何评估是否可以从创建的信息和通信技术系统中获得优势。本研究介绍了与特定工业挑战相关的工作场所解决方案的技术。随后,讨论了一种两步法来评估所提出的系统。启发式是“工业4.0启发式”项目的输出,用于测试开发的解决方案是否涵盖了社会技术系统设计的关键方面。应该展示对车间数字工具的设计、开发和整体评估的见解。
{"title":"Insights into the Introduction of Digital Interventions at the shop floor","authors":"Marlene Schafler, F. J. Lacueva-Pérez, L. Hannola, Stelios Damalas, Jan Nierhoff, Thomas Herrmann","doi":"10.1145/3197768.3203176","DOIUrl":"https://doi.org/10.1145/3197768.3203176","url":null,"abstract":"It is well-known that the introduction of innovative digital tools in manufacturing due to Industry 4.0 has far-reaching effects on an organizational and on an individual level. The H2020 funded project FACTS4WORKERS - Worker-Centric Workplaces in Smart Factories - aims to develop user-centered assistance systems in order to demonstrate their impact and applicability at the shop floor. To do so it is important to understand how to develop such tools and how to assess if advantages can be derived from the created ICT system. This study introduces the technology of a workplace solution that is linked to a specific industrial challenge. Subsequently, a 2-stepped approach to evaluate the presented system is discussed. Heuristics, which are an output of project \"Heuristics for Industry 4.0\" are used to test if the developed solution covers critical aspects of socio-technical system design. Insights into the design, development and holistic evaluation of digital tools at the shop floor should be shown.","PeriodicalId":130190,"journal":{"name":"Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125548557","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
v-CAT: A Cyberlearning Framework for Personalized Cognitive Skill Assessment and Training v-CAT:个性化认知技能评估和培训的网络学习框架
Michalis Papakostas, K. Tsiakas, M. Abujelala, M. Bell, F. Makedon
Recent research has shown that hundreds of millions of workers worldwide may lose their jobs to robots and automation by 2030, impacting over 40 developed and emerging countries and affecting more than 800 types of jobs. While automation promises to increase productivity and relieve workers from tedious or heavy-duty tasks, it can also widen the gap, leaving behind workers who lack automation training. In this project, we propose to build a technologically based, personalized vocational cyberlearning training system, where the user is assessed while immersed in a simulated workplace/factory task environment, and the system collecting and analyzing multisensory cognitive, behavioral and physiological data. Such a system, will produce recommendations to support targeted vocational training decision-making. The focus is on collecting and analyzing specific neurocognitive functions that include, working memory, attention, cognitive overload and cognitive flexibility. Collected data are analyzed to reveal, in iterative fashion, relationships between physiological and cognitive performance metrics, and how these relate to work-related behavioral patterns that require special vocational training.
最近的研究表明,到2030年,全球数亿工人可能会因机器人和自动化而失去工作,影响40多个发达国家和新兴国家,影响800多种工作岗位。虽然自动化有望提高生产率,并将工人从繁琐或繁重的任务中解脱出来,但它也可能扩大差距,留下缺乏自动化培训的工人。在这个项目中,我们建议建立一个基于技术的、个性化的职业网络学习培训系统,在该系统中,用户沉浸在模拟的工作场所/工厂任务环境中进行评估,系统收集和分析多感官认知、行为和生理数据。这一系统将提出建议,以支持有针对性的职业培训决策。重点是收集和分析特定的神经认知功能,包括工作记忆、注意力、认知过载和认知灵活性。对收集到的数据进行分析,以迭代的方式揭示生理和认知表现指标之间的关系,以及这些指标与需要特殊职业培训的工作行为模式之间的关系。
{"title":"v-CAT: A Cyberlearning Framework for Personalized Cognitive Skill Assessment and Training","authors":"Michalis Papakostas, K. Tsiakas, M. Abujelala, M. Bell, F. Makedon","doi":"10.1145/3197768.3201545","DOIUrl":"https://doi.org/10.1145/3197768.3201545","url":null,"abstract":"Recent research has shown that hundreds of millions of workers worldwide may lose their jobs to robots and automation by 2030, impacting over 40 developed and emerging countries and affecting more than 800 types of jobs. While automation promises to increase productivity and relieve workers from tedious or heavy-duty tasks, it can also widen the gap, leaving behind workers who lack automation training. In this project, we propose to build a technologically based, personalized vocational cyberlearning training system, where the user is assessed while immersed in a simulated workplace/factory task environment, and the system collecting and analyzing multisensory cognitive, behavioral and physiological data. Such a system, will produce recommendations to support targeted vocational training decision-making. The focus is on collecting and analyzing specific neurocognitive functions that include, working memory, attention, cognitive overload and cognitive flexibility. Collected data are analyzed to reveal, in iterative fashion, relationships between physiological and cognitive performance metrics, and how these relate to work-related behavioral patterns that require special vocational training.","PeriodicalId":130190,"journal":{"name":"Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference","volume":"82 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125692940","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Tactile sheets: using engraved paper overlays to facilitate access to a digital document's layout and logical structure 触觉页:使用雕刻纸覆盖,以方便访问数字文档的布局和逻辑结构
M. Avila, Francisco Kiss, Ismael Rodríguez, A. Schmidt, Tonja Machulla
Touchscreen devices (e.g., smartphones, tablets) are a major means of accessing digital resources. However, touchscreen accessibility remains a challenge for users with visual impairments. Mainstream solutions implicitly favor a sequential navigation of digital information. This precludes users from enjoying the advantages of well laid-out, visually-structured documents, especially for certain tasks (e.g., text navigation). In this paper, we introduce tactile sheets---engraved paper sheets that represent the layout of a specific page and that are used as an overlay on a capacitive touchscreen device. Via engraved tactile patterns and textures, users can locate and discriminate different content areas, navigate the spatially-distributed content non-sequentially and access speech feedback with gestures. We report a comparative study with nine visually-impaired users that investigates the technical feasibility and the usability of this approach. Specifically, we compared a mainstream screen reader and two different types of tactile sheets. A similar level of usability is achieved between conditions. Also, participants' qualitative feedback provides strong arguments for the use of tactile pattern overlays. Finally, we introduce a processing pipeline for automatically create tactile sheets based on an existing e-book.
触屏设备(如智能手机、平板电脑)是访问数字资源的主要手段。然而,对于有视觉障碍的用户来说,触摸屏的可访问性仍然是一个挑战。主流解决方案隐含地支持数字信息的顺序导航。这妨碍了用户享受布局良好、可视化结构的文档的优势,特别是对于某些任务(例如,文本导航)。在本文中,我们介绍了触觉片-代表特定页面布局的雕刻纸片,并用作电容触摸屏设备上的覆盖层。通过雕刻的触觉图案和纹理,用户可以定位和区分不同的内容区域,无顺序地浏览空间分布的内容,并通过手势获得语音反馈。我们报告了与九个视障用户的比较研究,调查了这种方法的技术可行性和可用性。具体来说,我们比较了一种主流的屏幕阅读器和两种不同类型的触觉板。两个条件之间的可用性达到了类似的水平。此外,参与者的定性反馈为使用触觉模式叠加提供了强有力的论据。最后,我们介绍了一个基于现有电子书自动创建触觉页的处理流水线。
{"title":"Tactile sheets: using engraved paper overlays to facilitate access to a digital document's layout and logical structure","authors":"M. Avila, Francisco Kiss, Ismael Rodríguez, A. Schmidt, Tonja Machulla","doi":"10.1145/3197768.3201530","DOIUrl":"https://doi.org/10.1145/3197768.3201530","url":null,"abstract":"Touchscreen devices (e.g., smartphones, tablets) are a major means of accessing digital resources. However, touchscreen accessibility remains a challenge for users with visual impairments. Mainstream solutions implicitly favor a sequential navigation of digital information. This precludes users from enjoying the advantages of well laid-out, visually-structured documents, especially for certain tasks (e.g., text navigation). In this paper, we introduce tactile sheets---engraved paper sheets that represent the layout of a specific page and that are used as an overlay on a capacitive touchscreen device. Via engraved tactile patterns and textures, users can locate and discriminate different content areas, navigate the spatially-distributed content non-sequentially and access speech feedback with gestures. We report a comparative study with nine visually-impaired users that investigates the technical feasibility and the usability of this approach. Specifically, we compared a mainstream screen reader and two different types of tactile sheets. A similar level of usability is achieved between conditions. Also, participants' qualitative feedback provides strong arguments for the use of tactile pattern overlays. Finally, we introduce a processing pipeline for automatically create tactile sheets based on an existing e-book.","PeriodicalId":130190,"journal":{"name":"Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128884902","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Smart Tourism in Cities: Exploring Urban Destinations with Audio Augmented Reality 城市中的智慧旅游:利用音频增强现实探索城市目的地
Costas Boletsis, Dimitra Chasanidou
Audio augmented reality (AR) allows for the simultaneous perception of the real environment and a virtual audio overlay. This is especially important in a mobile use context, where users should be continuously aware of their surroundings, such as in the case of urban tourism, when tourists explore foreign cities and their tourist sights. In this work, we investigate the design and implementation of audio AR systems in urban tourism. Our prototype, called AudioNear, is designed to support tourists' exploration of open, urban environments while providing speech-based information about surrounding tourist sights, based on the users' location. At this stage, we present the design concept of AudioNear, its hardware implementation and the first usability feedback. Overall, the study indicated the promising potential of audio AR for providing informative tourist services and engaging experiences.
音频增强现实(AR)允许同时感知真实环境和虚拟音频覆盖。这在移动使用环境中尤其重要,因为用户应该持续了解周围环境,例如在城市旅游中,当游客探索外国城市及其旅游景点时。在这项工作中,我们研究了城市旅游中音频AR系统的设计和实现。我们的原型名为AudioNear,旨在支持游客探索开放的城市环境,同时根据用户的位置提供有关周围旅游景点的语音信息。在这个阶段,我们提出了AudioNear的设计概念,它的硬件实现和第一个可用性反馈。总体而言,该研究表明,音频增强现实在提供信息丰富的旅游服务和吸引人的体验方面具有很大的潜力。
{"title":"Smart Tourism in Cities: Exploring Urban Destinations with Audio Augmented Reality","authors":"Costas Boletsis, Dimitra Chasanidou","doi":"10.1145/3197768.3201549","DOIUrl":"https://doi.org/10.1145/3197768.3201549","url":null,"abstract":"Audio augmented reality (AR) allows for the simultaneous perception of the real environment and a virtual audio overlay. This is especially important in a mobile use context, where users should be continuously aware of their surroundings, such as in the case of urban tourism, when tourists explore foreign cities and their tourist sights. In this work, we investigate the design and implementation of audio AR systems in urban tourism. Our prototype, called AudioNear, is designed to support tourists' exploration of open, urban environments while providing speech-based information about surrounding tourist sights, based on the users' location. At this stage, we present the design concept of AudioNear, its hardware implementation and the first usability feedback. Overall, the study indicated the promising potential of audio AR for providing informative tourist services and engaging experiences.","PeriodicalId":130190,"journal":{"name":"Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference","volume":"58 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131112761","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 27
Visually Perceived Relevance of Objects reveals Learning Improvements and Task Difficulty 物体视觉感知相关性揭示学习进步和任务难度
Michael Haslgrübler, Florian Jungwirth, Michaela Murauer, A. Ferscha
Recently, there has been increased interest in eye tracking and eye-based human-computer interaction research, as gaze reveals attention and intention information, making it highly interesting as an input modality for cognitive assistant systems. In this paper, we present how to apply gaze-awareness in an industrial environment to create such a cognitive assistant system. A prototypical system was built upon a mobile eye tracker, that analyses the user's field of view, to recognize possible objects of interest, while simultaneously checking for gaze fixations. A twenty-one participants user study was carried out, which builds upon established hypothesis of a correlation between eye fixations and the relevance of objects and additionally shows that this relationship changes over multiple tasks and runs, revealing learning improvements and task difficulty. Both features are vital for a reduction of amount of the support an assistance system provides towards its users, resulting in an overall better user experience.
近年来,人们对眼动追踪和基于眼睛的人机交互研究越来越感兴趣,因为凝视揭示了注意力和意图信息,使其成为认知辅助系统的一种输入方式。在本文中,我们提出了如何在工业环境中应用凝视感知来创建这样一个认知辅助系统。一个原型系统建立在一个移动眼动仪上,分析用户的视野,识别可能感兴趣的物体,同时检查凝视。我们对21名参与者进行了一项用户研究,该研究建立在注视与物体相关性之间的既定假设的基础上,并进一步表明这种关系在多个任务和运行中发生变化,揭示了学习的改进和任务的难度。这两个功能对于减少辅助系统向用户提供的支持量至关重要,从而产生更好的整体用户体验。
{"title":"Visually Perceived Relevance of Objects reveals Learning Improvements and Task Difficulty","authors":"Michael Haslgrübler, Florian Jungwirth, Michaela Murauer, A. Ferscha","doi":"10.1145/3197768.3201520","DOIUrl":"https://doi.org/10.1145/3197768.3201520","url":null,"abstract":"Recently, there has been increased interest in eye tracking and eye-based human-computer interaction research, as gaze reveals attention and intention information, making it highly interesting as an input modality for cognitive assistant systems. In this paper, we present how to apply gaze-awareness in an industrial environment to create such a cognitive assistant system. A prototypical system was built upon a mobile eye tracker, that analyses the user's field of view, to recognize possible objects of interest, while simultaneously checking for gaze fixations. A twenty-one participants user study was carried out, which builds upon established hypothesis of a correlation between eye fixations and the relevance of objects and additionally shows that this relationship changes over multiple tasks and runs, revealing learning improvements and task difficulty. Both features are vital for a reduction of amount of the support an assistance system provides towards its users, resulting in an overall better user experience.","PeriodicalId":130190,"journal":{"name":"Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131962674","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Design Thinking: Using Photo Prototyping for a user-centered Interface Design for Pick-by-Vision Systems 设计思维:使用照片原型设计以用户为中心的视觉拾取系统界面设计
Nela Murauer
With Industry 4.0 manufacturing facilities experience a dynamic change towards smart factories. Digitalization of processes accompanied by extensive data acquisition enables process planners to utilize innovative technologies like Augmented Reality (AR) to support employees in their tasks on the shop floor. Among others a visualization in the user's field of view allows hands-free work and avoids unnecessary head movements. To make use of the employee's expertise, we try to involve workers with the aid of Design Thinking at an early stage in the AR-interface design process. A pervasive method in app design is Paper Prototyping. Early sketches of user interfaces serve as common language in interdisciplinary teams. In this paper we develop a method based on Paper Prototyping especially for AR content needs, which is called Photo Prototyping. This method overlays the user's field of view with sketches of the future AR-content. Furthermore we elucidate our experience, we've gained during a workshop with 40 workers out of logistics in the automotive industry.
随着工业4.0的发展,制造设施经历了智能工厂的动态变化。伴随着广泛数据采集的流程数字化使流程规划者能够利用增强现实(AR)等创新技术来支持员工在车间完成任务。除此之外,用户视野的可视化允许免提工作,避免不必要的头部运动。为了利用员工的专业知识,我们试图在ar界面设计过程的早期阶段让员工参与设计思维的帮助。在应用设计中,纸上原型是一种普遍的方法。用户界面的早期草图是跨学科团队的共同语言。在本文中,我们开发了一种基于纸原型的方法,特别针对AR内容的需求,称为照片原型。这种方法用未来ar内容的草图覆盖用户的视野。此外,我们还阐述了我们的经验,我们在一次有40名汽车行业物流工人参加的研讨会上获得的经验。
{"title":"Design Thinking: Using Photo Prototyping for a user-centered Interface Design for Pick-by-Vision Systems","authors":"Nela Murauer","doi":"10.1145/3197768.3201532","DOIUrl":"https://doi.org/10.1145/3197768.3201532","url":null,"abstract":"With Industry 4.0 manufacturing facilities experience a dynamic change towards smart factories. Digitalization of processes accompanied by extensive data acquisition enables process planners to utilize innovative technologies like Augmented Reality (AR) to support employees in their tasks on the shop floor. Among others a visualization in the user's field of view allows hands-free work and avoids unnecessary head movements. To make use of the employee's expertise, we try to involve workers with the aid of Design Thinking at an early stage in the AR-interface design process. A pervasive method in app design is Paper Prototyping. Early sketches of user interfaces serve as common language in interdisciplinary teams. In this paper we develop a method based on Paper Prototyping especially for AR content needs, which is called Photo Prototyping. This method overlays the user's field of view with sketches of the future AR-content. Furthermore we elucidate our experience, we've gained during a workshop with 40 workers out of logistics in the automotive industry.","PeriodicalId":130190,"journal":{"name":"Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130291533","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Development of a Mobile Functional Near-infrared Spectroscopy Prototype and its Initial Evaluation: Lessons Learned 移动功能近红外光谱样机的开发及其初步评估:经验教训
Nils Volkening, Anirudh Unni, Sabeth Becker, J. Rieger, Sebastian J. F. Fudickar, A. Hein
This paper presents a new mobile near-infrared functional spectroscopy (fNIRS) device, with digital detectors that can be placed anywhere on the head and fit into standard caps to measure cortical brain activation. The device's functionality was evaluated in two steps, i.e. first, by means of simple pulse measurements and second, in a motor cortex study with nine subjects. In this study, the subjects had to alternate between right and left hands while using hand-held strength trainers. While the signals from the mobile prototype were not yet stable enough across all channels to perform analysis such as statistical parametric mapping, it was able to measure significant brain activation changes over the area of the motor cortex with the mobile prototype when the contralateral hand was activated in four subjects. In contrast, the device was yet unable to measure ipsilateral activities. The problems encountered and possible methods to improve signal acquisition are discussed at the end of the paper.
本文介绍了一种新的移动近红外功能光谱(fNIRS)装置,该装置带有数字探测器,可以放置在头部的任何地方,并安装在标准的帽子上,以测量大脑皮层的激活。该设备的功能分两步进行评估,即第一步,通过简单的脉冲测量,第二步,在九名受试者的运动皮层研究中。在这项研究中,受试者必须在使用手持力量训练器时交替使用右手和左手。虽然来自移动原型的信号在所有通道上还不够稳定,无法进行统计参数映射等分析,但当对侧手被激活时,它能够测量出四个受试者的运动皮层区域与移动原型的显著大脑激活变化。相比之下,该装置还无法测量同侧活动。最后讨论了信号采集过程中遇到的问题和改进信号采集的可能方法。
{"title":"Development of a Mobile Functional Near-infrared Spectroscopy Prototype and its Initial Evaluation: Lessons Learned","authors":"Nils Volkening, Anirudh Unni, Sabeth Becker, J. Rieger, Sebastian J. F. Fudickar, A. Hein","doi":"10.1145/3197768.3201534","DOIUrl":"https://doi.org/10.1145/3197768.3201534","url":null,"abstract":"This paper presents a new mobile near-infrared functional spectroscopy (fNIRS) device, with digital detectors that can be placed anywhere on the head and fit into standard caps to measure cortical brain activation. The device's functionality was evaluated in two steps, i.e. first, by means of simple pulse measurements and second, in a motor cortex study with nine subjects. In this study, the subjects had to alternate between right and left hands while using hand-held strength trainers. While the signals from the mobile prototype were not yet stable enough across all channels to perform analysis such as statistical parametric mapping, it was able to measure significant brain activation changes over the area of the motor cortex with the mobile prototype when the contralateral hand was activated in four subjects. In contrast, the device was yet unable to measure ipsilateral activities. The problems encountered and possible methods to improve signal acquisition are discussed at the end of the paper.","PeriodicalId":130190,"journal":{"name":"Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130303973","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1