首页 > 最新文献

Proceedings of the 2023 ACM International Conference on Interactive Media Experiences最新文献

英文 中文
Generating Utterances for Companion Robots using Television Program Subtitles 使用电视节目字幕为同伴机器人生成语音
Yuta Hagio, Makoto Okuda, Marina Kamimura, Yutaka Kaneko, H. Ohmata
This study presents a method for generating utterances for companion robots that watch TV with people, using TV program subtitles. To enable the robot to automatically generate relevant utterances while watching TV, we created a dataset of approximately 12,000 utterances that were manually added to the collected TV subtitles. Using this dataset, we fine-tuned a large-scale language model to construct an utterance generation model. The proposed model generates utterances based on multiple keywords extracted from the subtitles as topics, while also taking into account the context of the subtitles by inputting them. The evaluation of the generated utterances revealed that approximately 88% of the sentences were natural Japanese, and approximately 75% were relevant and natural in the context of the TV program. Moreover, approximately 99% of the sentences contained the extracted keywords, indicating that our proposed method can generate diverse and contextually appropriate utterances containing the targeted topics. These findings provide evidence of the effectiveness of our approach in generating natural utterances for companion robots that watch TV with people.
本研究提出了一种利用电视节目字幕为与人一起看电视的同伴机器人生成语音的方法。为了使机器人能够在看电视时自动生成相关的话语,我们创建了一个大约12,000个话语的数据集,这些话语被手动添加到收集的电视字幕中。利用该数据集,我们对一个大规模的语言模型进行微调,以构建一个话语生成模型。该模型基于从字幕中提取的多个关键词作为主题生成话语,同时通过输入字幕来考虑字幕的上下文。对生成的话语的评估显示,大约88%的句子是自然的日语,大约75%的句子与电视节目的语境相关且自然。此外,大约99%的句子包含提取的关键词,表明我们的方法可以生成包含目标主题的多样化和上下文合适的话语。这些发现证明了我们的方法在为与人一起看电视的同伴机器人生成自然话语方面的有效性。
{"title":"Generating Utterances for Companion Robots using Television Program Subtitles","authors":"Yuta Hagio, Makoto Okuda, Marina Kamimura, Yutaka Kaneko, H. Ohmata","doi":"10.1145/3573381.3596463","DOIUrl":"https://doi.org/10.1145/3573381.3596463","url":null,"abstract":"This study presents a method for generating utterances for companion robots that watch TV with people, using TV program subtitles. To enable the robot to automatically generate relevant utterances while watching TV, we created a dataset of approximately 12,000 utterances that were manually added to the collected TV subtitles. Using this dataset, we fine-tuned a large-scale language model to construct an utterance generation model. The proposed model generates utterances based on multiple keywords extracted from the subtitles as topics, while also taking into account the context of the subtitles by inputting them. The evaluation of the generated utterances revealed that approximately 88% of the sentences were natural Japanese, and approximately 75% were relevant and natural in the context of the TV program. Moreover, approximately 99% of the sentences contained the extracted keywords, indicating that our proposed method can generate diverse and contextually appropriate utterances containing the targeted topics. These findings provide evidence of the effectiveness of our approach in generating natural utterances for companion robots that watch TV with people.","PeriodicalId":120872,"journal":{"name":"Proceedings of the 2023 ACM International Conference on Interactive Media Experiences","volume":"64 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131730428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
GoNature AR: Air Quality & Noise Visualization Through a Multimodal and Interactive Augmented Reality Experience 自然AR:通过多模式和互动增强现实体验的空气质量和噪音可视化
Minas Katsiokalis, Elisavet Tsekeri, Aikaterini Lilli, K. Gobakis, D. Kolokotsa, K. Mania
As Extended Reality (XR) media experiences become a commodity, there is a unique opportunity to deploy XR for environmental awareness. Interaction challenges of Augmented Reality (AR) still exist, focused on limited gesture and head tracking affordances. AR technologies should also be seamlessly integrated with sensor data, analytics and ultimately status prediction, to be visualized in an AR experience, rather than merely superimposing visuals onto the real world. This paper presents an innovative, work-in-progress, multimodal AR experience integrating interactive narration, gestures, hands recognition and voice commands, while a citizen is wearing a head-worn AR display, promoting environmental awareness, health, and wellness. By combining AR technologies and a sensor network, GoNature AR provides citizen awareness of real-time, multimodal, air and noise pollution data.
随着扩展现实(XR)媒体体验成为一种商品,有一个独特的机会来部署XR来提高环境意识。增强现实(AR)的交互挑战仍然存在,主要集中在有限的手势和头部跟踪功能上。AR技术还应该与传感器数据、分析和最终状态预测无缝集成,在AR体验中实现可视化,而不仅仅是将视觉效果叠加到现实世界中。本文介绍了一种创新的、正在开发的、集成交互式叙述、手势、手势识别和语音命令的多模式增强现实体验,同时公民戴着头戴式增强现实显示器,促进环境意识、健康和健康。通过结合AR技术和传感器网络,gonnature AR为市民提供实时、多模式、空气和噪音污染数据。
{"title":"GoNature AR: Air Quality & Noise Visualization Through a Multimodal and Interactive Augmented Reality Experience","authors":"Minas Katsiokalis, Elisavet Tsekeri, Aikaterini Lilli, K. Gobakis, D. Kolokotsa, K. Mania","doi":"10.1145/3573381.3597229","DOIUrl":"https://doi.org/10.1145/3573381.3597229","url":null,"abstract":"As Extended Reality (XR) media experiences become a commodity, there is a unique opportunity to deploy XR for environmental awareness. Interaction challenges of Augmented Reality (AR) still exist, focused on limited gesture and head tracking affordances. AR technologies should also be seamlessly integrated with sensor data, analytics and ultimately status prediction, to be visualized in an AR experience, rather than merely superimposing visuals onto the real world. This paper presents an innovative, work-in-progress, multimodal AR experience integrating interactive narration, gestures, hands recognition and voice commands, while a citizen is wearing a head-worn AR display, promoting environmental awareness, health, and wellness. By combining AR technologies and a sensor network, GoNature AR provides citizen awareness of real-time, multimodal, air and noise pollution data.","PeriodicalId":120872,"journal":{"name":"Proceedings of the 2023 ACM International Conference on Interactive Media Experiences","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128992434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Producing Personalised Object-Based Audio-Visual Experiences: an Ethnographic Study 生产个性化的基于对象的视听体验:一项民族志研究
Craig Cieciura, M. Glancy, P. Jackson
Developments in object-based media and IP-based delivery offer an opportunity to create superior audience experiences through personalisation. Towards the aim of making personalised experiences regularly available across the breadth of audio-visual media, we conducted a study to understand how personalised experiences are being created. This consisted of interviews with producers of six representative case studies, followed by a thematic analysis. We describe the workflows and report on the producers’ experiences and obstacles faced. We found that the metadata models, enabling personalisation, were developed independently for each experience, restricting interoperability of personalisation affordances provided to users. Furthermore, the available tools were not effectively integrated into preferred workflows, substantially increasing role responsibilities and production time. To ameliorate these issues, we propose the development of a unifying metadata framework and novel production tools. These tools should be integrated into existing workflows; improve efficiency using AI; and enable producers to serve more diverse audiences.
基于对象的媒体和基于ip的传播的发展为通过个性化创造卓越的受众体验提供了机会。为了在广泛的视听媒体中定期提供个性化体验,我们进行了一项研究,以了解个性化体验是如何创造的。这包括对六个代表性案例研究的制作人进行访谈,然后进行专题分析。我们描述了工作流程,并报告了制作人的经验和面临的障碍。我们发现,支持个性化的元数据模型是为每种体验独立开发的,这限制了提供给用户的个性化功能的互操作性。此外,可用的工具没有有效地集成到首选的工作流中,从而大大增加了角色的责任和生产时间。为了改善这些问题,我们建议开发统一的元数据框架和新的生产工具。这些工具应该集成到现有的工作流程中;利用人工智能提高效率;并使制片人能够为更多样化的观众服务。
{"title":"Producing Personalised Object-Based Audio-Visual Experiences: an Ethnographic Study","authors":"Craig Cieciura, M. Glancy, P. Jackson","doi":"10.1145/3573381.3596156","DOIUrl":"https://doi.org/10.1145/3573381.3596156","url":null,"abstract":"Developments in object-based media and IP-based delivery offer an opportunity to create superior audience experiences through personalisation. Towards the aim of making personalised experiences regularly available across the breadth of audio-visual media, we conducted a study to understand how personalised experiences are being created. This consisted of interviews with producers of six representative case studies, followed by a thematic analysis. We describe the workflows and report on the producers’ experiences and obstacles faced. We found that the metadata models, enabling personalisation, were developed independently for each experience, restricting interoperability of personalisation affordances provided to users. Furthermore, the available tools were not effectively integrated into preferred workflows, substantially increasing role responsibilities and production time. To ameliorate these issues, we propose the development of a unifying metadata framework and novel production tools. These tools should be integrated into existing workflows; improve efficiency using AI; and enable producers to serve more diverse audiences.","PeriodicalId":120872,"journal":{"name":"Proceedings of the 2023 ACM International Conference on Interactive Media Experiences","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125271190","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DatAR: Comparing Relationships between Brain Regions and Diseases: An Immersive AR Tool for Neuroscientists 数据:比较大脑区域和疾病之间的关系:神经科学家的沉浸式AR工具
Ghazaleh Tanhaei, L. Hardman, Wolfgang Hürst
Different brain diseases are associated with distinct patterns of affected brain regions. Neuroscientists aim to understand the variability of these patterns across different brain diseases. We used a user-centered design approach to develop support for neuroscientists in exploring and comparing which regions are affected by which diseases based on neuroscience literature. Our study involved six neuroscientists and nine visualization experts who evaluated the usability and explainability of our visualization tool for comparing disease patterns in brain regions. Our results show that our tool can help neuroscientists explore and visualize relationships between brain regions and diseases, and compare patterns of affected regions in an immersive AR environment.
不同的脑部疾病与受影响的大脑区域的不同模式有关。神经科学家的目标是了解这些模式在不同脑部疾病中的可变性。我们使用以用户为中心的设计方法,为神经科学家提供支持,以探索和比较基于神经科学文献的哪些区域受到哪些疾病的影响。我们的研究涉及六位神经科学家和九位可视化专家,他们评估了我们的可视化工具的可用性和可解释性,用于比较大脑区域的疾病模式。我们的研究结果表明,我们的工具可以帮助神经科学家探索和可视化大脑区域与疾病之间的关系,并在沉浸式AR环境中比较受影响区域的模式。
{"title":"DatAR: Comparing Relationships between Brain Regions and Diseases: An Immersive AR Tool for Neuroscientists","authors":"Ghazaleh Tanhaei, L. Hardman, Wolfgang Hürst","doi":"10.1145/3573381.3597222","DOIUrl":"https://doi.org/10.1145/3573381.3597222","url":null,"abstract":"Different brain diseases are associated with distinct patterns of affected brain regions. Neuroscientists aim to understand the variability of these patterns across different brain diseases. We used a user-centered design approach to develop support for neuroscientists in exploring and comparing which regions are affected by which diseases based on neuroscience literature. Our study involved six neuroscientists and nine visualization experts who evaluated the usability and explainability of our visualization tool for comparing disease patterns in brain regions. Our results show that our tool can help neuroscientists explore and visualize relationships between brain regions and diseases, and compare patterns of affected regions in an immersive AR environment.","PeriodicalId":120872,"journal":{"name":"Proceedings of the 2023 ACM International Conference on Interactive Media Experiences","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127656045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Navigating Full-Motion Video: Emerging Design Patterns for Parameterized Replay Stories 导航全动态视频:参数化重放故事的新兴设计模式
Pedro Silva
The 1980s saw full-motion video (FMV) titles inaugurate design patterns for a new genre of interactive digital narrative (IDN). Recently, this genre made a resurgence in popularity. Despite the intervening years, FMV’s design conventions remain tightly coupled to the affordances of laserdisc technology. This paper employs IDN affordances and aesthetics as a lens to examine modern FMV games, namely the recent works of Wales Interactive. Also, this paper leverages research on the emerging conventions of Timeline–an authoring platform for tightly parallel, parameterized stories–to address the challenges of FMV design.
20世纪80年代,全动态视频(FMV)开创了一种新型互动数字叙事(IDN)的设计模式。最近,这一类型又重新流行起来。尽管经过多年的发展,FMV的设计惯例仍然与激光光盘技术的发展紧密相连。本文采用IDN的可视性和美学作为视角来审视现代FMV游戏,即Wales Interactive最近的作品。此外,本文还利用对时间线(一个紧密并行、参数化故事的创作平台)新兴惯例的研究来解决FMV设计的挑战。
{"title":"Navigating Full-Motion Video: Emerging Design Patterns for Parameterized Replay Stories","authors":"Pedro Silva","doi":"10.1145/3573381.3596455","DOIUrl":"https://doi.org/10.1145/3573381.3596455","url":null,"abstract":"The 1980s saw full-motion video (FMV) titles inaugurate design patterns for a new genre of interactive digital narrative (IDN). Recently, this genre made a resurgence in popularity. Despite the intervening years, FMV’s design conventions remain tightly coupled to the affordances of laserdisc technology. This paper employs IDN affordances and aesthetics as a lens to examine modern FMV games, namely the recent works of Wales Interactive. Also, this paper leverages research on the emerging conventions of Timeline–an authoring platform for tightly parallel, parameterized stories–to address the challenges of FMV design.","PeriodicalId":120872,"journal":{"name":"Proceedings of the 2023 ACM International Conference on Interactive Media Experiences","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125184269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Nothing Beside Remains: How might we use digital technologies and speculative design to explore the contested and hidden histories of heritage and museum artefacts? 除了遗迹什么都没有:我们如何利用数字技术和投机设计来探索遗产和博物馆文物中有争议的和隐藏的历史?
Saad Ahmed Maqbool, D. Maxwell
An existing body of Human-Computer Interaction (HCI) work has had a focus on cultural heritage settings such as historic sites and museums where digital technologies are used to augment user experience through a variety of methods such as interactive displays, museum guides and mixed/virtual reality experiences. However, very little of this work has been used to explore some of the more contemporary and pressing issues surrounding museums and heritage today. This project, Nothing Beside Remains explores the nature of narratives and stories in the context of museums and heritage through the creation of tangible interactive digital artefacts. Specifically, it looks at ‘Contested Histories’ - a broad spectrum of issues relating to heritage sites and museum artefacts that in recent years have become more urgent to address. These can include issues such as heritage loss (e.g., through decay, destruction or theft either through nature or human conflict), unsustainable preservation and conservation practice (the continuing accumulation of historic artefacts, lack of financial and specialist resources in maintaining sites and artefacts) and repatriation (the disputed claims by nations in reclaiming artefacts that were looted often due to colonial activity). Design (and additionally Speculative Design) as an approach to these issues allows individuals or groups to imagine radically different futures or pose questions relating to phenomena through the convergence of creativity and critical theory – therefore this work aims to extend how this kind of critical enquiry can pose questions to museum and heritage sectors as well as other stakeholders, surrounding contentious narratives and propose possible futures. It involves the creation of physical digital artefacts and tests their effectiveness in creating debate and discussion surrounding these issues. In addition, it will look at the agency of museum and heritage organisations to address these problems and explore experimental design work as a vehicle for actionable change.
现有的人机交互(HCI)工作侧重于文化遗产环境,如历史遗址和博物馆,在这些环境中,数字技术通过各种方法(如交互式展示、博物馆导游和混合/虚拟现实体验)来增强用户体验。然而,这些工作很少用于探索当今围绕博物馆和遗产的一些更当代和紧迫的问题。这个项目,除了遗迹什么都没有,通过创造有形的互动数字文物,探索博物馆和遗产背景下叙事和故事的本质。具体来说,它关注的是“有争议的历史”——与遗产遗址和博物馆文物有关的一系列广泛问题,这些问题近年来变得更加迫切需要解决。这些问题可能包括遗产损失(例如,由于自然或人类冲突导致的腐烂、破坏或盗窃)、不可持续的保护和保护实践(历史文物的持续积累,在维护遗址和文物方面缺乏财政和专业资源)和遣返(各国在收回往往由于殖民活动而被掠夺的文物时提出的有争议的主张)。设计(以及投机设计)作为解决这些问题的一种方法,允许个人或团体想象完全不同的未来,或者通过创造力和批判理论的融合提出与现象相关的问题——因此,这项工作旨在扩展这种批判性探究如何向博物馆和遗产部门以及其他利益相关者提出问题,围绕有争议的叙述并提出可能的未来。它包括创建物理数字人工制品,并测试它们在围绕这些问题进行辩论和讨论方面的有效性。此外,它将着眼于博物馆和遗产组织的代理,以解决这些问题,并探索实验性设计工作作为可行变革的工具。
{"title":"Nothing Beside Remains: How might we use digital technologies and speculative design to explore the contested and hidden histories of heritage and museum artefacts?","authors":"Saad Ahmed Maqbool, D. Maxwell","doi":"10.1145/3573381.3596505","DOIUrl":"https://doi.org/10.1145/3573381.3596505","url":null,"abstract":"An existing body of Human-Computer Interaction (HCI) work has had a focus on cultural heritage settings such as historic sites and museums where digital technologies are used to augment user experience through a variety of methods such as interactive displays, museum guides and mixed/virtual reality experiences. However, very little of this work has been used to explore some of the more contemporary and pressing issues surrounding museums and heritage today. This project, Nothing Beside Remains explores the nature of narratives and stories in the context of museums and heritage through the creation of tangible interactive digital artefacts. Specifically, it looks at ‘Contested Histories’ - a broad spectrum of issues relating to heritage sites and museum artefacts that in recent years have become more urgent to address. These can include issues such as heritage loss (e.g., through decay, destruction or theft either through nature or human conflict), unsustainable preservation and conservation practice (the continuing accumulation of historic artefacts, lack of financial and specialist resources in maintaining sites and artefacts) and repatriation (the disputed claims by nations in reclaiming artefacts that were looted often due to colonial activity). Design (and additionally Speculative Design) as an approach to these issues allows individuals or groups to imagine radically different futures or pose questions relating to phenomena through the convergence of creativity and critical theory – therefore this work aims to extend how this kind of critical enquiry can pose questions to museum and heritage sectors as well as other stakeholders, surrounding contentious narratives and propose possible futures. It involves the creation of physical digital artefacts and tests their effectiveness in creating debate and discussion surrounding these issues. In addition, it will look at the agency of museum and heritage organisations to address these problems and explore experimental design work as a vehicle for actionable change.","PeriodicalId":120872,"journal":{"name":"Proceedings of the 2023 ACM International Conference on Interactive Media Experiences","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130088221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Proactivity in the TV Context: Understanding the Relevance and Characteristics of Proactive Behaviours in Voice Assistants 电视情境下的主动行为:理解语音助手主动行为的相关性和特征
Tiffany Marques, J. Abreu, Rita Santos
In the context of Television (TV), intelligent voice assistants are still mainly based on reactive behaviours, only responding to users' requests. However, the addition of proactivity in TV assistants could have the potential to reduce the user-assistant interaction effort and bring an additional "human" layer, leading to a more organic adoption of these systems. Within this framework, this paper aims to contribute to the understanding of the relevance of a set of proactive scenarios for TV and get clues on how to design these behaviours to be efficient and avoid intrusion feelings. To this end, focus groups were conducted to discuss the conceptualised scenarios. The results showed that most of the idealized scenarios were relevant for the participants and that they will be positive if some characteristics can be pre-configured regarding the type of communication and intrusion of proactive suggestions.
在电视(TV)的背景下,智能语音助手仍然以反应性行为为主,只响应用户的请求。然而,在电视助手中增加主动性可能会减少用户助理的交互努力,并带来额外的“人类”层面,从而导致这些系统更有机地采用。在此框架内,本文旨在帮助理解一组电视主动场景的相关性,并获得如何设计这些行为以提高效率并避免侵入感的线索。为此目的,进行了焦点小组讨论概念化的情景。结果表明,大多数理想化的情景对被试都是相关的,如果可以预先配置一些关于沟通类型和主动建议入侵的特征,他们将是积极的。
{"title":"Proactivity in the TV Context: Understanding the Relevance and Characteristics of Proactive Behaviours in Voice Assistants","authors":"Tiffany Marques, J. Abreu, Rita Santos","doi":"10.1145/3573381.3597219","DOIUrl":"https://doi.org/10.1145/3573381.3597219","url":null,"abstract":"In the context of Television (TV), intelligent voice assistants are still mainly based on reactive behaviours, only responding to users' requests. However, the addition of proactivity in TV assistants could have the potential to reduce the user-assistant interaction effort and bring an additional \"human\" layer, leading to a more organic adoption of these systems. Within this framework, this paper aims to contribute to the understanding of the relevance of a set of proactive scenarios for TV and get clues on how to design these behaviours to be efficient and avoid intrusion feelings. To this end, focus groups were conducted to discuss the conceptualised scenarios. The results showed that most of the idealized scenarios were relevant for the participants and that they will be positive if some characteristics can be pre-configured regarding the type of communication and intrusion of proactive suggestions.","PeriodicalId":120872,"journal":{"name":"Proceedings of the 2023 ACM International Conference on Interactive Media Experiences","volume":"129 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127093748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Designing an Assistance Tool for Analyzing and Modeling Trainer Activity in Professional Training Through Simulation 基于仿真的专业培训中培训师活动分析与建模辅助工具设计
F. Rocca, Madison Dave, Valérie Duvivier, Agnès Van Daele, M. Demeuse, Antoine Derobertmasure, M. Mancas, B. Gosselin
Human audience analysis is crucial in numerous domains to understand people’s behavior based on their knowledge and environment. In this paper we focus on simulation-based training which has become a popular teaching approach that requires a trainer able to manage a lot of data at the same time. We present tools that are currently being developed to help trainers from two different fields: training for practical teaching gestures and training in civil defense. In this sense, three technological blocks are built to collect and analyze data about trainers’ and learners’ gestures, gaze, speech and movements. The paper also discusses the future work planned for this project, including the integration of the framework into the Noldus system and its use in civil security training. Overall, the article highlights the potential of technology to improve simulation-based training and provides a roadmap for future development.
人类受众分析在许多领域都是至关重要的,它可以根据人们的知识和环境来理解人们的行为。基于仿真的训练是一种非常流行的教学方法,它要求训练者能够同时管理大量的数据。我们介绍了目前正在开发的工具,以帮助来自两个不同领域的培训人员:实际教学手势培训和民防培训。从这个意义上讲,我们构建了三个技术模块来收集和分析关于训练者和学习者的手势、凝视、语言和动作的数据。本文还讨论了该项目未来计划的工作,包括将该框架集成到Noldus系统中,并将其用于民事安全培训。总的来说,本文强调了技术在改进基于模拟的培训方面的潜力,并为未来的发展提供了路线图。
{"title":"Designing an Assistance Tool for Analyzing and Modeling Trainer Activity in Professional Training Through Simulation","authors":"F. Rocca, Madison Dave, Valérie Duvivier, Agnès Van Daele, M. Demeuse, Antoine Derobertmasure, M. Mancas, B. Gosselin","doi":"10.1145/3573381.3596475","DOIUrl":"https://doi.org/10.1145/3573381.3596475","url":null,"abstract":"Human audience analysis is crucial in numerous domains to understand people’s behavior based on their knowledge and environment. In this paper we focus on simulation-based training which has become a popular teaching approach that requires a trainer able to manage a lot of data at the same time. We present tools that are currently being developed to help trainers from two different fields: training for practical teaching gestures and training in civil defense. In this sense, three technological blocks are built to collect and analyze data about trainers’ and learners’ gestures, gaze, speech and movements. The paper also discusses the future work planned for this project, including the integration of the framework into the Noldus system and its use in civil security training. Overall, the article highlights the potential of technology to improve simulation-based training and provides a roadmap for future development.","PeriodicalId":120872,"journal":{"name":"Proceedings of the 2023 ACM International Conference on Interactive Media Experiences","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128941781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Physically-based Lighting of 3D Point Clouds for Quality Assessment 基于物理的3D点云照明质量评估
Amar Tious, Toinon Vigier, V. Ricordel
Point clouds are acknowledged as an essential data structure to represent 3D objects in many use cases, notably immersive experience settings such as Virtual, Augmented or Mixed Reality. This work is the first part of a research project on immersive Quality Assessment of point clouds in different lighting. In this report, I focus mainly on the physically-based rendering of such data in Unity 3D, and the impact of point cloud compression when considering various lighting conditions on the objects. These first observations and results will serve in the implementation of a 6DoF immersive experiment setting for subjective quality assessment.
点云被认为是在许多用例中表示3D对象的基本数据结构,特别是沉浸式体验设置,如虚拟,增强或混合现实。本研究是不同光照下点云沉浸式质量评估研究项目的第一部分。在这篇报告中,我主要关注这些数据在Unity 3D中基于物理的渲染,以及在考虑各种光照条件时点云压缩对物体的影响。这些初步观察和结果将用于实施6DoF沉浸式实验设置,用于主观质量评估。
{"title":"Physically-based Lighting of 3D Point Clouds for Quality Assessment","authors":"Amar Tious, Toinon Vigier, V. Ricordel","doi":"10.1145/3573381.3597231","DOIUrl":"https://doi.org/10.1145/3573381.3597231","url":null,"abstract":"Point clouds are acknowledged as an essential data structure to represent 3D objects in many use cases, notably immersive experience settings such as Virtual, Augmented or Mixed Reality. This work is the first part of a research project on immersive Quality Assessment of point clouds in different lighting. In this report, I focus mainly on the physically-based rendering of such data in Unity 3D, and the impact of point cloud compression when considering various lighting conditions on the objects. These first observations and results will serve in the implementation of a 6DoF immersive experiment setting for subjective quality assessment.","PeriodicalId":120872,"journal":{"name":"Proceedings of the 2023 ACM International Conference on Interactive Media Experiences","volume":"26 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129134665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhancing Arabic Content Generation with Prompt Augmentation Using Integrated GPT and Text-to-Image Models 使用集成的GPT和文本到图像模型,通过提示增强增强阿拉伯语内容生成
Wala Elsharif, James She, Preslav Nakov, Simon Wong
With the current and continuous advancements in the field of text-to-image modeling, it has become critical to design prompts that make the best of these model capabilities and guides them to generate the most desirable images, and thus the field of prompt engineering has emerged. Here, we study a method to use prompt engineering to enhance text-to-image model representation of the Arabic culture. This work proposes a simple, novel approach for prompt engineering that uses the domain knowledge of a state-of-the-art language model, GPT, to perform the task of prompt augmentation, where a simple, initial prompt is used to generate multiple, more detailed prompts related to the Arabic culture from multiple categories through a GPT model through a process known as in-context learning. The augmented prompts are then used to generate images enhanced for the Arabic culture. We perform multiple experiments with a number of participants to evaluate the performance of the proposed method, which shows promising results, specially for generating prompts that are more inclusive of the different Arabic countries and with a wider variety in terms of image subjects, where we find that our proposed method generates image with more variety 85 % of the time and are more inclusive of the Arabic countries more than 72.66 % of the time, compared to the direct approach.
随着当前文本到图像建模领域的不断进步,设计提示以充分利用这些模型功能并引导它们生成最理想的图像变得至关重要,因此提示工程领域应运而生。在这里,我们研究了一种使用提示工程来增强阿拉伯文化的文本到图像模型表示的方法。这项工作提出了一种简单、新颖的提示工程方法,该方法使用最先进的语言模型GPT的领域知识来执行提示增强任务,其中使用一个简单的初始提示,通过GPT模型通过称为上下文学习的过程从多个类别中生成多个更详细的与阿拉伯文化相关的提示。然后使用增强的提示符生成针对阿拉伯文化的增强图像。我们执行多个实验的参与者评价该方法的性能,它显示了有前景的结果,特别用于生成提示更具包容性的不同的阿拉伯国家,广泛的主题形象,我们发现该方法生成图像的地方有更多的种类的85%的时间和更包容的阿拉伯国家72.66%以上的时间,而直接的方法。
{"title":"Enhancing Arabic Content Generation with Prompt Augmentation Using Integrated GPT and Text-to-Image Models","authors":"Wala Elsharif, James She, Preslav Nakov, Simon Wong","doi":"10.1145/3573381.3596466","DOIUrl":"https://doi.org/10.1145/3573381.3596466","url":null,"abstract":"With the current and continuous advancements in the field of text-to-image modeling, it has become critical to design prompts that make the best of these model capabilities and guides them to generate the most desirable images, and thus the field of prompt engineering has emerged. Here, we study a method to use prompt engineering to enhance text-to-image model representation of the Arabic culture. This work proposes a simple, novel approach for prompt engineering that uses the domain knowledge of a state-of-the-art language model, GPT, to perform the task of prompt augmentation, where a simple, initial prompt is used to generate multiple, more detailed prompts related to the Arabic culture from multiple categories through a GPT model through a process known as in-context learning. The augmented prompts are then used to generate images enhanced for the Arabic culture. We perform multiple experiments with a number of participants to evaluate the performance of the proposed method, which shows promising results, specially for generating prompts that are more inclusive of the different Arabic countries and with a wider variety in terms of image subjects, where we find that our proposed method generates image with more variety 85 % of the time and are more inclusive of the Arabic countries more than 72.66 % of the time, compared to the direct approach.","PeriodicalId":120872,"journal":{"name":"Proceedings of the 2023 ACM International Conference on Interactive Media Experiences","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128603920","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
Proceedings of the 2023 ACM International Conference on Interactive Media Experiences
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1