首页 > 最新文献

DM@EACL最新文献

英文 中文
A Natural Language Instructor for pedestrian navigation based in generation by selection 基于选择生成的行人导航自然语言指导器
Pub Date : 2014-04-01 DOI: 10.3115/v1/W14-0205
Santiago Avalos, Luciana Benotti
In this paper we describe a method for developing a virtual instructor for pedestrian navigation based on real interactions between a human instructor and a human pedestrian. A virtual instructor is an agent capable of fulfilling the role of a human instructor, and its goal is to assist a pedestrian in the accomplishment of different tasks within the context of a real city. The instructor decides what to say using a generation by selection algorithm, based on a corpus of real interactions generated within the world of interest. The instructor is able to react to different requests by the pedestrian. It is also aware of the pedestrian position with a certain degree of uncertainty, and it can use different city landmarks to guide him.
在本文中,我们描述了一种基于人类指导员和人类行人之间真实交互的行人导航虚拟指导员的开发方法。虚拟指导员是一种能够履行人类指导员角色的代理,其目标是帮助行人在真实城市的背景下完成不同的任务。讲师根据感兴趣的世界中生成的真实交互语料库,使用选择生成算法来决定说什么。指导员能够对行人的不同要求作出反应。它对行人的位置也有一定程度的不确定性,并可以利用不同的城市地标来引导他。
{"title":"A Natural Language Instructor for pedestrian navigation based in generation by selection","authors":"Santiago Avalos, Luciana Benotti","doi":"10.3115/v1/W14-0205","DOIUrl":"https://doi.org/10.3115/v1/W14-0205","url":null,"abstract":"In this paper we describe a method for developing a virtual instructor for pedestrian navigation based on real interactions between a human instructor and a human pedestrian. A virtual instructor is an agent capable of fulfilling the role of a human instructor, and its goal is to assist a pedestrian in the accomplishment of different tasks within the context of a real city. The instructor decides what to say using a generation by selection algorithm, based on a corpus of real interactions generated within the world of interest. The instructor is able to react to different requests by the pedestrian. It is also aware of the pedestrian position with a certain degree of uncertainty, and it can use different city landmarks to guide him.","PeriodicalId":198983,"journal":{"name":"DM@EACL","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121892195","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Recipes for building voice search UIs for automotive 构建汽车语音搜索ui的方法
Pub Date : 2014-04-01 DOI: 10.3115/v1/W14-0204
M. Labský, L. Kunc, T. Macek, Jan Kleindienst, J. Vystrcil
In this paper we describe a set of techniques we found suitable for building multi-modal search applications for automotive environments. As these applications often search across different topical domains, such as maps, weather or Wikipedia, we discuss the problem of switching focus between different domains. Also, we propose techniques useful for minimizing the response time of the search system in mobile environment. We evaluate some of the proposed techniques by means of usability tests with 10 novice test subjects who drove a simulated lane change test on a driving simulator. We report results describing the induced driving distraction and user acceptance.
在本文中,我们描述了一组我们发现适合于为汽车环境构建多模式搜索应用程序的技术。由于这些应用程序经常搜索不同的主题领域,例如地图、天气或维基百科,因此我们讨论了在不同领域之间切换焦点的问题。此外,我们还提出了一些有助于减少移动环境下搜索系统响应时间的技术。我们通过10名新手在驾驶模拟器上驾驶模拟变道测试的可用性测试来评估一些建议的技术。我们报告了描述诱导驾驶分心和用户接受度的结果。
{"title":"Recipes for building voice search UIs for automotive","authors":"M. Labský, L. Kunc, T. Macek, Jan Kleindienst, J. Vystrcil","doi":"10.3115/v1/W14-0204","DOIUrl":"https://doi.org/10.3115/v1/W14-0204","url":null,"abstract":"In this paper we describe a set of techniques we found suitable for building multi-modal search applications for automotive environments. As these applications often search across different topical domains, such as maps, weather or Wikipedia, we discuss the problem of switching focus between different domains. Also, we propose techniques useful for minimizing the response time of the search system in mobile environment. We evaluate some of the proposed techniques by means of usability tests with 10 novice test subjects who drove a simulated lane change test on a driving simulator. We report results describing the induced driving distraction and user acceptance.","PeriodicalId":198983,"journal":{"name":"DM@EACL","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130548495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Conversational Strategies for Robustly Managing Dialog in Public Spaces 公共空间对话稳健管理的会话策略
Pub Date : 2014-04-01 DOI: 10.3115/v1/W14-0211
Aasish Pappu, Ming Sun, Seshadri Sridharan, Alexander I. Rudnicky
Open environments present an attention management challenge for conversational systems. We describe a kiosk system (based on Ravenclaw‐Olympus) that uses simple auditory and visual information to interpret human presence and manage the system’s attention. The system robustly differentiates intended interactions from unintended ones at an accuracy of 93% and provides similar task completion rates in both a quiet room and a public space.
开放环境对会话系统提出了注意力管理的挑战。我们描述了一个kiosk系统(基于拉文克劳-奥林巴斯),它使用简单的听觉和视觉信息来解释人类的存在并管理系统的注意力。该系统能够区分有意互动和无意互动,准确率高达93%,在安静的房间和公共空间都能提供相似的任务完成率。
{"title":"Conversational Strategies for Robustly Managing Dialog in Public Spaces","authors":"Aasish Pappu, Ming Sun, Seshadri Sridharan, Alexander I. Rudnicky","doi":"10.3115/v1/W14-0211","DOIUrl":"https://doi.org/10.3115/v1/W14-0211","url":null,"abstract":"Open environments present an attention management challenge for conversational systems. We describe a kiosk system (based on Ravenclaw‐Olympus) that uses simple auditory and visual information to interpret human presence and manage the system’s attention. The system robustly differentiates intended interactions from unintended ones at an accuracy of 93% and provides similar task completion rates in both a quiet room and a public space.","PeriodicalId":198983,"journal":{"name":"DM@EACL","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114072072","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Mining human interactions to construct a virtual guide for a virtual fair 挖掘人际互动,构建虚拟展会虚拟导览
Pub Date : 2014-04-01 DOI: 10.3115/v1/W14-0206
A. Luna, Luciana Benotti
Ponencia presentada en la 14th Conference of the European Chapter of the Association for Computational Linguistics. Workshop on Dialogue in Motion. Gotemburgo, Suecia, 26 de abril de 2014
Ponencia在第14届计算语言学协会欧洲分会会议上发表了演讲。动态对话研讨会。2014年4月26日,瑞典哥德堡
{"title":"Mining human interactions to construct a virtual guide for a virtual fair","authors":"A. Luna, Luciana Benotti","doi":"10.3115/v1/W14-0206","DOIUrl":"https://doi.org/10.3115/v1/W14-0206","url":null,"abstract":"Ponencia presentada en la 14th Conference of the European Chapter of the Association for Computational Linguistics. Workshop on Dialogue in Motion. Gotemburgo, Suecia, 26 de abril de 2014","PeriodicalId":198983,"journal":{"name":"DM@EACL","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130483794","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Collaborative Exploration in Human-Robot Teams: What’s in their Corpora of Dialog, Video, & LIDAR Messages? 人机团队的协作探索:对话、视频和激光雷达信息的语料库中有什么?
Pub Date : 2014-04-01 DOI: 10.3115/v1/W14-0207
Clare R. Voss, Taylor Cassidy, Douglas Summers-Stay
This paper briefly sketches new work-inprogress (i) developing task-based scenarios where human-robot teams collaboratively explore real-world environments in which the robot is immersed but the humans are not, (ii) extracting and constructing “multi-modal interval corpora” from dialog, video, and LIDAR messages that were recorded in ROS bagfiles during task sessions, and (iii) testing automated methods to identify, track, and align co-referent content both within and across modalities in these interval corpora. The pre-pilot study and its corpora provide a unique, empirical starting point for our longerterm research objective: characterizing the balance of explicitly shared and tacitly assumed information exchanged during effective teamwork. 1 Overview
本文简要概述了正在进行的新工作(i)开发基于任务的场景,在这些场景中,人机团队协作探索机器人沉浸在其中但人类不在其中的现实世界环境;(ii)从任务会话期间记录在ROS包文件中的对话、视频和激光雷达信息中提取和构建“多模态间隔语料库”;(iii)测试自动化方法,以识别、跟踪、并在这些区间语料库的模态内部和模态之间对齐共指内容。预试点研究及其语料库为我们的长期研究目标提供了一个独特的经验起点:表征有效团队合作中明确共享和默认信息交换的平衡。1概述
{"title":"Collaborative Exploration in Human-Robot Teams: What’s in their Corpora of Dialog, Video, & LIDAR Messages?","authors":"Clare R. Voss, Taylor Cassidy, Douglas Summers-Stay","doi":"10.3115/v1/W14-0207","DOIUrl":"https://doi.org/10.3115/v1/W14-0207","url":null,"abstract":"This paper briefly sketches new work-inprogress (i) developing task-based scenarios where human-robot teams collaboratively explore real-world environments in which the robot is immersed but the humans are not, (ii) extracting and constructing “multi-modal interval corpora” from dialog, video, and LIDAR messages that were recorded in ROS bagfiles during task sessions, and (iii) testing automated methods to identify, track, and align co-referent content both within and across modalities in these interval corpora. The pre-pilot study and its corpora provide a unique, empirical starting point for our longerterm research objective: characterizing the balance of explicitly shared and tacitly assumed information exchanged during effective teamwork. 1 Overview","PeriodicalId":198983,"journal":{"name":"DM@EACL","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126991760","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Human pause and resume behaviours for unobtrusive humanlike in-car spoken dialogue systems 人类暂停和恢复行为的不引人注目的人类车内语音对话系统
Pub Date : 2014-04-01 DOI: 10.3115/v1/W14-0213
Jens Edlund, Fredrik Edelstam, Joakim Gustafson
This paper presents a first, largely qualitative analysis of a set of human-human dialogues recorded specifically to provide insights in how humans handle pauses and resumptions in situations where the speakers cannot see each other, but have to rely on the acoustic signal alone. The work presented is part of a larger effort to find unobtrusive human dialogue behaviours that can be mimicked and implemented in-car spoken dialogue systems within in the EU project Get Home Safe, a collaboration between KTH, DFKI, Nuance, IBM and Daimler aiming to find ways of driver interaction that minimizes safety issues,. The analysis reveals several human temporal, semantic/pragmatic, and structural behaviours that are good candidates for inclusion in spoken dialogue systems.
本文首先对一组记录下来的人类对话进行了定性分析,以深入了解人类在说话者看不到对方,而只能依赖声音信号的情况下如何处理停顿和恢复。这项工作是欧盟项目Get Home Safe的一部分,旨在寻找可以模仿和实施车内语音对话系统的不引人注目的人类对话行为,该项目由KTH、DFKI、Nuance、IBM和戴姆勒合作,旨在找到将安全问题降至最低的驾驶员互动方式。分析揭示了几种人类的时间、语义/语用和结构行为,这些行为很适合包含在口语对话系统中。
{"title":"Human pause and resume behaviours for unobtrusive humanlike in-car spoken dialogue systems","authors":"Jens Edlund, Fredrik Edelstam, Joakim Gustafson","doi":"10.3115/v1/W14-0213","DOIUrl":"https://doi.org/10.3115/v1/W14-0213","url":null,"abstract":"This paper presents a first, largely qualitative analysis of a set of human-human dialogues recorded specifically to provide insights in how humans handle pauses and resumptions in situations where the speakers cannot see each other, but have to rely on the acoustic signal alone. The work presented is part of a larger effort to find unobtrusive human dialogue behaviours that can be mimicked and implemented in-car spoken dialogue systems within in the EU project Get Home Safe, a collaboration between KTH, DFKI, Nuance, IBM and Daimler aiming to find ways of driver interaction that minimizes safety issues,. The analysis reveals several human temporal, semantic/pragmatic, and structural behaviours that are good candidates for inclusion in spoken dialogue systems.","PeriodicalId":198983,"journal":{"name":"DM@EACL","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123042418","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Click or Type: An Analysis of Wizard’s Interaction for Future Wizard Interface Design 点击或键入:对未来向导界面设计的向导交互分析
Pub Date : 2014-04-01 DOI: 10.3115/v1/W14-0203
S. Janarthanam, Robin L. Hill, A. Dickinson, Morgan Fredriksson
We present an analysis of a Pedestrian Navigation and Information dialogue corpus collected using a Wizard-of-Oz interface. We analysed how wizards preferred to communicate to users given three different options: preset buttons that can generate an utterance, sequences of buttons and dropdown lists to construct complex utterances and free text utterances. We present our findings and suggestions for future WoZ design based on our findings.
我们提出了使用Wizard-of-Oz界面收集的行人导航和信息对话语料库的分析。我们分析了在给定三种不同选项的情况下,向导如何倾向于与用户交流:可以生成话语的预设按钮,构建复杂话语的按钮序列和下拉列表,以及自由文本话语。基于我们的发现,我们提出了我们的发现和对未来WoZ设计的建议。
{"title":"Click or Type: An Analysis of Wizard’s Interaction for Future Wizard Interface Design","authors":"S. Janarthanam, Robin L. Hill, A. Dickinson, Morgan Fredriksson","doi":"10.3115/v1/W14-0203","DOIUrl":"https://doi.org/10.3115/v1/W14-0203","url":null,"abstract":"We present an analysis of a Pedestrian Navigation and Information dialogue corpus collected using a Wizard-of-Oz interface. We analysed how wizards preferred to communicate to users given three different options: preset buttons that can generate an utterance, sequences of buttons and dropdown lists to construct complex utterances and free text utterances. We present our findings and suggestions for future WoZ design based on our findings.","PeriodicalId":198983,"journal":{"name":"DM@EACL","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122230821","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Mostly Passive Information Delivery – a Prototype 主要是被动的信息传递——一个原型
Pub Date : 2014-04-01 DOI: 10.3115/v1/W14-0209
J. Vystrcil, T. Macek, David Luksch, M. Labský, L. Kunc, Jan Kleindienst, Tereza Kasparová
In this paper we introduce a new UI paradigm that mimics radio broadcast along with a prototype called Radio One. The approach aims to present useful information from multiple domains to mobile users (e.g. drivers on the go or cell phone users). The information is served in an entertaining manner in a mostly passive style – without the user having to ask for it– as in real radio broadcast. The content is generated on the fly by a machine and integrates a mix of personal (calendar, emails) and publicly available but customized information (news, weather, POIs). Most of the spoken audio output is machine synthesized. The implemented prototype permits passive listening as well as interaction using voice commands or buttons. Initial feedback gathered while testing the prototype while driving indicates good acceptance of the system and relatively low distraction levels.
在本文中,我们介绍了一种新的UI范例,它模仿了无线电广播以及一个名为radio One的原型。该方法旨在向移动用户提供来自多个领域的有用信息(例如,行驶中的司机或手机用户)。这些信息以一种娱乐的方式以一种被动的方式提供- -无需用户主动要求- -就像在真正的无线电广播中一样。内容由一台机器动态生成,并集成了个人信息(日历、电子邮件)和公开但可定制的信息(新闻、天气、poi)。大部分语音输出都是机器合成的。实现的原型允许被动聆听以及使用语音命令或按钮进行交互。在驾驶过程中测试原型车时收集的初步反馈表明,人们对该系统的接受度很高,分心程度也相对较低。
{"title":"Mostly Passive Information Delivery – a Prototype","authors":"J. Vystrcil, T. Macek, David Luksch, M. Labský, L. Kunc, Jan Kleindienst, Tereza Kasparová","doi":"10.3115/v1/W14-0209","DOIUrl":"https://doi.org/10.3115/v1/W14-0209","url":null,"abstract":"In this paper we introduce a new UI paradigm that mimics radio broadcast along with a prototype called Radio One. The approach aims to present useful information from multiple domains to mobile users (e.g. drivers on the go or cell phone users). The information is served in an entertaining manner in a mostly passive style – without the user having to ask for it– as in real radio broadcast. The content is generated on the fly by a machine and integrates a mix of personal (calendar, emails) and publicly available but customized information (news, weather, POIs). Most of the spoken audio output is machine synthesized. The implemented prototype permits passive listening as well as interaction using voice commands or buttons. Initial feedback gathered while testing the prototype while driving indicates good acceptance of the system and relatively low distraction levels.","PeriodicalId":198983,"journal":{"name":"DM@EACL","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114340554","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Multi-threaded Interaction Management for Dynamic Spatial Applications 动态空间应用的多线程交互管理
Pub Date : 2014-04-01 DOI: 10.3115/v1/W14-0208
S. Janarthanam, Oliver Lemon
We present a multi-threaded Interaction Manager (IM) that is used to track different dimensions of user-system conversations that are required to interleave with each other in a coherent and timely manner. This is explained in the context of a spoken dialogue system for pedestrian navigation and city question-answering, with information push about nearby or visible points-of-interest (PoI).
我们提出了一个多线程交互管理器(IM),用于跟踪需要以连贯和及时的方式相互交错的用户-系统对话的不同维度。这在行人导航和城市问答语音对话系统的背景下得到了解释,并提供了有关附近或可见兴趣点(PoI)的信息推送。
{"title":"Multi-threaded Interaction Management for Dynamic Spatial Applications","authors":"S. Janarthanam, Oliver Lemon","doi":"10.3115/v1/W14-0208","DOIUrl":"https://doi.org/10.3115/v1/W14-0208","url":null,"abstract":"We present a multi-threaded Interaction Manager (IM) that is used to track different dimensions of user-system conversations that are required to interleave with each other in a coherent and timely manner. This is explained in the context of a spoken dialogue system for pedestrian navigation and city question-answering, with information push about nearby or visible points-of-interest (PoI).","PeriodicalId":198983,"journal":{"name":"DM@EACL","volume":"24 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125076307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
IBM’s Belief Tracker: Results On Dialog State Tracking Challenge Datasets IBM的信念跟踪器:对话状态跟踪挑战数据集的结果
Pub Date : 2014-04-01 DOI: 10.3115/v1/W14-0202
Rudolf Kadlec, Jindřich Libovický, Jan Macek, Jan Kleindienst
Accurate dialog state tracking is crucial for the design of an efficient spoken dialog system. Until recently, quantitative comparison of different state tracking methods was difficult. However the 2013 Dialog State Tracking Challenge (DSTC) introduced a common dataset and metrics that allow to evaluate the performance of trackers on a standardized task. In this paper we present our belief tracker based on the Hidden Information State (HIS) model with an adjusted user model component. Further, we report the results of our tracker on test3 dataset from DSTC. Our tracker is competitive with trackers submitted to DSTC, even without training it achieves the best results in L2 metrics and it performs between second and third place in accuracy. After adjusting the tracker using the provided data it outperformed the other submissions also in accuracy and yet improved in L2. Additionally we present preliminary results on another two datasets, test1 and test2, used in the DSTC. Strong performance in L2 metric means that our tracker produces well calibrated hypotheses probabilities.
准确的对话状态跟踪是设计高效口语对话系统的关键。直到最近,对不同状态跟踪方法的定量比较还是很困难的。然而,2013年对话状态跟踪挑战(DSTC)引入了一个通用的数据集和指标,允许评估跟踪器在标准化任务中的性能。本文提出了一种基于HIS (Hidden Information State)模型的信念跟踪器,该模型具有调整后的用户模型组件。此外,我们报告了我们的跟踪器在DSTC的test3数据集上的结果。我们的跟踪器与提交给DSTC的跟踪器相比具有竞争力,即使没有经过培训,它在L2指标中也取得了最好的结果,并且在准确性方面表现在第二到第三名之间。在使用提供的数据调整跟踪器后,它在准确性上也优于其他提交,但在L2中有所提高。此外,我们还介绍了DSTC中使用的另外两个数据集test1和test2的初步结果。L2指标的强劲表现意味着我们的跟踪器产生了校准良好的假设概率。
{"title":"IBM’s Belief Tracker: Results On Dialog State Tracking Challenge Datasets","authors":"Rudolf Kadlec, Jindřich Libovický, Jan Macek, Jan Kleindienst","doi":"10.3115/v1/W14-0202","DOIUrl":"https://doi.org/10.3115/v1/W14-0202","url":null,"abstract":"Accurate dialog state tracking is crucial for the design of an efficient spoken dialog system. Until recently, quantitative comparison of different state tracking methods was difficult. However the 2013 Dialog State Tracking Challenge (DSTC) introduced a common dataset and metrics that allow to evaluate the performance of trackers on a standardized task. In this paper we present our belief tracker based on the Hidden Information State (HIS) model with an adjusted user model component. Further, we report the results of our tracker on test3 dataset from DSTC. Our tracker is competitive with trackers submitted to DSTC, even without training it achieves the best results in L2 metrics and it performs between second and third place in accuracy. After adjusting the tracker using the provided data it outperformed the other submissions also in accuracy and yet improved in L2. Additionally we present preliminary results on another two datasets, test1 and test2, used in the DSTC. Strong performance in L2 metric means that our tracker produces well calibrated hypotheses probabilities.","PeriodicalId":198983,"journal":{"name":"DM@EACL","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2014-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123316772","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
期刊
DM@EACL
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1