In the domain of natural language understanding and more precisely man-machine dialogue design, there are usually two trends of research which seem to be rather differentiated. On the one hand, many studies have tackled the problem of interpreting spatial references expressed in verbal utterances, focusing in particular on the different geometric or functionnal constraints which are bound to the existance of a 'source' (or site) element in relation to which a 'target' is being situated. Such studies are usually based upon fine grained linguistic descriptions for different languages (Vandeloise, 1986). On the other hand, the problem raised by the integration of a gestural mode within classical NL interfaces has yielded some specific research about the association of demonstrative or deictic Nps together with designations, as initited by Bolt some two decades ago (cf. Thorisson et alii, 1992; Bellalem and Romary, 1995). Our aim in this paper is to show that the different phenomena described in the context of spatial reference or multimodal interaction should not necessarily be considered as two independant issues, but should rather be analysed in a unified way to account for the fact that they are both based on linguistic and perceptual data.
在自然语言理解和更精确的人机对话设计领域，通常有两种研究趋势，似乎相当分化。一方面，许多研究解决了解释言语表达的空间参考的问题，特别关注与“源”(或“地点”)元素的存在有关的不同几何或功能限制，这些限制与“目标”所在的位置有关。这类研究通常基于对不同语言的细粒度语言描述(Vandeloise, 1986)。另一方面，在经典NL界面中整合手势模式所带来的问题已经产生了一些关于指示性或指示性Nps与名称的关联的具体研究，这是由Bolt在大约20年前发起的(参见Thorisson et alii, 1992;Bellalem and Romary, 1995)。我们在本文中的目的是表明，在空间参考或多模态相互作用的背景下描述的不同现象不应该被视为两个独立的问题，而应该以统一的方式进行分析，以解释它们都基于语言和感知数据的事实。
{"title":"Constraints on the Use of Language, Gesture and Speech for Multimodal Dialogues","authors":"B. Gaiffe, Laurent Romary","doi":"10.3115/1621585.1621602","DOIUrl":"https://doi.org/10.3115/1621585.1621602","url":null,"abstract":"In the domain of natural language understanding and more precisely man-machine dialogue design, there are usually two trends of research which seem to be rather differentiated. On the one hand, many studies have tackled the problem of interpreting spatial references expressed in verbal utterances, focusing in particular on the different geometric or functionnal constraints which are bound to the existance of a 'source' (or site) element in relation to which a 'target' is being situated. Such studies are usually based upon fine grained linguistic descriptions for different languages (Vandeloise, 1986). On the other hand, the problem raised by the integration of a gestural mode within classical NL interfaces has yielded some specific research about the association of demonstrative or deictic Nps together with designations, as initited by Bolt some two decades ago (cf. Thorisson et alii, 1992; Bellalem and Romary, 1995). Our aim in this paper is to show that the different phenomena described in the context of spatial reference or multimodal interaction should not necessarily be considered as two independant issues, but should rather be analysed in a unified way to account for the fact that they are both based on linguistic and perceptual data.","PeriodicalId":339726,"journal":{"name":"Referring Phenomena in a Multimedia Context and their Computational Treatment on - ReferringPhenomena '97","volume":"41 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"1997-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128394126","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：