Proposal of a Model to Determine the Attention Target for an Agent in Group Discussion with Non-verbal Features

Seiya Kimura, Hung-Hsuan Huang, Qi Zhang, S. Okada, Naoki Ohta, K. Kuwabara
{"title":"Proposal of a Model to Determine the Attention Target for an Agent in Group Discussion with Non-verbal Features","authors":"Seiya Kimura, Hung-Hsuan Huang, Qi Zhang, S. Okada, Naoki Ohta, K. Kuwabara","doi":"10.1145/3125739.3125775","DOIUrl":null,"url":null,"abstract":"In recent years, companies are seeking for communication skill from their employers. More and more companies adopt group discussions in employer recruitment to evaluate the ap- plicants' communication skill. However, the opportunity to improve communication skill in group discussion is limited due to the lack of partners. In order to solve this issue, our ongoing project is aiming to build a virtual agent or a robot that can participate group discussion, so that its users can re- peatedly practice group discussion with it. In this paper, we propose the models in directing the agent's attention toward the other participants in three situations:when the agent is speaking, when the agent is listening, and when no partic- ipant is speaking. First, we gathered a data corpus of the discussion of 10 four-people groups. We then use low-level non-verbal features including attention of other participant, voice prosody, head movements, and speech turn extracted in the 10-hour corpus to train support vector machine models to determine the agent's attention on the other participants, or the material. The performance of the detection models in F-measure range between 0.4 and 0.6.","PeriodicalId":346669,"journal":{"name":"Proceedings of the 5th International Conference on Human Agent Interaction","volume":"44 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 5th International Conference on Human Agent Interaction","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3125739.3125775","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

In recent years, companies are seeking for communication skill from their employers. More and more companies adopt group discussions in employer recruitment to evaluate the ap- plicants' communication skill. However, the opportunity to improve communication skill in group discussion is limited due to the lack of partners. In order to solve this issue, our ongoing project is aiming to build a virtual agent or a robot that can participate group discussion, so that its users can re- peatedly practice group discussion with it. In this paper, we propose the models in directing the agent's attention toward the other participants in three situations:when the agent is speaking, when the agent is listening, and when no partic- ipant is speaking. First, we gathered a data corpus of the discussion of 10 four-people groups. We then use low-level non-verbal features including attention of other participant, voice prosody, head movements, and speech turn extracted in the 10-hour corpus to train support vector machine models to determine the agent's attention on the other participants, or the material. The performance of the detection models in F-measure range between 0.4 and 0.6.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
具有非语言特征的群体讨论中主体注意目标确定模型的提出
近年来,公司都在向雇主寻求沟通技巧。越来越多的公司在招聘中采用小组讨论的方式来评估应聘者的沟通能力。然而,由于缺乏合作伙伴,在小组讨论中提高沟通技巧的机会有限。为了解决这个问题,我们正在进行的项目旨在建立一个可以参与小组讨论的虚拟代理或机器人,让它的用户可以和它反复练习小组讨论。在本文中,我们提出了在三种情况下将代理的注意力引导到其他参与者身上的模型:当代理说话时,当代理倾听时,以及当没有参与者说话时。首先,我们收集了10个四人小组讨论的数据语料库。然后,我们使用从10小时语料库中提取的低级非语言特征,包括其他参与者的注意力、语音韵律、头部运动和语音转向,来训练支持向量机模型,以确定智能体对其他参与者或材料的注意力。检测模型在f值范围为0.4 ~ 0.6之间。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Conversational Agent Learning Natural Gaze and Motion of Multi-Party Conversation from Example Keynote Talk Virtual Character Agent for Lowering Knowledge-sharing Barriers on Q&A Websites The Impact of Personalisation on Human-Robot Interaction in Learning Scenarios Human-Assisted Learning of Object Models through Active Object Exploration
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1