首页 > 最新文献

2015 International Conference on Affective Computing and Intelligent Interaction (ACII)最新文献

英文 中文
Towards affect detection during human-technology interaction: An empirical study using a combined EEG and fNIRS approach 人-技术交互过程中的情感检测:一项结合EEG和fNIRS方法的实证研究
K. Pollmann, Mathias Vukelić, M. Peissner
The present Ph. D. project explores possibilities to apply neurophysiological methods for affect detection during human-technology interaction (HTI). Portable neurophysio-logical methods such as electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) offer an objective, ecologically valid and rather convenient way to infer the user's affective state through the monitoring of brain activity. To identify neural signatures for positive and negative affective user reactions an empirical study is proposed. The experimental design of this study enables synchronous data acquisition for EEG, fNIRS and psychophysiological measurements while the user is interacting with an adaptive web-interface. During the interaction process positive and negative affective states are induced by system-generated adaptive actions which are either appropriate and helpful or inappropriate and impedimental. The findings of the empirical study shed light into the question whether EEG, fNIRS or a hybrid approach that combines the employed methods is most reliable for affect detection during HTI.
目前的博士项目探索在人机交互(HTI)过程中应用神经生理学方法进行情感检测的可能性。便携式神经生理学方法,如脑电图(EEG)和功能近红外光谱(fNIRS)提供了一种客观、生态有效和相当方便的方法,通过监测大脑活动来推断用户的情感状态。为了识别积极和消极情感用户反应的神经特征,提出了一项实证研究。本研究的实验设计能够在用户与自适应网络界面交互时同步采集EEG、fNIRS和心理生理测量数据。在互动过程中,积极和消极的情感状态是由系统产生的适应性行为引起的,这些适应性行为可能是适当的、有益的,也可能是不适当的、有害的。实证研究的结果揭示了一个问题,即EEG、fNIRS或结合所采用方法的混合方法在HTI期间的情感检测中是最可靠的。
{"title":"Towards affect detection during human-technology interaction: An empirical study using a combined EEG and fNIRS approach","authors":"K. Pollmann, Mathias Vukelić, M. Peissner","doi":"10.1109/ACII.2015.7344649","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344649","url":null,"abstract":"The present Ph. D. project explores possibilities to apply neurophysiological methods for affect detection during human-technology interaction (HTI). Portable neurophysio-logical methods such as electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) offer an objective, ecologically valid and rather convenient way to infer the user's affective state through the monitoring of brain activity. To identify neural signatures for positive and negative affective user reactions an empirical study is proposed. The experimental design of this study enables synchronous data acquisition for EEG, fNIRS and psychophysiological measurements while the user is interacting with an adaptive web-interface. During the interaction process positive and negative affective states are induced by system-generated adaptive actions which are either appropriate and helpful or inappropriate and impedimental. The findings of the empirical study shed light into the question whether EEG, fNIRS or a hybrid approach that combines the employed methods is most reliable for affect detection during HTI.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"1 1","pages":"726-732"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77439815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Warmth in affective mediated interaction: Exploring the effects of physical warmth on interpersonal warmth 情感中介互动中的温暖:探讨身体温暖对人际温暖的影响
Christian J. A. M. Willemse, D. Heylen, J. V. Erp
Recent research suggests that physical warmth activates perceptions of metaphorical interpersonal warmth and closeness, and increases pro-social behavior. These effects are grounded in our earliest intimate experiences: being held by our loving caregivers. These findings provide reasons to incorporate warmth in devices for distant affective communication, which could simulate one's body heat. An experiment was carried out to gain a better understanding of the implications of physical warmth for mediated social interaction. Moreover, we aimed at disentangling effects of social warmth (body temperature) from effects of non-social warmth (artificial heat sources and ambient temperature). Except for an increase in perceptions of metaphorical warmth as a consequence of higher ambient temperature, no effects were found. We use our study to pinpoint the caveats and challenges that research into warmth in affective mediated interaction faces.
最近的研究表明,身体上的温暖会激活隐喻性的人际温暖和亲密感,并增加亲社会行为。这些影响根植于我们最早的亲密体验:被爱我们的照顾者抱着。这些发现为在远程情感交流设备中加入温度提供了理由,这种设备可以模拟人的体温。为了更好地理解身体温暖对中介社会互动的影响,进行了一项实验。此外,我们旨在将社会温暖(体温)的影响与非社会温暖(人工热源和环境温度)的影响分离开来。除了由于环境温度升高而增加了对隐喻性温暖的感知外,没有发现任何影响。我们利用我们的研究来确定在情感介导的互动中研究温暖所面临的警告和挑战。
{"title":"Warmth in affective mediated interaction: Exploring the effects of physical warmth on interpersonal warmth","authors":"Christian J. A. M. Willemse, D. Heylen, J. V. Erp","doi":"10.1109/ACII.2015.7344547","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344547","url":null,"abstract":"Recent research suggests that physical warmth activates perceptions of metaphorical interpersonal warmth and closeness, and increases pro-social behavior. These effects are grounded in our earliest intimate experiences: being held by our loving caregivers. These findings provide reasons to incorporate warmth in devices for distant affective communication, which could simulate one's body heat. An experiment was carried out to gain a better understanding of the implications of physical warmth for mediated social interaction. Moreover, we aimed at disentangling effects of social warmth (body temperature) from effects of non-social warmth (artificial heat sources and ambient temperature). Except for an increase in perceptions of metaphorical warmth as a consequence of higher ambient temperature, no effects were found. We use our study to pinpoint the caveats and challenges that research into warmth in affective mediated interaction faces.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"126 1","pages":"28-34"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85275900","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Functional connectivity from EEG signals during perceiving pleasant and unpleasant odors 在感知愉快气味和不愉快气味时脑电信号的功能连接
He Xu, E. Kroupi, T. Ebrahimi
The olfactory sense is strongly related to memory and emotional processes. Studies on the effects of odor perception from brain activity have been conducted by using different neuro-imaging techniques. In this paper, we analyse electroencephalography (EEG) of 23 subjects during perceiving pleasant and unpleasant odor stimuli. We describe the construction of brain functional connectivity networks measured by most commonly used models. We discuss the network-based features of functional connectivity, and design classifiers by applying different functional connectivity network features. Finally, we show that pleasant and unpleasant emotions from olfactory perceptions can be better classified if we see the brain as a nonlinear small-world network. By extracting appropriate features from functional connectivity networks, we manage to classify pleasant and unpleasant olfactory perceptions with an average Kappa value of 0.11 ± 0.17, which is significantly non-random.
嗅觉与记忆和情绪过程密切相关。通过使用不同的神经成像技术,对大脑活动对气味感知的影响进行了研究。本文分析了23名受试者在感知愉快和不愉快气味刺激时的脑电图。我们描述了用最常用的模型测量的脑功能连接网络的构建。我们讨论了基于网络的功能连接特征,并通过应用不同的功能连接网络特征来设计分类器。最后,我们表明,如果我们把大脑看作一个非线性的小世界网络,来自嗅觉感知的愉快和不愉快的情绪可以更好地分类。通过从功能连接网络中提取适当的特征,我们成功地对愉快和不愉快的嗅觉感知进行了分类,平均Kappa值为0.11±0.17,这是非随机的。
{"title":"Functional connectivity from EEG signals during perceiving pleasant and unpleasant odors","authors":"He Xu, E. Kroupi, T. Ebrahimi","doi":"10.1109/ACII.2015.7344683","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344683","url":null,"abstract":"The olfactory sense is strongly related to memory and emotional processes. Studies on the effects of odor perception from brain activity have been conducted by using different neuro-imaging techniques. In this paper, we analyse electroencephalography (EEG) of 23 subjects during perceiving pleasant and unpleasant odor stimuli. We describe the construction of brain functional connectivity networks measured by most commonly used models. We discuss the network-based features of functional connectivity, and design classifiers by applying different functional connectivity network features. Finally, we show that pleasant and unpleasant emotions from olfactory perceptions can be better classified if we see the brain as a nonlinear small-world network. By extracting appropriate features from functional connectivity networks, we manage to classify pleasant and unpleasant olfactory perceptions with an average Kappa value of 0.11 ± 0.17, which is significantly non-random.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"43 1","pages":"911-916"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85481339","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Gesture mimicry in expression of laughter 用手势模仿来表示笑
H. Griffin, G. Varni, G. Volpe, Gisela Tomé Lourido, M. Mancini, N. Bianchi-Berthouze
Mimicry and laughter are two social signals displaying affiliation among people. To date, however, their relationship remains uninvestigated and relatively unexploited in designing the behaviour of robots and virtual characters. This paper presents an experiment aimed at examining how laughter and mimicry are related. The hypothesis is that hand movements a person produces during a laughter episode are mimicked through equivalent or other hand movements other participants in the interaction produce when they laugh. To investigate this, we analysed mimicry at two levels of specificity during laughter and non-laughter periods in a playful triadic social interaction. Changes in mimicry rates over the whole interaction were analysed as well as possible leader-follower relationships. Results show that hand movement rates were varied and strongly dependent on group. Even though hand movement are more frequent during laughter, mimicry does not increase. Mimicry levels, however, increase over the course of a session indicating that familiarity and comfort may increase emotional contagion.
模仿和笑是显示人与人之间关系的两种社会信号。然而,到目前为止,它们之间的关系仍未被研究,在设计机器人和虚拟角色的行为方面也相对未被利用。这篇论文提出了一个旨在研究笑和模仿之间关系的实验。这个假设是,一个人在笑的时候做出的手部动作,会被其他参与者在笑的时候做出的相同或其他的手部动作所模仿。为了研究这一点,我们分析了在一个有趣的三合一社会互动中,笑和不笑期间的两个特异性水平的模仿。在整个互动过程中,模仿率的变化以及可能的领导-追随者关系被分析。结果表明,手的运动速度是不同的,并且强烈依赖于组。尽管在笑的时候手部动作更频繁,但模仿并没有增加。然而,模仿水平会随着会话的进行而增加,这表明熟悉和舒适可能会增加情绪传染。
{"title":"Gesture mimicry in expression of laughter","authors":"H. Griffin, G. Varni, G. Volpe, Gisela Tomé Lourido, M. Mancini, N. Bianchi-Berthouze","doi":"10.1109/ACII.2015.7344642","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344642","url":null,"abstract":"Mimicry and laughter are two social signals displaying affiliation among people. To date, however, their relationship remains uninvestigated and relatively unexploited in designing the behaviour of robots and virtual characters. This paper presents an experiment aimed at examining how laughter and mimicry are related. The hypothesis is that hand movements a person produces during a laughter episode are mimicked through equivalent or other hand movements other participants in the interaction produce when they laugh. To investigate this, we analysed mimicry at two levels of specificity during laughter and non-laughter periods in a playful triadic social interaction. Changes in mimicry rates over the whole interaction were analysed as well as possible leader-follower relationships. Results show that hand movement rates were varied and strongly dependent on group. Even though hand movement are more frequent during laughter, mimicry does not increase. Mimicry levels, however, increase over the course of a session indicating that familiarity and comfort may increase emotional contagion.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"16 1","pages":"677-683"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90311395","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Multimodal data collection of human-robot humorous interactions in the Joker project Joker项目中人机幽默互动的多模式数据收集
L. Devillers, S. Rosset, G. D. Duplessis, M. A. Sehili, Lucile Bechade, Agnès Delaborde, Clément Gossart, Vincent Letard, Fan Yang, Y. Yemez, Bekir Berker Turker, T. M. Sezgin, Kevin El Haddad, S. Dupont, Daniel Luzzati, Y. Estève, E. Gilmartin, N. Campbell
Thanks to a remarkably great ability to show amusement and engagement, laughter is one of the most important social markers in human interactions. Laughing together can actually help to set up a positive atmosphere and favors the creation of new relationships. This paper presents a data collection of social interaction dialogs involving humor between a human participant and a robot. In this work, interaction scenarios have been designed in order to study social markers such as laughter. They have been implemented within two automatic systems developed in the Joker project: a social dialog system using paralinguistic cues and a task-based dialog system using linguistic content. One of the major contributions of this work is to provide a context to study human laughter produced during a human-robot interaction. The collected data will be used to build a generic intelligent user interface which provides a multimodal dialog system with social communication skills including humor and other informal socially oriented behaviors. This system will emphasize the fusion of verbal and non-verbal channels for emotional and social behavior perception, interaction and generation capabilities.
笑是一种表现娱乐和参与的非凡能力,是人类交往中最重要的社会标志之一。一起笑实际上可以帮助建立一个积极的氛围,有利于建立新的关系。本文介绍了人类参与者和机器人之间涉及幽默的社会互动对话的数据收集。在这项工作中,互动场景的设计是为了研究笑声等社会标志。它们已经在Joker项目中开发的两个自动系统中实现:使用副语言线索的社交对话系统和使用语言内容的基于任务的对话系统。这项工作的主要贡献之一是为研究人机交互过程中产生的人类笑声提供了一个背景。收集到的数据将用于构建一个通用的智能用户界面,该界面提供一个具有社交沟通技巧的多模态对话系统,包括幽默和其他非正式的社交导向行为。该系统将强调情感和社会行为感知、互动和生成能力的语言和非语言渠道的融合。
{"title":"Multimodal data collection of human-robot humorous interactions in the Joker project","authors":"L. Devillers, S. Rosset, G. D. Duplessis, M. A. Sehili, Lucile Bechade, Agnès Delaborde, Clément Gossart, Vincent Letard, Fan Yang, Y. Yemez, Bekir Berker Turker, T. M. Sezgin, Kevin El Haddad, S. Dupont, Daniel Luzzati, Y. Estève, E. Gilmartin, N. Campbell","doi":"10.1109/ACII.2015.7344594","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344594","url":null,"abstract":"Thanks to a remarkably great ability to show amusement and engagement, laughter is one of the most important social markers in human interactions. Laughing together can actually help to set up a positive atmosphere and favors the creation of new relationships. This paper presents a data collection of social interaction dialogs involving humor between a human participant and a robot. In this work, interaction scenarios have been designed in order to study social markers such as laughter. They have been implemented within two automatic systems developed in the Joker project: a social dialog system using paralinguistic cues and a task-based dialog system using linguistic content. One of the major contributions of this work is to provide a context to study human laughter produced during a human-robot interaction. The collected data will be used to build a generic intelligent user interface which provides a multimodal dialog system with social communication skills including humor and other informal socially oriented behaviors. This system will emphasize the fusion of verbal and non-verbal channels for emotional and social behavior perception, interaction and generation capabilities.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"122 1","pages":"348-354"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90575113","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 40
Affect-expressive movement generation with factored conditional Restricted Boltzmann Machines 基于因子条件受限玻尔兹曼机的情感表达运动生成
Omid Alemi, William Li, Philippe Pasquier
The expressivity of virtual, animated agents plays an important role in their believability. While the planning and goal-oriented aspects of agent movements have been addressed in the literature extensively, expressing the emotional state of the agents in their movements is an open research problem. We present our interactive animated agent model with controllable affective movements. We have recorded a corpus of affect-expressive motion capture data of two actors, performing various movements, and annotated based on their arousal and valence levels. We train a Factored, Conditional Restricted Boltzmann Machine (FCRBM) with this corpus in order to capture and control the valence and arousal qualities of movement patterns. The agents are then able to control the emotional qualities of their movements through the FCRBM for any given combination of the valence and arousal. Our results show that the model is capable of controlling the arousal level of the synthesized movements, and to some extent their valence, through manually defining the level of valence and arousal of the agent, as well as making transitions from one state to the other. We validate the expressive abilities of the model through conducting an experiment where participants were asked to rate their perceived affective state for both the generated and recorded movements.
虚拟动画代理的表现力对其可信度起着重要的作用。虽然智能体运动的计划和目标导向方面已经在文献中得到了广泛的讨论,但表达智能体在运动中的情绪状态是一个开放的研究问题。提出了具有可控情感运动的交互式动画智能体模型。我们记录了两个演员表演各种动作的情感表达动作捕捉数据,并根据他们的唤醒和效价水平进行了注释。为了捕获和控制运动模式的价态和唤醒性质,我们使用该语料库训练了一个因子条件受限玻尔兹曼机(FCRBM)。然后,参与者能够通过FCRBM控制他们动作的情感品质,以适应任何给定的价态和觉醒组合。我们的结果表明,该模型能够通过手动定义智能体的价和唤醒水平,以及从一种状态到另一种状态的转换,来控制合成动作的唤醒水平,并在一定程度上控制它们的价。我们通过进行一项实验来验证模型的表达能力,该实验要求参与者对生成的和记录的动作进行感知情感状态的评分。
{"title":"Affect-expressive movement generation with factored conditional Restricted Boltzmann Machines","authors":"Omid Alemi, William Li, Philippe Pasquier","doi":"10.1109/ACII.2015.7344608","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344608","url":null,"abstract":"The expressivity of virtual, animated agents plays an important role in their believability. While the planning and goal-oriented aspects of agent movements have been addressed in the literature extensively, expressing the emotional state of the agents in their movements is an open research problem. We present our interactive animated agent model with controllable affective movements. We have recorded a corpus of affect-expressive motion capture data of two actors, performing various movements, and annotated based on their arousal and valence levels. We train a Factored, Conditional Restricted Boltzmann Machine (FCRBM) with this corpus in order to capture and control the valence and arousal qualities of movement patterns. The agents are then able to control the emotional qualities of their movements through the FCRBM for any given combination of the valence and arousal. Our results show that the model is capable of controlling the arousal level of the synthesized movements, and to some extent their valence, through manually defining the level of valence and arousal of the agent, as well as making transitions from one state to the other. We validate the expressive abilities of the model through conducting an experiment where participants were asked to rate their perceived affective state for both the generated and recorded movements.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"83 1","pages":"442-448"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89641984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 21
Investigation of risk taking behavior and outcomes in decision making with modified BART (m-BART) 基于改良捷运(m-BART)的风险行为与决策结果调查
Kemal Taskin, D. Gökçay
Responses to risky choices were collected and analyzed in a continuous, engaging and decomposable risk taking task; a slightly modified version of BART (Balloon Analog Risk Task [1]). Pupil dilation data throughout the experiment were collected and analyzed to understand participants' physiological expressions under risky choices. Participants were also administered a survey, prior to the experiment to monitor individual risk taking attitudes. A thorough analysis of responses indicated a dynamic system consisting of risk taking or aversive states. Participants' pupil dilation rates were predictable from this dynamical model abstracted from consecutive responses. These findings may lead to a model that fuses affective and cognitive aspects within risky uncertain decisions. Natural risk tendencies, extracted from the survey had no statistically significant effect on the results.
对风险选择的反应被收集和分析成一个连续的、引人入胜的、可分解的风险承担任务;一个稍作修改的BART(气球模拟风险任务[1])。收集并分析整个实验过程中的瞳孔扩张数据,以了解参与者在风险选择下的生理表达。在实验之前,参与者还接受了一项调查,以监测个人的冒险态度。对反应的彻底分析表明,这是一个由冒险或厌恶状态组成的动态系统。从连续反应中提取的动态模型可预测受试者的瞳孔扩张率。这些发现可能会导致一个模型,融合情感和认知方面的风险不确定的决定。从调查中提取的自然风险倾向对结果没有统计学上显著的影响。
{"title":"Investigation of risk taking behavior and outcomes in decision making with modified BART (m-BART)","authors":"Kemal Taskin, D. Gökçay","doi":"10.1109/ACII.2015.7344587","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344587","url":null,"abstract":"Responses to risky choices were collected and analyzed in a continuous, engaging and decomposable risk taking task; a slightly modified version of BART (Balloon Analog Risk Task [1]). Pupil dilation data throughout the experiment were collected and analyzed to understand participants' physiological expressions under risky choices. Participants were also administered a survey, prior to the experiment to monitor individual risk taking attitudes. A thorough analysis of responses indicated a dynamic system consisting of risk taking or aversive states. Participants' pupil dilation rates were predictable from this dynamical model abstracted from consecutive responses. These findings may lead to a model that fuses affective and cognitive aspects within risky uncertain decisions. Natural risk tendencies, extracted from the survey had no statistically significant effect on the results.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"56 1","pages":"302-307"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91478446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Web questionnaire as construction method of affect-annotated lexicon - Risks reduction strategy 网络问卷作为情感注释词典的构建方法——风险降低策略
A. Landowska
The paper concerns credibility of construction methods for affect-annotated lexicons, specifically a web questionnaire is explored and evaluated. Web-based surveys are susceptible to some risks, which might influence credibility of the results, as some participants might perform random clicks or intentionally falsify the responses. The paper explores the risks and proposes some strategies to reduce them. The strategies are supported by their experimental evaluation in the real case of SentiD affect-annotated dictionary construction.
本文探讨了情感注释词典构建方法的可信度,并对网络问卷进行了探讨和评价。基于网络的调查容易受到一些风险的影响,这可能会影响结果的可信度,因为一些参与者可能会随机点击或故意伪造回答。本文对风险进行了探讨,并提出了降低风险的策略。这些策略在SentiD情感注释字典构建的实际案例中得到了实验评估的支持。
{"title":"Web questionnaire as construction method of affect-annotated lexicon - Risks reduction strategy","authors":"A. Landowska","doi":"10.1109/ACII.2015.7344605","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344605","url":null,"abstract":"The paper concerns credibility of construction methods for affect-annotated lexicons, specifically a web questionnaire is explored and evaluated. Web-based surveys are susceptible to some risks, which might influence credibility of the results, as some participants might perform random clicks or intentionally falsify the responses. The paper explores the risks and proposes some strategies to reduce them. The strategies are supported by their experimental evaluation in the real case of SentiD affect-annotated dictionary construction.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"84 1","pages":"421-427"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77392968","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Recognizing emotion from singing and speaking using shared models 使用共享模型从唱歌和说话中识别情感
Biqiao Zhang, Georg Essl, E. Provost
Speech and song are two types of vocal communications that are closely related to each other. While significant progress has been made in both speech and music emotion recognition, few works have concentrated on building a shared emotion recognition model for both speech and song. In this paper, we propose three shared emotion recognition models for speech and song: a simple model, a single-task hierarchical model, and a multi-task hierarchical model. We study the commonalities and differences present in emotion expression across these two communication domains. We compare the performance across different settings, investigate the relationship between evaluator agreement rate and classification accuracy, and analyze the classification performance of individual feature groups. Our results show that the multi-task model classifies emotion more accurately compared to single-task models when the same set of features is used. This suggests that although spoken and sung emotion recognition tasks are different, they are related, and can be considered together. The results demonstrate that utterances with lower agreement rate and emotions with low activation benefit the most from multi-task learning. Visual features appear to be more similar across spoken and sung emotion expression, compared to acoustic features.
言语和歌声是两种相互密切相关的声音交流方式。虽然语音和音乐情感识别都取得了重大进展,但很少有工作集中在为语音和歌曲建立共享情感识别模型上。本文提出了语音和歌曲的三种共享情感识别模型:简单模型、单任务分层模型和多任务分层模型。我们研究了这两个交流领域中情感表达的共性和差异。我们比较了不同设置下的性能,研究了评估者一致性和分类准确率之间的关系,并分析了单个特征组的分类性能。我们的研究结果表明,当使用相同的特征集时,多任务模型比单任务模型更准确地分类情绪。这表明,尽管口头和歌唱的情感识别任务不同,但它们是相关的,可以一起考虑。结果表明,一致性率较低的话语和激活度较低的情绪在多任务学习中获益最大。与声音特征相比,视觉特征在口头和歌唱情感表达中似乎更相似。
{"title":"Recognizing emotion from singing and speaking using shared models","authors":"Biqiao Zhang, Georg Essl, E. Provost","doi":"10.1109/ACII.2015.7344563","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344563","url":null,"abstract":"Speech and song are two types of vocal communications that are closely related to each other. While significant progress has been made in both speech and music emotion recognition, few works have concentrated on building a shared emotion recognition model for both speech and song. In this paper, we propose three shared emotion recognition models for speech and song: a simple model, a single-task hierarchical model, and a multi-task hierarchical model. We study the commonalities and differences present in emotion expression across these two communication domains. We compare the performance across different settings, investigate the relationship between evaluator agreement rate and classification accuracy, and analyze the classification performance of individual feature groups. Our results show that the multi-task model classifies emotion more accurately compared to single-task models when the same set of features is used. This suggests that although spoken and sung emotion recognition tasks are different, they are related, and can be considered together. The results demonstrate that utterances with lower agreement rate and emotions with low activation benefit the most from multi-task learning. Visual features appear to be more similar across spoken and sung emotion expression, compared to acoustic features.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"45 1","pages":"139-145"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79252087","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 36
Stress is in the eye of the beholder 压力存在于旁观者的眼中
Yuliya Lutchyn, Paul Johns, M. Czerwinski, Shamsi T. Iqbal, G. Mark, A. Sano
Despite a long history and a large volume of affective research, measuring affective states is still a non-trivial task that is complicated by numerous conceptual and methodological decisions that the researcher has to make. We suggest that inconsistent results reported in some areas of research can be partially explained by the choice of measurements that capture different manifestations of affective phenomena, or focus on different elements of affective processes. In the present study we examine one of such topics - a relationship between stress and individual's work role. In a 2-week, multi-method in situ study we collected affective information from 40 subjects. All participants provided continuous physiological (cardiovascular) data for the entire duration of the study, submitted multiple daily self-reports of momentary affect, and filled out a onetime assessment of the global perceived stress. We found that individuals' job role (specifically, decision-making workload) was not related to the cumulative measures of momentary affect, but was negatively correlated with the overall level of perceived stress. We further found that this negative relationship was partially mediated by individuals' coping behaviors. Our results emphasize the important difference between fleeting and global (appraised) affective states, and remind about intervening variables that can significantly modify affective processes. We suggest directions for future research and discuss practical applications for stress management.
尽管有悠久的历史和大量的情感研究,测量情感状态仍然是一项重要的任务,研究人员必须做出许多概念和方法上的决定。我们认为,在某些研究领域报告的不一致结果可以部分解释为选择捕捉情感现象的不同表现的测量方法,或关注情感过程的不同元素。在目前的研究中,我们考察了其中一个主题-压力与个人工作角色之间的关系。在为期两周的多方法原位研究中,我们收集了40名受试者的情感信息。所有参与者在整个研究过程中都提供了连续的生理(心血管)数据,提交了多份每日瞬间影响的自我报告,并填写了一份一次性的全球感知压力评估。我们发现个体的工作角色(特别是决策工作量)与瞬时影响的累积测量无关,但与感知压力的总体水平呈负相关。我们进一步发现,个体的应对行为在这种负向关系中起部分中介作用。我们的研究结果强调了短暂的情感状态和整体(评估)情感状态之间的重要区别,并提醒了可以显著改变情感过程的干预变量。我们提出了未来研究的方向,并讨论了压力管理的实际应用。
{"title":"Stress is in the eye of the beholder","authors":"Yuliya Lutchyn, Paul Johns, M. Czerwinski, Shamsi T. Iqbal, G. Mark, A. Sano","doi":"10.1109/ACII.2015.7344560","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344560","url":null,"abstract":"Despite a long history and a large volume of affective research, measuring affective states is still a non-trivial task that is complicated by numerous conceptual and methodological decisions that the researcher has to make. We suggest that inconsistent results reported in some areas of research can be partially explained by the choice of measurements that capture different manifestations of affective phenomena, or focus on different elements of affective processes. In the present study we examine one of such topics - a relationship between stress and individual's work role. In a 2-week, multi-method in situ study we collected affective information from 40 subjects. All participants provided continuous physiological (cardiovascular) data for the entire duration of the study, submitted multiple daily self-reports of momentary affect, and filled out a onetime assessment of the global perceived stress. We found that individuals' job role (specifically, decision-making workload) was not related to the cumulative measures of momentary affect, but was negatively correlated with the overall level of perceived stress. We further found that this negative relationship was partially mediated by individuals' coping behaviors. Our results emphasize the important difference between fleeting and global (appraised) affective states, and remind about intervening variables that can significantly modify affective processes. We suggest directions for future research and discuss practical applications for stress management.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"4 1","pages":"119-124"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81538152","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
期刊
2015 International Conference on Affective Computing and Intelligent Interaction (ACII)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1