首页 > 最新文献

2015 International Conference on Affective Computing and Intelligent Interaction (ACII)最新文献

英文 中文
A locally weighted method to improve linear regression for lexical-based valence-arousal prediction 一种改进线性回归的局部加权方法用于基于词汇的效价唤醒预测
Jin Wang, K. R. Lai, Liang-Chih Yu, Xuejie Zhang
Text-based sentiment analysis is a growing research field in affective computing, driven by both commercial applications and academic interest. Continuous dimensional representations, such as valence-arousal (VA) space, can represent the affective state more precisely than discrete effective representations. In building dimensional sentiment applications, affective lexicons with valence-arousal ratings are useful resources but are still very rare. Therefore, recent studies have investigated the automatic development of VA lexicons using linear regression techniques. One of the major limitations of linear regression is the under-fitting problem which can cause a poor fit between the algorithm and the training data. To tackle this problem, this study proposes the use of a locally weighted linear regression (LWLR) model to predict the valence-arousal ratings of affective words. The locally weighted method performs a regression around the point of interest using only training data that are “local” to that point, and thus can reduce the impact of noise from unrelated training data. Experimental results show that the proposed method achieved better performance for VA word prediction.
基于文本的情感分析是情感计算的一个新兴研究领域,受到商业应用和学术兴趣的双重驱动。连续维度表征,如效价觉醒(VA)空间,能比离散有效表征更精确地表征情感状态。在构建维度情感应用中,带有价-唤醒评级的情感词汇是有用的资源,但仍然非常罕见。因此,近年来有研究利用线性回归技术对虚拟语言词汇的自动生成进行了研究。线性回归的主要限制之一是欠拟合问题,这可能导致算法与训练数据之间的拟合不良。为了解决这一问题,本研究提出使用局部加权线性回归(LWLR)模型来预测情感词的效价唤醒等级。局部加权方法仅使用与该点“局部”的训练数据围绕感兴趣点执行回归,因此可以减少来自不相关训练数据的噪声的影响。实验结果表明,本文提出的方法在VA词预测中取得了较好的效果。
{"title":"A locally weighted method to improve linear regression for lexical-based valence-arousal prediction","authors":"Jin Wang, K. R. Lai, Liang-Chih Yu, Xuejie Zhang","doi":"10.1109/ACII.2015.7344604","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344604","url":null,"abstract":"Text-based sentiment analysis is a growing research field in affective computing, driven by both commercial applications and academic interest. Continuous dimensional representations, such as valence-arousal (VA) space, can represent the affective state more precisely than discrete effective representations. In building dimensional sentiment applications, affective lexicons with valence-arousal ratings are useful resources but are still very rare. Therefore, recent studies have investigated the automatic development of VA lexicons using linear regression techniques. One of the major limitations of linear regression is the under-fitting problem which can cause a poor fit between the algorithm and the training data. To tackle this problem, this study proposes the use of a locally weighted linear regression (LWLR) model to predict the valence-arousal ratings of affective words. The locally weighted method performs a regression around the point of interest using only training data that are “local” to that point, and thus can reduce the impact of noise from unrelated training data. Experimental results show that the proposed method achieved better performance for VA word prediction.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"1 1","pages":"415-420"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72887881","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Emotions triggered by innovative products: A multi-componential approach of emotions for user experience tools 创新产品引发的情感:用户体验工具的多成分情感方法
Damien Dupré, A. Tcherkassof, Michel Dubois
User eXperience studies with products, systems or services have significantly increased in companies in order to anticipate their commercial success. Among the user experience dimensions, emotions are predominant. However User eXperience studies used several concepts to refer to emotions and current measures still have some flaws. Consequently, this doctoral project aims firstly to provide a multi-componential approach of emotions based on a psychological view, and secondly to provide Affective Computing solutions in order to evaluate emotions in User eXperience studies. Through a study using hand-gesture interface devices, three components of users' emotions were simultaneously measured with self-reports: the subjective, cognitive and motivational components. The results point out the possibility of measuring different components in order to gain a better understanding of emotions triggered by products. They also point out that self-reports measures could be improved with Affective Computing solutions. In this perspective, two emotion assessment tools were developed: Oudjat and EmoLyse.
公司对产品、系统或服务的用户体验研究已显著增加,以预测其商业成功。在用户体验维度中,情感占主导地位。然而,用户体验研究使用了几个概念来指代情感,目前的测量方法仍然存在一些缺陷。因此,本博士项目旨在首先提供基于心理学观点的情绪多成分方法,其次提供情感计算解决方案,以便在用户体验研究中评估情绪。通过使用手势界面设备的研究,用自我报告同时测量了用户情绪的三个组成部分:主观、认知和动机成分。研究结果指出了测量不同成分的可能性,以便更好地理解产品引发的情绪。他们还指出,情感计算解决方案可以改善自我报告措施。从这个角度来看,开发了两种情绪评估工具:Oudjat和EmoLyse。
{"title":"Emotions triggered by innovative products: A multi-componential approach of emotions for user experience tools","authors":"Damien Dupré, A. Tcherkassof, Michel Dubois","doi":"10.1109/ACII.2015.7344657","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344657","url":null,"abstract":"User eXperience studies with products, systems or services have significantly increased in companies in order to anticipate their commercial success. Among the user experience dimensions, emotions are predominant. However User eXperience studies used several concepts to refer to emotions and current measures still have some flaws. Consequently, this doctoral project aims firstly to provide a multi-componential approach of emotions based on a psychological view, and secondly to provide Affective Computing solutions in order to evaluate emotions in User eXperience studies. Through a study using hand-gesture interface devices, three components of users' emotions were simultaneously measured with self-reports: the subjective, cognitive and motivational components. The results point out the possibility of measuring different components in order to gain a better understanding of emotions triggered by products. They also point out that self-reports measures could be improved with Affective Computing solutions. In this perspective, two emotion assessment tools were developed: Oudjat and EmoLyse.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"25 1","pages":"772-777"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73065936","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 6
Reducing BCI calibration effort in RSVP tasks using online weighted adaptation regularization with source domain selection 利用带源域选择的在线加权自适应正则化方法减少RSVP任务中BCI校准的工作量
Dongrui Wu, Vernon J. Lawhern, Brent Lance
Rapid serial visual presentation based brain-computer interface (BCI) system relies on single-trial classification of event-related potentials. Because of large individual differences, some labeled subject-specific data are needed to calibrate the classifier for each new subject. This paper proposes an online weighted adaptation regularization (OwAR) algorithm to reduce the online calibration effort, and hence to increase the utility of the BCI system. We show that given the same number of labeled subject-specific training samples, OwAR can significantly improve the online calibration performance. In other words, given a desired classification accuracy, OwAR can significantly reduce the number of labeled subject-specific training samples. Furthermore, we also show that the computational cost of OwAR can be reduced by more than 50% by source domain selection, without a statistically significant sacrifice of classification performance.
基于快速串行视觉呈现的脑机接口(BCI)系统依赖于事件相关电位的单次分类。由于个体差异很大,需要一些标记的特定主题数据来校准每个新主题的分类器。本文提出了一种在线加权自适应正则化(OwAR)算法,以减少在线校准的工作量,从而提高BCI系统的实用性。我们表明,给定相同数量的标记主题特定训练样本,OwAR可以显著提高在线校准性能。换句话说,给定期望的分类精度,OwAR可以显著减少标记的特定主题训练样本的数量。此外,我们还表明,通过源域选择可以将OwAR的计算成本降低50%以上,而不会牺牲统计上显著的分类性能。
{"title":"Reducing BCI calibration effort in RSVP tasks using online weighted adaptation regularization with source domain selection","authors":"Dongrui Wu, Vernon J. Lawhern, Brent Lance","doi":"10.1109/ACII.2015.7344626","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344626","url":null,"abstract":"Rapid serial visual presentation based brain-computer interface (BCI) system relies on single-trial classification of event-related potentials. Because of large individual differences, some labeled subject-specific data are needed to calibrate the classifier for each new subject. This paper proposes an online weighted adaptation regularization (OwAR) algorithm to reduce the online calibration effort, and hence to increase the utility of the BCI system. We show that given the same number of labeled subject-specific training samples, OwAR can significantly improve the online calibration performance. In other words, given a desired classification accuracy, OwAR can significantly reduce the number of labeled subject-specific training samples. Furthermore, we also show that the computational cost of OwAR can be reduced by more than 50% by source domain selection, without a statistically significant sacrifice of classification performance.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"1 1","pages":"567-573"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74436497","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 15
Data-objects: Re-designing everyday objects as tactile affective interfaces 数据对象:将日常物品重新设计为触觉情感界面
C. Zhu, Harshit Agrawal, P. Maes
Data-Objects introduces the idea of re-designing physical objects that a person uses every day to act as tactile affective interfaces. Data-Objects are a means to provide users information about their use of different everyday objects and how it affects them. We do this by re-designing the objects to embed information in the physical body of the object itself without hampering its original functional capability. By 3D printing the body in a set period of time, differences in the information represented on the physical body over the time are aimed at highlighting patterns of how the usage of that object has been affecting the user. The overwhelming digital information that we are exposed to and the disconnect that it has from what it is representing makes the relation of the information to the different aspects of our life not effective. We think that using physical forms of objects to provide information can make the data more meaningful, enhancing the value of the object beyond its intended function. Physical forms can provide subliminal and tactile feedback to the users as they use the objects throughout the day, without specific visual attention. Being present physically ensures that people are more conscious of the data and patterns, and makes the data visible to other people as well.
数据对象引入了重新设计人们每天使用的物理对象作为触觉情感界面的想法。数据对象是一种向用户提供关于他们使用不同的日常对象及其如何影响他们的信息的方法。我们通过重新设计对象来实现这一点,在不妨碍其原始功能的情况下,将信息嵌入对象本身的物理身体中。通过在一段时间内3D打印身体,在一段时间内物理身体上表示的信息的差异旨在突出该对象的使用如何影响用户的模式。我们接触到的铺天盖地的数字信息,以及它所代表的东西之间的脱节,使得信息与我们生活的不同方面的关系变得无效。我们认为用物体的物理形式来提供信息可以使数据更有意义,使物体的价值超出其预期的功能。物理形式可以为用户提供潜意识和触觉反馈,因为他们一整天都在使用这些物体,而不需要特定的视觉注意。在现场可以确保人们更清楚地意识到数据和模式,并使其他人也能看到数据。
{"title":"Data-objects: Re-designing everyday objects as tactile affective interfaces","authors":"C. Zhu, Harshit Agrawal, P. Maes","doi":"10.1109/ACII.2015.7344590","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344590","url":null,"abstract":"Data-Objects introduces the idea of re-designing physical objects that a person uses every day to act as tactile affective interfaces. Data-Objects are a means to provide users information about their use of different everyday objects and how it affects them. We do this by re-designing the objects to embed information in the physical body of the object itself without hampering its original functional capability. By 3D printing the body in a set period of time, differences in the information represented on the physical body over the time are aimed at highlighting patterns of how the usage of that object has been affecting the user. The overwhelming digital information that we are exposed to and the disconnect that it has from what it is representing makes the relation of the information to the different aspects of our life not effective. We think that using physical forms of objects to provide information can make the data more meaningful, enhancing the value of the object beyond its intended function. Physical forms can provide subliminal and tactile feedback to the users as they use the objects throughout the day, without specific visual attention. Being present physically ensures that people are more conscious of the data and patterns, and makes the data visible to other people as well.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"43 1","pages":"322-326"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74820627","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Online driver's drowsiness estimation using domain adaptation with model fusion 基于域自适应和模型融合的在线驾驶员困倦估计
Dongrui Wu, Chun-Hsiang Chuang, Chin-Teng Lin
Drowsy driving is a pervasive problem among drivers, and is also an important contributor to motor vehicle accidents. It is very important to be able to estimate a driver's drowsiness level online so that preventative actions could be taken to avoid accidents. However, because of large individual differences, it is very challenging to design an estimation algorithm whose parameters fit all subjects. Some subject-specific calibration data must be used to tailor the algorithm for each new subject. This paper proposes a domain adaptation with model fusion (DAMF) online drowsiness estimation approach using EEG signals. By making use of EEG data from other subjects in a transfer learning framework, DAMF requires very little subject-specific calibration data, which significantly increases its utility in practice. We demonstrate using a simulated driving experiment and 15 subjects that DAMF can achieve much better performance than several other approaches.
疲劳驾驶是驾驶员普遍存在的问题,也是造成机动车交通事故的重要原因。能够在线估计驾驶员的困倦程度是非常重要的,这样可以采取预防措施来避免事故。然而,由于个体差异很大,设计一种参数适合所有被试的估计算法是非常具有挑战性的。必须使用特定科目的校准数据来为每个新科目量身定制算法。提出了一种基于脑电信号的域自适应模型融合(DAMF)在线睡意估计方法。通过在迁移学习框架中使用来自其他受试者的EEG数据,DAMF只需要很少的特定受试者校准数据,这大大提高了其在实践中的实用性。我们通过模拟驾驶实验和15名受试者证明,DAMF可以比其他几种方法获得更好的性能。
{"title":"Online driver's drowsiness estimation using domain adaptation with model fusion","authors":"Dongrui Wu, Chun-Hsiang Chuang, Chin-Teng Lin","doi":"10.1109/ACII.2015.7344682","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344682","url":null,"abstract":"Drowsy driving is a pervasive problem among drivers, and is also an important contributor to motor vehicle accidents. It is very important to be able to estimate a driver's drowsiness level online so that preventative actions could be taken to avoid accidents. However, because of large individual differences, it is very challenging to design an estimation algorithm whose parameters fit all subjects. Some subject-specific calibration data must be used to tailor the algorithm for each new subject. This paper proposes a domain adaptation with model fusion (DAMF) online drowsiness estimation approach using EEG signals. By making use of EEG data from other subjects in a transfer learning framework, DAMF requires very little subject-specific calibration data, which significantly increases its utility in practice. We demonstrate using a simulated driving experiment and 15 subjects that DAMF can achieve much better performance than several other approaches.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"5 1","pages":"904-910"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73928499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 26
Emotional signaling in a social dilemma: An automatic analysis 社会困境中的情绪信号:自动分析
Giota Stratou, Rens Hoegen, Gale M. Lucas, J. Gratch
Emotional signaling plays an important role in negotiations and other social decision-making tasks as it can signal intention and shape joint decisions. Specifically it has been shown to influence cooperation or competition. This has been shown in previous studies for scripted interactions that control emotion signaling and rely on manual coding of affect. In this work we examine face-to-face interactions in an iterative social dilemma task (prisoner's dilemma) via an automatic framework for facial expression analysis. We explore if automatic analysis of emotion can give insight into the social function of emotion in face-to-face interactions. Our analysis suggests that positive and negative displays of emotion are associated with more prosocial and proself game acts respectively. Moreover signaling cooperative intentions to the opponent via positivity can leave participants more open to exploitation, whereas signaling a more tough stance via negativity seems to discourage exploitation. However, the benefit of negative affect is short-term and both players do worse over time if they show negative emotions.
情绪信号在谈判和其他社会决策任务中发挥着重要作用,因为它可以表明意图并形成共同决策。具体来说,它已被证明会影响合作或竞争。这在之前的研究中已经证明了,这些研究控制着情感信号,依赖于情感的手动编码。在这项工作中,我们通过面部表情分析的自动框架来研究迭代社会困境任务(囚犯困境)中的面对面互动。我们将探讨情绪的自动分析是否可以深入了解情绪在面对面互动中的社会功能。我们的分析表明,积极和消极的情绪表现分别与更多的亲社会和亲自我游戏行为相关。此外,通过积极的方式向对手传达合作意向会让参与者更容易受到剥削,而通过消极的方式传达更强硬的立场似乎会阻碍剥削。然而,消极情绪的好处是短期的,如果他们表现出消极情绪,双方的表现都会随着时间的推移而变差。
{"title":"Emotional signaling in a social dilemma: An automatic analysis","authors":"Giota Stratou, Rens Hoegen, Gale M. Lucas, J. Gratch","doi":"10.1109/ACII.2015.7344569","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344569","url":null,"abstract":"Emotional signaling plays an important role in negotiations and other social decision-making tasks as it can signal intention and shape joint decisions. Specifically it has been shown to influence cooperation or competition. This has been shown in previous studies for scripted interactions that control emotion signaling and rely on manual coding of affect. In this work we examine face-to-face interactions in an iterative social dilemma task (prisoner's dilemma) via an automatic framework for facial expression analysis. We explore if automatic analysis of emotion can give insight into the social function of emotion in face-to-face interactions. Our analysis suggests that positive and negative displays of emotion are associated with more prosocial and proself game acts respectively. Moreover signaling cooperative intentions to the opponent via positivity can leave participants more open to exploitation, whereas signaling a more tough stance via negativity seems to discourage exploitation. However, the benefit of negative affect is short-term and both players do worse over time if they show negative emotions.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"11 1","pages":"180-186"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76748041","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
Multimodal dimensional affect recognition using deep bidirectional long short-term memory recurrent neural networks 基于深度双向长短期记忆递归神经网络的多模态多维情感识别
Ercheng Pei, Le Yang, D. Jiang, H. Sahli
In this paper we propose the deep bidirectional long short-term memory recurrent neural network (DBLSTM-RNN) based single modal and multi-modal affect recognition frameworks. In the single modal framework DBLSTM with moving average (MA), audio or visual features are input into the DBLSTM-RNN model, whose output estimations of a dimension are smoothed by the moving average filter. After the smoothed estimations are expanded to the frame rate of the ground truth labels, another MA is adopted for smoothing the final results. In the multi-modal framework DBLSTM-DBLSTM-MA, the initial estimations from the audio and visual modalities via the first layer of DBLSTM-RNNs are input into a second layer of DBLSTM-RNN, whose outputs are smoothed by MA. The smoothed estimations are then expanded to the frame rate of the ground truth labels and smoothed again by another MA. Affect recognition experiments are carried out on the training set and development set of the AVEC2014 database, results show that the proposed DBLSTM-MA framework outperforms linear regression, support vector regression (SVR), and BLSTM for single modal dimension estimation. For audio visual multi-modal affect recognition, DBLSTM-DBLSTM-MA obtains better or comparable performance than the state of the art results in the competition of AVEC2014, with the average correlation coefficient (COR) reaches 0.599 on the Freeform database, 0.630 on the Northwind database, and 0.615 on the Freeform-Northwind database.
提出了基于深度双向长短期记忆递归神经网络(DBLSTM-RNN)的单模态和多模态情感识别框架。在具有移动平均(MA)的单模态DBLSTM框架中,将音频或视觉特征输入到DBLSTM- rnn模型中,通过移动平均滤波器对输出的维数估计进行平滑处理。将平滑估计扩展到地面真值标签的帧率后,采用另一个MA对最终结果进行平滑处理。在多模态框架DBLSTM-DBLSTM-MA中,通过第一层DBLSTM-RNN的音频和视觉模态的初始估计被输入到第二层DBLSTM-RNN中,其输出被MA平滑。然后将平滑估计扩展到地面真值标签的帧速率,并通过另一个MA再次平滑。在AVEC2014数据库的训练集和开发集上进行了影响识别实验,结果表明,DBLSTM-MA框架在单模态维数估计方面优于线性回归、支持向量回归和BLSTM。在视听多模态情感识别方面,DBLSTM-DBLSTM-MA在AVEC2014竞赛中取得了优于或可与现有成果相媲美的性能,其平均相关系数(COR)在Freeform数据库上达到0.599,在Northwind数据库上达到0.630,在Freeform-Northwind数据库上达到0.615。
{"title":"Multimodal dimensional affect recognition using deep bidirectional long short-term memory recurrent neural networks","authors":"Ercheng Pei, Le Yang, D. Jiang, H. Sahli","doi":"10.1109/ACII.2015.7344573","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344573","url":null,"abstract":"In this paper we propose the deep bidirectional long short-term memory recurrent neural network (DBLSTM-RNN) based single modal and multi-modal affect recognition frameworks. In the single modal framework DBLSTM with moving average (MA), audio or visual features are input into the DBLSTM-RNN model, whose output estimations of a dimension are smoothed by the moving average filter. After the smoothed estimations are expanded to the frame rate of the ground truth labels, another MA is adopted for smoothing the final results. In the multi-modal framework DBLSTM-DBLSTM-MA, the initial estimations from the audio and visual modalities via the first layer of DBLSTM-RNNs are input into a second layer of DBLSTM-RNN, whose outputs are smoothed by MA. The smoothed estimations are then expanded to the frame rate of the ground truth labels and smoothed again by another MA. Affect recognition experiments are carried out on the training set and development set of the AVEC2014 database, results show that the proposed DBLSTM-MA framework outperforms linear regression, support vector regression (SVR), and BLSTM for single modal dimension estimation. For audio visual multi-modal affect recognition, DBLSTM-DBLSTM-MA obtains better or comparable performance than the state of the art results in the competition of AVEC2014, with the average correlation coefficient (COR) reaches 0.599 on the Freeform database, 0.630 on the Northwind database, and 0.615 on the Freeform-Northwind database.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"319 1","pages":"208-214"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77267832","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 26
Detection of depression in speech 言语抑制性的检测
Zhenyu Liu, B. Hu, Lihua Yan, Tian-Zhong Wang, Fei Liu, Xiaoyu Li, Huanyu Kang
Depression is a common mental disorder and one of the main causes of disability worldwide. Lacking objective depressive disorder assessment methods is the key reason that many depressive patients can't be treated properly. Developments in affective sensing technology with a focus on acoustic features will potentially bring a change due to depressed patient's slow, hesitating, monotonous voice as remarkable characteristics. Our motivation is to find out a speech feature set to detect, evaluate and even predict depression. For these goals, we investigate a large sample of 300 subjects (100 depressed patients, 100 healthy controls and 100 high-risk people) through comparative analysis and follow-up study. For examining the correlation between depression and speech, we extract features as many as possible according to previous research to create a large voice feature set. Then we employ some feature selection methods to eliminate irrelevant, redundant and noisy features to form a compact subset. To measure effectiveness of this new subset, we test it on our dataset with 300 subjects using several common classifiers and 10-fold cross-validation. Since we are collecting data currently, we have no result to report yet.
抑郁症是一种常见的精神障碍,也是全世界致残的主要原因之一。缺乏客观的抑郁障碍评估方法是许多抑郁症患者无法得到正确治疗的关键原因。以声学特征为重点的情感传感技术的发展将有可能改变抑郁症患者缓慢、犹豫、单调的声音作为显著特征。我们的动机是找到一个语音特征集来检测、评估甚至预测抑郁症。为此,我们对300名受试者(100名抑郁症患者、100名健康对照者和100名高危人群)进行了比较分析和随访研究。为了检验抑郁和语音之间的相关性,我们根据之前的研究尽可能多地提取特征,以创建一个大的语音特征集。然后采用一些特征选择方法去除不相关的、冗余的和有噪声的特征,形成一个紧凑的子集。为了衡量这个新子集的有效性,我们使用几个常见分类器和10倍交叉验证在我们的数据集上测试了300个主题。由于我们目前正在收集数据,所以还没有结果可以报告。
{"title":"Detection of depression in speech","authors":"Zhenyu Liu, B. Hu, Lihua Yan, Tian-Zhong Wang, Fei Liu, Xiaoyu Li, Huanyu Kang","doi":"10.1109/ACII.2015.7344652","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344652","url":null,"abstract":"Depression is a common mental disorder and one of the main causes of disability worldwide. Lacking objective depressive disorder assessment methods is the key reason that many depressive patients can't be treated properly. Developments in affective sensing technology with a focus on acoustic features will potentially bring a change due to depressed patient's slow, hesitating, monotonous voice as remarkable characteristics. Our motivation is to find out a speech feature set to detect, evaluate and even predict depression. For these goals, we investigate a large sample of 300 subjects (100 depressed patients, 100 healthy controls and 100 high-risk people) through comparative analysis and follow-up study. For examining the correlation between depression and speech, we extract features as many as possible according to previous research to create a large voice feature set. Then we employ some feature selection methods to eliminate irrelevant, redundant and noisy features to form a compact subset. To measure effectiveness of this new subset, we test it on our dataset with 300 subjects using several common classifiers and 10-fold cross-validation. Since we are collecting data currently, we have no result to report yet.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"32 1","pages":"743-747"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80769267","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 34
Physiological correlates of mental effort as manipulated through lane width during simulated driving 在模拟驾驶中,通过车道宽度操纵心理努力的生理相关性
A. Brouwer, C. Dijksterhuis, J. V. Erp
Previous studies suggest that physiological effects of mental effort as manipulated trough cognitive task difficulty differ from effects of mental effort as manipulated trough a visuomotor task such as lane keeping in simulated driving. Most notably, heart rate increases with mental effort in the former but not in the latter task. EEG seems to be indicative of mental effort in both cases. In previous research [1], Brouwer and colleagues examined effects of mental effort as manipulated in a cognitive (memory) task on a range of physiological signals. In the present research we examine the same types of physiological signals using the same kind of analysis in a visuomotor (simulated driving) task. In this case, mental effort was manipulated using wide and narrow lanes. Effects of task difficulty on both subjective mental effort and behavioral variables were comparable across tasks. Effect of task difficulty was replicated for respiration frequency and to some extent for EEG alpha activity. However, in contrast to the cognitive task [1], skin conductance and heart rate related variables were not significantly affected by task difficulty in the current visuomotor task. We argue that differences in visual attention and cerebral energy demand between the types of tasks may be at the basis of this.
先前的研究表明,在模拟驾驶中,通过认知任务难度操纵心理努力的生理效应与通过视觉运动任务(如车道保持)操纵心理努力的生理效应不同。最值得注意的是,在前一项任务中,心率随着脑力劳动的增加而增加,而在后一项任务中则没有。脑电图似乎显示了两种情况下的精神活动。在之前的研究中,布劳维尔和他的同事们研究了在认知(记忆)任务中操纵精神努力对一系列生理信号的影响。在本研究中,我们在视觉运动(模拟驾驶)任务中使用相同的分析方法来检查相同类型的生理信号。在这种情况下,心理努力是通过宽和窄的车道来操纵的。任务难度对主观心理努力和行为变量的影响在不同任务间具有可比性。任务难度对呼吸频率和脑电图α活动的影响在一定程度上是相同的。然而,与认知任务[1]相比,当前视觉运动任务中皮肤电导和心率相关变量不受任务难度的显著影响。我们认为,不同类型的任务之间视觉注意力和大脑能量需求的差异可能是这一现象的基础。
{"title":"Physiological correlates of mental effort as manipulated through lane width during simulated driving","authors":"A. Brouwer, C. Dijksterhuis, J. V. Erp","doi":"10.1109/ACII.2015.7344549","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344549","url":null,"abstract":"Previous studies suggest that physiological effects of mental effort as manipulated trough cognitive task difficulty differ from effects of mental effort as manipulated trough a visuomotor task such as lane keeping in simulated driving. Most notably, heart rate increases with mental effort in the former but not in the latter task. EEG seems to be indicative of mental effort in both cases. In previous research [1], Brouwer and colleagues examined effects of mental effort as manipulated in a cognitive (memory) task on a range of physiological signals. In the present research we examine the same types of physiological signals using the same kind of analysis in a visuomotor (simulated driving) task. In this case, mental effort was manipulated using wide and narrow lanes. Effects of task difficulty on both subjective mental effort and behavioral variables were comparable across tasks. Effect of task difficulty was replicated for respiration frequency and to some extent for EEG alpha activity. However, in contrast to the cognitive task [1], skin conductance and heart rate related variables were not significantly affected by task difficulty in the current visuomotor task. We argue that differences in visual attention and cerebral energy demand between the types of tasks may be at the basis of this.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":" 15","pages":"42-48"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91415148","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
HealthAware: An advice system for stress, sleep, diet and exercise HealthAware:一个针对压力、睡眠、饮食和运动的建议系统
A. Sano, Paul Johns, M. Czerwinski
We developed a feedback-loop, user-tailored advice system to provide stress interventions and advice about improving sleep, diet, and exercise habits at the workplace. Thirty participants joined a 2 week study: in the first week, we collected their behaviors about sleep, diet, exercise and stress levels using Fitbit and surveys. During the second week we continued monitoring, and based on the participants' measurements in the previous days, we also provided interventions and advice during the workday, and evaluated their preferences. We found that participants with higher stress levels liked stress interventions more and that somatic activities were most preferred and reduced stress levels the most. We observed individual preference differences in the types of advice; however, tracking and receiving advice raised users' awareness of their stress, sleep, exercise, and dietary behaviors. We found that the largest positive impact was on our participants' dietary behaviors.
我们开发了一个反馈回路,用户定制的建议系统,提供压力干预和建议,改善工作场所的睡眠,饮食和锻炼习惯。30名参与者参加了为期2周的研究:在第一周,我们使用Fitbit和调查收集了他们在睡眠、饮食、运动和压力水平方面的行为。在第二周,我们继续监测,并根据参与者前几天的测量结果,在工作日提供干预和建议,并评估他们的偏好。我们发现压力水平较高的参与者更喜欢压力干预,身体活动最受欢迎,减少压力水平的参与者最多。我们观察到建议类型的个人偏好差异;然而,跟踪和接收建议提高了用户对他们的压力、睡眠、锻炼和饮食行为的认识。我们发现,最大的积极影响是在参与者的饮食行为上。
{"title":"HealthAware: An advice system for stress, sleep, diet and exercise","authors":"A. Sano, Paul Johns, M. Czerwinski","doi":"10.1109/ACII.2015.7344623","DOIUrl":"https://doi.org/10.1109/ACII.2015.7344623","url":null,"abstract":"We developed a feedback-loop, user-tailored advice system to provide stress interventions and advice about improving sleep, diet, and exercise habits at the workplace. Thirty participants joined a 2 week study: in the first week, we collected their behaviors about sleep, diet, exercise and stress levels using Fitbit and surveys. During the second week we continued monitoring, and based on the participants' measurements in the previous days, we also provided interventions and advice during the workday, and evaluated their preferences. We found that participants with higher stress levels liked stress interventions more and that somatic activities were most preferred and reduced stress levels the most. We observed individual preference differences in the types of advice; however, tracking and receiving advice raised users' awareness of their stress, sleep, exercise, and dietary behaviors. We found that the largest positive impact was on our participants' dietary behaviors.","PeriodicalId":6863,"journal":{"name":"2015 International Conference on Affective Computing and Intelligent Interaction (ACII)","volume":"86 1","pages":"546-552"},"PeriodicalIF":0.0,"publicationDate":"2015-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86863134","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 21
期刊
2015 International Conference on Affective Computing and Intelligent Interaction (ACII)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1