首页 > 最新文献

IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics最新文献

英文 中文
Online Signature Verification Based on Generative Models. 基于生成模型的在线签名验证。
Pub Date : 2012-08-01 Epub Date: 2012-04-04 DOI: 10.1109/TSMCB.2012.2188508
E Argones Rua, J L Alba Castro

The success of generative models for online signature verification has motivated many research works on this topic. These systems may use hidden Markov models (HMMs) in two different modes: user-specific HMM (US-HMM) and user-adapted universal background models (UBMs) (UA-UBMs). Verification scores can be obtained from likelihood ratios and a distance measure on the Viterbi decoded state sequences. This paper analyzes several factors that can modify the behavior of these systems and which have not been deeply studied yet. First, we study the influence of the feature set choice, paying special attention to the role of dynamic information order, suitability of feature sets on each kind of generative model-based system, and the importance of inclination angles and pressure. Moreover, this analysis is also extended to the influence of the HMM complexity in the performance of the different approaches. For this study, a set of experiments is performed on the publicly available MCYT-100 database using only skilled forgeries. These experiments provide interesting outcomes. First, the Viterbi path evidences a notable stability for most of the feature sets and systems. Second, in the case of US-HMM systems, likelihood evidence obtains better results when lowest order dynamics are included in the feature set, while likelihood ratio obtains better results in UA-UBM systems when lowest dynamics are not included in the feature set. Finally, US-HMM and UA-UBM systems can be used together for improved verification performance by fusing at the score level the Viterbi path information from the US-HMM system and the likelihood ratio evidence from the UA-UBM system. Additional comparisons to other state-of-the-art systems, from the ESRA 2011 signature evaluation contest, are also reported, reinforcing the high performance of the systems and the generality of the experimental results described in this paper.

在线签名验证生成模型的成功激发了对该主题的许多研究工作。这些系统可以在两种不同的模式下使用隐马尔可夫模型(HMM):用户特定的HMM (US-HMM)和用户适应的通用背景模型(ubm)。验证分数可以通过对Viterbi解码状态序列的似然比和距离度量获得。本文分析了影响这些系统行为的几个尚未深入研究的因素。首先,我们研究了特征集选择的影响,特别关注了动态信息顺序的作用,特征集在各种基于生成模型的系统中的适用性,以及倾角和压力的重要性。此外,本文还将分析扩展到HMM复杂度对不同方法性能的影响。在这项研究中,一组实验是在公开可用的MCYT-100数据库上进行的,只使用熟练的伪造。这些实验提供了有趣的结果。首先,Viterbi路径证明了大多数特性集和系统的显著稳定性。其次,在US-HMM系统中,当最低阶动态包含在特征集中时,似然证据获得了更好的结果,而在UA-UBM系统中,当最低阶动态不包含在特征集中时,似然比获得了更好的结果。最后,US-HMM和UA-UBM系统可以一起使用,通过在分数水平上融合来自US-HMM系统的Viterbi路径信息和来自UA-UBM系统的似然比证据来提高验证性能。此外,还报道了与ESRA 2011签名评估竞赛中其他最先进系统的比较,加强了系统的高性能和本文中描述的实验结果的通用性。
{"title":"Online Signature Verification Based on Generative Models.","authors":"E Argones Rua,&nbsp;J L Alba Castro","doi":"10.1109/TSMCB.2012.2188508","DOIUrl":"https://doi.org/10.1109/TSMCB.2012.2188508","url":null,"abstract":"<p><p>The success of generative models for online signature verification has motivated many research works on this topic. These systems may use hidden Markov models (HMMs) in two different modes: user-specific HMM (US-HMM) and user-adapted universal background models (UBMs) (UA-UBMs). Verification scores can be obtained from likelihood ratios and a distance measure on the Viterbi decoded state sequences. This paper analyzes several factors that can modify the behavior of these systems and which have not been deeply studied yet. First, we study the influence of the feature set choice, paying special attention to the role of dynamic information order, suitability of feature sets on each kind of generative model-based system, and the importance of inclination angles and pressure. Moreover, this analysis is also extended to the influence of the HMM complexity in the performance of the different approaches. For this study, a set of experiments is performed on the publicly available MCYT-100 database using only skilled forgeries. These experiments provide interesting outcomes. First, the Viterbi path evidences a notable stability for most of the feature sets and systems. Second, in the case of US-HMM systems, likelihood evidence obtains better results when lowest order dynamics are included in the feature set, while likelihood ratio obtains better results in UA-UBM systems when lowest dynamics are not included in the feature set. Finally, US-HMM and UA-UBM systems can be used together for improved verification performance by fusing at the score level the Viterbi path information from the US-HMM system and the likelihood ratio evidence from the UA-UBM system. Additional comparisons to other state-of-the-art systems, from the ESRA 2011 signature evaluation contest, are also reported, reinforcing the high performance of the systems and the generality of the experimental results described in this paper. </p>","PeriodicalId":55006,"journal":{"name":"IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics","volume":" ","pages":"1231-42"},"PeriodicalIF":0.0,"publicationDate":"2012-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TSMCB.2012.2188508","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30563922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 68
Facial Action Recognition Combining Heterogeneous Features via Multikernel Learning. 基于多核学习的异构特征面部动作识别。
Pub Date : 2012-08-01 Epub Date: 2012-05-18 DOI: 10.1109/TSMCB.2012.2193567
T Senechal, V Rapp, H Salam, R Seguier, K Bailly, L Prevost

This paper presents our response to the first international challenge on facial emotion recognition and analysis. We propose to combine different types of features to automatically detect action units (AUs) in facial images. We use one multikernel support vector machine (SVM) for each AU we want to detect. The first kernel matrix is computed using local Gabor binary pattern histograms and a histogram intersection kernel. The second kernel matrix is computed from active appearance model coefficients and a radial basis function kernel. During the training step, we combine these two types of features using the recently proposed SimpleMKL algorithm. SVM outputs are then averaged to exploit temporal information in the sequence. To evaluate our system, we perform deep experimentation on several key issues: influence of features and kernel function in histogram-based SVM approaches, influence of spatially independent information versus geometric local appearance information and benefits of combining both, sensitivity to training data, and interest of temporal context adaptation. We also compare our results with those of the other participants and try to explain why our method had the best performance during the facial expression recognition and analysis challenge.

本文介绍了我们对面部情绪识别和分析的第一个国际挑战的回应。我们提出结合不同类型的特征来自动检测面部图像中的动作单元。我们对每个要检测的AU使用一个多核支持向量机(SVM)。第一个核矩阵是使用局部Gabor二值模式直方图和直方图交集核计算的。第二核矩阵由活动外观模型系数和径向基函数核计算得到。在训练步骤中,我们使用最近提出的SimpleMKL算法将这两种类型的特征结合起来。然后对支持向量机的输出进行平均,以利用序列中的时间信息。为了评估我们的系统,我们对几个关键问题进行了深入的实验:特征和核函数在基于直方图的支持向量机方法中的影响,空间独立信息与几何局部外观信息的影响以及两者结合的好处,对训练数据的敏感性,以及对时间上下文适应的兴趣。我们还将我们的结果与其他参与者的结果进行了比较,并试图解释为什么我们的方法在面部表情识别和分析挑战中表现最好。
{"title":"Facial Action Recognition Combining Heterogeneous Features via Multikernel Learning.","authors":"T Senechal,&nbsp;V Rapp,&nbsp;H Salam,&nbsp;R Seguier,&nbsp;K Bailly,&nbsp;L Prevost","doi":"10.1109/TSMCB.2012.2193567","DOIUrl":"https://doi.org/10.1109/TSMCB.2012.2193567","url":null,"abstract":"<p><p>This paper presents our response to the first international challenge on facial emotion recognition and analysis. We propose to combine different types of features to automatically detect action units (AUs) in facial images. We use one multikernel support vector machine (SVM) for each AU we want to detect. The first kernel matrix is computed using local Gabor binary pattern histograms and a histogram intersection kernel. The second kernel matrix is computed from active appearance model coefficients and a radial basis function kernel. During the training step, we combine these two types of features using the recently proposed SimpleMKL algorithm. SVM outputs are then averaged to exploit temporal information in the sequence. To evaluate our system, we perform deep experimentation on several key issues: influence of features and kernel function in histogram-based SVM approaches, influence of spatially independent information versus geometric local appearance information and benefits of combining both, sensitivity to training data, and interest of temporal context adaptation. We also compare our results with those of the other participants and try to explain why our method had the best performance during the facial expression recognition and analysis challenge. </p>","PeriodicalId":55006,"journal":{"name":"IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics","volume":" ","pages":"993-1005"},"PeriodicalIF":0.0,"publicationDate":"2012-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TSMCB.2012.2193567","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30641266","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 136
A New Adaptive Fast Cellular Automaton Neighborhood Detection and Rule Identification Algorithm. 一种新的自适应快速元胞自动机邻域检测与规则识别算法。
Pub Date : 2012-08-01 Epub Date: 2012-06-07 DOI: 10.1109/TSMCB.2012.2185790
Y Zhao, H L Wei, S A Billings

An important step in the identification of cellular automata (CA) is to detect the correct neighborhood before parameter estimation. Many authors have suggested procedures based on the removal of redundant neighbors from a very large initial neighborhood one by one to find the real model, but this often induces ill conditioning and overfitting. This is true particularly for a large initial neighborhood where there are few significant terms, and this will be demonstrated by an example in this paper. By introducing a new criteria and three new techniques, this paper proposes a new adaptive fast CA orthogonal-least-square (Adaptive-FCA-OLS) algorithm, which cannot only adaptively search for the correct neighborhood without any preset tolerance but can also considerably reduce the computational complexity and memory usage. Several numerical examples demonstrate that the Adaptive-FCA-OLS algorithm has better robustness to noise and to the size of the initial neighborhood than other recently developed neighborhood detection methods in the identification of binary CA.

元胞自动机识别的一个重要步骤是在参数估计之前检测出正确的邻域。许多作者提出了基于从一个非常大的初始邻域中逐个去除冗余邻域来找到真实模型的方法,但这通常会导致条件反射不良和过拟合。特别是对于一个大的初始邻域,其中很少有重要项,这是正确的,这将在本文中通过一个例子来证明。通过引入新的准则和三种新的技术,提出了一种新的自适应快速CA正交最小二乘(adaptive - fca - ols)算法,该算法不仅能自适应地搜索正确的邻域,而且不需要任何预设公差,还能大大降低计算量和内存占用。数值算例表明,自适应fca - ols算法对噪声和初始邻域大小的鲁棒性优于近期发展的邻域检测方法。
{"title":"A New Adaptive Fast Cellular Automaton Neighborhood Detection and Rule Identification Algorithm.","authors":"Y Zhao,&nbsp;H L Wei,&nbsp;S A Billings","doi":"10.1109/TSMCB.2012.2185790","DOIUrl":"https://doi.org/10.1109/TSMCB.2012.2185790","url":null,"abstract":"<p><p>An important step in the identification of cellular automata (CA) is to detect the correct neighborhood before parameter estimation. Many authors have suggested procedures based on the removal of redundant neighbors from a very large initial neighborhood one by one to find the real model, but this often induces ill conditioning and overfitting. This is true particularly for a large initial neighborhood where there are few significant terms, and this will be demonstrated by an example in this paper. By introducing a new criteria and three new techniques, this paper proposes a new adaptive fast CA orthogonal-least-square (Adaptive-FCA-OLS) algorithm, which cannot only adaptively search for the correct neighborhood without any preset tolerance but can also considerably reduce the computational complexity and memory usage. Several numerical examples demonstrate that the Adaptive-FCA-OLS algorithm has better robustness to noise and to the size of the initial neighborhood than other recently developed neighborhood detection methods in the identification of binary CA. </p>","PeriodicalId":55006,"journal":{"name":"IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics","volume":" ","pages":"1283-7"},"PeriodicalIF":0.0,"publicationDate":"2012-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TSMCB.2012.2185790","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30688485","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 16
Prediction of User's Web-Browsing Behavior: Application of Markov Model. 用户网络浏览行为预测:马尔可夫模型的应用。
Pub Date : 2012-08-01 Epub Date: 2012-03-02 DOI: 10.1109/TSMCB.2012.2187441
M A Awad, I Khalil

Web prediction is a classification problem in which we attempt to predict the next set of Web pages that a user may visit based on the knowledge of the previously visited pages. Predicting user's behavior while serving the Internet can be applied effectively in various critical applications. Such application has traditional tradeoffs between modeling complexity and prediction accuracy. In this paper, we analyze and study Markov model and all- Kth Markov model in Web prediction. We propose a new modified Markov model to alleviate the issue of scalability in the number of paths. In addition, we present a new two-tier prediction framework that creates an example classifier EC, based on the training examples and the generated classifiers. We show that such framework can improve the prediction time without compromising prediction accuracy. We have used standard benchmark data sets to analyze, compare, and demonstrate the effectiveness of our techniques using variations of Markov models and association rule mining. Our experiments show the effectiveness of our modified Markov model in reducing the number of paths without compromising accuracy. Additionally, the results support our analysis conclusions that accuracy improves with higher orders of all- Kth model.

Web预测是一个分类问题,在这个问题中,我们试图根据之前访问过的页面的知识来预测用户可能访问的下一组Web页面。在服务互联网的同时预测用户的行为可以有效地应用于各种关键应用。这种应用程序在建模复杂性和预测精度之间进行了传统的权衡。本文对Web预测中的马尔可夫模型和全k阶马尔可夫模型进行了分析和研究。我们提出了一个新的改进的马尔可夫模型来缓解路径数量的可扩展性问题。此外,我们提出了一个新的两层预测框架,该框架基于训练样例和生成的分类器创建一个示例分类器EC。我们证明了这种框架可以在不影响预测精度的情况下提高预测时间。我们使用标准基准数据集来分析、比较和演示我们使用马尔可夫模型和关联规则挖掘的变体技术的有效性。我们的实验证明了改进的马尔可夫模型在不影响精度的情况下减少路径数量的有效性。此外,结果支持了我们的分析结论,即全k阶模型的阶数越高,精度越高。
{"title":"Prediction of User's Web-Browsing Behavior: Application of Markov Model.","authors":"M A Awad,&nbsp;I Khalil","doi":"10.1109/TSMCB.2012.2187441","DOIUrl":"https://doi.org/10.1109/TSMCB.2012.2187441","url":null,"abstract":"<p><p>Web prediction is a classification problem in which we attempt to predict the next set of Web pages that a user may visit based on the knowledge of the previously visited pages. Predicting user's behavior while serving the Internet can be applied effectively in various critical applications. Such application has traditional tradeoffs between modeling complexity and prediction accuracy. In this paper, we analyze and study Markov model and all- Kth Markov model in Web prediction. We propose a new modified Markov model to alleviate the issue of scalability in the number of paths. In addition, we present a new two-tier prediction framework that creates an example classifier EC, based on the training examples and the generated classifiers. We show that such framework can improve the prediction time without compromising prediction accuracy. We have used standard benchmark data sets to analyze, compare, and demonstrate the effectiveness of our techniques using variations of Markov models and association rule mining. Our experiments show the effectiveness of our modified Markov model in reducing the number of paths without compromising accuracy. Additionally, the results support our analysis conclusions that accuracy improves with higher orders of all- Kth model. </p>","PeriodicalId":55006,"journal":{"name":"IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics","volume":" ","pages":"1131-42"},"PeriodicalIF":0.0,"publicationDate":"2012-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TSMCB.2012.2187441","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40144890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 143
Visual Control for Multirobot Organized Rendezvous. 多机器人组织交会的视觉控制。
Pub Date : 2012-08-01 Epub Date: 2012-03-02 DOI: 10.1109/TSMCB.2012.2187639
G Lopez-Nicolas, M Aranda, Y Mezouar, C Sagues

This paper addresses the problem of visual control of a set of mobile robots. In our framework, the perception system consists of an uncalibrated flying camera performing an unknown general motion. The robots are assumed to undergo planar motion considering nonholonomic constraints. The goal of the control task is to drive the multirobot system to a desired rendezvous configuration relying solely on visual information given by the flying camera. The desired multirobot configuration is defined with an image of the set of robots in that configuration without any additional information. We propose a homography-based framework relying on the homography induced by the multirobot system that gives a desired homography to be used to define the reference target, and a new image-based control law that drives the robots to the desired configuration by imposing a rigidity constraint. This paper extends our previous work, and the main contributions are that the motion constraints on the flying camera are removed, the control law is improved by reducing the number of required steps, the stability of the new control law is proved, and real experiments are provided to validate the proposal.

本文研究了一组移动机器人的视觉控制问题。在我们的框架中,感知系统由一个未校准的飞行相机组成,执行未知的一般运动。假设机器人在考虑非完整约束的情况下进行平面运动。控制任务的目标是仅仅依靠飞行摄像机给出的视觉信息来驱动多机器人系统达到期望的交会配置。期望的多机器人配置是用该配置中的一组机器人的图像定义的,不包含任何附加信息。我们提出了一种基于单应性的框架,该框架依赖于多机器人系统引起的单应性,该框架给出了用于定义参考目标的期望单应性,以及一种新的基于图像的控制律,该律通过施加刚性约束来驱动机器人达到期望的构型。本文对之前的工作进行了扩展,主要贡献是消除了飞行摄像机的运动约束,通过减少所需的步数来改进控制律,证明了新控制律的稳定性,并提供了实际实验来验证该建议。
{"title":"Visual Control for Multirobot Organized Rendezvous.","authors":"G Lopez-Nicolas,&nbsp;M Aranda,&nbsp;Y Mezouar,&nbsp;C Sagues","doi":"10.1109/TSMCB.2012.2187639","DOIUrl":"https://doi.org/10.1109/TSMCB.2012.2187639","url":null,"abstract":"<p><p>This paper addresses the problem of visual control of a set of mobile robots. In our framework, the perception system consists of an uncalibrated flying camera performing an unknown general motion. The robots are assumed to undergo planar motion considering nonholonomic constraints. The goal of the control task is to drive the multirobot system to a desired rendezvous configuration relying solely on visual information given by the flying camera. The desired multirobot configuration is defined with an image of the set of robots in that configuration without any additional information. We propose a homography-based framework relying on the homography induced by the multirobot system that gives a desired homography to be used to define the reference target, and a new image-based control law that drives the robots to the desired configuration by imposing a rigidity constraint. This paper extends our previous work, and the main contributions are that the motion constraints on the flying camera are removed, the control law is improved by reducing the number of required steps, the stability of the new control law is proved, and real experiments are provided to validate the proposal. </p>","PeriodicalId":55006,"journal":{"name":"IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics","volume":" ","pages":"1155-68"},"PeriodicalIF":0.0,"publicationDate":"2012-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TSMCB.2012.2187639","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40144891","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 24
Chaotic Dynamics in Social Foraging Swarms-An Analysis. 社会觅食群体的混沌动力学分析
Pub Date : 2012-08-01 Epub Date: 2012-03-08 DOI: 10.1109/TSMCB.2012.2186799
S Das, U Halder, D Maity

This paper investigates the chaotic characteristics in the dynamics of an aggregating swarm model. The range of the parameters of the swarm model is determined for which chaos exists in the dynamics. The trajectories of the individuals are simulated, and the stable, limit cyclic, and chaotic behaviors are demonstrated. The existence of chaos in the swarm is determined by the maximum Lyapunov exponent. The computer simulation supports the results obtained by theoretical analysis.

本文研究了聚集群模型动力学中的混沌特性。确定了混沌存在时群模型参数的取值范围。对个体的运动轨迹进行了仿真,证明了个体的稳定、极限循环和混沌行为。混沌的存在是由最大Lyapunov指数决定的。计算机模拟结果与理论分析结果一致。
{"title":"Chaotic Dynamics in Social Foraging Swarms-An Analysis.","authors":"S Das,&nbsp;U Halder,&nbsp;D Maity","doi":"10.1109/TSMCB.2012.2186799","DOIUrl":"https://doi.org/10.1109/TSMCB.2012.2186799","url":null,"abstract":"<p><p>This paper investigates the chaotic characteristics in the dynamics of an aggregating swarm model. The range of the parameters of the swarm model is determined for which chaos exists in the dynamics. The trajectories of the individuals are simulated, and the stable, limit cyclic, and chaotic behaviors are demonstrated. The existence of chaos in the swarm is determined by the maximum Lyapunov exponent. The computer simulation supports the results obtained by theoretical analysis. </p>","PeriodicalId":55006,"journal":{"name":"IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics","volume":" ","pages":"1288-93"},"PeriodicalIF":0.0,"publicationDate":"2012-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TSMCB.2012.2186799","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40159264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 21
Meta-Analysis of the First Facial Expression Recognition Challenge. 第一次面部表情识别挑战的元分析。
Pub Date : 2012-08-01 Epub Date: 2012-06-20 DOI: 10.1109/TSMCB.2012.2200675
M F Valstar, M Mehu, Bihan Jiang, M Pantic, K Scherer

Automatic facial expression recognition has been an active topic in computer science for over two decades, in particular facial action coding system action unit (AU) detection and classification of a number of discrete emotion states from facial expressive imagery. Standardization and comparability have received some attention; for instance, there exist a number of commonly used facial expression databases. However, lack of a commonly accepted evaluation protocol and, typically, lack of sufficient details needed to reproduce the reported individual results make it difficult to compare systems. This, in turn, hinders the progress of the field. A periodical challenge in facial expression recognition would allow such a comparison on a level playing field. It would provide an insight on how far the field has come and would allow researchers to identify new goals, challenges, and targets. This paper presents a meta-analysis of the first such challenge in automatic recognition of facial expressions, held during the IEEE conference on Face and Gesture Recognition 2011. It details the challenge data, evaluation protocol, and the results attained in two subchallenges: AU detection and classification of facial expression imagery in terms of a number of discrete emotion categories. We also summarize the lessons learned and reflect on the future of the field of facial expression recognition in general and on possible future challenges in particular.

二十多年来,自动面部表情识别一直是计算机科学中的一个活跃话题,特别是面部动作编码系统(AU)对面部表情图像中离散情绪状态的检测和分类。标准化和可比性受到了一些关注;例如,有许多常用的面部表情数据库。然而,由于缺乏普遍接受的评估方案,并且通常缺乏重现所报告的个别结果所需的足够细节,因此很难对系统进行比较。这反过来又阻碍了该领域的发展。面部表情识别的周期性挑战将允许在公平的竞争环境中进行这种比较。它将提供对该领域发展的深入了解,并使研究人员能够确定新的目标、挑战和目标。本文介绍了在2011年IEEE面部和手势识别会议期间举行的面部表情自动识别中的第一个此类挑战的元分析。它详细介绍了挑战数据,评估方案,以及在两个子挑战中获得的结果:AU检测和面部表情图像在许多离散情感类别方面的分类。我们还总结了经验教训,并对面部表情识别领域的未来进行了反思,特别是对未来可能面临的挑战。
{"title":"Meta-Analysis of the First Facial Expression Recognition Challenge.","authors":"M F Valstar,&nbsp;M Mehu,&nbsp;Bihan Jiang,&nbsp;M Pantic,&nbsp;K Scherer","doi":"10.1109/TSMCB.2012.2200675","DOIUrl":"https://doi.org/10.1109/TSMCB.2012.2200675","url":null,"abstract":"<p><p>Automatic facial expression recognition has been an active topic in computer science for over two decades, in particular facial action coding system action unit (AU) detection and classification of a number of discrete emotion states from facial expressive imagery. Standardization and comparability have received some attention; for instance, there exist a number of commonly used facial expression databases. However, lack of a commonly accepted evaluation protocol and, typically, lack of sufficient details needed to reproduce the reported individual results make it difficult to compare systems. This, in turn, hinders the progress of the field. A periodical challenge in facial expression recognition would allow such a comparison on a level playing field. It would provide an insight on how far the field has come and would allow researchers to identify new goals, challenges, and targets. This paper presents a meta-analysis of the first such challenge in automatic recognition of facial expressions, held during the IEEE conference on Face and Gesture Recognition 2011. It details the challenge data, evaluation protocol, and the results attained in two subchallenges: AU detection and classification of facial expression imagery in terms of a number of discrete emotion categories. We also summarize the lessons learned and reflect on the future of the field of facial expression recognition in general and on possible future challenges in particular. </p>","PeriodicalId":55006,"journal":{"name":"IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics","volume":" ","pages":"966-79"},"PeriodicalIF":0.0,"publicationDate":"2012-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TSMCB.2012.2200675","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30721894","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 292
Adapting the Right Measures for Pattern Discovery: A Unified View. 适应模式发现的正确方法:一个统一的观点。
Pub Date : 2012-08-01 Epub Date: 2012-03-09 DOI: 10.1109/TSMCB.2012.2188283
Junjie Wu, Shiwei Zhu, Hui Xiong, Jian Chen, Jianming Zhu

This paper presents a unified view of interestingness measures for interesting pattern discovery. Specifically, we first provide three necessary conditions for interestingness measures being used for association pattern discovery. Then, we reveal one desirable property for interestingness measures: the support-ascending conditional antimonotone property (SA-CAMP). Along this line, we prove that the measures possessing SA-CAMP are suitable for pattern discovery if the itemset-traversal structure is defined by a support-ascending set enumeration tree. In addition, we provide a thorough study on the family of the generalized mean (GM) measure and show their appealing properties, which are exploited for developing the GMiner algorithm for finding interesting association patterns. Finally, experimental results show that GMiner can efficiently identify interesting patterns based on SA-CAMP of the GM measure, even at an extremely low level of support.

本文提出了一种统一的有趣模式发现的有趣度度量方法。具体来说,我们首先提供了用于关联模式发现的兴趣度度量的三个必要条件。然后,我们揭示了兴趣度度量的一个理想性质:支持升序条件反单调性(SA-CAMP)。沿着这条思路,我们证明了如果项集遍历结构由支持升序集枚举树定义,则具有SA-CAMP的度量适用于模式发现。此外,我们对广义均值(GM)测度家族进行了深入的研究,并展示了它们吸引人的特性,这些特性被用于开发GMiner算法来寻找有趣的关联模式。最后,实验结果表明,即使在极低的支持水平下,基于GM度量的SA-CAMP, GMiner也能有效地识别出有趣的模式。
{"title":"Adapting the Right Measures for Pattern Discovery: A Unified View.","authors":"Junjie Wu,&nbsp;Shiwei Zhu,&nbsp;Hui Xiong,&nbsp;Jian Chen,&nbsp;Jianming Zhu","doi":"10.1109/TSMCB.2012.2188283","DOIUrl":"https://doi.org/10.1109/TSMCB.2012.2188283","url":null,"abstract":"<p><p>This paper presents a unified view of interestingness measures for interesting pattern discovery. Specifically, we first provide three necessary conditions for interestingness measures being used for association pattern discovery. Then, we reveal one desirable property for interestingness measures: the support-ascending conditional antimonotone property (SA-CAMP). Along this line, we prove that the measures possessing SA-CAMP are suitable for pattern discovery if the itemset-traversal structure is defined by a support-ascending set enumeration tree. In addition, we provide a thorough study on the family of the generalized mean (GM) measure and show their appealing properties, which are exploited for developing the GMiner algorithm for finding interesting association patterns. Finally, experimental results show that GMiner can efficiently identify interesting patterns based on SA-CAMP of the GM measure, even at an extremely low level of support. </p>","PeriodicalId":55006,"journal":{"name":"IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics","volume":" ","pages":"1203-14"},"PeriodicalIF":0.0,"publicationDate":"2012-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TSMCB.2012.2188283","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40159266","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Face Feature Weighted Fusion Based on Fuzzy Membership Degree for Video Face Recognition. 基于模糊隶属度的人脸特征加权融合视频人脸识别。
Pub Date : 2012-08-01 Epub Date: 2012-06-12 DOI: 10.1109/TSMCB.2012.2185693
Jae Young Choi, K N Plataniotis, Yong Man Ro

This paper proposes a new video face recognition (FR) method that is designed for significantly improving FR via adaptive fusion of multiple face features (belonging to the same subject) acquired from a face sequence of video frames. In this paper, we derive an upper bound for recognition error arising from the proposed weighted feature fusion to justify theoretically its effectiveness for recognition from videos. In addition, in order to compute the optimal weights of face features to be fused, we develop a novel weight determination solution based on fuzzy membership function and quality measurement for face images. Using four public video databases, the effectiveness of the proposed method has been successfully evaluated under the conditions that are similar to those in real-world video FR applications. Furthermore, our method is simple and straightforward to implement.

本文提出了一种新的视频人脸识别方法,通过自适应融合从视频帧的人脸序列中获取的多个人脸特征(属于同一主体),显著提高了视频人脸识别的识别率。在本文中,我们推导了由所提出的加权特征融合引起的识别误差的上界,从理论上证明了其对视频识别的有效性。此外,为了计算待融合人脸特征的最优权重,我们提出了一种基于模糊隶属函数和人脸图像质量测量的权重确定方法。利用四个公共视频数据库,在与实际视频FR应用相似的条件下,成功地评估了该方法的有效性。此外,我们的方法简单且易于实现。
{"title":"Face Feature Weighted Fusion Based on Fuzzy Membership Degree for Video Face Recognition.","authors":"Jae Young Choi,&nbsp;K N Plataniotis,&nbsp;Yong Man Ro","doi":"10.1109/TSMCB.2012.2185693","DOIUrl":"https://doi.org/10.1109/TSMCB.2012.2185693","url":null,"abstract":"<p><p>This paper proposes a new video face recognition (FR) method that is designed for significantly improving FR via adaptive fusion of multiple face features (belonging to the same subject) acquired from a face sequence of video frames. In this paper, we derive an upper bound for recognition error arising from the proposed weighted feature fusion to justify theoretically its effectiveness for recognition from videos. In addition, in order to compute the optimal weights of face features to be fused, we develop a novel weight determination solution based on fuzzy membership function and quality measurement for face images. Using four public video databases, the effectiveness of the proposed method has been successfully evaluated under the conditions that are similar to those in real-world video FR applications. Furthermore, our method is simple and straightforward to implement. </p>","PeriodicalId":55006,"journal":{"name":"IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics","volume":" ","pages":"1270-82"},"PeriodicalIF":0.0,"publicationDate":"2012-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TSMCB.2012.2185693","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"30702996","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 23
Combining Tensor Space Analysis and Active Appearance Models for Aging Effect Simulation on Face Images. 结合张量空间分析和主动外观模型的人脸图像老化效应仿真。
Pub Date : 2012-08-01 Epub Date: 2012-03-02 DOI: 10.1109/TSMCB.2012.2187051
Yunhong Wang, Zhaoxiang Zhang, Weixin Li, Fangyuan Jiang

Applications of the simulation of adult aging effects are widespread nowadays, whereas the difficulties in certain aspects restrict its development. In this paper, a method is proposed for simulating adult facial aging effects by means of super-resolution. Accounting for the nature of multimodalities in the face image set, multilinear algebra is introduced to represent and process the whole image set in tensor space. To ameliorate the aging simulation results generated by merely the super-resolution method, we further adopt active appearance models to reduce the blurring effects of the results through adding normalization of the faces and postprocessing to the algorithm. To evaluate our aging simulation method, the aged faces obtained are compared with the ground-truth face images of the same individuals and also assessed by several volunteers mainly from two perspectives: the aged faces' perceived age and their preservation effects of the original identities of subjects in the test images. Additionally, objective experiments based on an automatic age estimator and a face recognition method using eigenfaces are also conducted as another way of the evaluation.

目前成人衰老效应模拟的应用十分广泛,但在某些方面存在的困难制约了其发展。本文提出了一种用超分辨率技术模拟成人面部衰老效果的方法。考虑到人脸图像集的多模态特性,引入多元线性代数在张量空间中对整个图像集进行表示和处理。为了改善单纯采用超分辨率方法产生的老化仿真结果,我们进一步采用主动外观模型,通过对算法进行人脸归一化和后处理,降低仿真结果的模糊效果。为了评估我们的衰老模拟方法,我们将获得的衰老人脸与同一个体的真实人脸图像进行比较,并由几名志愿者进行评估,主要从两个方面进行评估:衰老人脸的感知年龄和对测试图像中受试者原始身份的保存效果。此外,还进行了基于自动年龄估计器和基于特征脸的人脸识别方法的客观实验,作为另一种评估方法。
{"title":"Combining Tensor Space Analysis and Active Appearance Models for Aging Effect Simulation on Face Images.","authors":"Yunhong Wang,&nbsp;Zhaoxiang Zhang,&nbsp;Weixin Li,&nbsp;Fangyuan Jiang","doi":"10.1109/TSMCB.2012.2187051","DOIUrl":"https://doi.org/10.1109/TSMCB.2012.2187051","url":null,"abstract":"<p><p>Applications of the simulation of adult aging effects are widespread nowadays, whereas the difficulties in certain aspects restrict its development. In this paper, a method is proposed for simulating adult facial aging effects by means of super-resolution. Accounting for the nature of multimodalities in the face image set, multilinear algebra is introduced to represent and process the whole image set in tensor space. To ameliorate the aging simulation results generated by merely the super-resolution method, we further adopt active appearance models to reduce the blurring effects of the results through adding normalization of the faces and postprocessing to the algorithm. To evaluate our aging simulation method, the aged faces obtained are compared with the ground-truth face images of the same individuals and also assessed by several volunteers mainly from two perspectives: the aged faces' perceived age and their preservation effects of the original identities of subjects in the test images. Additionally, objective experiments based on an automatic age estimator and a face recognition method using eigenfaces are also conducted as another way of the evaluation. </p>","PeriodicalId":55006,"journal":{"name":"IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics","volume":" ","pages":"1107-18"},"PeriodicalIF":0.0,"publicationDate":"2012-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1109/TSMCB.2012.2187051","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40144889","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
期刊
IEEE Transactions on Systems Man and Cybernetics Part B-Cybernetics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1