Pub Date : 2014-11-01DOI: 10.1016/S1874-1029(14)60410-9
Wen-Juan QI , Peng ZHANG , Zi-Li DENG
This paper deals with the problem of designing robust sequential covariance intersection (SCI) fusion Kalman filter for the clustering multi-agent sensor network system with measurement delays and uncertain noise variances. The sensor network is partitioned into clusters by the nearest neighbor rule. Using the minimax robust estimation principle, based on the worst-case conservative sensor network system with conservative upper bounds of noise variances, and applying the unbiased linear minimum variance (ULMV) optimal estimation rule, we present the two-layer SCI fusion robust steady-state Kalman filter which can reduce communication and computation burdens and save energy sources, and guarantee that the actual filtering error variances have a less-conservative upper-bound. A Lyapunov equation method for robustness analysis is proposed, by which the robustness of the local and fused Kalman filters is proved. The concept of the robust accuracy is presented and the robust accuracy relations of the local and fused robust Kalman filters are proved. It is proved that the robust accuracy of the global SCI fuser is higher than those of the local SCI fusers and the robust accuracies of all SCI fusers are higher than that of each local robust Kalman filter. A simulation example for a tracking system verifies the robustness and robust accuracy relations.
{"title":"Robust Sequential Covariance Intersection Fusion Kalman Filtering over Multi-agent Sensor Networks with Measurement Delays and Uncertain Noise Variances","authors":"Wen-Juan QI , Peng ZHANG , Zi-Li DENG","doi":"10.1016/S1874-1029(14)60410-9","DOIUrl":"10.1016/S1874-1029(14)60410-9","url":null,"abstract":"<div><p>This paper deals with the problem of designing robust sequential covariance intersection (SCI) fusion Kalman filter for the clustering multi-agent sensor network system with measurement delays and uncertain noise variances. The sensor network is partitioned into clusters by the nearest neighbor rule. Using the minimax robust estimation principle, based on the worst-case conservative sensor network system with conservative upper bounds of noise variances, and applying the unbiased linear minimum variance (ULMV) optimal estimation rule, we present the two-layer SCI fusion robust steady-state Kalman filter which can reduce communication and computation burdens and save energy sources, and guarantee that the actual filtering error variances have a less-conservative upper-bound. A Lyapunov equation method for robustness analysis is proposed, by which the robustness of the local and fused Kalman filters is proved. The concept of the robust accuracy is presented and the robust accuracy relations of the local and fused robust Kalman filters are proved. It is proved that the robust accuracy of the global SCI fuser is higher than those of the local SCI fusers and the robust accuracies of all SCI fusers are higher than that of each local robust Kalman filter. A simulation example for a tracking system verifies the robustness and robust accuracy relations.</p></div>","PeriodicalId":35798,"journal":{"name":"自动化学报","volume":"40 11","pages":"Pages 2632-2642"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S1874-1029(14)60410-9","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56928739","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2014-11-01DOI: 10.1016/S1874-1029(14)60400-6
Xie-Yan ZHANG , Jing ZHANG
This paper discusses the sampled-data consensus problem of multi-agent systems with general linear dynamics and time-varying sampling intervals. To investigate the allowable upper bound of sampling intervals, we employ the property of discretization of sampled-data to identify the upper bound on the variable sampling intervals via a continuous-time model. Without considering the states in the sampling intervals, the decrease of Lyapunov function is guaranteed only at each sampling time. Consequently, it results in a more robust sampling interval which is obtained by verifying the feasibility of LMIs. Subsequently, provided a limited matrix variable, the control gain matrix K is solved by the LMI approach. Numerical simulations are provided to demonstrate the effectiveness of theoretical results.
{"title":"Sampled-data Consensus of Multi-agent Systems with General Linear Dynamics Based on a Continuous-time Model","authors":"Xie-Yan ZHANG , Jing ZHANG","doi":"10.1016/S1874-1029(14)60400-6","DOIUrl":"10.1016/S1874-1029(14)60400-6","url":null,"abstract":"<div><p>This paper discusses the sampled-data consensus problem of multi-agent systems with general linear dynamics and time-varying sampling intervals. To investigate the allowable upper bound of sampling intervals, we employ the property of discretization of sampled-data to identify the upper bound on the variable sampling intervals via a continuous-time model. Without considering the states in the sampling intervals, the decrease of Lyapunov function is guaranteed only at each sampling time. Consequently, it results in a more robust sampling interval which is obtained by verifying the feasibility of LMIs. Subsequently, provided a limited matrix variable, the control gain matrix <em>K</em> is solved by the LMI approach. Numerical simulations are provided to demonstrate the effectiveness of theoretical results.</p></div>","PeriodicalId":35798,"journal":{"name":"自动化学报","volume":"40 11","pages":"Pages 2549-2555"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S1874-1029(14)60400-6","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56928662","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2014-11-01DOI: 10.1016/S1874-1029(14)60401-8
Zhen-Xing LI , Hai-Bo JI
This paper investigates the consensus control for multi-agent systems subject to external disturbances, input delays and model uncertainties of networks. By defining an appropriate controlled output, we transform this question into a robust H∞ control problem. Then, we give two criteria to judge the consensusability of closed-loop multi-agent systems and present a cone-complementary linearization algorithm to get the state feedback controller's parameters. Finally, numerical examples are given to show the effectiveness of the proposed consensus protocols.
{"title":"Robust Delay-dependent H∞ Consensus Control for Multi-agent Systems with Input Delays","authors":"Zhen-Xing LI , Hai-Bo JI","doi":"10.1016/S1874-1029(14)60401-8","DOIUrl":"10.1016/S1874-1029(14)60401-8","url":null,"abstract":"<div><p>This paper investigates the consensus control for multi-agent systems subject to external disturbances, input delays and model uncertainties of networks. By defining an appropriate controlled output, we transform this question into a robust <em>H</em><sub>∞</sub> control problem. Then, we give two criteria to judge the consensusability of closed-loop multi-agent systems and present a cone-complementary linearization algorithm to get the state feedback controller's parameters. Finally, numerical examples are given to show the effectiveness of the proposed consensus protocols.</p></div>","PeriodicalId":35798,"journal":{"name":"自动化学报","volume":"40 11","pages":"Pages 2556-2562"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S1874-1029(14)60401-8","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56928665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2014-11-01DOI: 10.1016/S1874-1029(14)60407-9
Yan-Rong GE , Yang-Zhou CHEN , Ya-Xiao ZHANG
This paper investigates the consensus problem of discrete-time linear multi-agent systems (DLMASs) with directed switching information topologies and time-varying delays. First, we transform the consensus problem to an asymptotic stability problem of a corresponding time-delayed switched linear system (TDSLS) via a proper linear transformation. Then by using a constructed Lyapunov functional and the average dwell-time scheme, we establish a novel delay-dependent sufficient condition for the solvability of the consensus problem in terms of linear matrix inequalities (LMIs) for two cases, respectively: 1) all of the given information topologies are consensusable; 2) some of the given information topologies are consensusable. Finally, numerical examples are given to show the validness of the established results.
{"title":"Average Dwell-time Conditions for Consensus of Discrete-time Linear Multi-agent Systems with Switching Topologies and Time-varying Delays","authors":"Yan-Rong GE , Yang-Zhou CHEN , Ya-Xiao ZHANG","doi":"10.1016/S1874-1029(14)60407-9","DOIUrl":"10.1016/S1874-1029(14)60407-9","url":null,"abstract":"<div><p>This paper investigates the consensus problem of discrete-time linear multi-agent systems (DLMASs) with directed switching information topologies and time-varying delays. First, we transform the consensus problem to an asymptotic stability problem of a corresponding time-delayed switched linear system (TDSLS) via a proper linear transformation. Then by using a constructed Lyapunov functional and the average dwell-time scheme, we establish a novel delay-dependent sufficient condition for the solvability of the consensus problem in terms of linear matrix inequalities (LMIs) for two cases, respectively: 1) all of the given information topologies are consensusable; 2) some of the given information topologies are consensusable. Finally, numerical examples are given to show the validness of the established results.</p></div>","PeriodicalId":35798,"journal":{"name":"自动化学报","volume":"40 11","pages":"Pages 2609-2617"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S1874-1029(14)60407-9","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56928730","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2014-11-01DOI: 10.1016/S1874-1029(14)60404-3
Peng ZHANG , Wen-Juan QI , Zi-Li DENG
This paper investigates the distributed fusion Kalman filtering over clustering sensor networks. The sensor network is partitioned as clusters by the nearest neighbor rule and each cluster consists of sensing nodes and cluster-head. Using the minimax robust estimation principle, based on the worst-case conservative system with the conservative upper bounds of noise variances, two-level robust measurement fusion Kalman filter is presented for the clustering sensor network systems with uncertain noise variances. It can significantly reduce the communication load and save energy when the number of sensors is very large. A Lyapunov equation approach for the robustness analysis is presented, by which the robustness of the local and fused Kalman filters is proved. The concept of the robust accuracy is presented, and the robust accuracy relations among the local and fused robust Kalman filters are proved. It is proved that the robust accuracy of the two-level weighted measurement fuser is equal to that of the global centralized robust fuser and is higher than those of each local robust filter and each local weighted measurement fuser. A simulation example shows the correctness and effectiveness of the proposed results.
{"title":"Two-level Robust Measurement Fusion Kalman Filter for Clustering Sensor Networks","authors":"Peng ZHANG , Wen-Juan QI , Zi-Li DENG","doi":"10.1016/S1874-1029(14)60404-3","DOIUrl":"10.1016/S1874-1029(14)60404-3","url":null,"abstract":"<div><p>This paper investigates the distributed fusion Kalman filtering over clustering sensor networks. The sensor network is partitioned as clusters by the nearest neighbor rule and each cluster consists of sensing nodes and cluster-head. Using the minimax robust estimation principle, based on the worst-case conservative system with the conservative upper bounds of noise variances, two-level robust measurement fusion Kalman filter is presented for the clustering sensor network systems with uncertain noise variances. It can significantly reduce the communication load and save energy when the number of sensors is very large. A Lyapunov equation approach for the robustness analysis is presented, by which the robustness of the local and fused Kalman filters is proved. The concept of the robust accuracy is presented, and the robust accuracy relations among the local and fused robust Kalman filters are proved. It is proved that the robust accuracy of the two-level weighted measurement fuser is equal to that of the global centralized robust fuser and is higher than those of each local robust filter and each local weighted measurement fuser. A simulation example shows the correctness and effectiveness of the proposed results.</p></div>","PeriodicalId":35798,"journal":{"name":"自动化学报","volume":"40 11","pages":"Pages 2585-2594"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S1874-1029(14)60404-3","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56928713","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2014-11-01DOI: 10.1016/S1874-1029(14)60405-5
Zhou-Hua PENG , Dan WANG , Hao WANG , Wei WANG
This paper considers the cooperative tracking of linear multi-agent systems with a dynamic leader whose input information is unavailable to any followers. Cooperative iterative learning controllers, based on the relative state information of neighboring agents, are proposed for tracking the dynamic leader over directed communication topologies. Stability and convergence of the proposed controllers are established using Lyapunov-Krasovskii functionals. Furthermore, this result is extended to the output feedback case where only the output information of each agent can be obtained. A local observer is constructed to estimate the unmeasurable states. Then, cooperative iterative learning controllers, based on the relative observed states of neighboring agents, are devised. For both cases, it is shown that the multi-agent systems whose communication topologies contain a spanning tree can reach synchronization with the dynamic leader, and meanwhile identify the unknown input of the dynamic leader using distributed iterative learning laws. An illustrative example is provided to verify the proposed control schemes.
{"title":"Cooperative Iterative Learning Control of Linear Multi-agent Systems with a Dynamic Leader under Directed Topologies","authors":"Zhou-Hua PENG , Dan WANG , Hao WANG , Wei WANG","doi":"10.1016/S1874-1029(14)60405-5","DOIUrl":"10.1016/S1874-1029(14)60405-5","url":null,"abstract":"<div><p>This paper considers the cooperative tracking of linear multi-agent systems with a dynamic leader whose input information is unavailable to any followers. Cooperative iterative learning controllers, based on the relative state information of neighboring agents, are proposed for tracking the dynamic leader over directed communication topologies. Stability and convergence of the proposed controllers are established using Lyapunov-Krasovskii functionals. Furthermore, this result is extended to the output feedback case where only the output information of each agent can be obtained. A local observer is constructed to estimate the unmeasurable states. Then, cooperative iterative learning controllers, based on the relative observed states of neighboring agents, are devised. For both cases, it is shown that the multi-agent systems whose communication topologies contain a spanning tree can reach synchronization with the dynamic leader, and meanwhile identify the unknown input of the dynamic leader using distributed iterative learning laws. An illustrative example is provided to verify the proposed control schemes.</p></div>","PeriodicalId":35798,"journal":{"name":"自动化学报","volume":"40 11","pages":"Pages 2595-2601"},"PeriodicalIF":0.0,"publicationDate":"2014-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S1874-1029(14)60405-5","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56928718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2014-10-01DOI: 10.1016/S1874-1029(14)60363-3
Jian CHEN , Kai-Xiong SU , Wei-Xing WANG , Cheng-Dong LAN
Compressed sensing (CS) is a novel technology to acquire and reconstruct sparse signals below the Nyquist rate. It has great potential in image and video acquisition and processing. To effectively improve the sparsity of signal being measured and reconstructing efficiency, an encoding and decoding model of residual distributed compressive video sensing based on double side information (RDCVS-DSI) is proposed in this paper. Exploiting the characteristics of image itself in the frequency domain and the correlation between successive frames, the model regards the video frame in low quality as the first side information in the process of coding, and generates the second side information for the non-key frames using motion estimation and compensation technology at its decoding end. Performance analysis and simulation experiments show that the RDCVS-DSI model can rebuild the video sequence with high fidelity in the consumption of quite low complexity. About 1 ~ 5 dB gain in the average peak signal-to-noise ratio of the reconstructed frames is observed, and the speed is close to the least complex DCVS, when compared with prior works on compressive video sensing.
{"title":"Residual Distributed Compressive Video Sensing Based on Double Side Information","authors":"Jian CHEN , Kai-Xiong SU , Wei-Xing WANG , Cheng-Dong LAN","doi":"10.1016/S1874-1029(14)60363-3","DOIUrl":"10.1016/S1874-1029(14)60363-3","url":null,"abstract":"<div><p>Compressed sensing (CS) is a novel technology to acquire and reconstruct sparse signals below the Nyquist rate. It has great potential in image and video acquisition and processing. To effectively improve the sparsity of signal being measured and reconstructing efficiency, an encoding and decoding model of residual distributed compressive video sensing based on double side information (RDCVS-DSI) is proposed in this paper. Exploiting the characteristics of image itself in the frequency domain and the correlation between successive frames, the model regards the video frame in low quality as the first side information in the process of coding, and generates the second side information for the non-key frames using motion estimation and compensation technology at its decoding end. Performance analysis and simulation experiments show that the RDCVS-DSI model can rebuild the video sequence with high fidelity in the consumption of quite low complexity. About 1 ~ 5 dB gain in the average peak signal-to-noise ratio of the reconstructed frames is observed, and the speed is close to the least complex DCVS, when compared with prior works on compressive video sensing.</p></div>","PeriodicalId":35798,"journal":{"name":"自动化学报","volume":"40 10","pages":"Pages 2316-2323"},"PeriodicalIF":0.0,"publicationDate":"2014-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S1874-1029(14)60363-3","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56928123","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2014-10-01DOI: 10.1016/S1874-1029(14)60361-X
Chang-Wei LUO , Jun YU , Zeng-Fu WANG
In this paper, we present a system for real-time performance-driven facial animation. With the system, the user can control the facial expression of a digital character by acting out the desired facial action in front of an ordinary camera. First, we create a muscle-based 3D face model. The muscle actuation parameters are used to animate the face model. To increase the reality of facial animation, the orbicularis oris in our face model is divided into the inner part and outer part. We also establish the relationship between jaw rotation and facial surface deformation. Second, a real-time facial tracking method is employed to track the facial features of a performer in the video. Finally, the tracked facial feature points are used to estimate muscle actuation parameters to drive the face model. Experimental results show that our system runs in real time and outputs realistic facial animations. Compared with most existing performance-based facial animation systems, ours does not require facial markers, intrusive lighting, or special scanning equipment, thus it is inexpensive and easy to use.
{"title":"Synthesizing Performance-driven Facial Animation","authors":"Chang-Wei LUO , Jun YU , Zeng-Fu WANG","doi":"10.1016/S1874-1029(14)60361-X","DOIUrl":"10.1016/S1874-1029(14)60361-X","url":null,"abstract":"<div><p>In this paper, we present a system for real-time performance-driven facial animation. With the system, the user can control the facial expression of a digital character by acting out the desired facial action in front of an ordinary camera. First, we create a muscle-based 3D face model. The muscle actuation parameters are used to animate the face model. To increase the reality of facial animation, the orbicularis oris in our face model is divided into the inner part and outer part. We also establish the relationship between jaw rotation and facial surface deformation. Second, a real-time facial tracking method is employed to track the facial features of a performer in the video. Finally, the tracked facial feature points are used to estimate muscle actuation parameters to drive the face model. Experimental results show that our system runs in real time and outputs realistic facial animations. Compared with most existing performance-based facial animation systems, ours does not require facial markers, intrusive lighting, or special scanning equipment, thus it is inexpensive and easy to use.</p></div>","PeriodicalId":35798,"journal":{"name":"自动化学报","volume":"40 10","pages":"Pages 2245-2252"},"PeriodicalIF":0.0,"publicationDate":"2014-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S1874-1029(14)60361-X","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56928371","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2014-10-01DOI: 10.1016/S1874-1029(14)60362-1
Ding-Cheng FENG , Feng CHEN , Wen-Li XU
Unsupervised feature selection is fundamental in statistical pattern recognition, and has drawn persistent attention in the past several decades. Recently, much work has shown that feature selection can be formulated as nonlinear dimensionality reduction with discrete constraints. This line of research emphasizes utilizing the manifold learning techniques, where feature selection and learning can be studied based on the manifold assumption in data distribution. Many existing feature selection methods such as Laplacian score, SPEC (spectrum decomposition of graph Laplacian), TR (trace ratio) criterion, MSFS (multi-cluster feature selection) and EVSC (eigenvalue sensitive criterion) apply the basic properties of graph Laplacian, and select the optimal feature subsets which best preserve the manifold structure defined on the graph Laplacian. In this paper, we propose a new feature selection perspective from locally linear embedding (LLE), which is another popular manifold learning method. The main difficulty of using LLE for feature selection is that its optimization involves quadratic programming and eigenvalue decomposition, both of which are continuous procedures and different from discrete feature selection. We prove that the LLE objective can be decomposed with respect to data dimensionalities in the subset selection problem, which also facilitates constructing better coordinates from data using the principal component analysis (PCA) technique. Based on these results, we propose a novel unsupervised feature selection algorithm, called locally linear selection (LLS), to select a feature subset representing the underlying data manifold. The local relationship among samples is computed from the LLE formulation, which is then used to estimate the contribution of each individual feature to the underlying manifold structure. These contributions, represented as LLS scores, are ranked and selected as the candidate solution to feature selection. We further develop a locally linear rotation-selection (LLRS) algorithm which extends LLS to identify the optimal coordinate subset from a new space. Experimental results on real-world datasets show that our method can be more effective than Laplacian eigenmap based feature selection methods.
{"title":"Detecting Local Manifold Structure for Unsupervised Feature Selection","authors":"Ding-Cheng FENG , Feng CHEN , Wen-Li XU","doi":"10.1016/S1874-1029(14)60362-1","DOIUrl":"10.1016/S1874-1029(14)60362-1","url":null,"abstract":"<div><p>Unsupervised feature selection is fundamental in statistical pattern recognition, and has drawn persistent attention in the past several decades. Recently, much work has shown that feature selection can be formulated as nonlinear dimensionality reduction with discrete constraints. This line of research emphasizes utilizing the manifold learning techniques, where feature selection and learning can be studied based on the manifold assumption in data distribution. Many existing feature selection methods such as Laplacian score, SPEC (spectrum decomposition of graph Laplacian), TR (trace ratio) criterion, MSFS (multi-cluster feature selection) and EVSC (eigenvalue sensitive criterion) apply the basic properties of graph Laplacian, and select the optimal feature subsets which best preserve the manifold structure defined on the graph Laplacian. In this paper, we propose a new feature selection perspective from locally linear embedding (LLE), which is another popular manifold learning method. The main difficulty of using LLE for feature selection is that its optimization involves quadratic programming and eigenvalue decomposition, both of which are continuous procedures and different from discrete feature selection. We prove that the LLE objective can be decomposed with respect to data dimensionalities in the subset selection problem, which also facilitates constructing better coordinates from data using the principal component analysis (PCA) technique. Based on these results, we propose a novel unsupervised feature selection algorithm, called locally linear selection (LLS), to select a feature subset representing the underlying data manifold. The local relationship among samples is computed from the LLE formulation, which is then used to estimate the contribution of each individual feature to the underlying manifold structure. These contributions, represented as LLS scores, are ranked and selected as the candidate solution to feature selection. We further develop a locally linear rotation-selection (LLRS) algorithm which extends LLS to identify the optimal coordinate subset from a new space. Experimental results on real-world datasets show that our method can be more effective than Laplacian eigenmap based feature selection methods.</p></div>","PeriodicalId":35798,"journal":{"name":"自动化学报","volume":"40 10","pages":"Pages 2253-2261"},"PeriodicalIF":0.0,"publicationDate":"2014-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S1874-1029(14)60362-1","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56927993","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2014-10-01DOI: 10.1016/S1874-1029(14)60366-9
Hao-Han WU , Fu-Jiang JIN , Lian-You LAI , Liang WANG
This paper provides a new adaptive algorithm for single-step prediction by modeling the potential field of a one dimension Schrödinger wave equation using neural network. This new architecture is referred to as the recurrent quantum neural network (RQNN). The RQNN can filter the signal embedded with non-stationary noise without any priori knowledge of the shape of the signal and statistical properties of the noise. We compared the simulation results of the RQNN with a classical adaptive stochastic filter-RLS. It is shown that the RQNN is much more efficient in denoising signals embedded with Gaussian stationary, non-Gaussian stationary and Gaussian non-stationary noise such as DC, sinusoid, staircase and speech signals. The RQNN can enhance the signal to noise rate (SNR) by 20 dB, which is more than 10 dB given by the traditional technology when it denoising sinusoid signal.
{"title":"A Stochastic Filtering Algorithm Using Schrödinger Equation","authors":"Hao-Han WU , Fu-Jiang JIN , Lian-You LAI , Liang WANG","doi":"10.1016/S1874-1029(14)60366-9","DOIUrl":"10.1016/S1874-1029(14)60366-9","url":null,"abstract":"<div><p>This paper provides a new adaptive algorithm for single-step prediction by modeling the potential field of a one dimension Schrödinger wave equation using neural network. This new architecture is referred to as the recurrent quantum neural network (RQNN). The RQNN can filter the signal embedded with non-stationary noise without any priori knowledge of the shape of the signal and statistical properties of the noise. We compared the simulation results of the RQNN with a classical adaptive stochastic filter-RLS. It is shown that the RQNN is much more efficient in denoising signals embedded with Gaussian stationary, non-Gaussian stationary and Gaussian non-stationary noise such as DC, sinusoid, staircase and speech signals. The RQNN can enhance the signal to noise rate (SNR) by 20 dB, which is more than 10 dB given by the traditional technology when it denoising sinusoid signal.</p></div>","PeriodicalId":35798,"journal":{"name":"自动化学报","volume":"40 10","pages":"Pages 2370-2376"},"PeriodicalIF":0.0,"publicationDate":"2014-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1016/S1874-1029(14)60366-9","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"56928139","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}