Yixu Song, Jing Hu, Xiaokui Yang, Jie Fu, Xiufen Xie
{"title":"一种基于曲线拟合的数据流处理方法","authors":"Yixu Song, Jing Hu, Xiaokui Yang, Jie Fu, Xiufen Xie","doi":"10.1109/ICSPS.2010.5555670","DOIUrl":null,"url":null,"abstract":"The sampling storage method which used in the current data stream could not respond data tendency effectively. For the problem, this paper presents a new processing method based on curve fitting. A weighted least-square principle is used to fit the cached stream data and better model description is obtained. Then the fitting results are analyzed by clustering algorithm, which serves as a classifier for polynomial fitting parameters. According to the clustering result, the appropriate window size will be given to fit the periodic stream data. Comparing the function solutions with the actual data, the different methods are adopted to store data according to the comparison result. The experimental results indicate that the proposed method has better fitting accuracy and compression ratio, could meet the requirement of data stream processing. And the data tendency could be responded effectively by the fitting results.","PeriodicalId":234084,"journal":{"name":"2010 2nd International Conference on Signal Processing Systems","volume":"109 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2010-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"A method for data stream processing based on curve fitting\",\"authors\":\"Yixu Song, Jing Hu, Xiaokui Yang, Jie Fu, Xiufen Xie\",\"doi\":\"10.1109/ICSPS.2010.5555670\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The sampling storage method which used in the current data stream could not respond data tendency effectively. For the problem, this paper presents a new processing method based on curve fitting. A weighted least-square principle is used to fit the cached stream data and better model description is obtained. Then the fitting results are analyzed by clustering algorithm, which serves as a classifier for polynomial fitting parameters. According to the clustering result, the appropriate window size will be given to fit the periodic stream data. Comparing the function solutions with the actual data, the different methods are adopted to store data according to the comparison result. The experimental results indicate that the proposed method has better fitting accuracy and compression ratio, could meet the requirement of data stream processing. And the data tendency could be responded effectively by the fitting results.\",\"PeriodicalId\":234084,\"journal\":{\"name\":\"2010 2nd International Conference on Signal Processing Systems\",\"volume\":\"109 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2010-07-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2010 2nd International Conference on Signal Processing Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSPS.2010.5555670\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2010 2nd International Conference on Signal Processing Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSPS.2010.5555670","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A method for data stream processing based on curve fitting
The sampling storage method which used in the current data stream could not respond data tendency effectively. For the problem, this paper presents a new processing method based on curve fitting. A weighted least-square principle is used to fit the cached stream data and better model description is obtained. Then the fitting results are analyzed by clustering algorithm, which serves as a classifier for polynomial fitting parameters. According to the clustering result, the appropriate window size will be given to fit the periodic stream data. Comparing the function solutions with the actual data, the different methods are adopted to store data according to the comparison result. The experimental results indicate that the proposed method has better fitting accuracy and compression ratio, could meet the requirement of data stream processing. And the data tendency could be responded effectively by the fitting results.