首页 > 最新文献

2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)最新文献

英文 中文
An exploration on the word co-occurrence network of Chinese popular song titles 中文流行歌名词共现网络研究
Baorong He, Dekuan Xu
Song titles is a special form of language expression with modernity and popularity: they are short in form and concise in meaning and can reflect the ideology and values of an era. In this paper, we built a co-occurrence network with the titles of approximately six thousand Chinese popular songs. We make an all-round research about it from the perspective of complex networks and explain such characteristics as small world effect, scale-free, hierarchy, betweenness centrality and assortiveness and so on. This paper reveals the unique nature of the co-occurrence network of the titles of popular songs and broadens the scope of language network studies.
歌名是一种特殊的语言表达形式,具有时代性和通俗性,其形式短小精悍,意义简洁,能反映一个时代的思想观念和价值观。在本文中,我们建立了一个包含大约6000首中国流行歌曲标题的共现网络。本文从复杂网络的角度对其进行了全面的研究,并解释了其小世界效应、无标度性、层次性、中间性、中心性和分类性等特征。本文揭示了流行歌曲标题共现网络的独特性,拓宽了语言网络研究的范围。
{"title":"An exploration on the word co-occurrence network of Chinese popular song titles","authors":"Baorong He, Dekuan Xu","doi":"10.1109/FSKD.2016.7603190","DOIUrl":"https://doi.org/10.1109/FSKD.2016.7603190","url":null,"abstract":"Song titles is a special form of language expression with modernity and popularity: they are short in form and concise in meaning and can reflect the ideology and values of an era. In this paper, we built a co-occurrence network with the titles of approximately six thousand Chinese popular songs. We make an all-round research about it from the perspective of complex networks and explain such characteristics as small world effect, scale-free, hierarchy, betweenness centrality and assortiveness and so on. This paper reveals the unique nature of the co-occurrence network of the titles of popular songs and broadens the scope of language network studies.","PeriodicalId":373155,"journal":{"name":"2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131125437","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
An intelligent decision support system for skin cancer detection from dermoscopic images 基于皮肤镜图像的皮肤癌检测智能决策支持系统
Teck Yan Tan, Li Zhang, Ming Jiang
It is challenging to develop an intelligent agent-based or robotic system to conduct long-term automatic health monitoring and robust efficient disease diagnosis as autonomous e-Carers in real-world applications. In this research, we aim to deal with such challenges by presenting an intelligent decision support system for skin lesion recognition as the initial step, which could be embedded into an intelligent service robot for health monitoring in home environments to promote early diagnosis. The system is developed to identify benign and malignant skin lesions using multiple steps, including pre-processing such as noise removal, segmentation, feature extraction from lesion regions, feature selection and classification. After extracting thousands of raw shape, colour and texture features from the lesion areas, a Genetic Algorithm (GA) is used to identify the most discriminating significant feature subsets for healthy and cancerous cases. A Support Vector Machine classifier has been employed to perform benign and malignant lesion recognition. Evaluated with 1300 images from the Dermofit dermoscopy image database, the empirical results indicate that our approach achieves superior performance in comparison to other related research reported in the literature.
在现实应用中,如何开发一种基于智能体或机器人的系统来进行长期的自动健康监测和稳健高效的疾病诊断,是一个具有挑战性的问题。在本研究中,我们的目标是通过提出一个智能决策支持系统来应对这些挑战,作为第一步,该系统可以嵌入到智能服务机器人中,用于家庭环境中的健康监测,以促进早期诊断。该系统通过对病变区域进行去噪、分割、特征提取、特征选择和分类等预处理,实现对皮肤良恶性病变的识别。在从病变区域提取数千个原始形状、颜色和纹理特征后,使用遗传算法(GA)来识别健康和癌症病例中最具区别性的显著特征子集。使用支持向量机分类器进行良性和恶性病变的识别。通过对来自Dermofit皮肤镜图像数据库的1300张图像进行评估,实证结果表明,与文献中报道的其他相关研究相比,我们的方法具有优越的性能。
{"title":"An intelligent decision support system for skin cancer detection from dermoscopic images","authors":"Teck Yan Tan, Li Zhang, Ming Jiang","doi":"10.1109/FSKD.2016.7603521","DOIUrl":"https://doi.org/10.1109/FSKD.2016.7603521","url":null,"abstract":"It is challenging to develop an intelligent agent-based or robotic system to conduct long-term automatic health monitoring and robust efficient disease diagnosis as autonomous e-Carers in real-world applications. In this research, we aim to deal with such challenges by presenting an intelligent decision support system for skin lesion recognition as the initial step, which could be embedded into an intelligent service robot for health monitoring in home environments to promote early diagnosis. The system is developed to identify benign and malignant skin lesions using multiple steps, including pre-processing such as noise removal, segmentation, feature extraction from lesion regions, feature selection and classification. After extracting thousands of raw shape, colour and texture features from the lesion areas, a Genetic Algorithm (GA) is used to identify the most discriminating significant feature subsets for healthy and cancerous cases. A Support Vector Machine classifier has been employed to perform benign and malignant lesion recognition. Evaluated with 1300 images from the Dermofit dermoscopy image database, the empirical results indicate that our approach achieves superior performance in comparison to other related research reported in the literature.","PeriodicalId":373155,"journal":{"name":"2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"68 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131073763","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 43
Hypemasality detection in cleft palate speech based on natural computation 基于自然计算的腭裂语音Hypemasality检测
Yin Liu, Xiyue Wang, Yipeng Hang, Ling He, H. Yin, Chuxian Liu
The speakers with cleft palate, due to the defective velopharyngeal mechanism, allow the passage of air through the nasal cavity, which introduces inappropriate nasal resonance during speech production and results in hypernasal speech. The existence of hypernasality severely reduces the intelligibility of the speech. The treatment of cleft palate hypernasal speech requires the follow up operation to close fracture and restore the normal voice. Speech evaluation is essential to assess the hypernasality grades. In this work, an automatic hypernasality grades detection method is proposed in cleft palate speech. After a low quefrency liftering at 90 quefrencies cutoff in cepstrum domain, a homomorphic spectrum is calculated as the extraction feature. Then a BP neural network classifier based on natural computation is applied to detect four grades of hypernasality: normal, mild, moderate and severe. The experiment results show that the classification accuracy for four grades of hypernasality is above 80%.
腭裂的说话者,由于腭咽机制的缺陷,使空气通过鼻腔,从而在说话过程中引入不适当的鼻共振,导致高鼻音。鼻音过度的存在严重地降低了说话的可理解性。腭裂多鼻语音的治疗需要后续手术闭合骨折,恢复正常语音。言语评价是评估鼻音过重程度的必要条件。本文提出了一种腭裂语音高鼻音自动分级检测方法。在倒谱域90个频率截止处进行低频提升后,计算同态谱作为提取特征。然后应用基于自然计算的BP神经网络分类器对正常、轻度、中度和重度四个级别的鼻窦炎进行检测。实验结果表明,该方法对4个级别的鼻音分类准确率均在80%以上。
{"title":"Hypemasality detection in cleft palate speech based on natural computation","authors":"Yin Liu, Xiyue Wang, Yipeng Hang, Ling He, H. Yin, Chuxian Liu","doi":"10.1109/FSKD.2016.7603228","DOIUrl":"https://doi.org/10.1109/FSKD.2016.7603228","url":null,"abstract":"The speakers with cleft palate, due to the defective velopharyngeal mechanism, allow the passage of air through the nasal cavity, which introduces inappropriate nasal resonance during speech production and results in hypernasal speech. The existence of hypernasality severely reduces the intelligibility of the speech. The treatment of cleft palate hypernasal speech requires the follow up operation to close fracture and restore the normal voice. Speech evaluation is essential to assess the hypernasality grades. In this work, an automatic hypernasality grades detection method is proposed in cleft palate speech. After a low quefrency liftering at 90 quefrencies cutoff in cepstrum domain, a homomorphic spectrum is calculated as the extraction feature. Then a BP neural network classifier based on natural computation is applied to detect four grades of hypernasality: normal, mild, moderate and severe. The experiment results show that the classification accuracy for four grades of hypernasality is above 80%.","PeriodicalId":373155,"journal":{"name":"2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131158491","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Parameter analysis of hybrid intelligent model for the prediction of rare earth stock futures 稀土股票期货预测的混合智能模型参数分析
Huijuan Zhang, R. Sun
Because of rare earth futures stock variability and uncertainty of the market, many investors hope to be able to predict the price of rare earth futures on the stock market in the future. The neural network does do better than others in short-term forecasting, and there is no need to establish a complex nonlinear mathematical model and relationship. Based on these advantages, this paper uses the neural network based on genetic algorithm to predict the closing price of rare earth stock by analyzing the historical data of rare earth stock. In the genetic algorithm, the parameters such as crossover rate, mutation rate, iterations and population size are analyzed. Based on the parameter analysis results, a hybrid machine learning model which is suitable for the prediction of rare earth stock is established, which provides a reference for the investors.
由于稀土期货库存的可变性和市场的不确定性,许多投资者希望能够预测未来股票市场上稀土期货的价格。神经网络在短期预测方面确实优于其他方法,而且不需要建立复杂的非线性数学模型和关系。基于这些优点,本文通过分析稀土股票的历史数据,采用基于遗传算法的神经网络对稀土股票的收盘价进行预测。在遗传算法中,对交叉率、突变率、迭代次数和种群大小等参数进行了分析。基于参数分析结果,建立了适合于稀土股票预测的混合机器学习模型,为投资者提供参考。
{"title":"Parameter analysis of hybrid intelligent model for the prediction of rare earth stock futures","authors":"Huijuan Zhang, R. Sun","doi":"10.1109/FSKD.2016.7603285","DOIUrl":"https://doi.org/10.1109/FSKD.2016.7603285","url":null,"abstract":"Because of rare earth futures stock variability and uncertainty of the market, many investors hope to be able to predict the price of rare earth futures on the stock market in the future. The neural network does do better than others in short-term forecasting, and there is no need to establish a complex nonlinear mathematical model and relationship. Based on these advantages, this paper uses the neural network based on genetic algorithm to predict the closing price of rare earth stock by analyzing the historical data of rare earth stock. In the genetic algorithm, the parameters such as crossover rate, mutation rate, iterations and population size are analyzed. Based on the parameter analysis results, a hybrid machine learning model which is suitable for the prediction of rare earth stock is established, which provides a reference for the investors.","PeriodicalId":373155,"journal":{"name":"2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128740848","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Domain adaptation for statistical machine translation 统计机器翻译的领域自适应
Xiaoxue Wang, Conghui Zhu, Sheng Li, T. Zhao, Dequan Zheng
Statistical machine translation (SMT) plays more and more important role now. The performance of the SMT is largely dependent on the size and quality of training data. But the demands for translation is rich, how to make the best of limited in-domain data to satisfy the needs of translation coming from different domains is one of the hot focus in current SMT. Domain adaption aims to obviously improve the specific-domain performance by bringing much out-of-domain parallel corpus at the absence of in-domain parallel corpus. Domain adaption is one of the keys to get the SMT into practical application. This paper introduces mainstream methods of domain adaption for SMT, compares advantages and disadvantages of representative methods based on the result of the same data and shows personal views about the possible future direction of domain adaption for SMT.
统计机器翻译(SMT)在翻译中发挥着越来越重要的作用。SMT的性能在很大程度上取决于训练数据的大小和质量。但是对翻译的需求是丰富的,如何充分利用有限的域内数据来满足来自不同域的翻译需求是当前SMT研究的热点之一。领域自适应的目的是在缺乏领域内并行语料库的情况下引入大量的领域外并行语料库,从而明显提高特定领域的性能。领域自适应是SMT进入实际应用的关键之一。本文介绍了SMT领域自适应的主流方法,根据相同数据的结果比较了代表性方法的优缺点,并对SMT领域自适应未来可能的发展方向提出了个人看法。
{"title":"Domain adaptation for statistical machine translation","authors":"Xiaoxue Wang, Conghui Zhu, Sheng Li, T. Zhao, Dequan Zheng","doi":"10.1109/FSKD.2016.7603425","DOIUrl":"https://doi.org/10.1109/FSKD.2016.7603425","url":null,"abstract":"Statistical machine translation (SMT) plays more and more important role now. The performance of the SMT is largely dependent on the size and quality of training data. But the demands for translation is rich, how to make the best of limited in-domain data to satisfy the needs of translation coming from different domains is one of the hot focus in current SMT. Domain adaption aims to obviously improve the specific-domain performance by bringing much out-of-domain parallel corpus at the absence of in-domain parallel corpus. Domain adaption is one of the keys to get the SMT into practical application. This paper introduces mainstream methods of domain adaption for SMT, compares advantages and disadvantages of representative methods based on the result of the same data and shows personal views about the possible future direction of domain adaption for SMT.","PeriodicalId":373155,"journal":{"name":"2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124800369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
A flight slot allocation model based on game theory 基于博弈论的航班时段分配模型
Zhi-wei Xing, Yunxiao Tang, Qian Luo
In view of the status and problems of the airport flight slot allocation, such as flight delays, traffic jams, and resource waste, etc. this paper analyzes the game phenomenon that exist between the management department and the airlines as well as among the various airlines during the process of time slot allocation, by adopting the idea of game theory. Through the establishment of certain assumptions and game theory principle, this study build the Stackelberg game model about flight slot allocation, and obtain the Nash equilibrium, at the same time put forward the strategy model based on credibility priority. All the above are in order to realize the perfect optimization of the time slot allocation. In the end, this paper analyze the computational case according to the actual departure data of a western airport, proving that by using the game strategy model with both price and credibility to optimize, the resource utilization, fairness and allocation efficiency all have been largely improved during the process of flight slot allocation.
针对机场航班时隙分配的现状和问题,如航班延误、交通堵塞、资源浪费等,本文运用博弈论的思想,分析了管理部门与航空公司之间以及各航空公司之间在时隙分配过程中存在的博弈现象。本研究通过建立一定的假设和博弈论原理,建立了关于航班时段分配的Stackelberg博弈模型,得到了纳什均衡,同时提出了基于可信度优先的策略模型。所有这些都是为了实现时隙分配的完美优化。最后,结合西部某机场实际离港数据,对计算案例进行了分析,证明了采用价格与可信度并重的博弈策略模型进行优化后,在机位分配过程中,资源利用率、公平性和分配效率都得到了较大的提高。
{"title":"A flight slot allocation model based on game theory","authors":"Zhi-wei Xing, Yunxiao Tang, Qian Luo","doi":"10.1109/FSKD.2016.7603201","DOIUrl":"https://doi.org/10.1109/FSKD.2016.7603201","url":null,"abstract":"In view of the status and problems of the airport flight slot allocation, such as flight delays, traffic jams, and resource waste, etc. this paper analyzes the game phenomenon that exist between the management department and the airlines as well as among the various airlines during the process of time slot allocation, by adopting the idea of game theory. Through the establishment of certain assumptions and game theory principle, this study build the Stackelberg game model about flight slot allocation, and obtain the Nash equilibrium, at the same time put forward the strategy model based on credibility priority. All the above are in order to realize the perfect optimization of the time slot allocation. In the end, this paper analyze the computational case according to the actual departure data of a western airport, proving that by using the game strategy model with both price and credibility to optimize, the resource utilization, fairness and allocation efficiency all have been largely improved during the process of flight slot allocation.","PeriodicalId":373155,"journal":{"name":"2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"28 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128131249","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Modal linguistic summaries based on natural language equivalence with cognitive semantics 基于自然语言与认知语义对等的情态语言摘要
R. Katarzyniak, Wojciech A. Lorkiewicz, Dominik P. Wiecek
An original model of linguistic summaries extracted from episodic data is briefly presented. In particular, a class of linguistic summaries expressed as modal equivalences is considered. The model is tailored to the concept of autonomous agent systems, and is supported by several detailed, non-technical, natural language processing and knowledge representation theories. Complementary to the well known classic interpretation of linguistic summaries, based on the fuzzy sets theory, the proposed model deals with a different class of vague cognitive concepts. The class consists of epistemic modalities, in particular the concepts of knowledge, belief and possibility. Each sub-class of linguistic summaries is processed as understood in the context of natural systems and supported by related cognitive semantics. Remarks on relevant implementation technologies are given, and an illustrative computational example is presented.
本文简要介绍了一种从情景数据中提取语言摘要的原始模型。特别考虑了一类以模态等价表示的语言摘要。该模型是针对自主智能体系统的概念量身定制的,并由几个详细的、非技术的、自然语言处理和知识表示理论支持。作为对经典语言摘要解释的补充,该模型基于模糊集理论,处理了不同类型的模糊认知概念。这门课包括认知模式,特别是知识、信念和可能性的概念。语言摘要的每个子类都是在自然系统的背景下被理解的,并得到相关认知语义的支持。给出了相关实现技术的说明,并给出了一个说明性的计算实例。
{"title":"Modal linguistic summaries based on natural language equivalence with cognitive semantics","authors":"R. Katarzyniak, Wojciech A. Lorkiewicz, Dominik P. Wiecek","doi":"10.1109/FSKD.2016.7603360","DOIUrl":"https://doi.org/10.1109/FSKD.2016.7603360","url":null,"abstract":"An original model of linguistic summaries extracted from episodic data is briefly presented. In particular, a class of linguistic summaries expressed as modal equivalences is considered. The model is tailored to the concept of autonomous agent systems, and is supported by several detailed, non-technical, natural language processing and knowledge representation theories. Complementary to the well known classic interpretation of linguistic summaries, based on the fuzzy sets theory, the proposed model deals with a different class of vague cognitive concepts. The class consists of epistemic modalities, in particular the concepts of knowledge, belief and possibility. Each sub-class of linguistic summaries is processed as understood in the context of natural systems and supported by related cognitive semantics. Remarks on relevant implementation technologies are given, and an illustrative computational example is presented.","PeriodicalId":373155,"journal":{"name":"2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122951962","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Parallelizing hot topic detection of microblog on spark 基于spark的微博热点话题并行检测
Wei Ai, Dapu Li
With the emergence of the big data age, how to get valuable hot topic from the vast amount of digitized textual materials quickly and accurately has attracted more and more attention. This paper proposes a parallel Two-phase Mic-mac Hot Topic Detection(TMHTD) method specially design for microblogging in “Big Data” environment, which is implemented based on Apache Spark cloud computing environment. TMHTD is a distributed clustering framework for documents sets with two phases, including micro-clustering and macro-clustering. In the first phase, TMHTD partitions original data sets into a group of smaller data sets, and these data subsets are clustered into many small topics, producing intermediate results. In the second phase, the intermediate results are integrated into one, further clustered, and achieve the final hot topic sets. To improve the accuracy of the hot topic detection, an optimization of TMHTD is proposed. To handle large databases, we deliberately design a group of MapReduce jobs to concretely accomplish the hot topic detection in a highly scalable way. Extensive experimental results indicate that the accuracy and performance of TMHTD algorithm can be improved significantly over existing approaches.
随着大数据时代的到来,如何从海量的数字化文本资料中快速准确地获取有价值的热点话题越来越受到人们的关注。本文提出了一种专门针对“大数据”环境下微博的并行两相Mic-mac热点话题检测(TMHTD)方法,并基于Apache Spark云计算环境实现。TMHTD是文档集的分布式聚类框架,分为两个阶段,包括微聚类和宏聚类。在第一阶段,TMHTD将原始数据集划分为一组较小的数据集,并将这些数据子集聚类成许多小主题,从而产生中间结果。第二阶段,将中间结果整合为一个,进一步聚类,得到最终的热点话题集。为了提高热点话题检测的准确性,提出了一种TMHTD的优化方法。为了处理大型数据库,我们特意设计了一组MapReduce作业,以高度可扩展的方式具体完成热点话题检测。大量的实验结果表明,TMHTD算法的精度和性能都比现有方法有显著提高。
{"title":"Parallelizing hot topic detection of microblog on spark","authors":"Wei Ai, Dapu Li","doi":"10.1109/FSKD.2016.7603392","DOIUrl":"https://doi.org/10.1109/FSKD.2016.7603392","url":null,"abstract":"With the emergence of the big data age, how to get valuable hot topic from the vast amount of digitized textual materials quickly and accurately has attracted more and more attention. This paper proposes a parallel Two-phase Mic-mac Hot Topic Detection(TMHTD) method specially design for microblogging in “Big Data” environment, which is implemented based on Apache Spark cloud computing environment. TMHTD is a distributed clustering framework for documents sets with two phases, including micro-clustering and macro-clustering. In the first phase, TMHTD partitions original data sets into a group of smaller data sets, and these data subsets are clustered into many small topics, producing intermediate results. In the second phase, the intermediate results are integrated into one, further clustered, and achieve the final hot topic sets. To improve the accuracy of the hot topic detection, an optimization of TMHTD is proposed. To handle large databases, we deliberately design a group of MapReduce jobs to concretely accomplish the hot topic detection in a highly scalable way. Extensive experimental results indicate that the accuracy and performance of TMHTD algorithm can be improved significantly over existing approaches.","PeriodicalId":373155,"journal":{"name":"2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123143062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Gaussian kernel particle swarm optimization clustering algorithm 高斯核粒子群优化聚类算法
Shengyu Pei, Lang Tong
As the K-means algorithm is dependent on the initial clustering center, and the particle swarm optimization (PSO) converges prematurely and is easily trapped in local minima, a Gaussian kernel particle swarm optimization clustering algorithm is proposed in this paper. The algorithm adopts the theory of good point set to initialize population, which makes the initial clustering center more rational. Particle swarm iteration formula was optimized by using Gaussian kernel method, which makes particle swarm algorithm converge rapidly to the global optimal. By testing 23 UCI data sets, the experimental results show that the clustering effect of the proposed algorithm is better than that of the K-means and the traditional particle swarm optimization clustering algorithm.
针对K-means算法依赖于初始聚类中心,粒子群优化(PSO)过早收敛且容易陷入局部极小值的问题,本文提出了一种高斯核粒子群优化聚类算法。该算法采用优点集理论对种群进行初始化,使初始聚类中心更加合理。采用高斯核方法对粒子群迭代公式进行优化,使粒子群算法快速收敛到全局最优。通过对23个UCI数据集的测试,实验结果表明,本文算法的聚类效果优于K-means和传统的粒子群优化聚类算法。
{"title":"Gaussian kernel particle swarm optimization clustering algorithm","authors":"Shengyu Pei, Lang Tong","doi":"10.1109/FSKD.2016.7603174","DOIUrl":"https://doi.org/10.1109/FSKD.2016.7603174","url":null,"abstract":"As the K-means algorithm is dependent on the initial clustering center, and the particle swarm optimization (PSO) converges prematurely and is easily trapped in local minima, a Gaussian kernel particle swarm optimization clustering algorithm is proposed in this paper. The algorithm adopts the theory of good point set to initialize population, which makes the initial clustering center more rational. Particle swarm iteration formula was optimized by using Gaussian kernel method, which makes particle swarm algorithm converge rapidly to the global optimal. By testing 23 UCI data sets, the experimental results show that the clustering effect of the proposed algorithm is better than that of the K-means and the traditional particle swarm optimization clustering algorithm.","PeriodicalId":373155,"journal":{"name":"2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"125 3 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126274833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Moving force identification based on particle swarm optimization 基于粒子群优化的运动力识别
Huanlin Liu, Ling Yu
Moving force is very important for bridge design, structural analysis and structural health monitoring. Some studies on moving force identification (MFI) attract extensive attentions in the past decades. A novel two-step MFI method is proposed based on particle swarm optimization (PSO) and time domain method (TDM) in this study. The new proposed MFI method includes two steps. In the first step, the PSO is used to identify the constant loads without matrix inversion. In the second step, the conventional TDM is employed to estimate the rest time-varying loads where the Tikhonov regularization and general cross validation (GCV) are introduced to improve the MFI accuracy and to select optimal regularization parameters, respectively. A simply supported beam bridge subjected to moving forces is taken as a numerical simulation example to assess the performance of the proposed method. The illustrated results show that the new two-step MFI method can more effectively identify the moving forces compared to the conventional TDM and the improved Tikhonov regularization method, the proposed new method can provide more accurate MFI results on two moving forces under eight combinations of bridge responses.
运动力是桥梁设计、结构分析和结构健康监测的重要内容。在过去的几十年里,一些关于运动力识别的研究引起了广泛的关注。提出了一种基于粒子群优化(PSO)和时域方法(TDM)的两步MFI算法。新提出的MFI方法包括两个步骤。第一步,利用粒子群算法辨识恒负荷,不需要矩阵反演。第二步,采用常规TDM估计剩余时变负荷,分别引入Tikhonov正则化和通用交叉验证(GCV)来提高MFI精度和选择最优正则化参数。以某简支梁桥为例,对该方法的性能进行了数值模拟。结果表明,与传统的TDM和改进的Tikhonov正则化方法相比,新方法能更有效地识别移动力,在8种桥梁响应组合下,新方法能提供更准确的两个移动力的MFI结果。
{"title":"Moving force identification based on particle swarm optimization","authors":"Huanlin Liu, Ling Yu","doi":"10.1109/FSKD.2016.7603283","DOIUrl":"https://doi.org/10.1109/FSKD.2016.7603283","url":null,"abstract":"Moving force is very important for bridge design, structural analysis and structural health monitoring. Some studies on moving force identification (MFI) attract extensive attentions in the past decades. A novel two-step MFI method is proposed based on particle swarm optimization (PSO) and time domain method (TDM) in this study. The new proposed MFI method includes two steps. In the first step, the PSO is used to identify the constant loads without matrix inversion. In the second step, the conventional TDM is employed to estimate the rest time-varying loads where the Tikhonov regularization and general cross validation (GCV) are introduced to improve the MFI accuracy and to select optimal regularization parameters, respectively. A simply supported beam bridge subjected to moving forces is taken as a numerical simulation example to assess the performance of the proposed method. The illustrated results show that the new two-step MFI method can more effectively identify the moving forces compared to the conventional TDM and the improved Tikhonov regularization method, the proposed new method can provide more accurate MFI results on two moving forces under eight combinations of bridge responses.","PeriodicalId":373155,"journal":{"name":"2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2016-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127133439","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1