基于半监督学习的支持向量机短文本分类新方法

Chunyong Yin, Jun Xiang, Hui Zhang, Jin Wang, Zhichao Yin, Jeong-Uk Kim
{"title":"基于半监督学习的支持向量机短文本分类新方法","authors":"Chunyong Yin, Jun Xiang, Hui Zhang, Jin Wang, Zhichao Yin, Jeong-Uk Kim","doi":"10.1109/AITS.2015.34","DOIUrl":null,"url":null,"abstract":"Short text is a popular text form, which is widely used in short commentary, micro-blog and many other fields. With the development of the social software and movie websites, the size of data is also becoming larger and larger. Most data is useless for us while other data is important for us. Therefore, it is very necessary for us to extract the useful short text from the big data. However, there are some problems such as fewer features, irregularity on the short text classification. To solve the problem we should pretreat the short text set and choose the significant features. This paper use semi-supervised learning and SVM to improve the traditional method and it can classify a large number of short texts to mining the useful massage from the short text. The experimental results also show a good improvement.","PeriodicalId":196795,"journal":{"name":"2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2015-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"44","resultStr":"{\"title\":\"A New SVM Method for Short Text Classification Based on Semi-Supervised Learning\",\"authors\":\"Chunyong Yin, Jun Xiang, Hui Zhang, Jin Wang, Zhichao Yin, Jeong-Uk Kim\",\"doi\":\"10.1109/AITS.2015.34\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Short text is a popular text form, which is widely used in short commentary, micro-blog and many other fields. With the development of the social software and movie websites, the size of data is also becoming larger and larger. Most data is useless for us while other data is important for us. Therefore, it is very necessary for us to extract the useful short text from the big data. However, there are some problems such as fewer features, irregularity on the short text classification. To solve the problem we should pretreat the short text set and choose the significant features. This paper use semi-supervised learning and SVM to improve the traditional method and it can classify a large number of short texts to mining the useful massage from the short text. The experimental results also show a good improvement.\",\"PeriodicalId\":196795,\"journal\":{\"name\":\"2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-08-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"44\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AITS.2015.34\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AITS.2015.34","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 44

摘要

短文本是一种流行的文本形式,被广泛应用于短文评论、微博等诸多领域。随着社交软件和电影网站的发展,数据的规模也越来越大。大多数数据对我们来说是无用的,而其他数据对我们来说是重要的。因此,从大数据中提取有用的短文本对我们来说是非常必要的。然而,目前的短文本分类存在特征较少、不规范等问题。为了解决这个问题,我们应该对短文本集进行预处理,选择显著特征。本文利用半监督学习和支持向量机对传统方法进行改进,可以对大量的短文本进行分类,从短文本中挖掘出有用的信息。实验结果也显示出较好的改进。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A New SVM Method for Short Text Classification Based on Semi-Supervised Learning
Short text is a popular text form, which is widely used in short commentary, micro-blog and many other fields. With the development of the social software and movie websites, the size of data is also becoming larger and larger. Most data is useless for us while other data is important for us. Therefore, it is very necessary for us to extract the useful short text from the big data. However, there are some problems such as fewer features, irregularity on the short text classification. To solve the problem we should pretreat the short text set and choose the significant features. This paper use semi-supervised learning and SVM to improve the traditional method and it can classify a large number of short texts to mining the useful massage from the short text. The experimental results also show a good improvement.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Falling Detection System Based on Machine Learning Image Fusion Algorithm Based on Wavelet Transform Study on Trust Management-Based Cluster-Head Selection in Wireless Sensor Networks A New Mobile Recommendation Algorithm Based on Statistical Theory Design of Fresh Sea Cucumber Weighing Sorting Machine
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1