基于数据挖掘技术的文本总结与聚类

Zainab Abdul-Nabay Salman
{"title":"基于数据挖掘技术的文本总结与聚类","authors":"Zainab Abdul-Nabay Salman","doi":"10.23851/mjs.v34i1.1195","DOIUrl":null,"url":null,"abstract":"Text summarization is an important research topic in the field of information technology because of the large volume of texts, and the large amount of data found on the Internet and social media. The task of summarizing the text has gained great importance that requires finding highly efficient ways in the process of extracting knowledge in various fields, Thus, there was a need for methods of summarizing texts for one document or multiple documents. The summarization methods aim to obtain the main content of the set of documents at the same time to reduce redundant information. In this paper, an efficient method to summarize texts is proposed that depends on the word association algorithm to separate and merge sentences after summarizing them. As well as the use of data mining technology in the process of redistributing information according to the (K-Mean) algorithm and the use of (Term Frequency Inverse Document Frequency TF-IDF) technology for measuring the properties of summarized texts. The experimental results found that the summarization ratios are good by deleting unimportant words. Also, the method of extracting characteristics for texts was useful in grouping similar texts into clusters, which makes this method possible to be combined with other methods in artificial intelligence such as fuzzy logic or evolutionary algorithms in increasing summarization rates and accelerating cluster operations.","PeriodicalId":7867,"journal":{"name":"Al-Mustansiriyah Journal of Science","volume":"127 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Text Summarizing and Clustering Using Data Mining Technique\",\"authors\":\"Zainab Abdul-Nabay Salman\",\"doi\":\"10.23851/mjs.v34i1.1195\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Text summarization is an important research topic in the field of information technology because of the large volume of texts, and the large amount of data found on the Internet and social media. The task of summarizing the text has gained great importance that requires finding highly efficient ways in the process of extracting knowledge in various fields, Thus, there was a need for methods of summarizing texts for one document or multiple documents. The summarization methods aim to obtain the main content of the set of documents at the same time to reduce redundant information. In this paper, an efficient method to summarize texts is proposed that depends on the word association algorithm to separate and merge sentences after summarizing them. As well as the use of data mining technology in the process of redistributing information according to the (K-Mean) algorithm and the use of (Term Frequency Inverse Document Frequency TF-IDF) technology for measuring the properties of summarized texts. The experimental results found that the summarization ratios are good by deleting unimportant words. Also, the method of extracting characteristics for texts was useful in grouping similar texts into clusters, which makes this method possible to be combined with other methods in artificial intelligence such as fuzzy logic or evolutionary algorithms in increasing summarization rates and accelerating cluster operations.\",\"PeriodicalId\":7867,\"journal\":{\"name\":\"Al-Mustansiriyah Journal of Science\",\"volume\":\"127 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-03-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Al-Mustansiriyah Journal of Science\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.23851/mjs.v34i1.1195\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Al-Mustansiriyah Journal of Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23851/mjs.v34i1.1195","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

文本摘要是信息技术领域的一个重要研究课题,因为文本量大,在互联网和社交媒体上发现了大量的数据。摘要文本的任务变得越来越重要,需要在各个领域的知识提取过程中找到高效的方法,因此需要针对单个文档或多个文档的文本摘要方法。摘要方法的目的是获取文档集的主要内容,同时减少冗余信息。本文提出了一种高效的文本摘要方法,该方法依靠词关联算法对摘要后的句子进行分离和合并。以及利用数据挖掘技术在信息重分布过程中根据(K-Mean)算法和利用(Term Frequency Inverse Document Frequency TF-IDF)技术对摘要文本的属性进行度量。实验结果表明,通过删除不重要的单词,可以获得较好的摘要率。此外,提取文本特征的方法有助于将相似文本分组到聚类中,这使得该方法可以与人工智能中的其他方法(如模糊逻辑或进化算法)相结合,以提高摘要率和加速聚类操作。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Text Summarizing and Clustering Using Data Mining Technique
Text summarization is an important research topic in the field of information technology because of the large volume of texts, and the large amount of data found on the Internet and social media. The task of summarizing the text has gained great importance that requires finding highly efficient ways in the process of extracting knowledge in various fields, Thus, there was a need for methods of summarizing texts for one document or multiple documents. The summarization methods aim to obtain the main content of the set of documents at the same time to reduce redundant information. In this paper, an efficient method to summarize texts is proposed that depends on the word association algorithm to separate and merge sentences after summarizing them. As well as the use of data mining technology in the process of redistributing information according to the (K-Mean) algorithm and the use of (Term Frequency Inverse Document Frequency TF-IDF) technology for measuring the properties of summarized texts. The experimental results found that the summarization ratios are good by deleting unimportant words. Also, the method of extracting characteristics for texts was useful in grouping similar texts into clusters, which makes this method possible to be combined with other methods in artificial intelligence such as fuzzy logic or evolutionary algorithms in increasing summarization rates and accelerating cluster operations.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Prevalence and Physiological Effect of Blastocystis Hominis on Lipid Metabolism, Magnesium, and Zinc Levels in Diarrheal Patients Optical and Degradation Characteristics of Green Synthesized Cornstarch-Base Bioorganic Polymer Educational Certificate Verification System: Enhancing Security and Authenticity using Ethereum Blockchain and IPFS Image Analysis and Detection of Olive Leaf Diseases Using Recurrent Neural Networks The Relationship between Vertical Kinematic Eddy Heat Flux, Air Temperature and Turbulent Kinetic Energy in Atmospheric Boundary Layer: Baghdad City
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1