{"title":"基于数据挖掘技术的文本总结与聚类","authors":"Zainab Abdul-Nabay Salman","doi":"10.23851/mjs.v34i1.1195","DOIUrl":null,"url":null,"abstract":"Text summarization is an important research topic in the field of information technology because of the large volume of texts, and the large amount of data found on the Internet and social media. The task of summarizing the text has gained great importance that requires finding highly efficient ways in the process of extracting knowledge in various fields, Thus, there was a need for methods of summarizing texts for one document or multiple documents. The summarization methods aim to obtain the main content of the set of documents at the same time to reduce redundant information. In this paper, an efficient method to summarize texts is proposed that depends on the word association algorithm to separate and merge sentences after summarizing them. As well as the use of data mining technology in the process of redistributing information according to the (K-Mean) algorithm and the use of (Term Frequency Inverse Document Frequency TF-IDF) technology for measuring the properties of summarized texts. The experimental results found that the summarization ratios are good by deleting unimportant words. Also, the method of extracting characteristics for texts was useful in grouping similar texts into clusters, which makes this method possible to be combined with other methods in artificial intelligence such as fuzzy logic or evolutionary algorithms in increasing summarization rates and accelerating cluster operations.","PeriodicalId":7867,"journal":{"name":"Al-Mustansiriyah Journal of Science","volume":"127 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Text Summarizing and Clustering Using Data Mining Technique\",\"authors\":\"Zainab Abdul-Nabay Salman\",\"doi\":\"10.23851/mjs.v34i1.1195\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Text summarization is an important research topic in the field of information technology because of the large volume of texts, and the large amount of data found on the Internet and social media. The task of summarizing the text has gained great importance that requires finding highly efficient ways in the process of extracting knowledge in various fields, Thus, there was a need for methods of summarizing texts for one document or multiple documents. The summarization methods aim to obtain the main content of the set of documents at the same time to reduce redundant information. In this paper, an efficient method to summarize texts is proposed that depends on the word association algorithm to separate and merge sentences after summarizing them. As well as the use of data mining technology in the process of redistributing information according to the (K-Mean) algorithm and the use of (Term Frequency Inverse Document Frequency TF-IDF) technology for measuring the properties of summarized texts. The experimental results found that the summarization ratios are good by deleting unimportant words. Also, the method of extracting characteristics for texts was useful in grouping similar texts into clusters, which makes this method possible to be combined with other methods in artificial intelligence such as fuzzy logic or evolutionary algorithms in increasing summarization rates and accelerating cluster operations.\",\"PeriodicalId\":7867,\"journal\":{\"name\":\"Al-Mustansiriyah Journal of Science\",\"volume\":\"127 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-03-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Al-Mustansiriyah Journal of Science\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.23851/mjs.v34i1.1195\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Al-Mustansiriyah Journal of Science","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.23851/mjs.v34i1.1195","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
文本摘要是信息技术领域的一个重要研究课题,因为文本量大,在互联网和社交媒体上发现了大量的数据。摘要文本的任务变得越来越重要,需要在各个领域的知识提取过程中找到高效的方法,因此需要针对单个文档或多个文档的文本摘要方法。摘要方法的目的是获取文档集的主要内容,同时减少冗余信息。本文提出了一种高效的文本摘要方法,该方法依靠词关联算法对摘要后的句子进行分离和合并。以及利用数据挖掘技术在信息重分布过程中根据(K-Mean)算法和利用(Term Frequency Inverse Document Frequency TF-IDF)技术对摘要文本的属性进行度量。实验结果表明,通过删除不重要的单词,可以获得较好的摘要率。此外,提取文本特征的方法有助于将相似文本分组到聚类中,这使得该方法可以与人工智能中的其他方法(如模糊逻辑或进化算法)相结合,以提高摘要率和加速聚类操作。
Text Summarizing and Clustering Using Data Mining Technique
Text summarization is an important research topic in the field of information technology because of the large volume of texts, and the large amount of data found on the Internet and social media. The task of summarizing the text has gained great importance that requires finding highly efficient ways in the process of extracting knowledge in various fields, Thus, there was a need for methods of summarizing texts for one document or multiple documents. The summarization methods aim to obtain the main content of the set of documents at the same time to reduce redundant information. In this paper, an efficient method to summarize texts is proposed that depends on the word association algorithm to separate and merge sentences after summarizing them. As well as the use of data mining technology in the process of redistributing information according to the (K-Mean) algorithm and the use of (Term Frequency Inverse Document Frequency TF-IDF) technology for measuring the properties of summarized texts. The experimental results found that the summarization ratios are good by deleting unimportant words. Also, the method of extracting characteristics for texts was useful in grouping similar texts into clusters, which makes this method possible to be combined with other methods in artificial intelligence such as fuzzy logic or evolutionary algorithms in increasing summarization rates and accelerating cluster operations.