基于图论方法的马拉雅拉姆语抽取文档摘要

E. B. Ajmal, Rosna P. Haroon
{"title":"基于图论方法的马拉雅拉姆语抽取文档摘要","authors":"E. B. Ajmal, Rosna P. Haroon","doi":"10.1109/ECONF.2015.41","DOIUrl":null,"url":null,"abstract":"Text summarization is a way to condense the large amount of information into a concise form by the process of selection of important information and discarding unimportant and redundant information. The need for Text summarization has increased much due to the abundance of documents in the internet.Even though a lot of text summarization systems have been developed for summarizing documents in various languages, there is no such well performing system for Malayalam.In this paper, we propose the use of Graph theoretic approach for summarizing Malayalam documents that is motivated by the method of identification of themes. After the common preprocessing steps, namely, stop word removal and stemming, sentences in the documents are represented as nodes in an undirected graph. There is a node for every sentence. Two sentences are connected with an edge if the two sentences share some common words, or in other words, their (cosine, or such) similarity is above some threshold. This representation yields two results: The partitions contained in the graph (that is those sub-graphs that are unconnected to the other sub graphs), form distinct topics covered in the documents. The second result yielded by the graph-theoretic method is the identification of the important sentences in the document. We apply graph theoretic approach on Malayalam text summarization task and achieve comparable results to the state of the art.","PeriodicalId":268471,"journal":{"name":"2015 Fifth International Conference on e-Learning (econf)","volume":"47 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2015-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"An Extractive Malayalam Document Summarization Based on Graph Theoretic Approach\",\"authors\":\"E. B. Ajmal, Rosna P. Haroon\",\"doi\":\"10.1109/ECONF.2015.41\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Text summarization is a way to condense the large amount of information into a concise form by the process of selection of important information and discarding unimportant and redundant information. The need for Text summarization has increased much due to the abundance of documents in the internet.Even though a lot of text summarization systems have been developed for summarizing documents in various languages, there is no such well performing system for Malayalam.In this paper, we propose the use of Graph theoretic approach for summarizing Malayalam documents that is motivated by the method of identification of themes. After the common preprocessing steps, namely, stop word removal and stemming, sentences in the documents are represented as nodes in an undirected graph. There is a node for every sentence. Two sentences are connected with an edge if the two sentences share some common words, or in other words, their (cosine, or such) similarity is above some threshold. This representation yields two results: The partitions contained in the graph (that is those sub-graphs that are unconnected to the other sub graphs), form distinct topics covered in the documents. The second result yielded by the graph-theoretic method is the identification of the important sentences in the document. We apply graph theoretic approach on Malayalam text summarization task and achieve comparable results to the state of the art.\",\"PeriodicalId\":268471,\"journal\":{\"name\":\"2015 Fifth International Conference on e-Learning (econf)\",\"volume\":\"47 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2015-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2015 Fifth International Conference on e-Learning (econf)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ECONF.2015.41\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2015 Fifth International Conference on e-Learning (econf)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ECONF.2015.41","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

摘要

摘要是通过对重要信息的选择和对不重要信息和冗余信息的丢弃,将大量信息浓缩为简洁形式的一种方法。由于互联网上大量的文档,对文本摘要的需求大大增加。尽管已经开发了许多文本摘要系统,用于总结各种语言的文档,但马拉雅拉姆语却没有这样表现良好的系统。在本文中,我们建议使用图论方法来总结马拉雅拉姆文献,这是由主题识别方法所激发的。经过常见的预处理步骤,即停止词去除和词干提取,文档中的句子被表示为无向图中的节点。每个句子都有一个节点。如果两个句子有一些共同的词,或者换句话说,它们的相似性(余弦等)高于某个阈值,则两个句子被连接在一条边上。这种表示产生两个结果:图中包含的分区(即那些与其他子图没有连接的子图)形成文档中涵盖的不同主题。图论方法产生的第二个结果是识别文档中的重要句子。我们将图论方法应用于马拉雅拉姆语文本摘要任务,并取得了与目前水平相当的结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
An Extractive Malayalam Document Summarization Based on Graph Theoretic Approach
Text summarization is a way to condense the large amount of information into a concise form by the process of selection of important information and discarding unimportant and redundant information. The need for Text summarization has increased much due to the abundance of documents in the internet.Even though a lot of text summarization systems have been developed for summarizing documents in various languages, there is no such well performing system for Malayalam.In this paper, we propose the use of Graph theoretic approach for summarizing Malayalam documents that is motivated by the method of identification of themes. After the common preprocessing steps, namely, stop word removal and stemming, sentences in the documents are represented as nodes in an undirected graph. There is a node for every sentence. Two sentences are connected with an edge if the two sentences share some common words, or in other words, their (cosine, or such) similarity is above some threshold. This representation yields two results: The partitions contained in the graph (that is those sub-graphs that are unconnected to the other sub graphs), form distinct topics covered in the documents. The second result yielded by the graph-theoretic method is the identification of the important sentences in the document. We apply graph theoretic approach on Malayalam text summarization task and achieve comparable results to the state of the art.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
The Future Educator Skills in the Digitization Era: Effects of Technological Development on Higher Education From a Dilapidated Blackboard to Creative Flash Videos: The Case of Training Teachers of Schools in Hebron Security Measures in a Keyless Quantum Communication Protocol Test of Information Technology (IT) - Self Efficacy and Online Learning Interaction Components on Student Retention: A Study of Synchronous Learning Environment The Effectiveness of the Flipped Classroom in Higher Education
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1