更快的压缩Top-k文档检索

W. Hon, Sharma V. Thankachan, R. Shah, J. Vitter
{"title":"更快的压缩Top-k文档检索","authors":"W. Hon, Sharma V. Thankachan, R. Shah, J. Vitter","doi":"10.1109/DCC.2013.42","DOIUrl":null,"url":null,"abstract":"Let D = {d<sub>1</sub>, d<sub>2</sub>,...d<sub>D</sub>} be a given collection of D string documents of total length n, our task is to index D, such that whenever a pattern P (of length p) and an integer k come as a query, those k documents in which P appears the most number of times can be listed efficiently. In this paper, we propose a compressed index taking 2|CSA| + D logn/D + O(D) + o(n) bits of space, which answers a query with O(t<sub>sa</sub> log k log<sup>ϵ</sup> n) per document report time. This improves the O(t<sub>sa</sub> log k log<sup>1+ϵ</sup> n) per document report time of the previously best-known index with (asymptotically) the same space requirements [Belazzougui and Navarro, SPIRE 2011]. Here, |CSA| represents the size (in bits) of the compressed suffix array (CSA) of the text obtained by concatenating all documents in V, and t<sub>sa</sub> is the time for decoding a suffix array value using the CSA.","PeriodicalId":388717,"journal":{"name":"2013 Data Compression Conference","volume":"123 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2013-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"21","resultStr":"{\"title\":\"Faster Compressed Top-k Document Retrieval\",\"authors\":\"W. Hon, Sharma V. Thankachan, R. Shah, J. Vitter\",\"doi\":\"10.1109/DCC.2013.42\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Let D = {d<sub>1</sub>, d<sub>2</sub>,...d<sub>D</sub>} be a given collection of D string documents of total length n, our task is to index D, such that whenever a pattern P (of length p) and an integer k come as a query, those k documents in which P appears the most number of times can be listed efficiently. In this paper, we propose a compressed index taking 2|CSA| + D logn/D + O(D) + o(n) bits of space, which answers a query with O(t<sub>sa</sub> log k log<sup>ϵ</sup> n) per document report time. This improves the O(t<sub>sa</sub> log k log<sup>1+ϵ</sup> n) per document report time of the previously best-known index with (asymptotically) the same space requirements [Belazzougui and Navarro, SPIRE 2011]. Here, |CSA| represents the size (in bits) of the compressed suffix array (CSA) of the text obtained by concatenating all documents in V, and t<sub>sa</sub> is the time for decoding a suffix array value using the CSA.\",\"PeriodicalId\":388717,\"journal\":{\"name\":\"2013 Data Compression Conference\",\"volume\":\"123 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2013-03-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"21\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2013 Data Compression Conference\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/DCC.2013.42\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2013 Data Compression Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DCC.2013.42","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 21

摘要

令D = {d1, d2,…dD}是一个给定的总长度为n的D个字符串文档的集合,我们的任务是对D进行索引,以便当一个模式P(长度为P)和一个整数k作为查询出现时,可以有效地列出P出现次数最多的k个文档。在本文中,我们提出了一个压缩索引,占用2|CSA| + D logn/D + O(D) + O(n)位空间,它回答每个文档报告时间为O(tsa log k logλ n)的查询。这提高了(渐近地)具有相同空间要求的以前最知名的索引的每个文档报告时间的O(tsa log k log1+柱n) [Belazzougui和Navarro, SPIRE 2011]。其中|CSA|表示通过将V中的所有文档连接得到的文本的压缩后缀数组(CSA)的大小(以位为单位),tsa是使用CSA解码后缀数组值的时间。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Faster Compressed Top-k Document Retrieval
Let D = {d1, d2,...dD} be a given collection of D string documents of total length n, our task is to index D, such that whenever a pattern P (of length p) and an integer k come as a query, those k documents in which P appears the most number of times can be listed efficiently. In this paper, we propose a compressed index taking 2|CSA| + D logn/D + O(D) + o(n) bits of space, which answers a query with O(tsa log k logϵ n) per document report time. This improves the O(tsa log k log1+ϵ n) per document report time of the previously best-known index with (asymptotically) the same space requirements [Belazzougui and Navarro, SPIRE 2011]. Here, |CSA| represents the size (in bits) of the compressed suffix array (CSA) of the text obtained by concatenating all documents in V, and tsa is the time for decoding a suffix array value using the CSA.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Variable-to-Fixed-Length Encoding for Large Texts Using Re-Pair Algorithm with Shared Dictionaries Low Bit-Rate Subpixel-Based Color Image Compression Robust Adaptive Image Coding for Frame Memory Reduction in LCD Overdrive A Scalable Video Coding Extension of HEVC Low Complexity Embedded Quantization Scheme Compatible with Bitplane Image Coding
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1