Multi-Thread Concurrent Compression Algorithm for Genomic Big Data

Yimu Ji, Shuai Chen, Haichang Yao, Houzhi Fang, Kui Li, Shangdong Liu, Zhengyuan Xie, Kairui Wang
{"title":"Multi-Thread Concurrent Compression Algorithm for Genomic Big Data","authors":"Yimu Ji, Shuai Chen, Haichang Yao, Houzhi Fang, Kui Li, Shangdong Liu, Zhengyuan Xie, Kairui Wang","doi":"10.1109/PDCAT46702.2019.00093","DOIUrl":null,"url":null,"abstract":"At present, there are many excellent genome compression algorithms with high genome compression ratio. However, there is a lack of highly efficient compression algorithms for simultaneous compression of a large number of genomes. This manuscript presents an algorithm, which is called FastLNGC, for simultaneous compression of a large amount of genome data based on multi-thread concurrency. This algorithm is based on the LNGC (Large Number of Genomes Compressor) algorithm, and adopts multi-thread technology to achieve concurrent processing of genome data compression. A large number of experiments show that FastLNGC has better performance on compression of a large number of genes. The source code of FastLNGC is available at https://github.com/APandaThief/FastLNGC.","PeriodicalId":166126,"journal":{"name":"2019 20th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT)","volume":"58 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 20th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/PDCAT46702.2019.00093","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

At present, there are many excellent genome compression algorithms with high genome compression ratio. However, there is a lack of highly efficient compression algorithms for simultaneous compression of a large number of genomes. This manuscript presents an algorithm, which is called FastLNGC, for simultaneous compression of a large amount of genome data based on multi-thread concurrency. This algorithm is based on the LNGC (Large Number of Genomes Compressor) algorithm, and adopts multi-thread technology to achieve concurrent processing of genome data compression. A large number of experiments show that FastLNGC has better performance on compression of a large number of genes. The source code of FastLNGC is available at https://github.com/APandaThief/FastLNGC.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基因组大数据的多线程并发压缩算法
目前,有许多优秀的基因组压缩算法都具有较高的基因组压缩比。然而,目前还缺乏能够同时压缩大量基因组的高效压缩算法。本文提出了一种基于多线程并发的海量基因组数据同时压缩算法FastLNGC。该算法以LNGC (Large Number of Genomes Compressor)算法为基础,采用多线程技术实现基因组数据压缩的并发处理。大量实验表明,FastLNGC在压缩大量基因方面具有较好的性能。FastLNGC的源代码可从https://github.com/APandaThief/FastLNGC获得。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
RNC: Reliable Network Property Classifier Based on Graph Embedding NFV Optimization Algorithm for Shortest Path and Service Function Assignment I/O Scheduling for Limited-Size Burst-Buffers Deployed High Performance Computing Efficient Fault-Tolerant Syndrome Measurement of Quantum Error-Correcting Codes Based on "Flag" Adaptive Clustering Strategy Based on Capacity Weight
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1