Weishan Zhang, Yuanjie Zhang, Liang Xu, Faming Gong
{"title":"Hbase Based Surveillance Video Processing, Storage and Retrieval","authors":"Weishan Zhang, Yuanjie Zhang, Liang Xu, Faming Gong","doi":"10.1109/IIKI.2016.21","DOIUrl":null,"url":null,"abstract":"Due to the rapid data growth of video monitoring, how to efficiently storing and querying massive surveillance videos is challenging, such as performance of querying, and fault tolerance for storage. The emerging cloud computing and big data techniques shed lights to intelligent processing for large-scale video data. This paper proposes a HBase based approach for surveillance video processing, storage, and querying. We adopt a distributed storage architecture, cut videos to many small ones and stored them in HDFS, extract video data through Hadoop preprocessing. In our approach, a number o strategies are used, e.g. pre-building regions, multi-thread and row-key optimization, to write data into HBase cluster in parallel. Evaluations show that our method has good performance.","PeriodicalId":371106,"journal":{"name":"2016 International Conference on Identification, Information and Knowledge in the Internet of Things (IIKI)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 International Conference on Identification, Information and Knowledge in the Internet of Things (IIKI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IIKI.2016.21","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2
Abstract
Due to the rapid data growth of video monitoring, how to efficiently storing and querying massive surveillance videos is challenging, such as performance of querying, and fault tolerance for storage. The emerging cloud computing and big data techniques shed lights to intelligent processing for large-scale video data. This paper proposes a HBase based approach for surveillance video processing, storage, and querying. We adopt a distributed storage architecture, cut videos to many small ones and stored them in HDFS, extract video data through Hadoop preprocessing. In our approach, a number o strategies are used, e.g. pre-building regions, multi-thread and row-key optimization, to write data into HBase cluster in parallel. Evaluations show that our method has good performance.