一种由视觉物联网系统获得的长时间户外镜头的图像稳定技术

Yuki Murakami, K. Murata, Kazutaka Kikuta, M. Niimi, T. Kawanabe, Takamichi Mizuhara, Toshiki Aoki, Kazunori Yamamoto, T. Nagatsuma, Kazuki Kobayashi, K. Fukazawa, P. Pavarangkoon
{"title":"一种由视觉物联网系统获得的长时间户外镜头的图像稳定技术","authors":"Yuki Murakami, K. Murata, Kazutaka Kikuta, M. Niimi, T. Kawanabe, Takamichi Mizuhara, Toshiki Aoki, Kazunori Yamamoto, T. Nagatsuma, Kazuki Kobayashi, K. Fukazawa, P. Pavarangkoon","doi":"10.1109/wpmc52694.2021.9700467","DOIUrl":null,"url":null,"abstract":"Disaster mitigation is a significant issue where modern wireless network systems are expected to play a crucial role. It is believed that Visual IoT is one of the key techniques because of its monitoring abilities of urban and rural areas. The outdoor Visual IoT systems generally transfer a large number of footage every day. To detect information from large-size footage datasets, automatic time subtractions between frames are effective. However, to extract even tiny difference between frames, camera shake causes a serious damage. In this study we first survey long-durational footage transmitted from outdoor cameras installed in a city to examine that the stabilization techniques based on feature keypoints are effective to camera shake. Based on this survey we define a matching index to judge if the stabilization is of use or not for every couple of frames. The index is implemented with help of a camera calibration library in OpenCV using AKAZE feature. We then propose a method to stabilize footage continuously obtained by outdoor Visual IoT systems. Using the matching index, we examine one-day footage to find that stabilization is occasionally not applicable in case when the matching index is relatively larger or smaller than 1 (when matching is complete) or the number of matching pairs using AKAZE keypoints are too few. According to the results we set a threshold value of the matching index. We finally perform this technique to footage recorded on a couple of strongly windy days. The efficiency is numerically and visually confirmed on each footage successfully.","PeriodicalId":299827,"journal":{"name":"2021 24th International Symposium on Wireless Personal Multimedia Communications (WPMC)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Image Stabilization Technique for Long-durational Outdoor Footages Obtained by Visual IoT Systems\",\"authors\":\"Yuki Murakami, K. Murata, Kazutaka Kikuta, M. Niimi, T. Kawanabe, Takamichi Mizuhara, Toshiki Aoki, Kazunori Yamamoto, T. Nagatsuma, Kazuki Kobayashi, K. Fukazawa, P. Pavarangkoon\",\"doi\":\"10.1109/wpmc52694.2021.9700467\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Disaster mitigation is a significant issue where modern wireless network systems are expected to play a crucial role. It is believed that Visual IoT is one of the key techniques because of its monitoring abilities of urban and rural areas. The outdoor Visual IoT systems generally transfer a large number of footage every day. To detect information from large-size footage datasets, automatic time subtractions between frames are effective. However, to extract even tiny difference between frames, camera shake causes a serious damage. In this study we first survey long-durational footage transmitted from outdoor cameras installed in a city to examine that the stabilization techniques based on feature keypoints are effective to camera shake. Based on this survey we define a matching index to judge if the stabilization is of use or not for every couple of frames. The index is implemented with help of a camera calibration library in OpenCV using AKAZE feature. We then propose a method to stabilize footage continuously obtained by outdoor Visual IoT systems. Using the matching index, we examine one-day footage to find that stabilization is occasionally not applicable in case when the matching index is relatively larger or smaller than 1 (when matching is complete) or the number of matching pairs using AKAZE keypoints are too few. According to the results we set a threshold value of the matching index. We finally perform this technique to footage recorded on a couple of strongly windy days. The efficiency is numerically and visually confirmed on each footage successfully.\",\"PeriodicalId\":299827,\"journal\":{\"name\":\"2021 24th International Symposium on Wireless Personal Multimedia Communications (WPMC)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-12-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 24th International Symposium on Wireless Personal Multimedia Communications (WPMC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/wpmc52694.2021.9700467\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 24th International Symposium on Wireless Personal Multimedia Communications (WPMC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/wpmc52694.2021.9700467","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

减灾是一个重要的问题,现代无线网络系统有望在其中发挥关键作用。视觉物联网以其对城市和农村的监测能力被认为是关键技术之一。户外视觉物联网系统通常每天传输大量镜头。为了从大尺寸的镜头数据集中检测信息,帧之间的自动时间减法是有效的。然而,为了提取帧之间的微小差异,相机抖动会造成严重的损害。在本研究中,我们首先调查了安装在城市中的户外摄像机传输的长时间镜头,以检验基于特征关键点的稳定技术对摄像机抖动的有效性。在此基础上,我们定义了一个匹配指标来判断每一对帧的稳定是否有用。该索引是借助OpenCV中使用AKAZE特性的相机校准库实现的。然后,我们提出了一种方法来稳定室外视觉物联网系统连续获得的镜头。使用匹配指数,我们检查了一天的连续镜头,发现当匹配指数相对大于或小于1(当匹配完成时)或使用AKAZE关键点的匹配对数量太少时,稳定偶尔不适用。根据结果设置匹配指标的阈值。我们最终执行这种技术的镜头记录在几个大风天。效率在每个镜头上都得到了数字和视觉上的成功验证。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
An Image Stabilization Technique for Long-durational Outdoor Footages Obtained by Visual IoT Systems
Disaster mitigation is a significant issue where modern wireless network systems are expected to play a crucial role. It is believed that Visual IoT is one of the key techniques because of its monitoring abilities of urban and rural areas. The outdoor Visual IoT systems generally transfer a large number of footage every day. To detect information from large-size footage datasets, automatic time subtractions between frames are effective. However, to extract even tiny difference between frames, camera shake causes a serious damage. In this study we first survey long-durational footage transmitted from outdoor cameras installed in a city to examine that the stabilization techniques based on feature keypoints are effective to camera shake. Based on this survey we define a matching index to judge if the stabilization is of use or not for every couple of frames. The index is implemented with help of a camera calibration library in OpenCV using AKAZE feature. We then propose a method to stabilize footage continuously obtained by outdoor Visual IoT systems. Using the matching index, we examine one-day footage to find that stabilization is occasionally not applicable in case when the matching index is relatively larger or smaller than 1 (when matching is complete) or the number of matching pairs using AKAZE keypoints are too few. According to the results we set a threshold value of the matching index. We finally perform this technique to footage recorded on a couple of strongly windy days. The efficiency is numerically and visually confirmed on each footage successfully.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Performance Analysis of Wireless Steganography based on OFDM and DFT-s-OFDM Signals over Frequency-Selective Rayleigh Fading Channels Evaluating 5G Coverage in 3D Scenarios under Configurable Antenna Beam Patterns Prototype Evaluation of the 38GHz-band Lens Antenna for High Altitude Platform Station (HAPS) Ground Station System Coverage Probability and Channel Capacity Analysis of Wireless Multi-connectivity Ad Hoc Networks Field Trials of Link Aggregation System based on Multipath TCP in Heterogeneous Mobile Network
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1