计算视觉注意模型

Milind S. Gide, Lina Karam
{"title":"计算视觉注意模型","authors":"Milind S. Gide, Lina Karam","doi":"10.1561/2000000055","DOIUrl":null,"url":null,"abstract":"The human visual system (HVS) has evolved to have the ability to selectively focus on the most relevant parts of a visual scene. This mechanism, referred to as visual attention (VA), has been the focus of several neurological and psychological studies in the past few decades. These studies have inspired several computational VA models which have been successfully applied to problems in computer vision and robotics. In this paper we provide a comprehensive survey of the state-of-the-art in computational VA modeling with a special focus on the latest trends. We review several models published since 2012. We also discuss theoretical advantages and disadvantages of each approach. In addition, we describe existing methodologies to evaluate computational models through the use of eye-tracking data along with the VA performance metrics used. We also discuss shortcomings in existing approaches and describe approaches to overcome these shortcomings. A recent subjective evaluation for benchmarking existing VA metrics is also presented and open problems in VA are discussed. M. S. Gide and L. J. Karam Computational Visual Attention Models. Foundations and Trends © in Signal Processing, vol. 10, no. 4, pp. 347–427, 2016. DOI: 10.1561/2000000055.","PeriodicalId":12340,"journal":{"name":"Found. Trends Signal Process.","volume":"5 1","pages":"347-427"},"PeriodicalIF":0.0000,"publicationDate":"2017-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"6","resultStr":"{\"title\":\"Computational Visual Attention Models\",\"authors\":\"Milind S. Gide, Lina Karam\",\"doi\":\"10.1561/2000000055\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The human visual system (HVS) has evolved to have the ability to selectively focus on the most relevant parts of a visual scene. This mechanism, referred to as visual attention (VA), has been the focus of several neurological and psychological studies in the past few decades. These studies have inspired several computational VA models which have been successfully applied to problems in computer vision and robotics. In this paper we provide a comprehensive survey of the state-of-the-art in computational VA modeling with a special focus on the latest trends. We review several models published since 2012. We also discuss theoretical advantages and disadvantages of each approach. In addition, we describe existing methodologies to evaluate computational models through the use of eye-tracking data along with the VA performance metrics used. We also discuss shortcomings in existing approaches and describe approaches to overcome these shortcomings. A recent subjective evaluation for benchmarking existing VA metrics is also presented and open problems in VA are discussed. M. S. Gide and L. J. Karam Computational Visual Attention Models. Foundations and Trends © in Signal Processing, vol. 10, no. 4, pp. 347–427, 2016. DOI: 10.1561/2000000055.\",\"PeriodicalId\":12340,\"journal\":{\"name\":\"Found. Trends Signal Process.\",\"volume\":\"5 1\",\"pages\":\"347-427\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2017-06-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"6\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Found. Trends Signal Process.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1561/2000000055\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Found. Trends Signal Process.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1561/2000000055","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 6

摘要

人类视觉系统(HVS)已经进化到有选择地关注视觉场景中最相关的部分的能力。这种机制被称为视觉注意(VA),在过去的几十年里一直是神经学和心理学研究的焦点。这些研究启发了一些计算式视觉模型,这些模型已经成功地应用于计算机视觉和机器人问题。在本文中,我们提供了一个全面的调查,在计算VA建模的国家的最新趋势特别关注。我们回顾了自2012年以来发布的几个模型。我们还讨论了每种方法的理论优缺点。此外,我们描述了现有的方法,通过使用眼动追踪数据以及使用的VA性能指标来评估计算模型。我们还讨论了现有方法的缺点,并描述了克服这些缺点的方法。本文还介绍了最近对现有VA指标进行基准测试的主观评价,并讨论了VA中存在的问题。M. S. Gide和L. J. Karam计算视觉注意模型。基础与趋势©in Signal Processing, vol. 10, no. 5。4, pp. 347-427, 2016。DOI: 10.1561 / 2000000055。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Computational Visual Attention Models
The human visual system (HVS) has evolved to have the ability to selectively focus on the most relevant parts of a visual scene. This mechanism, referred to as visual attention (VA), has been the focus of several neurological and psychological studies in the past few decades. These studies have inspired several computational VA models which have been successfully applied to problems in computer vision and robotics. In this paper we provide a comprehensive survey of the state-of-the-art in computational VA modeling with a special focus on the latest trends. We review several models published since 2012. We also discuss theoretical advantages and disadvantages of each approach. In addition, we describe existing methodologies to evaluate computational models through the use of eye-tracking data along with the VA performance metrics used. We also discuss shortcomings in existing approaches and describe approaches to overcome these shortcomings. A recent subjective evaluation for benchmarking existing VA metrics is also presented and open problems in VA are discussed. M. S. Gide and L. J. Karam Computational Visual Attention Models. Foundations and Trends © in Signal Processing, vol. 10, no. 4, pp. 347–427, 2016. DOI: 10.1561/2000000055.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Generalizing Graph Signal Processing: High Dimensional Spaces, Models and Structures An Introduction to Quantum Machine Learning for Engineers Signal Decomposition Using Masked Proximal Operators Online Component Analysis, Architectures and Applications Wireless for Machine Learning: A Survey
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1