Harmonizing motion and contrast vision for robust looming detection

IF 2.3 Q2 COMPUTER SCIENCE, THEORY & METHODS Array Pub Date : 2023-03-01 DOI:10.1016/j.array.2022.100272
Qinbing Fu , Zhiqiang Li , Jigen Peng
{"title":"Harmonizing motion and contrast vision for robust looming detection","authors":"Qinbing Fu ,&nbsp;Zhiqiang Li ,&nbsp;Jigen Peng","doi":"10.1016/j.array.2022.100272","DOIUrl":null,"url":null,"abstract":"<div><p>This paper presents a novel neural model of insect’s visual perception paradigm to address a challenging problem on detection of looming motion, particularly in extremely low-contrast, and highly variable natural scenes. Current looming detection models are greatly affected by visual contrast between moving target and cluttered background lacking robust and low-cost solutions. Considering the anatomical and physiological homology between preliminary visual systems of different insect species, this gap can be significantly reduced by coordinating motion and contrast neural processing mechanisms. The proposed model draws lessons from research progress in insect neuroscience, articulates a neural network hierarchy based upon ON/OFF channels encoding motion and contrast signals in four parallel pathways. Specifically, the two ON/OFF motion pathways react to successively expanding ON–ON and OFF–OFF edges through spatial–temporal interactions between polarity excitations and inhibitions. To formulate contrast neural computation, the instantaneous feedback normalization of preliminary motion received at starting cells of ON/OFF channels works effectively to suppress time-varying signals delivered into the ON/OFF motion pathways. Besides, another two ON/OFF contrast pathways are dedicated to neutralize high-contrast polarity optic flows when converging with motion signals. To corroborate the proposed method, we carried out systematic experiments with thousands of looming-square motions at varied grey scales, embedded in different natural moving backgrounds. The model response achieves remarkably lower variance and peaks more smoothly to looming motions in different natural scenarios, a significant enhancement upon previous works. Such robustness can be maintained against extremely low-contrast looming motion against cluttered backgrounds. The results demonstrate a parsimonious solution to stabilize looming detection against high input variability, analogous to insect’s capability.</p></div>","PeriodicalId":8417,"journal":{"name":"Array","volume":null,"pages":null},"PeriodicalIF":2.3000,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Array","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2590005622001059","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, THEORY & METHODS","Score":null,"Total":0}
引用次数: 0

Abstract

This paper presents a novel neural model of insect’s visual perception paradigm to address a challenging problem on detection of looming motion, particularly in extremely low-contrast, and highly variable natural scenes. Current looming detection models are greatly affected by visual contrast between moving target and cluttered background lacking robust and low-cost solutions. Considering the anatomical and physiological homology between preliminary visual systems of different insect species, this gap can be significantly reduced by coordinating motion and contrast neural processing mechanisms. The proposed model draws lessons from research progress in insect neuroscience, articulates a neural network hierarchy based upon ON/OFF channels encoding motion and contrast signals in four parallel pathways. Specifically, the two ON/OFF motion pathways react to successively expanding ON–ON and OFF–OFF edges through spatial–temporal interactions between polarity excitations and inhibitions. To formulate contrast neural computation, the instantaneous feedback normalization of preliminary motion received at starting cells of ON/OFF channels works effectively to suppress time-varying signals delivered into the ON/OFF motion pathways. Besides, another two ON/OFF contrast pathways are dedicated to neutralize high-contrast polarity optic flows when converging with motion signals. To corroborate the proposed method, we carried out systematic experiments with thousands of looming-square motions at varied grey scales, embedded in different natural moving backgrounds. The model response achieves remarkably lower variance and peaks more smoothly to looming motions in different natural scenarios, a significant enhancement upon previous works. Such robustness can be maintained against extremely low-contrast looming motion against cluttered backgrounds. The results demonstrate a parsimonious solution to stabilize looming detection against high input variability, analogous to insect’s capability.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
协调运动和对比度视觉,实现鲁棒逼近检测
本文提出了一种新的昆虫视觉感知范式的神经模型,以解决若隐若现运动检测方面的一个具有挑战性的问题,特别是在极低对比度和高度可变的自然场景中。当前的若隐若现检测模型在很大程度上受到运动目标和杂乱背景之间的视觉对比度的影响,缺乏稳健和低成本的解决方案。考虑到不同昆虫物种的初步视觉系统之间的解剖和生理同源性,可以通过协调运动和对比神经处理机制来显著减少这种差距。所提出的模型借鉴了昆虫神经科学的研究进展,阐明了基于ON/OFF通道的神经网络层次结构,该通道在四个平行路径中编码运动和对比度信号。具体而言,两个ON/OFF运动路径通过极性激发和抑制之间的空间-时间相互作用,对连续扩展的ON-ON和OFF-OFF边缘做出反应。为了公式化对比度神经计算,在ON/OFF通道的起始单元处接收到的初步运动的瞬时反馈归一化有效地抑制传递到ON/OFF运动路径中的时变信号。此外,另外两个ON/OFF对比度路径专用于在与运动信号会聚时中和高对比度极性光流。为了证实所提出的方法,我们对嵌入不同自然运动背景中的数千个不同灰度级的若隐若现的正方形运动进行了系统实验。模型响应在不同的自然场景中对若隐若现的运动实现了显著较低的方差和更平稳的峰值,这是对先前工作的显著增强。可以针对杂乱背景下的极低对比度的若隐若现运动来保持这种鲁棒性。结果证明了一种简单的解决方案,可以在高输入变异性的情况下稳定若隐若现的检测,类似于昆虫的能力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Array
Array Computer Science-General Computer Science
CiteScore
4.40
自引率
0.00%
发文量
93
审稿时长
45 days
期刊最新文献
Combining computational linguistics with sentence embedding to create a zero-shot NLIDB Development of automatic CNC machine with versatile applications in art, design, and engineering Dual-model approach for one-shot lithium-ion battery state of health sequence prediction Maximizing influence via link prediction in evolving networks Assessing generalizability of Deep Reinforcement Learning algorithms for Automated Vulnerability Assessment and Penetration Testing
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1