TSOM:受鸟类视觉回路启发的小物体运动检测神经网络。

IF 6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Neural Networks Pub Date : 2024-11-09 DOI:10.1016/j.neunet.2024.106881
Pingge Hu , Xiaoteng Zhang , Mengmeng Li , Yingjie Zhu , Li Shi
{"title":"TSOM:受鸟类视觉回路启发的小物体运动检测神经网络。","authors":"Pingge Hu ,&nbsp;Xiaoteng Zhang ,&nbsp;Mengmeng Li ,&nbsp;Yingjie Zhu ,&nbsp;Li Shi","doi":"10.1016/j.neunet.2024.106881","DOIUrl":null,"url":null,"abstract":"<div><div>Detecting small moving objects in complex backgrounds from an overhead perspective is a highly challenging task for machine vision systems. As an inspiration from nature, the avian visual system is capable of processing motion information in various complex aerial scenes, and the Retina-OT-Rt visual circuit of birds is highly sensitive to capturing the motion information of small objects from high altitudes. However, more needs to be done on small object motion detection algorithms based on the avian visual system. In this paper, we conducted mathematical description based on extensive studies of the biological mechanisms of the Retina-OT-Rt visual circuit. Based on this, we proposed a novel tectum small object motion detection neural network (TSOM). The TSOM neural network includes the retina, SGC dendritic, SGC Soma, and Rt layers, each corresponding to neurons in the visual pathway for precise topographic projection, spatial–temporal encoding, motion feature selection, and multi-directional motion integration. Extensive experiments on pigeon neurophysiological experiments and image sequence data showed that the TSOM is biologically interpretable and effective in extracting reliable small object motion features from complex high-altitude backgrounds.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"182 ","pages":"Article 106881"},"PeriodicalIF":6.0000,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"TSOM: Small object motion detection neural network inspired by avian visual circuit\",\"authors\":\"Pingge Hu ,&nbsp;Xiaoteng Zhang ,&nbsp;Mengmeng Li ,&nbsp;Yingjie Zhu ,&nbsp;Li Shi\",\"doi\":\"10.1016/j.neunet.2024.106881\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Detecting small moving objects in complex backgrounds from an overhead perspective is a highly challenging task for machine vision systems. As an inspiration from nature, the avian visual system is capable of processing motion information in various complex aerial scenes, and the Retina-OT-Rt visual circuit of birds is highly sensitive to capturing the motion information of small objects from high altitudes. However, more needs to be done on small object motion detection algorithms based on the avian visual system. In this paper, we conducted mathematical description based on extensive studies of the biological mechanisms of the Retina-OT-Rt visual circuit. Based on this, we proposed a novel tectum small object motion detection neural network (TSOM). The TSOM neural network includes the retina, SGC dendritic, SGC Soma, and Rt layers, each corresponding to neurons in the visual pathway for precise topographic projection, spatial–temporal encoding, motion feature selection, and multi-directional motion integration. Extensive experiments on pigeon neurophysiological experiments and image sequence data showed that the TSOM is biologically interpretable and effective in extracting reliable small object motion features from complex high-altitude backgrounds.</div></div>\",\"PeriodicalId\":49763,\"journal\":{\"name\":\"Neural Networks\",\"volume\":\"182 \",\"pages\":\"Article 106881\"},\"PeriodicalIF\":6.0000,\"publicationDate\":\"2024-11-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neural Networks\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0893608024008104\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Networks","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0893608024008104","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

对于机器视觉系统来说,从高空视角检测复杂背景中的小型移动物体是一项极具挑战性的任务。鸟类视觉系统从大自然中获得灵感,能够处理各种复杂空中场景中的运动信息,而且鸟类的视网膜-OT-Rt 视觉回路对从高空捕捉小物体的运动信息非常敏感。然而,基于鸟类视觉系统的小物体运动检测算法还有待进一步研究。在本文中,我们在广泛研究视网膜-OT-Rt 视觉回路生物机制的基础上进行了数学描述。在此基础上,我们提出了一种新型的视网膜小物体运动检测神经网络(TSOM)。TSOM神经网络包括视网膜层、SGC树突层、SGC索玛层和Rt层,分别对应视觉通路中的神经元,用于精确的地形投射、时空编码、运动特征选择和多向运动整合。在鸽子神经生理学实验和图像序列数据上进行的大量实验表明,TSOM 具有生物可解释性,能有效地从复杂的高空背景中提取可靠的小物体运动特征。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
TSOM: Small object motion detection neural network inspired by avian visual circuit
Detecting small moving objects in complex backgrounds from an overhead perspective is a highly challenging task for machine vision systems. As an inspiration from nature, the avian visual system is capable of processing motion information in various complex aerial scenes, and the Retina-OT-Rt visual circuit of birds is highly sensitive to capturing the motion information of small objects from high altitudes. However, more needs to be done on small object motion detection algorithms based on the avian visual system. In this paper, we conducted mathematical description based on extensive studies of the biological mechanisms of the Retina-OT-Rt visual circuit. Based on this, we proposed a novel tectum small object motion detection neural network (TSOM). The TSOM neural network includes the retina, SGC dendritic, SGC Soma, and Rt layers, each corresponding to neurons in the visual pathway for precise topographic projection, spatial–temporal encoding, motion feature selection, and multi-directional motion integration. Extensive experiments on pigeon neurophysiological experiments and image sequence data showed that the TSOM is biologically interpretable and effective in extracting reliable small object motion features from complex high-altitude backgrounds.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Neural Networks
Neural Networks 工程技术-计算机:人工智能
CiteScore
13.90
自引率
7.70%
发文量
425
审稿时长
67 days
期刊介绍: Neural Networks is a platform that aims to foster an international community of scholars and practitioners interested in neural networks, deep learning, and other approaches to artificial intelligence and machine learning. Our journal invites submissions covering various aspects of neural networks research, from computational neuroscience and cognitive modeling to mathematical analyses and engineering applications. By providing a forum for interdisciplinary discussions between biology and technology, we aim to encourage the development of biologically-inspired artificial intelligence.
期刊最新文献
Multi-source Selective Graph Domain Adaptation Network for cross-subject EEG emotion recognition. Spectral integrated neural networks (SINNs) for solving forward and inverse dynamic problems. Corrigendum to "Hydra: Multi-head Low-rank Adaptation for Parameter Efficient Fine-tuning" [Neural Networks Volume 178, October (2024), 1-11/106414]]. MIU-Net: Advanced multi-scale feature extraction and imbalance mitigation for optic disc segmentation Recovering Permuted Sequential Features for effective Reinforcement Learning
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1