Optical fibre based artificial compound eyes for direct static imaging and ultrafast motion detection

IF 20.6 Q1 OPTICS Light-Science & Applications Pub Date : 2024-09-18 DOI:10.1038/s41377-024-01580-5
Heng Jiang, Chi Chung Tsoi, Weixing Yu, Mengchao Ma, Mingjie Li, Zuankai Wang, Xuming Zhang
{"title":"Optical fibre based artificial compound eyes for direct static imaging and ultrafast motion detection","authors":"Heng Jiang, Chi Chung Tsoi, Weixing Yu, Mengchao Ma, Mingjie Li, Zuankai Wang, Xuming Zhang","doi":"10.1038/s41377-024-01580-5","DOIUrl":null,"url":null,"abstract":"<p>Natural selection has driven arthropods to evolve fantastic natural compound eyes (NCEs) with a unique anatomical structure, providing a promising blueprint for artificial compound eyes (ACEs) to achieve static and dynamic perceptions in complex environments. Specifically, each NCE utilises an array of ommatidia, the imaging units, distributed on a curved surface to enable abundant merits. This has inspired the development of many ACEs using various microlens arrays, but the reported ACEs have limited performances in static imaging and motion detection. Particularly, it is challenging to mimic the apposition modality to effectively transmit light rays collected by many microlenses on a curved surface to a flat imaging sensor chip while preserving their spatial relationships without interference. In this study, we integrate 271 lensed polymer optical fibres into a dome-like structure to faithfully mimic the structure of NCE. Our ACE has several parameters comparable to the NCEs: 271 ommatidia versus 272 for bark beetles, and 180<sup>o</sup> field of view (FOV) versus 150–180<sup>o</sup> FOV for most arthropods. In addition, our ACE outperforms the typical NCEs by ~100 times in dynamic response: 31.3 kHz versus 205 Hz for <i>Glossina morsitans</i>. Compared with other reported ACEs, our ACE enables real-time, 180<sup>o</sup> panoramic direct imaging and depth estimation within its nearly infinite depth of field. Moreover, our ACE can respond to an angular motion up to 5.6×10<sup>6</sup> deg/s with the ability to identify translation and rotation, making it suitable for applications to capture high-speed objects, such as surveillance, unmanned aerial/ground vehicles, and virtual reality.</p>","PeriodicalId":18069,"journal":{"name":"Light-Science & Applications","volume":null,"pages":null},"PeriodicalIF":20.6000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Light-Science & Applications","FirstCategoryId":"1089","ListUrlMain":"https://doi.org/10.1038/s41377-024-01580-5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Natural selection has driven arthropods to evolve fantastic natural compound eyes (NCEs) with a unique anatomical structure, providing a promising blueprint for artificial compound eyes (ACEs) to achieve static and dynamic perceptions in complex environments. Specifically, each NCE utilises an array of ommatidia, the imaging units, distributed on a curved surface to enable abundant merits. This has inspired the development of many ACEs using various microlens arrays, but the reported ACEs have limited performances in static imaging and motion detection. Particularly, it is challenging to mimic the apposition modality to effectively transmit light rays collected by many microlenses on a curved surface to a flat imaging sensor chip while preserving their spatial relationships without interference. In this study, we integrate 271 lensed polymer optical fibres into a dome-like structure to faithfully mimic the structure of NCE. Our ACE has several parameters comparable to the NCEs: 271 ommatidia versus 272 for bark beetles, and 180o field of view (FOV) versus 150–180o FOV for most arthropods. In addition, our ACE outperforms the typical NCEs by ~100 times in dynamic response: 31.3 kHz versus 205 Hz for Glossina morsitans. Compared with other reported ACEs, our ACE enables real-time, 180o panoramic direct imaging and depth estimation within its nearly infinite depth of field. Moreover, our ACE can respond to an angular motion up to 5.6×106 deg/s with the ability to identify translation and rotation, making it suitable for applications to capture high-speed objects, such as surveillance, unmanned aerial/ground vehicles, and virtual reality.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于光纤的人造复眼,用于直接静态成像和超快运动检测
自然选择促使节肢动物进化出具有独特解剖结构的神奇天然复眼(NCE),为人工复眼(ACE)在复杂环境中实现静态和动态感知提供了前景广阔的蓝图。具体来说,每只自然复眼都利用分布在弯曲表面上的成像单元--膜阵列来实现丰富的优点。受此启发,人们利用各种微透镜阵列开发出了许多 ACE,但已报道的 ACE 在静态成像和运动检测方面的性能有限。特别是,如何模仿贴合模式,将曲面上许多微透镜收集到的光线有效地传输到平面成像传感器芯片上,同时保留它们之间的空间关系而不受干扰,是一项挑战。在这项研究中,我们将 271 个透镜聚合物光纤集成到一个圆顶状结构中,以忠实模拟 NCE 的结构。我们的 ACE 有几个参数与 NCE 相当:271 个 mmatidia(而树皮甲虫为 272 个)和 180o 视场(FOV)(而大多数节肢动物为 150-180o FOV)。此外,我们的 ACE 在动态响应方面比典型的 NCE 高出约 100 倍:Glossina morsitans 的动态响应为 31.3 kHz,而我们的 ACE 为 205 Hz。与其他已报道的 ACE 相比,我们的 ACE 可在其近乎无限的景深范围内实现实时、180° 全景直接成像和深度估计。此外,我们的 ACE 能够对高达 5.6×106 度/秒的角运动做出响应,并能识别平移和旋转,因此适用于捕捉高速物体的应用,如监控、无人机/地面车辆和虚拟现实。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Light-Science & Applications
Light-Science & Applications 数理科学, 物理学I, 光学, 凝聚态物性 II :电子结构、电学、磁学和光学性质, 无机非金属材料, 无机非金属类光电信息与功能材料, 工程与材料, 信息科学, 光学和光电子学, 光学和光电子材料, 非线性光学与量子光学
自引率
0.00%
发文量
803
审稿时长
2.1 months
期刊最新文献
Phase-change VO2-based thermochromic smart windows Optical fibre based artificial compound eyes for direct static imaging and ultrafast motion detection Lanthanide ion-doped upconversion nanoparticles for low-energy super-resolution applications Towards next-generation diagnostic pathology: AI-empowered label-free multiphoton microscopy Deep-trap ultraviolet persistent phosphor for advanced optical storage application in bright environments
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1