Xiu Shu , Feng Huang , Zhaobing Qiu , Chunwei Tian , Qiao Liu , Di Yuan
{"title":"利用分层特征融合更新搜索区域,实现精确的热红外跟踪","authors":"Xiu Shu , Feng Huang , Zhaobing Qiu , Chunwei Tian , Qiao Liu , Di Yuan","doi":"10.1016/j.jfranklin.2024.107332","DOIUrl":null,"url":null,"abstract":"<div><div>Due to their resilience against lighting variations, thermal infrared (TIR) images demonstrate robust adaptability in diverse environments, enabling effective object tracking even in intricate scenarios. Nevertheless, TIR target tracking encounters challenges such as fast target motion and interference from visually similar objects, substantially compromising the tracking precision of TIR trackers. To surmount these challenges, we propose a method grounded in the strategy of search region updating and hierarchical feature fusion, tailored for the precise TIR target-tracking task. Specifically, to address the issue of fast motion causing the target to depart from the search region, we propose to update the current search region by leveraging historical frame information. Additionally, we employ a hierarchical feature fusion strategy to contend with interference from visually similar objects in the tracking scenario. This strategy enhances the ability to model and represent the target more accurately, thereby elevating the tracker’s capacity to discriminate between the target and similar objects. Furthermore, to tackle the challenge of inaccurate estimation of target bounding boxes, we introduce an enhanced Intersection over Union (IoU) loss function, which improvement facilitates a more precise prediction of target bounding boxes, resulting in superior target localization. Extensive experiments substantiate that our tracker exhibits a commendable level of competitiveness when compared to other trackers.</div></div>","PeriodicalId":17283,"journal":{"name":"Journal of The Franklin Institute-engineering and Applied Mathematics","volume":"361 18","pages":"Article 107332"},"PeriodicalIF":3.7000,"publicationDate":"2024-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Search region updating with hierarchical feature fusion for accurate thermal infrared tracking\",\"authors\":\"Xiu Shu , Feng Huang , Zhaobing Qiu , Chunwei Tian , Qiao Liu , Di Yuan\",\"doi\":\"10.1016/j.jfranklin.2024.107332\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Due to their resilience against lighting variations, thermal infrared (TIR) images demonstrate robust adaptability in diverse environments, enabling effective object tracking even in intricate scenarios. Nevertheless, TIR target tracking encounters challenges such as fast target motion and interference from visually similar objects, substantially compromising the tracking precision of TIR trackers. To surmount these challenges, we propose a method grounded in the strategy of search region updating and hierarchical feature fusion, tailored for the precise TIR target-tracking task. Specifically, to address the issue of fast motion causing the target to depart from the search region, we propose to update the current search region by leveraging historical frame information. Additionally, we employ a hierarchical feature fusion strategy to contend with interference from visually similar objects in the tracking scenario. This strategy enhances the ability to model and represent the target more accurately, thereby elevating the tracker’s capacity to discriminate between the target and similar objects. Furthermore, to tackle the challenge of inaccurate estimation of target bounding boxes, we introduce an enhanced Intersection over Union (IoU) loss function, which improvement facilitates a more precise prediction of target bounding boxes, resulting in superior target localization. Extensive experiments substantiate that our tracker exhibits a commendable level of competitiveness when compared to other trackers.</div></div>\",\"PeriodicalId\":17283,\"journal\":{\"name\":\"Journal of The Franklin Institute-engineering and Applied Mathematics\",\"volume\":\"361 18\",\"pages\":\"Article 107332\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-10-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of The Franklin Institute-engineering and Applied Mathematics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0016003224007531\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of The Franklin Institute-engineering and Applied Mathematics","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0016003224007531","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Search region updating with hierarchical feature fusion for accurate thermal infrared tracking
Due to their resilience against lighting variations, thermal infrared (TIR) images demonstrate robust adaptability in diverse environments, enabling effective object tracking even in intricate scenarios. Nevertheless, TIR target tracking encounters challenges such as fast target motion and interference from visually similar objects, substantially compromising the tracking precision of TIR trackers. To surmount these challenges, we propose a method grounded in the strategy of search region updating and hierarchical feature fusion, tailored for the precise TIR target-tracking task. Specifically, to address the issue of fast motion causing the target to depart from the search region, we propose to update the current search region by leveraging historical frame information. Additionally, we employ a hierarchical feature fusion strategy to contend with interference from visually similar objects in the tracking scenario. This strategy enhances the ability to model and represent the target more accurately, thereby elevating the tracker’s capacity to discriminate between the target and similar objects. Furthermore, to tackle the challenge of inaccurate estimation of target bounding boxes, we introduce an enhanced Intersection over Union (IoU) loss function, which improvement facilitates a more precise prediction of target bounding boxes, resulting in superior target localization. Extensive experiments substantiate that our tracker exhibits a commendable level of competitiveness when compared to other trackers.
期刊介绍:
The Journal of The Franklin Institute has an established reputation for publishing high-quality papers in the field of engineering and applied mathematics. Its current focus is on control systems, complex networks and dynamic systems, signal processing and communications and their applications. All submitted papers are peer-reviewed. The Journal will publish original research papers and research review papers of substance. Papers and special focus issues are judged upon possible lasting value, which has been and continues to be the strength of the Journal of The Franklin Institute.