Hanbo Zheng;Shiqi Xu;Jinheng Li;Fang Gao;Zhimei Cui
{"title":"一种集成关键点检测和透视几何的变电站安全距离监测轻量化方法","authors":"Hanbo Zheng;Shiqi Xu;Jinheng Li;Fang Gao;Zhimei Cui","doi":"10.1109/TPWRD.2024.3522808","DOIUrl":null,"url":null,"abstract":"In the high-voltage environment of substations, due to the lack of effective monitoring methods, personnel may fail to maintain a safe distance from the equipment due to subjective factors, leading to electric shock accidents. To more effectively reduce the occurrence of such accidents, this paper proposes a monocular vision-based method for monitoring the safety distance between personnel and live equipment. Firstly, this paper makes lightweight improvements to the YOLOv8 (You Only Look Once) keypoint detection model by introducing the proposed dense feature fusion (DFF) module and adaptive channel cross (ACC) module into the backbone and neck, respectively, and replacing the network's original path aggregation network (PAN) structure with the bi-directional feature pyramid network (BiFPN) structure. Subsequently, based on the principles of camera imaging and perspective geometry, this paper calculates the mapping relationship between two-dimensional pixel coordinates and three-dimensional world coordinates. Finally, based on the detected keypoints and the obtained mapping relationship, the distance between personnel and live equipment is monitored. Experiments conducted in a substation scenario show that the improved keypoint detection model increases AP from 0.718 to 0.771, reduces parameters from 3.09M to 2.10M, and lowers FLOPs from 8.48G to 7.01G, and the maximum distance measurement error is only 3.778%.","PeriodicalId":13498,"journal":{"name":"IEEE Transactions on Power Delivery","volume":"40 2","pages":"810-821"},"PeriodicalIF":3.7000,"publicationDate":"2024-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Lightweight Method Integrating Keypoint Detection and Perspective Geometry for Substation Safety Distance Monitoring\",\"authors\":\"Hanbo Zheng;Shiqi Xu;Jinheng Li;Fang Gao;Zhimei Cui\",\"doi\":\"10.1109/TPWRD.2024.3522808\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the high-voltage environment of substations, due to the lack of effective monitoring methods, personnel may fail to maintain a safe distance from the equipment due to subjective factors, leading to electric shock accidents. To more effectively reduce the occurrence of such accidents, this paper proposes a monocular vision-based method for monitoring the safety distance between personnel and live equipment. Firstly, this paper makes lightweight improvements to the YOLOv8 (You Only Look Once) keypoint detection model by introducing the proposed dense feature fusion (DFF) module and adaptive channel cross (ACC) module into the backbone and neck, respectively, and replacing the network's original path aggregation network (PAN) structure with the bi-directional feature pyramid network (BiFPN) structure. Subsequently, based on the principles of camera imaging and perspective geometry, this paper calculates the mapping relationship between two-dimensional pixel coordinates and three-dimensional world coordinates. Finally, based on the detected keypoints and the obtained mapping relationship, the distance between personnel and live equipment is monitored. Experiments conducted in a substation scenario show that the improved keypoint detection model increases AP from 0.718 to 0.771, reduces parameters from 3.09M to 2.10M, and lowers FLOPs from 8.48G to 7.01G, and the maximum distance measurement error is only 3.778%.\",\"PeriodicalId\":13498,\"journal\":{\"name\":\"IEEE Transactions on Power Delivery\",\"volume\":\"40 2\",\"pages\":\"810-821\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-12-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Power Delivery\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10816303/\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Power Delivery","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10816303/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
摘要
在变电站的高压环境中,由于缺乏有效的监控手段,人员可能由于主观因素而无法与设备保持安全距离,从而导致触电事故的发生。为了更有效地减少此类事故的发生,本文提出了一种基于单目视觉的人员与带电设备安全距离监测方法。首先,本文对YOLOv8 (You Only Look Once)关键点检测模型进行轻量级改进,在主干和颈部分别引入本文提出的密集特征融合(DFF)模块和自适应通道交叉(ACC)模块,并用双向特征金字塔网络(BiFPN)结构取代网络原有的路径聚合网络(PAN)结构。随后,根据相机成像和透视几何原理,计算二维像素坐标与三维世界坐标的映射关系。最后,根据检测到的关键点和得到的映射关系,对人员与带电设备之间的距离进行监控。变电站场景实验表明,改进的关键点检测模型将AP从0.718提高到0.771,将参数从3.09M降低到2.1 m,将FLOPs从8.48G降低到7.01G,最大距离测量误差仅为3.778%。
A Lightweight Method Integrating Keypoint Detection and Perspective Geometry for Substation Safety Distance Monitoring
In the high-voltage environment of substations, due to the lack of effective monitoring methods, personnel may fail to maintain a safe distance from the equipment due to subjective factors, leading to electric shock accidents. To more effectively reduce the occurrence of such accidents, this paper proposes a monocular vision-based method for monitoring the safety distance between personnel and live equipment. Firstly, this paper makes lightweight improvements to the YOLOv8 (You Only Look Once) keypoint detection model by introducing the proposed dense feature fusion (DFF) module and adaptive channel cross (ACC) module into the backbone and neck, respectively, and replacing the network's original path aggregation network (PAN) structure with the bi-directional feature pyramid network (BiFPN) structure. Subsequently, based on the principles of camera imaging and perspective geometry, this paper calculates the mapping relationship between two-dimensional pixel coordinates and three-dimensional world coordinates. Finally, based on the detected keypoints and the obtained mapping relationship, the distance between personnel and live equipment is monitored. Experiments conducted in a substation scenario show that the improved keypoint detection model increases AP from 0.718 to 0.771, reduces parameters from 3.09M to 2.10M, and lowers FLOPs from 8.48G to 7.01G, and the maximum distance measurement error is only 3.778%.
期刊介绍:
The scope of the Society embraces planning, research, development, design, application, construction, installation and operation of apparatus, equipment, structures, materials and systems for the safe, reliable and economic generation, transmission, distribution, conversion, measurement and control of electric energy. It includes the developing of engineering standards, the providing of information and instruction to the public and to legislators, as well as technical scientific, literary, educational and other activities that contribute to the electric power discipline or utilize the techniques or products within this discipline.