{"title":"异步事件相机的可解释像素强度重建模型","authors":"Hongwei Shan, Lichen Feng, Yueqi Zhang, Zhangming Zhu","doi":"10.1109/AICAS57966.2023.10168635","DOIUrl":null,"url":null,"abstract":"Event cameras with high temporal resolution and high dynamic range have great potential in computer vision (CV) tasks. To utilize the deep neural networks directly, an efficient reconstruction method converting event-based data to frame-based is necessary. In this work, the interpretable Event Represented Intensity (ERI) model that recovers the logarithm of the intensity sensed by a dynamic vision pixel is proposed for the first time. The amplitude-frequency characteristic of the recovered logarithm of the intensity is used to construct the frame-based image to complete CV tasks. Experiment results on the N-Caltech101 dataset show that the proposed ERI model achieves the classification accuracy of 79.20%, which balances the performance and computation cost better.","PeriodicalId":296649,"journal":{"name":"2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS)","volume":"73 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Interpretable Pixel Intensity Reconstruction Model for Asynchronous Event Camera\",\"authors\":\"Hongwei Shan, Lichen Feng, Yueqi Zhang, Zhangming Zhu\",\"doi\":\"10.1109/AICAS57966.2023.10168635\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Event cameras with high temporal resolution and high dynamic range have great potential in computer vision (CV) tasks. To utilize the deep neural networks directly, an efficient reconstruction method converting event-based data to frame-based is necessary. In this work, the interpretable Event Represented Intensity (ERI) model that recovers the logarithm of the intensity sensed by a dynamic vision pixel is proposed for the first time. The amplitude-frequency characteristic of the recovered logarithm of the intensity is used to construct the frame-based image to complete CV tasks. Experiment results on the N-Caltech101 dataset show that the proposed ERI model achieves the classification accuracy of 79.20%, which balances the performance and computation cost better.\",\"PeriodicalId\":296649,\"journal\":{\"name\":\"2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS)\",\"volume\":\"73 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/AICAS57966.2023.10168635\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE 5th International Conference on Artificial Intelligence Circuits and Systems (AICAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/AICAS57966.2023.10168635","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
An Interpretable Pixel Intensity Reconstruction Model for Asynchronous Event Camera
Event cameras with high temporal resolution and high dynamic range have great potential in computer vision (CV) tasks. To utilize the deep neural networks directly, an efficient reconstruction method converting event-based data to frame-based is necessary. In this work, the interpretable Event Represented Intensity (ERI) model that recovers the logarithm of the intensity sensed by a dynamic vision pixel is proposed for the first time. The amplitude-frequency characteristic of the recovered logarithm of the intensity is used to construct the frame-based image to complete CV tasks. Experiment results on the N-Caltech101 dataset show that the proposed ERI model achieves the classification accuracy of 79.20%, which balances the performance and computation cost better.