{"title":"一种基于硬件库的神经形态事件数据解释方法。","authors":"Hanrui Li, Dayanand Kumar, Nazek El-Atab","doi":"10.3389/fnins.2024.1467935","DOIUrl":null,"url":null,"abstract":"<p><p>Event cameras have shown unprecedented success in various computer vision applications due to their unique ability to capture dynamic scenes with high temporal resolution and low latency. However, many existing approaches for event data representation are typically algorithm-based, limiting their utilization and hardware deployment. This study explores a hardware event representation approach for event data utilizing a reservoir encoder implemented with analog memristor. The inherent stochastic and non-linear characteristics of the memristors enable the effective and low-cost feature extraction of temporal information from event streams as a reservoir encoder. We propose a simplified memristor model and memristor-based reservoir circuit specifically for processing dynamic visual information and extracting feature in event data. Experimental results with four event datasets demonstrate that our approach achieves superior accuracy over other methods, highlighting the potential of memristor-based event processing system.</p>","PeriodicalId":12639,"journal":{"name":"Frontiers in Neuroscience","volume":"18 ","pages":"1467935"},"PeriodicalIF":3.2000,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11602487/pdf/","citationCount":"0","resultStr":"{\"title\":\"A neuromorphic event data interpretation approach with hardware reservoir.\",\"authors\":\"Hanrui Li, Dayanand Kumar, Nazek El-Atab\",\"doi\":\"10.3389/fnins.2024.1467935\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Event cameras have shown unprecedented success in various computer vision applications due to their unique ability to capture dynamic scenes with high temporal resolution and low latency. However, many existing approaches for event data representation are typically algorithm-based, limiting their utilization and hardware deployment. This study explores a hardware event representation approach for event data utilizing a reservoir encoder implemented with analog memristor. The inherent stochastic and non-linear characteristics of the memristors enable the effective and low-cost feature extraction of temporal information from event streams as a reservoir encoder. We propose a simplified memristor model and memristor-based reservoir circuit specifically for processing dynamic visual information and extracting feature in event data. Experimental results with four event datasets demonstrate that our approach achieves superior accuracy over other methods, highlighting the potential of memristor-based event processing system.</p>\",\"PeriodicalId\":12639,\"journal\":{\"name\":\"Frontiers in Neuroscience\",\"volume\":\"18 \",\"pages\":\"1467935\"},\"PeriodicalIF\":3.2000,\"publicationDate\":\"2024-11-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11602487/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Frontiers in Neuroscience\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.3389/fnins.2024.1467935\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2024/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q2\",\"JCRName\":\"NEUROSCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Neuroscience","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3389/fnins.2024.1467935","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"NEUROSCIENCES","Score":null,"Total":0}
A neuromorphic event data interpretation approach with hardware reservoir.
Event cameras have shown unprecedented success in various computer vision applications due to their unique ability to capture dynamic scenes with high temporal resolution and low latency. However, many existing approaches for event data representation are typically algorithm-based, limiting their utilization and hardware deployment. This study explores a hardware event representation approach for event data utilizing a reservoir encoder implemented with analog memristor. The inherent stochastic and non-linear characteristics of the memristors enable the effective and low-cost feature extraction of temporal information from event streams as a reservoir encoder. We propose a simplified memristor model and memristor-based reservoir circuit specifically for processing dynamic visual information and extracting feature in event data. Experimental results with four event datasets demonstrate that our approach achieves superior accuracy over other methods, highlighting the potential of memristor-based event processing system.
期刊介绍:
Neural Technology is devoted to the convergence between neurobiology and quantum-, nano- and micro-sciences. In our vision, this interdisciplinary approach should go beyond the technological development of sophisticated methods and should contribute in generating a genuine change in our discipline.