{"title":"利用量化感知训练尖峰神经网络,在 Loihi 芯片上实现高能效频谱传感","authors":"Shiya Liu;Nima Mohammadi;Yang Yi","doi":"10.1109/TGCN.2023.3337748","DOIUrl":null,"url":null,"abstract":"Spectrum sensing is a technique used to identify idle/busy bandwidths in cognitive radio. Energy-efficient spectrum sensing is critical for multiple-input-multiple-output (MIMO) orthogonal-frequency-division multiplexing (OFDM) systems. In this paper, we propose the use of spiking neural networks (SNNs), which are more biologically plausible and energy-efficient than deep neural networks (DNNs), for spectrum sensing. The SNN models are implemented on the Loihi chip, which is better suited for SNNs than GPUs. Quantization is an effective technique to reduce the memory and energy consumption of SNNs. However, previous quantization methods for SNNs have suffered from accuracy degradation when compared to full-precision models. This degradation can be attributed to errors introduced by the coarse estimation of gradients in non-differentiable quantization layers. To address this issue, we introduce a quantization-aware training algorithm for SNNs running on Loihi. To mitigate errors caused by the poor estimation of gradients, we do not use a fixed configuration for the quantizer, as is common in existing SNN quantization methods. Instead, we make the scale parameters of the quantizer trainable. Furthermore, our proposed method adopts a probability-based scheme to selectively quantize individual layers within the network, rather than quantizing all layers simultaneously. Our experimental results demonstrate that high-performance and energy-efficient spectrum sensing can be achieved using Loihi.","PeriodicalId":13052,"journal":{"name":"IEEE Transactions on Green Communications and Networking","volume":null,"pages":null},"PeriodicalIF":5.3000,"publicationDate":"2023-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Quantization-Aware Training of Spiking Neural Networks for Energy-Efficient Spectrum Sensing on Loihi Chip\",\"authors\":\"Shiya Liu;Nima Mohammadi;Yang Yi\",\"doi\":\"10.1109/TGCN.2023.3337748\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Spectrum sensing is a technique used to identify idle/busy bandwidths in cognitive radio. Energy-efficient spectrum sensing is critical for multiple-input-multiple-output (MIMO) orthogonal-frequency-division multiplexing (OFDM) systems. In this paper, we propose the use of spiking neural networks (SNNs), which are more biologically plausible and energy-efficient than deep neural networks (DNNs), for spectrum sensing. The SNN models are implemented on the Loihi chip, which is better suited for SNNs than GPUs. Quantization is an effective technique to reduce the memory and energy consumption of SNNs. However, previous quantization methods for SNNs have suffered from accuracy degradation when compared to full-precision models. This degradation can be attributed to errors introduced by the coarse estimation of gradients in non-differentiable quantization layers. To address this issue, we introduce a quantization-aware training algorithm for SNNs running on Loihi. To mitigate errors caused by the poor estimation of gradients, we do not use a fixed configuration for the quantizer, as is common in existing SNN quantization methods. Instead, we make the scale parameters of the quantizer trainable. Furthermore, our proposed method adopts a probability-based scheme to selectively quantize individual layers within the network, rather than quantizing all layers simultaneously. Our experimental results demonstrate that high-performance and energy-efficient spectrum sensing can be achieved using Loihi.\",\"PeriodicalId\":13052,\"journal\":{\"name\":\"IEEE Transactions on Green Communications and Networking\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.3000,\"publicationDate\":\"2023-11-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Green Communications and Networking\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10332927/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"TELECOMMUNICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Green Communications and Networking","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10332927/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TELECOMMUNICATIONS","Score":null,"Total":0}
Quantization-Aware Training of Spiking Neural Networks for Energy-Efficient Spectrum Sensing on Loihi Chip
Spectrum sensing is a technique used to identify idle/busy bandwidths in cognitive radio. Energy-efficient spectrum sensing is critical for multiple-input-multiple-output (MIMO) orthogonal-frequency-division multiplexing (OFDM) systems. In this paper, we propose the use of spiking neural networks (SNNs), which are more biologically plausible and energy-efficient than deep neural networks (DNNs), for spectrum sensing. The SNN models are implemented on the Loihi chip, which is better suited for SNNs than GPUs. Quantization is an effective technique to reduce the memory and energy consumption of SNNs. However, previous quantization methods for SNNs have suffered from accuracy degradation when compared to full-precision models. This degradation can be attributed to errors introduced by the coarse estimation of gradients in non-differentiable quantization layers. To address this issue, we introduce a quantization-aware training algorithm for SNNs running on Loihi. To mitigate errors caused by the poor estimation of gradients, we do not use a fixed configuration for the quantizer, as is common in existing SNN quantization methods. Instead, we make the scale parameters of the quantizer trainable. Furthermore, our proposed method adopts a probability-based scheme to selectively quantize individual layers within the network, rather than quantizing all layers simultaneously. Our experimental results demonstrate that high-performance and energy-efficient spectrum sensing can be achieved using Loihi.