Stochastic Computing-based Computation-in-Memory (SC CiM) Architecture for DNNs and Hierarchical Evaluations of Non-volatile Memory Error and Defect Tolerance

Abstract

A Stochastic Computing-based Computation-inMemory architecture (SC CiM) with non-volatile memory (NVM) stochastic weights has been proposed. Both of the input and weight values are converted into stochastic bit streams. The multiply-and-accumulate (MAC) operation of the SC multiplication is performed in memory. The computational accuracy is characterized for Resnet-56 and CIFAR-10, with the bit error rate (BER) range from 1$0^{-4}$ to 1$0^{-2}$ representing the actual NVM characteristics. The effects of NVM BER are analyzed hierarchically at all computational layers (bit streams, MAC calculation and DNN inference) and compared both qualitatively and quantitatively with the conventional CiM. The results show the excellent robustness of the proposed SC CiM architecture in the wide range of BER. The tolerance to the manufacturing defects is even better than that of the conventional CiM. Furthermore, the desired weight distributions are discussed by exploiting the unique behaviors against NVM BER in the SC CiM.