{"title":"SAfEPaTh:高效卷积神经网络加速器功率和热估计的系统级方法","authors":"Yukai Chen, Simei Yang, Debjyoti Bhattacharjee, Francky Catthoor, Arindam Mallik","doi":"arxiv-2407.17623","DOIUrl":null,"url":null,"abstract":"The design of energy-efficient, high-performance, and reliable Convolutional\nNeural Network (CNN) accelerators involves significant challenges due to\ncomplex power and thermal management issues. This paper introduces SAfEPaTh, a\nnovel system-level approach for accurately estimating power and temperature in\ntile-based CNN accelerators. By addressing both steady-state and\ntransient-state scenarios, SAfEPaTh effectively captures the dynamic effects of\npipeline bubbles in interlayer pipelines, utilizing real CNN workloads for\ncomprehensive evaluation. Unlike traditional methods, it eliminates the need\nfor circuit-level simulations or on-chip measurements. Our methodology\nleverages TANIA, a cutting-edge hybrid digital-analog tile-based accelerator\nfeaturing analog-in-memory computing cores alongside digital cores. Through\nrigorous simulation results using the ResNet18 model, we demonstrate SAfEPaTh's\ncapability to accurately estimate power and temperature within 500 seconds,\nencompassing CNN model accelerator mapping exploration and detailed power and\nthermal estimations. This efficiency and accuracy make SAfEPaTh an invaluable\ntool for designers, enabling them to optimize performance while adhering to\nstringent power and thermal constraints. Furthermore, SAfEPaTh's adaptability\nextends its utility across various CNN models and accelerator architectures,\nunderscoring its broad applicability in the field. This study contributes\nsignificantly to the advancement of energy-efficient and reliable CNN\naccelerator designs, addressing critical challenges in dynamic power and\nthermal management.","PeriodicalId":501291,"journal":{"name":"arXiv - CS - Performance","volume":"142 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"SAfEPaTh: A System-Level Approach for Efficient Power and Thermal Estimation of Convolutional Neural Network Accelerator\",\"authors\":\"Yukai Chen, Simei Yang, Debjyoti Bhattacharjee, Francky Catthoor, Arindam Mallik\",\"doi\":\"arxiv-2407.17623\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The design of energy-efficient, high-performance, and reliable Convolutional\\nNeural Network (CNN) accelerators involves significant challenges due to\\ncomplex power and thermal management issues. This paper introduces SAfEPaTh, a\\nnovel system-level approach for accurately estimating power and temperature in\\ntile-based CNN accelerators. By addressing both steady-state and\\ntransient-state scenarios, SAfEPaTh effectively captures the dynamic effects of\\npipeline bubbles in interlayer pipelines, utilizing real CNN workloads for\\ncomprehensive evaluation. Unlike traditional methods, it eliminates the need\\nfor circuit-level simulations or on-chip measurements. Our methodology\\nleverages TANIA, a cutting-edge hybrid digital-analog tile-based accelerator\\nfeaturing analog-in-memory computing cores alongside digital cores. Through\\nrigorous simulation results using the ResNet18 model, we demonstrate SAfEPaTh's\\ncapability to accurately estimate power and temperature within 500 seconds,\\nencompassing CNN model accelerator mapping exploration and detailed power and\\nthermal estimations. This efficiency and accuracy make SAfEPaTh an invaluable\\ntool for designers, enabling them to optimize performance while adhering to\\nstringent power and thermal constraints. Furthermore, SAfEPaTh's adaptability\\nextends its utility across various CNN models and accelerator architectures,\\nunderscoring its broad applicability in the field. This study contributes\\nsignificantly to the advancement of energy-efficient and reliable CNN\\naccelerator designs, addressing critical challenges in dynamic power and\\nthermal management.\",\"PeriodicalId\":501291,\"journal\":{\"name\":\"arXiv - CS - Performance\",\"volume\":\"142 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Performance\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2407.17623\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Performance","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2407.17623","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
SAfEPaTh: A System-Level Approach for Efficient Power and Thermal Estimation of Convolutional Neural Network Accelerator
The design of energy-efficient, high-performance, and reliable Convolutional
Neural Network (CNN) accelerators involves significant challenges due to
complex power and thermal management issues. This paper introduces SAfEPaTh, a
novel system-level approach for accurately estimating power and temperature in
tile-based CNN accelerators. By addressing both steady-state and
transient-state scenarios, SAfEPaTh effectively captures the dynamic effects of
pipeline bubbles in interlayer pipelines, utilizing real CNN workloads for
comprehensive evaluation. Unlike traditional methods, it eliminates the need
for circuit-level simulations or on-chip measurements. Our methodology
leverages TANIA, a cutting-edge hybrid digital-analog tile-based accelerator
featuring analog-in-memory computing cores alongside digital cores. Through
rigorous simulation results using the ResNet18 model, we demonstrate SAfEPaTh's
capability to accurately estimate power and temperature within 500 seconds,
encompassing CNN model accelerator mapping exploration and detailed power and
thermal estimations. This efficiency and accuracy make SAfEPaTh an invaluable
tool for designers, enabling them to optimize performance while adhering to
stringent power and thermal constraints. Furthermore, SAfEPaTh's adaptability
extends its utility across various CNN models and accelerator architectures,
underscoring its broad applicability in the field. This study contributes
significantly to the advancement of energy-efficient and reliable CNN
accelerator designs, addressing critical challenges in dynamic power and
thermal management.