Kai Feng, Long Xu, Dong Zhao, Sixuan Liu, Xin Huang
{"title":"Toward Model Compression for a Deep Learning–Based Solar Flare Forecast on Satellites","authors":"Kai Feng, Long Xu, Dong Zhao, Sixuan Liu, Xin Huang","doi":"10.3847/1538-4365/ace96a","DOIUrl":null,"url":null,"abstract":"Abstract Timely solar flare forecasting is challenged by the delay of transmitting vast amounts of data from the satellite to the ground. To avoid this delay, it is expected that forecasting models will be deployed on satellites. Thus, transmitting forecasting results instead of huge volumes of observation data would greatly save network bandwidth and reduce forecasting delay. However, deep-learning models have a huge number of parameters so they need large memory and strong computing power, which hinders their deployment on satellites with limited memory and computing resources. Therefore, there is a great need to compress forecasting models for efficient deployment on satellites. First, three typical compression methods, namely knowledge distillation, pruning, and quantization, are examined individually for compressing of solar flare forecasting models. And then, an assembled compression model is proposed for better compressing solar flare forecasting models. The experimental results demonstrate that the assembled compression model can compress a pretrained solar flare forecasting model to only 1.67% of its original size while maintaining forecasting accuracy.","PeriodicalId":8588,"journal":{"name":"Astrophysical Journal Supplement Series","volume":"26 1","pages":"0"},"PeriodicalIF":8.6000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Astrophysical Journal Supplement Series","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3847/1538-4365/ace96a","RegionNum":1,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ASTRONOMY & ASTROPHYSICS","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract Timely solar flare forecasting is challenged by the delay of transmitting vast amounts of data from the satellite to the ground. To avoid this delay, it is expected that forecasting models will be deployed on satellites. Thus, transmitting forecasting results instead of huge volumes of observation data would greatly save network bandwidth and reduce forecasting delay. However, deep-learning models have a huge number of parameters so they need large memory and strong computing power, which hinders their deployment on satellites with limited memory and computing resources. Therefore, there is a great need to compress forecasting models for efficient deployment on satellites. First, three typical compression methods, namely knowledge distillation, pruning, and quantization, are examined individually for compressing of solar flare forecasting models. And then, an assembled compression model is proposed for better compressing solar flare forecasting models. The experimental results demonstrate that the assembled compression model can compress a pretrained solar flare forecasting model to only 1.67% of its original size while maintaining forecasting accuracy.
期刊介绍:
The Astrophysical Journal Supplement (ApJS) serves as an open-access journal that publishes significant articles featuring extensive data or calculations in the field of astrophysics. It also facilitates Special Issues, presenting thematically related papers simultaneously in a single volume.