Pub Date : 2023-08-29DOI: 10.57237/j.cst.2023.03.002
Yanchao Li
{"title":"Identification and Optimization of Big Data Mining Technology for Digital Economy Characteristics","authors":"Yanchao Li","doi":"10.57237/j.cst.2023.03.002","DOIUrl":"https://doi.org/10.57237/j.cst.2023.03.002","url":null,"abstract":"","PeriodicalId":50222,"journal":{"name":"Journal of Computer Science and Technology","volume":"16 1","pages":""},"PeriodicalIF":1.9,"publicationDate":"2023-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82558487","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-01DOI: 10.1007/s11390-021-1119-0
Yige Xu, Xipeng Qiu, Ligao Zhou, Xuanjing Huang
Fine-tuning pre-trained language models like BERT has become an effective way in NLP and yields state-of-the-art results on many downstream tasks. Recent studies on adapting BERT to new tasks mainly focus on modifying the model structure, re-designing the pre-train tasks, and leveraging external data and knowledge. The fine-tuning strategy itself has yet to be fully explored. In this paper, we improve the fine-tuning of BERT with two effective mechanisms: self-ensemble and self-distillation. The experiments on text classification and natural language inference tasks show our proposed methods can significantly improve the adaption of BERT without any external data or knowledge.
{"title":"Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation","authors":"Yige Xu, Xipeng Qiu, Ligao Zhou, Xuanjing Huang","doi":"10.1007/s11390-021-1119-0","DOIUrl":"https://doi.org/10.1007/s11390-021-1119-0","url":null,"abstract":"Fine-tuning pre-trained language models like BERT has become an effective way in NLP and yields state-of-the-art results on many downstream tasks. Recent studies on adapting BERT to new tasks mainly focus on modifying the model structure, re-designing the pre-train tasks, and leveraging external data and knowledge. The fine-tuning strategy itself has yet to be fully explored. In this paper, we improve the fine-tuning of BERT with two effective mechanisms: self-ensemble and self-distillation. The experiments on text classification and natural language inference tasks show our proposed methods can significantly improve the adaption of BERT without any external data or knowledge.","PeriodicalId":50222,"journal":{"name":"Journal of Computer Science and Technology","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135846006","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-01DOI: 10.1007/s11390-023-3140-y
Zi-Fei Jiang, Wei Li, Yan Huang, Yi-Long Yin, C.-C. Jay Kuo, Jing-Liang Peng
{"title":"PESTA: An Elastic Motion Capture Data Retrieval Method","authors":"Zi-Fei Jiang, Wei Li, Yan Huang, Yi-Long Yin, C.-C. Jay Kuo, Jing-Liang Peng","doi":"10.1007/s11390-023-3140-y","DOIUrl":"https://doi.org/10.1007/s11390-023-3140-y","url":null,"abstract":"","PeriodicalId":50222,"journal":{"name":"Journal of Computer Science and Technology","volume":"20 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135856855","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-01DOI: 10.1007/s11390-023-3285-8
Yi-Nan Xu, Zi-Hao Yu, Kai-Fan Wang, Hua-Qiang Wang, Jia-Wei Lin, Yue Jin, Lin-Juan Zhang, Zi-Fei Zhang, Dan Tang, Sa Wang, Kan Shi, Ning-Hui Sun, Yun-Gang Bao
{"title":"Functional Verification for Agile Processor Development: A Case for Workflow Integration","authors":"Yi-Nan Xu, Zi-Hao Yu, Kai-Fan Wang, Hua-Qiang Wang, Jia-Wei Lin, Yue Jin, Lin-Juan Zhang, Zi-Fei Zhang, Dan Tang, Sa Wang, Kan Shi, Ning-Hui Sun, Yun-Gang Bao","doi":"10.1007/s11390-023-3285-8","DOIUrl":"https://doi.org/10.1007/s11390-023-3285-8","url":null,"abstract":"","PeriodicalId":50222,"journal":{"name":"Journal of Computer Science and Technology","volume":"4 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135856837","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-01DOI: 10.1007/s11390-021-1099-0
Xue-Li Sun, Jian-Xi Fan, Bao-Lei Cheng, Yan Wang, Li Zhang
{"title":"Probabilistic Fault Diagnosis of Clustered Faults for Multiprocessor Systems","authors":"Xue-Li Sun, Jian-Xi Fan, Bao-Lei Cheng, Yan Wang, Li Zhang","doi":"10.1007/s11390-021-1099-0","DOIUrl":"https://doi.org/10.1007/s11390-021-1099-0","url":null,"abstract":"","PeriodicalId":50222,"journal":{"name":"Journal of Computer Science and Technology","volume":"9 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135856839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-07-01DOI: 10.1007/s11390-023-3074-4
Xinliang Wei, Jiyao Liu, Yu Wang
{"title":"Joint Participant Selection and Learning Optimization for Federated Learning of Multiple Models in Edge Cloud","authors":"Xinliang Wei, Jiyao Liu, Yu Wang","doi":"10.1007/s11390-023-3074-4","DOIUrl":"https://doi.org/10.1007/s11390-023-3074-4","url":null,"abstract":"","PeriodicalId":50222,"journal":{"name":"Journal of Computer Science and Technology","volume":"102 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135856857","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：