Jesus Barreda, Ashley Gomez, Ruben Puga, Kaixiong Zhou, Li Zhang
{"title":"COSCO:用于少镜头多变量时间序列分类的锐度感知训练框架","authors":"Jesus Barreda, Ashley Gomez, Ruben Puga, Kaixiong Zhou, Li Zhang","doi":"arxiv-2409.09645","DOIUrl":null,"url":null,"abstract":"Multivariate time series classification is an important task with widespread\ndomains of applications. Recently, deep neural networks (DNN) have achieved\nstate-of-the-art performance in time series classification. However, they often\nrequire large expert-labeled training datasets which can be infeasible in\npractice. In few-shot settings, i.e. only a limited number of samples per class\nare available in training data, DNNs show a significant drop in testing\naccuracy and poor generalization ability. In this paper, we propose to address\nthese problems from an optimization and a loss function perspective.\nSpecifically, we propose a new learning framework named COSCO consisting of a\nsharpness-aware minimization (SAM) optimization and a Prototypical loss\nfunction to improve the generalization ability of DNN for multivariate time\nseries classification problems under few-shot setting. Our experiments\ndemonstrate our proposed method outperforms the existing baseline methods. Our\nsource code is available at: https://github.com/JRB9/COSCO.","PeriodicalId":501347,"journal":{"name":"arXiv - CS - Neural and Evolutionary Computing","volume":"18 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"COSCO: A Sharpness-Aware Training Framework for Few-shot Multivariate Time Series Classification\",\"authors\":\"Jesus Barreda, Ashley Gomez, Ruben Puga, Kaixiong Zhou, Li Zhang\",\"doi\":\"arxiv-2409.09645\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Multivariate time series classification is an important task with widespread\\ndomains of applications. Recently, deep neural networks (DNN) have achieved\\nstate-of-the-art performance in time series classification. However, they often\\nrequire large expert-labeled training datasets which can be infeasible in\\npractice. In few-shot settings, i.e. only a limited number of samples per class\\nare available in training data, DNNs show a significant drop in testing\\naccuracy and poor generalization ability. In this paper, we propose to address\\nthese problems from an optimization and a loss function perspective.\\nSpecifically, we propose a new learning framework named COSCO consisting of a\\nsharpness-aware minimization (SAM) optimization and a Prototypical loss\\nfunction to improve the generalization ability of DNN for multivariate time\\nseries classification problems under few-shot setting. Our experiments\\ndemonstrate our proposed method outperforms the existing baseline methods. Our\\nsource code is available at: https://github.com/JRB9/COSCO.\",\"PeriodicalId\":501347,\"journal\":{\"name\":\"arXiv - CS - Neural and Evolutionary Computing\",\"volume\":\"18 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Neural and Evolutionary Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.09645\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Neural and Evolutionary Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.09645","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
COSCO: A Sharpness-Aware Training Framework for Few-shot Multivariate Time Series Classification
Multivariate time series classification is an important task with widespread
domains of applications. Recently, deep neural networks (DNN) have achieved
state-of-the-art performance in time series classification. However, they often
require large expert-labeled training datasets which can be infeasible in
practice. In few-shot settings, i.e. only a limited number of samples per class
are available in training data, DNNs show a significant drop in testing
accuracy and poor generalization ability. In this paper, we propose to address
these problems from an optimization and a loss function perspective.
Specifically, we propose a new learning framework named COSCO consisting of a
sharpness-aware minimization (SAM) optimization and a Prototypical loss
function to improve the generalization ability of DNN for multivariate time
series classification problems under few-shot setting. Our experiments
demonstrate our proposed method outperforms the existing baseline methods. Our
source code is available at: https://github.com/JRB9/COSCO.