Jesus Barreda, Ashley Gomez, Ruben Puga, Kaixiong Zhou, Li Zhang
{"title":"COSCO: A Sharpness-Aware Training Framework for Few-shot Multivariate Time Series Classification","authors":"Jesus Barreda, Ashley Gomez, Ruben Puga, Kaixiong Zhou, Li Zhang","doi":"arxiv-2409.09645","DOIUrl":null,"url":null,"abstract":"Multivariate time series classification is an important task with widespread\ndomains of applications. Recently, deep neural networks (DNN) have achieved\nstate-of-the-art performance in time series classification. However, they often\nrequire large expert-labeled training datasets which can be infeasible in\npractice. In few-shot settings, i.e. only a limited number of samples per class\nare available in training data, DNNs show a significant drop in testing\naccuracy and poor generalization ability. In this paper, we propose to address\nthese problems from an optimization and a loss function perspective.\nSpecifically, we propose a new learning framework named COSCO consisting of a\nsharpness-aware minimization (SAM) optimization and a Prototypical loss\nfunction to improve the generalization ability of DNN for multivariate time\nseries classification problems under few-shot setting. Our experiments\ndemonstrate our proposed method outperforms the existing baseline methods. Our\nsource code is available at: https://github.com/JRB9/COSCO.","PeriodicalId":501347,"journal":{"name":"arXiv - CS - Neural and Evolutionary Computing","volume":"18 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Neural and Evolutionary Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.09645","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Multivariate time series classification is an important task with widespread
domains of applications. Recently, deep neural networks (DNN) have achieved
state-of-the-art performance in time series classification. However, they often
require large expert-labeled training datasets which can be infeasible in
practice. In few-shot settings, i.e. only a limited number of samples per class
are available in training data, DNNs show a significant drop in testing
accuracy and poor generalization ability. In this paper, we propose to address
these problems from an optimization and a loss function perspective.
Specifically, we propose a new learning framework named COSCO consisting of a
sharpness-aware minimization (SAM) optimization and a Prototypical loss
function to improve the generalization ability of DNN for multivariate time
series classification problems under few-shot setting. Our experiments
demonstrate our proposed method outperforms the existing baseline methods. Our
source code is available at: https://github.com/JRB9/COSCO.