Biyun Sheng, Rui Han, Fu Xiao, Zhengxin Guo, Linqing Gui
{"title":"MetaFormer","authors":"Biyun Sheng, Rui Han, Fu Xiao, Zhengxin Guo, Linqing Gui","doi":"10.1145/3643550","DOIUrl":null,"url":null,"abstract":"WiFi based action recognition has attracted increasing attentions due to its convenience and universality in real-world applications, whereas the domain dependency leads to poor generalization ability towards new sensing environments or subjects. The majority of existing solutions fail to sufficiently extract action-related features from WiFi signals. Moreover, they are unable to make full use of the target data with only the labelled samples taken into consideration. To cope with these issues, we propose a WiFi-based sensing system, MetaFormer, which can effectively recognize actions from unseen domains with only one labelled target sample per category. Specifically, MetaFormer achieves this by firstly constructing a novel spatial-temporal transformer feature extraction structure with dense-sparse input named DS-STT to capture action primary and affiliated movements. It then designs Meta-teacher framework which meta-pre-trains source tasks and updates model parameters by dynamic pseudo label enhancement to bridge the relationship among the labelled and unlabelled target samples. In order to validate the performance of MetaFormer, we conduct comprehensive evaluations on SignFi, Widar and Wiar datasets and achieve superior performances under the one-shot case.","PeriodicalId":3,"journal":{"name":"ACS Applied Electronic Materials","volume":"137 43","pages":""},"PeriodicalIF":4.3000,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Electronic Materials","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3643550","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
WiFi based action recognition has attracted increasing attentions due to its convenience and universality in real-world applications, whereas the domain dependency leads to poor generalization ability towards new sensing environments or subjects. The majority of existing solutions fail to sufficiently extract action-related features from WiFi signals. Moreover, they are unable to make full use of the target data with only the labelled samples taken into consideration. To cope with these issues, we propose a WiFi-based sensing system, MetaFormer, which can effectively recognize actions from unseen domains with only one labelled target sample per category. Specifically, MetaFormer achieves this by firstly constructing a novel spatial-temporal transformer feature extraction structure with dense-sparse input named DS-STT to capture action primary and affiliated movements. It then designs Meta-teacher framework which meta-pre-trains source tasks and updates model parameters by dynamic pseudo label enhancement to bridge the relationship among the labelled and unlabelled target samples. In order to validate the performance of MetaFormer, we conduct comprehensive evaluations on SignFi, Widar and Wiar datasets and achieve superior performances under the one-shot case.
期刊介绍:
ACS Applied Electronic Materials is an interdisciplinary journal publishing original research covering all aspects of electronic materials. The journal is devoted to reports of new and original experimental and theoretical research of an applied nature that integrate knowledge in the areas of materials science, engineering, optics, physics, and chemistry into important applications of electronic materials. Sample research topics that span the journal's scope are inorganic, organic, ionic and polymeric materials with properties that include conducting, semiconducting, superconducting, insulating, dielectric, magnetic, optoelectronic, piezoelectric, ferroelectric and thermoelectric.
Indexed/Abstracted:
Web of Science SCIE
Scopus
CAS
INSPEC
Portico