{"title":"Continuous Latent Adversarial Autoencoder: A Time-Sensitive Method for Incomplete Time-Series Modeling","authors":"Zhuoqing Chang;Shubo Liu;Zhaohui Cai;Guoqing Tu","doi":"10.1109/JIOT.2024.3501376","DOIUrl":null,"url":null,"abstract":"Incomplete time-series modeling is an unavoidable topic in real-world time-series analysis because of the frequent occurrence of missing values in practical data. However, integrating data preprocessing and subsequent analysis within a model can amplify the errors from processed values. Moreover, most existing methods that directly model incomplete time series often fail to infer values at any desired time or support multistep prediction. To address these issues, this article introduces a novel generative model called the continuous latent adversarial autoencoder (CLAAE) for directly modeling incomplete time series. CLAAE can effectively impute missing data of any time point and support multistep prediction. Specifically, CLAAE devises a time-aware long short-term memory (LSTM) encoder to extract temporal and sequential characteristics. The decoder is built upon the augmented neural ordinary differential equation (ANODE), allowing it to infer the probability of missing data across an arbitrary continuous-time horizon. To guarantee the meaningfulness of samples generated from any region within the prior space, a fully connected neural network is utilized as a discriminator, encouraging the aggregated posterior learned by the encoder to be indistinguishable from a selected prior distribution. Extensive experimental results across simulations and real-world datasets demonstrate that CLAAE outperforms baseline methods, especially when the amount of missing data is overwhelming. By combining the autoencoder and adversarial training, CLAAE can significantly enhance the quality of the synthetic samples, respecting the original feature distributions and the temporal dynamics.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 7","pages":"8552-8569"},"PeriodicalIF":8.9000,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10756546/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Incomplete time-series modeling is an unavoidable topic in real-world time-series analysis because of the frequent occurrence of missing values in practical data. However, integrating data preprocessing and subsequent analysis within a model can amplify the errors from processed values. Moreover, most existing methods that directly model incomplete time series often fail to infer values at any desired time or support multistep prediction. To address these issues, this article introduces a novel generative model called the continuous latent adversarial autoencoder (CLAAE) for directly modeling incomplete time series. CLAAE can effectively impute missing data of any time point and support multistep prediction. Specifically, CLAAE devises a time-aware long short-term memory (LSTM) encoder to extract temporal and sequential characteristics. The decoder is built upon the augmented neural ordinary differential equation (ANODE), allowing it to infer the probability of missing data across an arbitrary continuous-time horizon. To guarantee the meaningfulness of samples generated from any region within the prior space, a fully connected neural network is utilized as a discriminator, encouraging the aggregated posterior learned by the encoder to be indistinguishable from a selected prior distribution. Extensive experimental results across simulations and real-world datasets demonstrate that CLAAE outperforms baseline methods, especially when the amount of missing data is overwhelming. By combining the autoencoder and adversarial training, CLAAE can significantly enhance the quality of the synthetic samples, respecting the original feature distributions and the temporal dynamics.
期刊介绍:
The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.