A Joint-Entropy Approach To Time-series Classification

Abstract

In this paper, the problem of entropy-based classification of time-series into stochastic, chaotic, and periodic is addressed, followed by proposing an alternative joint-entropy approach to time series classification. These data-driven methods describe the behavior of a signal, using the association of the entropy of a time-series with emergence and self-organization, as complex systems characteristics. First, we deduce that certain groups of entropies, namely Fuzzy entropy, and Distribution entropy, share more similarities with emergence, while permutation and dispersion entropies could be associated with self-organization. Then, we utilize these resemblances to propose a joint-entropy alternative approach, in which one of the specific entropies is presented for each characteristic. Further, in simulations, we evaluated the performance of our proposed approach, comparing with single entropy methods, using different classifiers and decision boundaries. The results reveal an excellent performance of 98% accuracy for simultaneous utilization of the Distribution and Permutation entropies as the input features of Random Forest classifier, while this value is at best 89% for when only a single entropy is fed to the classifier.