Uncertainty Measure-Based Incremental Feature Selection For Hierarchical Classification

Abstract

In the era of big data, there exist complex structure between different classes labels. Hierarchical structure, among others, has become a representative one, which is mathematically depicted as a tree-like structure or directed acyclic graph. Most studies in the literature focus on static feature selection in hierarchical information system. In this study, in order to solve the incremental feature selection problem of hierarchical classification in a dynamic environment, we develop two incremental algorithms for this purpose (IHFSGR-1 and IHFSGR-2 for short). As a preliminary step, we propose a new uncertainty measure to quantify the amount of information contained in the hierarchical classification system, and based on this, we develop a non-incremental hierarchical feature selection algorithm. Next, we investigate the updating mechanism of this uncertainty measure upon the arrival of samples, and propose two strategies for adding and deleting features, leading to the development of two incremental algorithms. Finally, we conduct some comparative experiments with several non-incremental algorithms. The experimental results suggest that compared with several non-incremental algorithms, our incremental algorithms can achieve better performance in terms of the classification accuracy and two hierarchical evaluation metrics, and can significantly accelerate the fuzzy rough set-based hierarchical feature selection.