A Joint-Encoding Evolutionary Algorithm for Multimodal Multiobjective Feature Selection in Classification

Abstract

In multiobjective feature selection, different feature subsets with the same number of selected features can achieve identical classification accuracy, meaning that it is a multimodal optimization problem. To effectively search for multimodal feature subsets within the vast search spaces of high-dimensional datasets, it is crucial to adopt reasonable encoding and search methods. Generally, applying a uniform evolutionary operator based on a single encoding method across the entire feature space is inefficient and prone to falling into local optima. To address the above issues, this article proposes a multimodal multiobjective feature selection method based on a joint encoding mechanism that combines discrete encoding and continuous encoding. It provides new perspectives to solve the high-dimensional feature selection problem from encoding methods to search operators. First, the search space is divided into a discrete encoding region and a continuous encoding region based on the knee points of feature importance ranking curve. A tailored initialization strategy is used to obtain the initial population for joint encoding. Second, an adaptive niche strategy based on three priorities is proposed, which ensures the similarity of individuals within a niche and the difference between niches. In addition, different search operators are cooperated with the two encoding strategies, respectively, to achieve effective and efficient search. The experimental results on 24 datasets show that the proposed algorithm achieves a better-classification performance than the state-of-the-art feature selection methods.