A principal label space transformation and ridge regression-based hybrid gorilla troops optimization and jellyfish search algorithm for multi-label classification

Abstract

Classification as an essential part of Machine Learning and Data Mining has significant roles in engineering, medicine, agriculture, military, etc. With the evolution of data collection tools and the unceasing efforts of researchers, new datasets with huge dimensions are obtained so that each data sample has multiple labels. This kind of classification is called Multi-Class Classification (MLC) and demands new techniques to predict the set of labels for a data instance. To date, a variety of methods have been proposed to solve MLC problems. However, new high-dimensional datasets with challenging patterns are being developed, making it necessary for new research to be conducted to develop more efficient methods. This paper presents a novel framework named QLHA to solve MLC problems more efficiently. In the QLHA, the Principal Label Space Transformation (PLST) and Ridge Regression (RR) are recruited to predict the labels of data. Next, an effective objective function is introduced. Also, a hybrid metaheuristic algorithm called QGTOJS is provided to optimize objective value and enhance the predicted labels by selecting the most relevant features. In the QGTOJS, the Gorilla Troops Optimization (GTO) and Jellyfish Search algorithm (JS) are binarized and hybridized through a modified variant of the Q-learning algorithm. Besides, an adjusted Hill Climbing strategy is adopted to balance the exploration and exploitation and improve local optima departure. Likewise, a local search mechanism is provided to enhance searchability as much as possible. Eventually, the QLHA is applied to ten multi-label datasets and the obtained results are compared with heuristic and metaheuristic-based MLC methods numerically and visually. The experimental results disclosed the effectiveness of the contributions and superiority of the QLHA over competitors.