Adaptive Incremental Broad Learning System Based on Interval Type-2 Fuzzy Set With Automatic Determination of Hyperparameters

Abstract

The fuzzy broad learning system (FBLS) has received increasing attention due to its ability to quickly train from broad learning systems (BLS) and interpretability with fuzzy inference. However, the randomness of BLS brings instability to the training performance of the model, so the hyperparameters of the model are crucial for its performance. Currently, many FBLS use grid search to determine hyperparameters. However, grid search brings longer search time and the parameters obtained have randomness, which may not necessarily be the optimal hyperparameters. In response to these challenges, this paper proposes a fuzzy broad learning system with automatic determination of hyperparameters (ADHFBLS). We construct a novel FBLS based on the interval type-2 fuzzy set and design an incremental learning algorithm for rules and enhancement nodes to support rapid model expansion. Meanwhile, a heuristic hyperparameter automatic optimization algorithm is designed to overcome the randomness and long optimization time of grid search. Experiments have shown that ADHFBLS has higher accuracy and shorter model tuning time compared to some state-of-the-art models based on FBLS.