INDUCING FUZZY REGRESSION TREE FORESTS USING ARTIFICIAL IMMUNE SYSTEMS

Fuzzy decision forests aim to improve the predictive power of single fuzzy decision trees by allowing multiple views of the same domain to be modelled. Such forests have been successfully created for classification problems where the outcome field is discrete; however predicting a continuous output value is more challenging in combining the output from multiple fuzzy decision trees. This paper presents a new approach to creating fuzzy regression tree forests based upon the induction of multiple fuzzy regression decision trees from one training sample, where each tree will represent a different view of the data domain. The singular fuzzy regression trees are induced using a proven algorithm known as Elgasir which fuzzifies crisp CHAID decision trees using trapezoidal membership functions for fuzzification and applies Takagi-Sugeno inference to obtain the final predicted values. A modified version of Artificial Immune System Network model (opt-aiNet) is then used for the simultaneous optimization of the membership functions across all trees within the forest. A strength of the proposed method is that data does not require fuzzification before forest induction this reducing pre-processing time and the need for subjective human experts. Five problem sets from the UCI repository and KEEL repository are used to evaluate the approach. The experimental results have shown that fuzzy regression tree forests reduce the error rate compared with single fuzzy regression trees.