Recursive regression estimation based on the two-time-scale stochastic approximation method and Bernstein polynomials

Abstract In this paper, we propose a recursive estimators of the regression function based on the two-time-scale stochastic approximation algorithms and the Bernstein polynomials. We study the asymptotic properties of this estimators. We compare the proposed estimators with the classic regression estimator using the Bernstein polynomial defined by Tenbusch. Results showed that, our proposed recursive estimators can overcome the problem of the edges associated with kernel regression estimation with a compact support. The proposed recursive two-time-scale estimators are compared to the non-recursive estimator introduced by Tenbusch and the performance of the two estimators are illustrated via simulations as well as two real datasets.