LMS is H/sup /spl infin// optimal

Abstract

Shows that the celebrated LMS (least-mean squares) adaptive algorithm is an H/sup /spl infin// optimal filter. In other words, the LMS algorithm, which has long been regarded as an approximate least-mean squares solution, is in fact a minimizer of the H/sup /spl infin// error norm. In particular, the LMS minimizes the energy gain from the disturbances to the predicted errors, while the normalized LMS minimizes the energy gain from the disturbances to the filtered errors. Moreover, since these algorithms are central H/sup /spl infin// filters, they are also risk-sensitive optimal and minimize a certain exponential cost function. The authors discuss various implications of these results, and show how they provide theoretical justification for the widely observed excellent robustness properties of the LMS filter.<>