Bias reduction of the nearest neighbor entropy estimator

Abstract

A new family of entropy estimators, constructed as a linear combination (weighted average) of nearest neighbor estimators with slightly different individual properties, is proposed. It is shown that a special sub-optimal selection of the coefficients in the linear combination results in a reduction of the estimatorpsilas bias. Computer simulation results are provided.