Shannon’s entropy and its bounds for some a priori known equiprobable states

Abstract

It is known that Shannon’s entropy is nonnegative and its maximum value is reached for equiprobable events. Adding or removing impossible events does not affect Shannon’s entropy. However, if we increase the number of events and consider not necessarily all of them equiprobable, but at least as many of them as the initial number of equiprobable events, how does Shannon’s entropy change? We study the lower bound of the interval where the probability value of the a priori assumed equiprobable states must belong when the entropy increases.