The level of uncertainty/information associated with a random variable ‘s possible states. It tells us how much information we are missing about random variable . Or in other words, how much information we gain by finding the exact value of
The level of uncertainty/information associated with a random variable X‘s possible states. It tells us how much information we are missing about random variable X. Or in other words, how much information we gain by finding the exact value of X