The term entropy is used in information theory as a "measure of the uncertainty associated with a random variable" and refers to an axiom called the Shannon Entropy. The concept was introduced by ...