zmVault/information.md

title, tags

title	tags
Information

Information

information entropy is the expected value of self-information of a random variable: the expected reduction of uncertainty when a value of the random variable is revealed.

units of information:

• natural unit of information (symbol nat)
• hartley (symbol Hart)
• shannon (symbol Sh)