vault backup: 2026-04-30 22:27:06

2026-04-30 22:27:06 -04:00
parent f1818ee578
commit f7c50ed0d2
59 changed files with 3099 additions and 180 deletions
@@ -0,0 +1,16 @@
+---
+title: Information
+tags: []
+---
+# Information
+
+[**information entropy**](https://en.wikipedia.org/wiki/Entropy_(information_theory))
+is the expected value of [self-information](https://en.wikipedia.org/wiki/Information_content)
+of a random variable:
+the expected reduction of uncertainty
+when a value of the random variable is revealed.
+
+[units of information](https://en.wikipedia.org/wiki/Units_of_information):
+* [**natural unit of information** (symbol **nat**)](https://en.wikipedia.org/wiki/Nat_(unit))
+* [**hartley** (symbol **Hart**)](https://en.wikipedia.org/wiki/Hartley_(unit))
+* [**shannon** (symbol **Sh**)](https://en.wikipedia.org/wiki/Shannon_(unit))