Summary: Information Theoretic
Analysis: Basics and
Application
By: Adel S. El-Atawy
2
Entropy:
- Randomness
- Uncertainty
- Unexpectedness
- Maximum Achievable Information
- Transferable Energy of a System (related to)
Statistical Form
(Shannon)
Entropy
Algorithmic Form
(Kolmogorov)
3
Applications of Entropy Estimation:
Examples:
Data Complexity Analysis (e.g., intelligent form of life vs.

Source: Al-Shaer, Ehab - School of Computer Science, Telecommunications and Information Systems, DePaul University

Collections: Computer Technologies and Information Sciences