Quite fascinating, but I don't really know much about probability and that would have helped out a great deal. I have a book on probability, so perhaps I will read that next.

This book expands on the Information Theory proposed by Claude Shannon in 1948 with his Mathematical Theory of Information. Covers some proofs and goes into further depth than Shannon did with it. Contains problems and solutions in the back, along with an appendix that explains some stuff about Hilbert spaces. ( )