Lately I’ve been hanging out on Physics Stack Exchange, a question-and-answer site for physicists and people interested in physics. Someone asked a question recently about the relationship between thermodynamics and a quantity from information theory. It lead me to quite an interesting result, which I think is new.
The relationship between probability and information is interesting and fun. The table below is a work in progress, but I think it’s kind of cool already. The idea is to compare information quantities with the probabilities of unlikely events. For instance, if I flipped a coin for every bit on my hard drive and they all came up heads, it would be pretty unlikely. But what else would be that improbable?