logoalt Hacker News

abetuskyesterday at 8:49 PM0 repliesview on HN

I'm not sure I had a well formed question. I saw the post title, didn't get a clarification in the article and started searching.

The entropy rate seems like a pretty natural definition of "entropy of a Markov chain", no? It's not exactly this but it's similar to "start at state i, end on state j (maybe in n steps?), what is the number of bits I need to send over the wire to tell you what path was taken".

What does the entropy of the raw stationary distribution give you? Is the entropy rate related to the entropy of the stationary distribution (the thermodynamic entropy?)?