‘ I was reading about compression recently when I stumbled upon something crazy: that compressors and LLMs are, at their core, trying to solve the exact same problem.’

This reads as written by someone who just happened to understand what LLMs do, so I totally fail to understand how anything further said can have any real credibility…

As a matter of fact the best compression by Fabrice Bellard’s models have been achieved with NNs long before LLMs.

And also MP3 and MPEG in general are very apparent neural networks, yet not deep as in modern VLMs