Relevant old school compression benchmarks where people have been using different models (incl. transformers) for compression: https://www.mattmahoney.net/dc/text.html

Also interesting the top entry is from fabrice bellard: https://bellard.org/nncp/nncp.pdf