logoalt Hacker News

pellatoday at 11:19 AM2 repliesview on HN

The future may be ~ AI-assisted format detection + OpenZL

(~ OpenZL-AI-LLM recognises the data structure, then guides OpenZL toward the best lossless compression path )


Replies

pellatoday at 3:17 PM

  "The unreasonable effectiveness of our first foray into training leads us to believe that the graph model is uniquely  positioned to facilitate ML-guided generation of compressors. We are tempted to view this as “the next big thing” in production-scale compression. Whereas compression research has up to now eluded those without domain expertise, we believe the future of application-specific compressors will be unlocked via investment in automated learning methods."
https://arxiv.org/abs/2605.09928 [11 May 2026] OpenZL: Using Graphs to Compress Smaller and Faster
mike_hocktoday at 2:56 PM

1. Upload data using conventional compression method (or uncompressed)

2. Spend orders of magnitude (literally) more on compute to run the LLM on the data than any compression algorithm would ever take.

show 1 reply