logoalt Hacker News

vessenes • today at 1:43 PM • 0 replies • view on HN

I like research notes, and I like reading what Dan is up to, always. That said, some helpful context to this post - Dan is working on some engineering questions -- how can we best use the tools we have, and how does that evolve?

His general test methods this year have been to provide a specification document of some sort and then prompt a clean room implementation of the spec, which can be tested against holdout tests.

Things move pretty quickly - this summer, his test was Zstd and results were at like 25-30% of tests passing at best. He now considers Zstd saturated, as is IMAP from RFC; pandoc is one that he's used throughout, and is not yet perfect.

With all that in mind, read away.