alt Hacker Newsengineering effort to make something 1000x faster that accounts for 0.1% of total runtime is the most software developer thing imaginable
Replies
michaelmior • today at 8:25 PM
This depends on what your workflow is. There are use cases for tokenization that don't always involve immediately feeding the text into a model.
alansaber • today at 8:26 PM
It's pretty funny but then again, why not if it's as trivial to simplify as it appears
"The pursuit of excellence does not need justification."
https://x.com/mitchellh/status/2074225453217505494