logoalt Hacker News

mike_hearnyesterday at 3:38 PM0 repliesview on HN

I think speculative decoding eliminates a lot of the savings people imagine they're getting from making LLMs use strange languages.