logoalt Hacker News

hedgehogtoday at 6:22 PM1 replyview on HN

Same, I have one workload where on 3.6 drafting 6 tokens is the fastest setting.


Replies

hypfertoday at 6:27 PM

I wonder if we could take a page out of the Solar power book and do MPPT but for draft count. Constantly sweep through possible values to find the best result for the current conditions.

Though it might turn out that that doesn't offer any benefits. Has it been tried yet?

___

EDIT:

LLM pointed me towards this thing I'm not going to read

https://arxiv.org/abs/2512.11280

"AdaSD: Adaptive Speculative Decoding for Efficient Language Model Inference"

Some higher level nerd please go have a look at that. I have important meetings and golf classes to attend.

show 2 replies