In my personal opinion as well "specialized enough" chips are exactly the right way to go - though disclaimer, also At Nvidia, working on spec dec/external drafts :)
With things like https://developer.nvidia.com/blog/co-designing-ai-models-usi... you can specialize one chip for decode/drafting, and the other for prefill and draft verification.