So what we want now is unsloth (or anyone) to release 4/6-bit quantized models of these releases?
Yep, Unsloth already did, as linked in the comment at the top of this thread
alt Hacker News
Yep, Unsloth already did, as linked in the comment at the top of this thread