And guess what all the providers of open models do: They quantize, badly.
This is why you pay premium for trusted providers, who are verified to not quantize
alt Hacker News
This is why you pay premium for trusted providers, who are verified to not quantize