alt Hacker NewsTried again with a different quant, UD-Q2_K_XL:
https://tools.simonwillison.net/markdown-svg-renderer#url=ht...
Replies
potus_kushner • yesterday at 10:18 PM
the xhigh version looks amazingly good for a 2 bit quant.
Tried again with a different quant, UD-Q2_K_XL:
https://tools.simonwillison.net/markdown-svg-renderer#url=ht...
the xhigh version looks amazingly good for a 2 bit quant.
... and once more with UD-IQ4_XS
https://tools.simonwillison.net/markdown-svg-renderer#url=ht...