logoalt Hacker News

danielbln • yesterday at 6:18 PM • 1 reply • view on HN

A3B is especially nice, MoE really shines on memory bandwidth contained platforms like the DGX Spark.

Replies

verdverm • yesterday at 9:26 PM

looks like MTP support has now been merged and also updated unsloth quants to go with it (not just the extras, all of 'em!)