Simpler (and faster): a single RTX Pro 6000 :)
Curious, do you find the 3.5 120B sized MoE works better than the dense 3.6 27B?
Hahaha well played! Hat tip
Curious, do you find the 3.5 120B sized MoE works better than the dense 3.6 27B?