alt Hacker NewsI run DSv4 Flash at home on 2 DGX Sparks and am pretty sure there is no more cost effective way for me to do so. I'm not interested in running smaller models.
I run DSv4 Flash at home on 2 DGX Sparks and am pretty sure there is no more cost effective way for me to do so. I'm not interested in running smaller models.
What's the tokens/sec you're getting on that setup (genuinely curious because it's a setup I haven't actually run myself)?