alt Hacker NewsWith current software you don't need those 6x RTX3090 anymore. With strata you get >50 t/s on Q4 on a single 5070Ti. And with 192GB RAM you can run Q6 without reducing speed too much.
With 6x3090 I'd most likely go for even bigger - DeepSeek?
With current software you don't need those 6x RTX3090 anymore. With strata you get >50 t/s on Q4 on a single 5070Ti. And with 192GB RAM you can run Q6 without reducing speed too much.
With 6x3090 I'd most likely go for even bigger - DeepSeek?