For the H200, between 150-700. The GB200 gets you something like 2-10k users. | alt Hacker News

alt Hacker News

fragmede • yesterday at 6:06 AM • 1 reply • view on HN

For the H200, between 150-700. The GB200 gets you something like 2-10k users.

Replies

forrestthewoods • yesterday at 9:37 PM

Whoa. How on earth can one system serve 2000 potentially concurrent users?