How many users can you serve with that?
For the H200, between 150-700. The GB200 gets you something like 2-10k users.
alt Hacker News
For the H200, between 150-700. The GB200 gets you something like 2-10k users.