alt Hacker News"Running your own infra" also includes managed infra like Bedrock, Foundry, etc.
Not just your local machines.
Enterprises are where you see this adoption. Legal, finance, tax; sensitive context where the data must be contractually opaque to external parties.
Precisely. I have figured out a nice recipe that is quite affordable, 288G of VRAM for a little under 20K, it takes some fiddling though, but once it works it is really neat.
PCIe is incredibly powerful tech.