alt Hacker NewsI'm hoping that hosting providers such as Hetzner will soon offer inference at reasonable prices and hosted in the EU with this kind of framework.
I'm hoping that hosting providers such as Hetzner will soon offer inference at reasonable prices and hosted in the EU with this kind of framework.
They are definitely experimenting with inference, see https://experiments.hetzner.com/ (needs login).