alt Hacker NewsI get some appeal of running locally, but isn't it just easier to rent cloud hardware and run whatever model you want to run?
I get some appeal of running locally, but isn't it just easier to rent cloud hardware and run whatever model you want to run?
There's certainly a mental difference between a computer you can use as much as you want for a fixed upfront cost vs a rented server you are being billed by the hour for.
But the cost difference between api and self hosted is so incredibly large now it's almost impossible to ignore the fact self hosting is a terrible deal. I'm waiting things out until the dust settles on what the required specs are and consumer hardware gets cheaper/more capable.