logoalt Hacker News

trollbridge • yesterday at 8:16 PM • 0 replies • view on HN

Works fine if you want to run Qwen, etc. or do OCR stuff.

I really only have it for data locality - some customers simply don’t have approval for me to share data from their customers with random cloud inference providers. I also use Bedrock for that but it’s expensive