alt Hacker NewsRunning a local llm at 10 t/s overnight to extract data from a few PDFs will burn more in electricity than paying cents for the hosted kimi models.
You can (sometimes) break even if you have a workstation GPU.
Running a local llm at 10 t/s overnight to extract data from a few PDFs will burn more in electricity than paying cents for the hosted kimi models.
You can (sometimes) break even if you have a workstation GPU.
Sometimes data privacy is paramount.