logoalt Hacker News

WillAdams • yesterday at 1:01 PM • 3 replies • view on HN

Can it though? I automated one aspect of my day job and promptly ran into upload limits.

When I found and configured a local LLM to handle files, it took 6 min. 45 seconds to process two files --- I need to handle almost 5,000 in Q4.


Replies

wtetzner • yesterday at 2:05 PM

I don't get it. Were you uploading files to a server to process them? Couldn't you run a local process to do it (which is, I assume, how the LLM got around the upload issues)?

➕ show 1 reply
kaashif • yesterday at 3:49 PM

To answer the question, we need to know something, anything about the tasks you automated.

If the task is filling in tax forms from a spreadsheet then yeah, you can ask an LLM to write a script for that.

If the task is proving thousands of math theorems or the task is translating specs into working software, then yeah, I guess you do need an LLM.

➕ show 1 reply
IX-103 • yesterday at 5:11 PM

In most cases you should have the LLM write a program to process the files instead of feeding them to the LLM itself.

➕ show 1 reply