alt Hacker News> it's only as hard as building a PC
I asked an AI agent to setup local AI inference for me. I gave it my use cases. It downloaded all the required bits, installed and configured them. Benchmarked different settings and models for my hardware and my use cases and then produced a nice report with findings and recommendations.
It is significantly easier than building a PC.
That's awesome. One warning for others following that route - due to training data cutoffs, and how fast things are moving, claude/chatgpt tend to have very out of date info about what models can be run and what hardware / software is required. Depending on how you ask it to solve the problem, they can lead you astray.
A quick gut check would be to look at the model release date. If it's older than the training cutoff for whatever you used, that's probably not the best thing you could be running.