logoalt Hacker News

epiccoleman • yesterday at 11:37 PM • 0 replies • view on HN

Yeah, and I don't think it's just about being a generalist - obviously we know that programming "specialists" can do things with LLM-assisted coding that other people can't do.

But this:

>While an LLM's near-perfect recall of a vast web of statistically weighted, taxonomically-related facts along with incredible speed and infinite patience are super valuable, they're not a replacement for my domain expert human guides.

Really reads true to me - LLMs don't have a filter, they "know everything". So the value in the human is exactly the filter - they can kinda sieve through the mass of knowledge, weight what's important in context, and thereby extract something interesting from an LLM.

If I can get weird for a sec, there's something almost divinatory to LLMs when you're using them in this particular way - it's like a Tarot deck or I Ching or something, where you have this big collection of vague symbols (tarot) or "phrase" (i ching) that could almost mean anything. The human in that loop has to collate what subset of the symbols are interesting to the given situation. Without that filtering you just have this morass of information that doesn't necessarily get you anywhere, but when you're able to direct your attention to what's currently germane, you can get uncanny results!

(to be clear, I don't really think there's anything "magical" in any of these cases, but there's something to the metaphor!)