logoalt Hacker News

epiccoleman • yesterday at 4:53 PM • 1 reply • view on HN

It's funny because - yes, it does seem like it should be that way. But I feel like a huge amount of the value I've gotten from LLMs has been specifically because I'm a generalist type and I can sort of quickly cut through the space of possibilities.

Just knowing what's possible, having been exposed to a bunch of ideas, libraries, tools, and, yes, reading too much Hacker News - seems like it's allowed me to ask good questions, propose interesting experiments, and drive my own knowledge forward faster with LLMs.

I don't know that it's a particularly unique skill, but from personal experience there seems to be a spectrum of ... creativity? Freedom of thought / expression? And people who are kinda stuck in their ways seem to get less out of LLMs than people who have some idea of what they want and even some direction in mind, but just need the details made frictionless.

I think I'm not doing the best job expressing what I'm on about, so here's an example - I have a little livecoding app[0], which I developed (vibe-coded) for a conference talk I gave in October[1]. It's been a lot of fun to play with and has formed a good surface for lots of different experiments that never made it into the codebase - just throwaway ideas, etc.

So when all the hype about Jev was going a month or two ago, my experiment was "can Jev sit in on the jam?" And what I did was hook it up to the app - not to the "musical context" information that other agents (agents in the Elixir sense, not really the 'llm agent' sense) in that app receive, but rather to the raw signal info that was coming out of the master audio node. And then Jev made a prediction about what note to play, and then that note was sent through WebMIDI to a VST on my machine so that Jev was almost like an outside "guy" soloing over the app's music.

(Jev was a pretty boring soloist, because playing the "most likely" note every time is not especially exciting, but that's beside the point here).

Maybe Claude / Codex could have come up with that idea without me - surely the models know about all of those different tools / options already. But I'd bet that if I hadn't known what to ask for, I'd have gotten something less fun.

So, idk. Does that mark me out as some kind of special generalist who will forever be ahead of the permanent underclass because he reads too much HN? Probably not. But it's at least a useful disposition in the LLM era.

[0]: https://github.com/epiccoleman/tripulator/ (AGPL, go nuts!)

[1]: https://epiccoleman.com/tripulator


Replies

mrandish • yesterday at 10:03 PM

> specifically because I'm a generalist type and I can sort of quickly cut through the space of possibilities.

I too have thought a lot about this because I've been able to get a lot of value out of lengthy, deep LLM sessions which bridge between domain exploration, research and ideation. A lot of the net value from the session isn't in the LLM's responses but in the notes I make as I'm spelunking different 'nodes in the knowledge graph' that I'm constructing, which is my own knowledge and understanding of a new, adjacent domain.

Working this way immediately felt comfortable to me because it mirrors the patterns I developed over a couple decades as a serial tech entrepreneur focused on identifying high-value customer problems which had been overlooked or insufficiently explored by others and then matching them to new technologies and processes to create a novel solution. Over the years, one pattern I found especially useful was hiring a university professor or grad student for a few hours of "Deep Q&A." My well-paid new academic friends often reported being exhausted afterward, with one describing it as "a high G-force, intensely non-linear Mr. Toad's Wild Ride" through his domain. Over years of doing this, I got pretty good at intuiting what I need to know, don't need to know and how to surface, then hone in on the boundaries and edge cases likely to yield whatever discontinuity I was intuitively sniffing out.

An entrepreneurship professor once asked to do a couple 'ride-alongs' to understand my "process" (though I've never called it that). His case study described it as "akin to an ADHD truffle pig unearthing raw, unrefined nuggets of economic opportunity". A key take-away was that nearly the entire value from the "process" was successively approximating down to the exact right "interesting question", far more than in any particular answer.

The nice thing about LLMs vs PhDs and grad students, is they're not unsettled when I hard-stop and reverse direction like an NFL running back or stall out retracing over the same seemingly barren patch until I 'pick up the signal' again and then go rocketing off in a different direction. To be clear, LLMs are not anywhere close to being a full replacement for the unique value my best human spelunking guides provide and I haven't yet seen any sign LLMs are improving in ways that will close that particular gap anytime soon (though they are improving in many other ways). I think the difference is the human domain experts have a degree of deep understanding with unbroken conceptual continuity from first principles all the way up the stack combined with a complete World Model. They can make insightful connections between concepts more than one or two degrees of separation apart (both vertically within a domain's 'abstraction stack' and horizontally across domains) in ways LLMs don't, except by widening their randomness thresholds which I've never found to be productive.

While an LLM's near-perfect recall of a vast web of statistically weighted, taxonomically-related facts along with incredible speed and infinite patience are super valuable, they're not a replacement for my domain expert human guides. For my needs, LLMs do provide around half the value of humans in this role, while being much cheaper with no vetting, introductions, appointments or breaks required. So, I'm using both in separate sessions - though an LLM able to fully track and engage both visually and verbally in a high-velocity, collaborative human brainstorm without being a 'third-wheel' would be an interesting design target for enterprising AI startup.

In short, I don't think you're wrong. There's real skill and unique value in being able to do, whatever it is I'm describing, consistently well - whether with a human or with an LLM.

➕ show 1 reply