> Early LLM models would spit out my code almost verbatim. Modern systems borrow heavily on the creative design of those systems.
Do you have some specific, actual examples you can share?
I’ve been hearing this exact claim for years, but every time I ask for a specific example, any example at all, I can’t seem to find anything more than a highly generic snippet of code or a coerced continuation.
Emailed the author of the Rust book Zero to Production a year or so ago about how his examples were being used verbatim in the output of AI systems. I own the book, yet I could inadvertently get any of its examples just by asking an AI about one of the book's concepts.
He basically said, "I know, there's nothing I can do."
Thats pretty much everywhere or was in raw form in the beginning. I used to do a fun exercise of searching for the explicit human comments for verification. Comments can be considered novel and unique, so you pick up some comment from popular open source project and then describe LLM for a similar functionality and add part of the comment. The response would have the complete comment for almost 70% of the time.
As far as I'm concerned, a coerced continuation is sufficiently a smoking gun.
> I can’t seem to find anything more than a highly generic snippet of code or a coerced continuation.
You’re disqualifying any example that people may provide preemptively. No wonder you’ve missed them.
I posted below, but see the example at [0].
This is a sparse matrix library, IIRC. Numerical linear algebra and applications using it are black art at this point. I have written a Boundary Element Method evaluator for my Ph.D., and know what it entails to work with these things.
Doing fast operations on sparse matrices is a cutthroat race and when you can shave your hot path by seconds, your solution can save hours in some cases. So, it's an interesting niche. i.e.: It's no ordinary boilerplate, and worthy of publications in academia.
While I worked with dense matrices; the effect, difficulty, blood sweat and tears are still there.
When a model can give back your hard work back to you with a "completion" without attribution, that's bad.
Edit: Somebody just posted this below [1]. Added here so it doesn't get lost as the discussion grows bigger.
[0]: https://x.com/docsparse/status/1581461734665367554
[1]: https://news.ycombinator.com/item?id=50509252