There's a lot of code under the surface that you'll never know about unless you happen to need it. It will be really hard write a prompt that recreates all functionality.
And I agree that the assets are a big barrier. If you look at Logic Pro X (my tool): it needs some 80GB for the full install without getting anything else. And without other software, you can expand it with extra loops and sample packs. I guess the interface to those can be reverse-engineered, but even that's a barrier.
I think a one-shot (if that's what you're suggesting) clone is somewhat unrealistic. I agree with you.
On the other hand, refining/tweaking over time may get you closer. I'm quite far down this road, having created a DAW of my own flavor.
It's absolutely not perfect, nor is it a production-level app or even clone, but I trust it for electronic music production because it, like many other programs, does the basics well.
That's another point worth making about the assets. They're a barrier as someone builds them over time. You might have 2000 (example) custom presets and audio file alterations in Ableton and use them as your "sound" as a producer.
Thinking names like Kaskade, Deadmau5, etc. Plenty of others.
Going back to the code, reverb is the example that illuminates the difficulty of cloning in my day-to-day. Sometimes quite explicit in songs, and sometimes hiding just enough in the background. But IMO - stands out immediately when it sounds "off" as I lack a better description.
Anyhow, here's my song from my DAW in case you're curious! Note that it's not mastered so you'll need to crank your volume somewhat.
>There's a lot of code under the surface that you'll never know about unless you happen to need it.
Oh I'm sure - but that's not the weakness of an LLM. An LLM can handle all sorts of complicated signal processing.
It cannot reproduce the sound of a 808. And if you give it a benchmark and a candidate it cannot hear the difference in a meaningful way nor determine if it sounds "good." It cannot do it. Only a person with extensive domain experience can.