I wonder how big you could say my friend Larry's "context" memory is. He's the long-time architect of a big, complex, international micro-services based system.

I'm guessing that when he goes to debug a complex problem that spans across multiple systems for his app, his brain is paging through the equivalent of a well-written 3GiB markdown design document file.

And my opinion is, yes, pretty soon SOTAs will be able to be that guy, if we are willing to hand that much control to an AI. But I sure hope we don't--it seems like way too much power for an AI. However: Larry sitting next to Fable working together? A team like that could change the world. I hope he's digging in to Claude or something, I'll have to give him a call.