Versus just packing all their needs and data into context, and RAG (i.e. context)?

Why isn’t this happening more already?

I honestly doubt this; very few companies have enough data. Maybe we could see mergers so it happens but basically it would mean everyone would need to be Google sized for it to work.