So the future is about replacing deterministic procedures with stochastic procedures?
On some level you are right, LLMs and the agents built with the various models and architectures will get cheaper. But there are some significant drawbacks by introducing this risk, regardless of cost. The future will need the capacity to understand this too.
Just as likely, as models and harnesses get better with memory, they will recognize the process of building and rebuilding the same tool to complete a task can be optimized by keeping the tool around and using it to deterministically complete the task instead.
This is the process of increasing efficiency today, automate manual processes to reduce human effort. Why wouldn’t models get better at this as well?