MS is actually moving in that direction. They have https://github.com/microsoft/agent-framework and https://learn.microsoft.com/en-us/agent-framework/integratio... which all aim to commoditize llms.