I do basically the same. Have multiple Docker sandboxes where I let agents yolo.

Must say I don't really love the setup. The workflow is not as frictionless as just opening Claude Code used to be.