It would be more accurate to say that toolbx is based on Podman, but is intended to provide tight configuration with your user's outside environment.
If you want to use toolbx for more isolation you'll have to end up turn off a bunch of features and configuring it in weird ways that ultimately defeats the purpose of having toolbx in the first place....
It is a lot easier to just to cut out the middle man and use podman directly.
Fully agree, that's why my python script is ultimately just a simple wrapper for podman but it makes my life a lot easier anyway.