You can do this with libkrun. I use it as a podman backend which works exactly as you describe here.
podman run --rm -it --runtime=krun ubuntu sh
Error: default OCI runtime "krun" not found: invalid argument
Error: default OCI runtime "krun" not found: invalid argument