You can cut out the middle man and use https://github.com/marxarelli/masse, a CUE frontend for BuildKit.
However I don’t think anything using BuildKit is as fine grained as Bazel.