Just set up a build server and have your docker containers fetch prebuilt binaries from that?