> I suddenly imagine a zip format with built-in git. Does this already exist?

OSTree, SQLite (single file DB), OCIRepository, git bundle. But it depends if you rather need code diffs or just versioning of large binary blobs (an image editor needs the latter).