Also interesting: https://github.com/apple/ml-sharp
Apples model to generate Gaussian splats from a single image. Takes about 30 seconds on an M1 Pro.
It falls apart once you move too much, but for a little side-wiggling or a second-eye view for VR, it's great. And looks a lot better than the old approach of depth map + vertex shaders that I use in https://github.com/combatwombat/tiefling. But ml-sharp has 2.6 GB weights, a bit too big to run in the browser.
Any idea what kind of vram is needed to run this on Nvidia?
Is this thing the basis of what Apple is doing in the Photos app in the most recent OS revisions?
It seems to work a lot quicker than 30s now on iDevices and Macs.