Any idea what kind of vram is needed to run this on Nvidia?
The Python process peaks at about 15 GB, so maybe a 24 GB GPU works. But others seem to have problems wih Nvidia: https://github.com/apple/ml-sharp/issues/84
The smallest Nvidia gpu I've run Sharp on is an Nvidia T4 which I think has 16 GB on the chip
It runs natively on the Photos app in Vision Pro, which shares 16GB of ram with GPU and CPU.