What is the current SOTA for impainting?
I have a potential project for my e-commerce where I want to allow users to upload images of their house exteriors and impaint awnings.
Proprietary? Either gpt-image-2 or NB2.
I have an example of interior decorating inpainting where I replaced a large floor-to-ceiling window with a mirror, and the result was pretty impressive using NB Pro from nearly a year ago.
Locally hostable? For my money I'd argue Flux.2 Klein but Qwen-Edit still puts in the work.
flux klein with LoRa. GPT image and nano often produce high frequency artifacts when editing.
Awnings, if I understand correctly (I just learned this word right now), are purely additive attachments to structure exteriors - so perhaps they wouldn't necessarily need a full inpainting model? Wouldn't it be enough to estimate an affine transform for a quad and blend the image of awning directly (and the same with shadow map to fake shade)? Is classical photogrammetry up to such task these days?