logoalt Hacker News

epolanskitoday at 3:33 PM3 repliesview on HN

What is the current SOTA for impainting?

I have a potential project for my e-commerce where I want to allow users to upload images of their house exteriors and impaint awnings.


Replies

TeMPOraLtoday at 4:56 PM

Awnings, if I understand correctly (I just learned this word right now), are purely additive attachments to structure exteriors - so perhaps they wouldn't necessarily need a full inpainting model? Wouldn't it be enough to estimate an affine transform for a quad and blend the image of awning directly (and the same with shadow map to fake shade)? Is classical photogrammetry up to such task these days?

show 2 replies
vunderbatoday at 3:59 PM

Proprietary? Either gpt-image-2 or NB2.

I have an example of interior decorating inpainting where I replaced a large floor-to-ceiling window with a mirror, and the result was pretty impressive using NB Pro from nearly a year ago.

https://imgpb.com/ZXkiXV

Locally hostable? For my money I'd argue Flux.2 Klein but Qwen-Edit still puts in the work.

show 3 replies
BoredPositrontoday at 4:38 PM

flux klein with LoRa. GPT image and nano often produce high frequency artifacts when editing.