ControlNet Inpainting for SDXL

[ajkrish95]

Currently we don't seem to have an ControlNet inpainting model for SD XL. Similar to the this - #1143 - are we planning to have a ControlNet Inpaint model?

[F0xbite]

Yes! I am deeply missing the Inpaint model when using XL. Hopefully we will see one. 🙏

[chlowden]

I too am looking for an inpaint SDXL model. Is there a particular reason why it does not seem to exist when other controlnets have been developed for SDXL? Or there a more modern technique that has replaced inpainting? Thank you

[JetsprintRacer]

Well... Fooocus, which is SDXL only WebUI, has built-in Inpainter, which works the same way as ControlNet Inpainting does with some bonus features.

[chlowden]

Thankyou for introducing me to Fooocus. It looks very interesting. But I'm looking for SDXL inpaint to upgrade a video comfyui workflow that works in SD 1.5 at the moment.

[Lalimec]

any news on this?

[2blackbar]

Yes it does work in fooocus and in sd forge, it does NOT work in auto11 , just download the patch file from here https://huggingface.co/lllyasviel/fooocus_inpaint/tree/main get inpaint_v26.fooocus.patch from the link i pasted and use it like normal controlnet model, tested it and works in forge.
Would be nice to have it in auto11 as well but it does not work so far.

[LucianoDaluz]

How to download this

[LeF0URBE]

@LucianoDaluz https://huggingface.co/lllyasviel/fooocus_inpaint/tree/main
like any other model on hugging face, there is a little download button on each model lines (in "files and version")

[vkleinmp]

Could you please elaborate how to use it in Forge? I've tried it as controllnet with inpainting, with and without inpaint preprocessor, tried all filling methods in inpaint.

[FruitPigFoot]

y'all tried controlnet inpaint with fooocus model and canny sdxl model at once? When i try using them both in txt2img, the result seems to show that it's not properly using inpaint mask that i gave(both when given mask image or drawing). Am i the only one experiencing this?

[roxmay]

First of all. Many thanks for the work !
I would also love a ControlNet Inpaint model ❤️

[zero41120]

The code commit on a1111 indicates that SDXL Inpainting is now supported. You can find more details here: a1111 Code Commit.