Add Qwen-Image-Edit Inpainting pipeline #12225

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

yiyixuxu merged 10 commits into huggingface:main from Trgtuan10:qwen-image

Aug 31, 2025

Merged

Add Qwen-Image-Edit Inpainting pipeline #12225

yiyixuxu merged 10 commits into huggingface:main from Trgtuan10:qwen-image

Aug 31, 2025

+1,133 −0

Conversation

Trgtuan10

Copy link

Contributor

@Trgtuan10 Trgtuan10 commented Aug 23, 2025 •

edited

Loading

What does this PR do?

This PR introduces support for the Qwen-Image-Edit model in Inpainting tasks, expanding the model’s creative capabilities and integration within the Diffusers library.

Example code

import torch
from diffusers import QwenImageEditInpaintPipeline
from diffusers.utils import load_image
import os
os.environ["HF_ENABLE_PARALLEL_LOADING"] = "YES"
pipe = QwenImageEditInpaintPipeline.from_pretrained("Qwen/Qwen-Image-Edit", torch_dtype=torch.bfloat16)
pipe.to("cuda")
prompt = "change the hat to red"
negative_prompt = " "
source = load_image("https://github.com/Trgtuan10/Image_storage/blob/main/cute_cat.png?raw=true")
mask = load_image("https://github.com/Trgtuan10/Image_storage/blob/main/mask_cat.png?raw=true")
image = pipe(
 prompt=prompt,
 negative_prompt=negative_prompt,
 image=source,
 mask_image=mask,
 strength=1.0,
 num_inference_steps=35,
 true_cfg_scale=4.0,
 generator=torch.Generator(device="cuda").manual_seed(422)
).images[0]
image.save(f"qwen_inpainting.png")

Comparison about performance of QwenImage-Edit Inpaint

Init image
Mask

QwenImage Inpaint
QwenImage-Edit
QwenImage-Edit Inpaint

Who can review?

Pipelines and pipeline callbacks: @yiyixuxu and @asomoza

cc @a-r-r-o-w @sayakpaul

"Trgtuan10" and others added 2 commits

August 23, 2025 08:41


 add qwenimage-edit inpaint feature

@Trgtuan10


 Merge branch 'main' into qwen-image

72dc221

@sayakpaul sayakpaul requested review from asomoza and yiyixuxu

August 23, 2025 15:57

@sayakpaul

Copy link

Member

sayakpaul commented Aug 23, 2025

Cc: @naykun as well.

@naykun

Copy link

Contributor

naykun commented Aug 24, 2025

Hi @Trgtuan10 , that would be an amazing feature! It seems to preserve details better than the current QwenImageInpaintPipeline—great improvement!

I’ll dive in and run some more extensive tests on this PR shortly. Thanks so much for your contribution, and for helping push this forward! 🙌

@TuanNT-ZenAI

Copy link

Contributor

TuanNT-ZenAI commented Aug 24, 2025

Thanks @naykun! Please feel free to test it out and let me know if you run into any issues.

@TuanNT-ZenAI

Copy link

Contributor

TuanNT-ZenAI commented Aug 27, 2025

Hi @naykun @sayakpaul, have you tested it yet? I'd appreciate any feedback or reviews!

@naykun

Copy link

Contributor

@Trgtuan10 I've tested it, and things are working well overall. This approach shows promise for handling complex editing scenarios while keeping the rest of the content unchanged. There are a few unstable cases where instructions don't always take effect, but I believe we can mitigate those with better prompts and strategic masking. I suggest we move forward with this PR.
cc @sayakpaul @yiyixuxu

sayakpaul

sayakpaul reviewed

Aug 27, 2025

View reviewed changes

Copy link

Member

@sayakpaul sayakpaul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this! I have two minor comments.

I think we should also add tests and docs. Thanks to @naykun for running the tests as well.

src/diffusers/pipelines/qwenimage/pipeline_qwenimage_edit_inpaint.py Show resolved Hide resolved

src/diffusers/pipelines/qwenimage/pipeline_qwenimage_edit_inpaint.py Outdated Show resolved Hide resolved

yiyixuxu

yiyixuxu approved these changes

Aug 27, 2025

View reviewed changes

Copy link

Collaborator

@yiyixuxu yiyixuxu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thank you for your PR!!
left some very small comments about #Copied from

src/diffusers/pipelines/qwenimage/pipeline_qwenimage_edit_inpaint.py Show resolved Hide resolved

TuanNT-ZenAI added 2 commits

August 28, 2025 16:48

@TuanNT-ZenAI


 stay up to date with main branch

4a8ccd7

@TuanNT-ZenAI


 Merge branch 'qwen-image' of https://github.com/Trgtuan10/diffusers i...

4a7b1c1

...nto qwen-image

@Trgtuan10

Copy link

Contributor Author

Trgtuan10 commented Aug 28, 2025

Thanks for the reviews @sayakpaul @yiyixuxu. I’ve updated the code to stay up to date with the latest changes from the main branch. Please check it again.

@yiyixuxu

Copy link

Collaborator

yiyixuxu commented Aug 30, 2025

@bot /style

@github-actions GitHub Actions

Copy link

Contributor

github-actions bot commented Aug 30, 2025

Style fix is beginning .... View the workflow run here.

@HuggingFaceDocBuilderDev

Copy link

HuggingFaceDocBuilderDev commented Aug 30, 2025

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.