How to use InstantX/Qwen-Image-ControlNet-Union with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("InstantX/Qwen-Image-ControlNet-Union", dtype=torch.bfloat16, device_map="cuda") prompt = "Turn this cat into a dog" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png") image = pipe(image=input_image, prompt=prompt).images[0]
Is it possible to use multiple controlnets in comfyui? What would be the work flow?
Before anyone else mentions something better. (ping me if someone does)I chained the two together. (Watch out for the memory.)
· Sign up or log in to comment