Spaces:
Running
on
Zero
Running
on
Zero
Could you please tell me how much VRAM
#4
by
allen666
- opened
Could you please tell me how much VRAM is required locally for this application to run normally? Thank you
1024×1024, 8 steps, bfloat16
➡12-16GB or more required.
If it is less than 12GB, the image size should be less than 512x512.
16GB VRAM (e.g., RTX 3090, A6000, 4080, 4090, A100 40GB)
12GB VRAM (very close to the limit) (e.g., RTX 3060 12GB, 4070Ti)
optimization
optimize_pipeline_(pipe, image=Image.new("RGB", (1024, 1024)), prompt="prompt")
👇
optimize_pipeline_(pipe, image=Image.new("RGB", (512, 512)), prompt="prompt")
add this:
pipe.enable_xformers_memory_efficient_attention()
If you'll use NVIDIA GPU:
bfloat16
👇
float16