Anyone running FLUX on Linux under ROCm getting fast-ish renders?
I keep seeing people with sub-minute render times, even on lower-end NVIDIA GPUs (6-8GB VRAM). I'm using RX 6900XT with 16GB VRAM with the ROCm version of PyTorch. And while SDXL and lower give me comparable render times to CUDA setups, I'm finding that the best I can get on a 1024x1024 image under FLUX is about 15sec/it. It's maddening. Yes, I'm using FP8 version. Both DEV and SCHNELL process at about the same speed. A 20 step DEV render takes me over 5 minutes to render. Even a 4-step SCHNELL render takes more than a minute. What am I doing wrong.
got prompt
[rgthree] Using rgthree's optimized recursive execution.
Requested to load FluxClipModel_
Loading 1 new model
loaded in lowvram mode 8909.969511718751
100%|████████████████████████████████████████████████████| 4/4 [01:03<00:00, 15.84s/it]
Requested to load AutoencodingEngine
Loading 1 new model
Prompt executed in 68.92 seconds
Posted Aug 11, 2024, 6:39 PM UTC
311