Very slow image generation
I have a 4070ti, and when loaded into the venv, torch shows cuda=true. I selected NV for the rng in stable diffusion settings, and I'm using the Stable Diffusion 3.5 Large model. A single 512x512 with a prompt such as "a cat in the snow" with default settings (dpm++ 2m, scheduling automatic, 20 steps) shows a generation time of 10-20 minutes.
nvidia-smi shows CUDA 12.9, i have torch 2.7.0+cu128 so I'm not sure if that mismatch is the issue. I don't get an error about torch not being able to use the GPU on startup. I have --xformers and have tried without it in the .bat args.
This is my console after startup:
PS C:\Users\Mason\Desktop\stable-diffusion-webui> .\webui-user.bat
venv "C:\Users\Mason\Desktop\stable-diffusion-webui\venv\Scripts\Python.exe"
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: v1.10.1
Commit hash: 82a973c04367123ae98bd9abdf80d9eda9b910e2
Launching Web UI with arguments: --xformers
C:\Users\Mason\Desktop\stable-diffusion-webui\venv\lib\site-packages\timm\models\layers\__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning)
Loading weights [ffef7a279d] from C:\Users\Mason\Desktop\stable-diffusion-webui\models\Stable-diffusion\sd3.5_large.safetensors
Creating model from config: C:\Users\Mason\Desktop\stable-diffusion-webui\configs\sd3-inference.yaml
Running on local URL: http://127.0.0.1:7860
C:\Users\Mason\Desktop\stable-diffusion-webui\venv\lib\site-packages\huggingface_hub\file_download.py:896: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
warnings.warn(
To create a public link, set `share=True` in `launch()`.
Startup time: 8.8s (prepare environment: 1.7s, import torch: 3.6s, import gradio: 1.0s, setup paths: 0.7s, initialize shared: 0.2s, other imports: 0.5s, load scripts: 0.5s, create ui: 0.2s, gradio launch: 0.3s).
C:\Users\Mason\Desktop\stable-diffusion-webui\venv\lib\site-packages\huggingface_hub\file_download.py:896: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
Posted May 4, 2025, 4:36 PM UTC