img2img rendition of an emerald-tipped spear from a doodle - This is actually addictive

Posted Oct 14, 2022, 8:07 PM UTC

Posted Oct 14, 2022, 8:07 PM UTC
Hey u/Sadnot - really cool results. This is SD img2img, correct? What would you say is a good way to get started w/ SD? Do you run it locally? Which version do you use and do you have any tips on installation/running it? I've been meaning to try it but seems it's moving a hundred miles a minute and I don't know where to begin haha
That's right, I'm using https://colab.research.google.com/github/TheLastBen/fast-stable-diffusion/blob/main/fast_stable_diffusion_AUTOMATIC1111.ipynb
You can run it off Google colab, either locally or with their provided GPU. I haven't tried much SD locally, since I don't have an nVidia GPU (tried it with my CPU, but it was 5x slower).
That's awesome, thanks for sharing! I'll have to read about Google Collab, haven't used that either! But I do have a gpu so it might be possible locally.
It's really simple to use if you have a google account. You'll also need a Hugging Face account to agree to the terms and conditions on the model.
Looks great! Crosspost to r/stablediffusion and tag as img2img. 👍🏼
In this case, I've used a low denoising strength (0.35) and generated successive images that were closer to what I wanted to achieve. Once the image was fairly close, I used inpainting to refine the details. Finally, I used photoshop to adjust the colours on the brass handles to match more closely, and to add a watercolour splotch behind the item.
Process:
My first attempt (https://i.imgur.com/wfDGF9R.png) with a higher denoising strength didn't match the image well and gave mostly sword-like results. Solution: lowered the denoising strength from 0.6 to 0.35 and added "sword" to the negative prompt list.
This generated results that more closely matched my image prompt but were crude (https://i.imgur.com/DwadCVU.png). So, I picked my favourite and put it back in as the new image input, while also increasing the number of iteration steps. Eventually, this got me fairly close to what I wanted (https://i.imgur.com/3lpM8Rp.png)
At this point, I selected individual features and regenerated them until I was happy. E.g. here's the pommel attempts: https://i.imgur.com/Q6ma9td.png
Finally, I generated a watercolour blotch and photoshopped it under the spear: https://i.imgur.com/gTt6fRd.png