How to train a lora without keeping the style of the dataset?
I'm looking to train some loras to make some backgrounds, such as spaceship/scifi rooms. I'll be pulling my dataset from various games such as mass effect, alien isolation, and guardians of the galaxy. My question is what would be the best parameters to set to capture only the design of the rooms but not the 3d video game style? I will be using NoobAI as the base model. I currently make character loras with bf16, AdamW, Cosine with Restarts, 128 - 64 / 64 - 32 network, 50-100 images with 20 repeats, very basic and minimal captioning, 10 epochs, and around 3500 when doing a batch of 5 which gives very accurate character loras but usually keeps the artstyle from the dataset, and that is something I would like to avoid when training these background loras.
Posted Sep 23, 2025, 10:49 PM UTC