Can i make a face lora using dataset images made with roop/reactor?

Since the faceswapper end up making the output image face way to perfect, (ive tried using skin texture loras but since the roop effect takesplace after the generation, it ends up making a realistic body and a face that way too clean and without any imperfection).

To fix this, could I make a lora based on a dataset of images generated using the output images using roop? I would then apply the lora, turn off roop, and therefore the skin texture loras should also take effect on the face?

Anyone knows a better alternative or?