Searching for a good model to do Voice cloning / Finetuning TTS

Hello newbie here. Pls be nice.

I want to clone and finetune my own TTS model with a preferred voice.

I have like 40 minutes clean voice data in .wav files. 3-5 seconds each and also for each one a transcription. So no RVC or Instant Cloning/Zero Shot. I really want to finetune my own model as clean as possible so it sounds good.

Any suggestions? I have an RTX 5080 16 GB VRAM for training locally.

Currently thinking about using XTTS-v2 with AllTalk.

Oh and the voice is german not english so this might shrink up the possibilities.