Downgrade help

Hi all, I recently updated to Tahoe on my 2019 MacBook Pro.

Long story short I want to downgrade to sequoia.

Now I successfully did this but now I want to restore my files using Time Machine. The problem is that the Time Machine backups I have are from Tahoe and it won’t restore the backup through command+r . Instead it notifies me I should install macOS again.

Are there any ways around this?