Gothic 2 notr lighthouse quest

So, I wanted to get to lighthouse to finish the quest to clear it from bandits, but on the way there's an elite orc and million wargs, so it's impossible for me with level 10 to get there, am I supposed to leave this quest for later?