Rogue Camp

Chapter 3 Spoilers here.

Man the rogue camp is so chill. I told thorus to leave them alone, too bad im a warder, is there additional quest if im like from the swampcamp? I was just thinking if i can beat them up to get exp, theres no negative impact technically as a warder.