Are hirelings worth adding?

I play with my 3 other people, and we have the main game as well the river folk, marauder, and underworld expansion packs. Would it be best to start adding hirelings to the game? Would it still make group games more interesting or is it better for smaller groups?