Do any of you dragons have any advice on how to deal with annoying villagers?

So what started as a group of people bringing food offerings because they think I'll hurt them (even though I won't and I told them I won't), now they decided to settle down and make my land their home, just outside of my cave. Now I got villagers hanging around, they are in the process of building and it seems like they're not going anywhere anytime soon.

Any of you dragons know how to deal with villagers? Like the dos and don't? Are there any benefits at all living with villagers?