Best way to defeat a walled opponent?

My friends are typically so well fortified that I find no avenue of attack and just keep building my own fortress. Any ideas on how to end this arms race?